Display screen control method and terminal equipment

Abstract

The invention discloses a display screen control method and terminal equipment, and relates to the field of terminal touch control, the terminal equipment comprises an acceleration sensor and a touch sensor arranged on a display screen, and the method comprises the steps that the terminal equipment obtains touch operation acting on the display screen according to a touch signal collected by the touch sensor, according to the posture signal collected by the acceleration sensor, the posture change of the terminal equipment is obtained, and under the condition that the touch operation of the display screen meets a preset first condition and the posture change of the terminal equipment meets a preset second condition, the screen turn-off action is executed. The situation that the screen-off action is wrongly judged due to the fact that the distance between the display screen and the shielding object cannot be accurately recognized when an optical proximity sensor is applied is avoided, and the stability of screen-off judgment is improved.

Description

Display screen control method and terminal device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on March 21, 2024, with application number 202410332642.5 and invention name “A display screen control method and terminal device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal touch control, and in particular to a display screen control method and a terminal device. Background Art

[0003] When users use mobile phones or other terminal devices to make and receive calls, the mobile phone display is close to the user's face, ears, hair and other parts. These parts contact the mobile phone display and can easily cause accidental touches, resulting in the call being hung up or jumping to other pages, affecting the user experience.

[0004] Currently, the solution to accidental touches on mobile phone displays generally uses: using an optical proximity sensor to detect the distance between the display and the obstructing object to determine whether the display is blocked, and using an acceleration sensor to detect changes in the phone's posture to determine whether the user is holding the phone to their ear. Based on these two pieces of information, it is determined that the scene is a call, and the phone's display is controlled to turn off to avoid accidental touches.

[0005] However, due to the structure of the optical proximity sensor, when the object blocking the display is close enough to the display, the mobile phone cannot accurately obtain the distance between the display and the blocking object through the optical proximity sensor, and thus cannot accurately determine whether the display is blocked at this time, and the display cannot be turned off. This greatly increases the possibility of accidental touches, seriously affecting the user experience. Summary of the Invention

[0006] The present invention provides a display screen control method and a terminal device. When a touch operation on the display screen satisfies a preset first condition and a posture change of the terminal device satisfies a preset second condition, a screen off action is executed to increase the stability of the screen off judgment.

[0007] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0008] In a first aspect, a display screen control method and a terminal device are provided, the method comprising:

[0009] The terminal device determines whether the touch operation on the display screen meets the preset first condition based on the touch signal collected by the touch sensor, and determines whether the posture change of the terminal device meets the preset second condition based on the posture signal collected by the acceleration sensor. When the touch operation meets the preset first condition and the posture change of the terminal device meets the preset second condition, the display screen is controlled to turn off.

[0010] In this embodiment, since the touch signal is collected when the display screen is in contact with an obstructing object (the user's face, hair, etc.), when the display screen is in contact with the obstructing object, the touch sensor is used to detect whether the touch operation acting on the display screen meets the preset first condition, thereby effectively determining whether the display screen is blocked. Compared with using an optical proximity sensor to determine whether the display screen is blocked, this avoids the problem that the mobile phone cannot accurately determine whether the display screen is blocked and cannot control the display screen to turn off when the object blocking the display screen is close enough to the display screen or even touches the display screen, thereby increasing the stability of the screen off judgment.

[0011] In one possible implementation, if a touch operation is performed within a first area of ​​a display screen, and the touch signal value is greater than or equal to a preset first threshold value, and the area of ​​the touch area is greater than or equal to a preset second threshold value, the terminal device determines that the touch operation performed on the display screen meets a preset first condition.

[0012] In this embodiment, by determining whether the touch signal value is greater than or equal to a preset first threshold value, it is possible to distinguish whether a part of the user's skin is in direct contact with the display screen, that is, to identify the touch operation as direct contact of the user's finger, ear, face, or other skin with the display screen. By determining whether the area of ​​the touch region is greater than or equal to a preset second threshold value, it is possible to distinguish the part of the user's skin that is in direct contact with the display screen, that is, to identify the touch operation as contact of a large area of ​​the user's skin, such as the face or ear, with the display screen. When the touch operation is identified as direct contact of the user's skin, and direct contact of a large area of ​​the skin, it is determined that the touch operation on the display screen meets the preset first condition, that is, the terminal device determines that the display screen is blocked, making the judgment process more similar to the scenario in which the user actually uses the terminal device, thereby improving the applicability of the judgment.

[0013] In one possible implementation, if a touch operation is performed within a first area of ​​a display screen, and the major axis length of the touch area is greater than or equal to a preset third threshold value, and the touch signal value is greater than or equal to a preset second threshold value, the terminal device determines that the touch operation performed on the display screen satisfies a preset first condition.

[0014] In this embodiment, by determining whether the touch signal value is greater than or equal to a preset first threshold value, it is possible to distinguish whether a part of the user's skin is directly contacting the display screen, that is, to identify the touch operation as direct contact of the user's finger, ear, face, or other skin with the display screen. By determining whether the major axis length of the touch area is greater than or equal to a preset third threshold value, it is possible to distinguish the part of the skin that is directly contacting the display screen, that is, to identify the touch operation as contact of a large area of ​​the user's skin, such as the face or ear, with the display screen. When the touch operation is identified as direct contact of the user's skin, and direct contact of a large area of ​​the skin, it is determined that the touch operation acting on the display screen meets the preset first condition, that is, the terminal device determines that the display screen is blocked, making the judgment process more similar to the scenario in which the user actually uses the terminal device, thereby improving the applicability of the judgment.

[0015] In a possible implementation, the touch signal value is a maximum value among the signal values ​​of each touch point in the touch area, or an average value of the signal values ​​of each touch point in the touch area.

[0016] In this embodiment, the flexibility and adaptability of touch signal value selection can be increased.

[0017] In one possible implementation, if the touch operation is performed within the second area of ​​the display screen, and the number of touch points on the display screen is greater than or equal to a preset fourth threshold value, the terminal device determines that the touch operation performed on the display screen meets the preset first condition.

[0018] In this embodiment, in scenarios where some users place the terminal device next to their ears, it is easy for hair to touch the display screen. Based on whether the number of touch points acting on the display screen by the touch operation is greater than a preset fourth threshold value, it can be distinguished whether the touch operation is the user's hair touching the display screen, and then it can be identified whether the touch operation acting on the display screen meets the preset first condition, which can increase the adaptability of determining whether the display screen is blocked.

[0019] In a possible implementation, the second area includes a first sub-area and a second sub-area, and the first sub-area and the second sub-area are respectively located on two sides of the earpiece.

[0020] In this embodiment, a first sub-area and a second sub-area are provided on either side of the earpiece. This allows for targeted identification of whether a touch operation meets a preset first condition based on the side of the display screen contacted by the user's hair. In some scenarios where a user actually moves the terminal device to their ear, depending on the user's left or right hand or usage habits, there may be more touch points contacting the user's hair on one side and fewer, or even no, touch points contacting the user's hair on the other side. Based on the actual application scenario, the first sub-area and the second sub-area are provided on either side of the earpiece. If the number of touch points contacting either sub-area by the user's hair exceeds a preset fourth threshold, the display screen is determined to be blocked. This increases the flexibility and adaptability of determining whether the display screen is blocked.

[0021] In one possible implementation, when the roll angle change value of the terminal device is greater than or equal to the first roll angle judgment threshold, and the pitch angle change value of the terminal device is greater than or equal to the first pitch angle judgment threshold, the terminal device determines that the posture change of the terminal device meets the preset second condition.

[0022] In this embodiment, by judging the pitch angle change value and the roll angle change value of the terminal device, it can be identified whether the posture change of the terminal device meets the preset second condition.

[0023] In one possible implementation, after the terminal device controls the display screen to turn off, when it is determined that the distance between the object generating the touch operation and the display screen is greater than or equal to a preset second distance threshold, and when it is determined that the posture change of the terminal device satisfies a preset third condition, the terminal device controls the display screen to light up.

[0024] In this embodiment, after the display screen is turned off, the display screen is controlled to light up by judging the distance between the display screen and the blocking object and the change in the posture of the device, which can increase the integrity of the display screen control method.

[0025] In one possible implementation, when the heading angle change value of the terminal device is greater than or equal to the second roll angle judgment threshold, and / or the pitch angle change value is greater than or equal to the second pitch angle judgment threshold, and / or the roll angle change value is greater than or equal to the second roll angle judgment threshold, the terminal device determines that the posture change of the terminal device meets a preset third condition.

[0026] In this embodiment, by determining the pitch angle change value and the roll angle change value of the terminal device, it can be identified whether the posture change of the terminal device meets the preset third condition.

[0027] In one possible implementation, when a touch operation on the display screen meets a preset first condition and lasts for a first preset time period, the terminal device controls the display screen to turn off.

[0028] In this embodiment, the first preset time length can be used to achieve delayed control of the display screen turning off, so that after the display screen is controlled to light up, the display screen can be controlled to turn off only when the touch operation meets the preset first condition and lasts for the first preset time length. In scenarios where some users have already touched their faces to the display screen of the mobile phone for the first preset time length, even if the terminal device fails to recognize that the posture of the terminal device meets the preset second condition, a screen-off judgment is still made, which will increase the flexibility and adaptability of the screen-off judgment.

[0029] In one possible implementation, when the terminal device detects that the handset is called, the user's touch operation on the display screen is obtained based on the touch signal collected by the touch sensor; and the posture change of the terminal device is obtained based on the posture signal collected by the acceleration sensor.

[0030] In this embodiment, the terminal device determines whether to control the display screen to be off only when it detects that the handset has been called, which can reduce unnecessary resource consumption.

[0031] In one possible implementation, a proximity sensor is deployed on the terminal device, and the terminal device obtains the distance between the display screen and the obstructing object based on the proximity signal collected by the proximity sensor; when the display screen is on, if the distance between the display screen and the obstructing object is less than or equal to a preset first distance threshold, and the posture change of the terminal device meets a preset second condition, the terminal device controls the display screen to turn off.

[0032] In this embodiment, the display screen is turned off in a manner that increases the distance between the display screen and the obstructing object to be less than or equal to a preset first distance threshold, and the posture change of the terminal device satisfies a preset second condition. This allows for adding multiple screen-off judgment methods to terminal devices equipped with proximity sensors, acceleration sensors, and touch sensors, thereby improving the stability of screen-off judgment.

[0033] In a second aspect, an electronic device is provided, comprising: a processor and a memory; the memory is used to store computer-executable instructions, and when the electronic device is running, the processor executes the computer-executable instructions stored in the memory to enable the electronic device to perform a method as described in any one of the above-mentioned first aspects.

[0034] In a third aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium. When the computer-readable storage medium is run on a computer, the computer can execute any one of the methods described in the first aspect.

[0035] In a fourth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute any one of the methods described in the first aspect.

[0036] Among them, the technical effects brought about by any design method in the second to fourth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] FIG1 is a schematic diagram of a scenario to which the method provided in an embodiment of the present application is applicable;

[0038] FIG2 is a schematic diagram of a scenario to which the method provided in an embodiment of the present application is applicable;

[0039] FIG3 is a schematic diagram of the posture signal detection principle applicable to the method provided in an embodiment of the present application;

[0040] FIG4 is a schematic diagram of the optical proximity detection principle applicable to the method provided in an embodiment of the present application;

[0041] FIG5 is a schematic diagram of a scenario to which the method provided in an embodiment of the present application is applicable;

[0042] FIG6 is a schematic diagram of the ultrasonic proximity detection principle applicable to the method provided in an embodiment of the present application;

[0043] FIG7 is a schematic diagram of a touch signal applicable to the method provided in an embodiment of the present application;

[0044] FIG8 is a flow chart of a method for determining facial contact applicable to the method provided in an embodiment of the present application;

[0045] FIG9 is a schematic diagram of a hair recognition area applicable to the method provided in an embodiment of the present application;

[0046] FIG10 is a schematic diagram of a touch signal recognition area applicable to the method provided in an embodiment of the present application;

[0047] FIG11 is a schematic diagram of the execution logic of a display screen control method applicable to the method provided in an embodiment of the present application;

[0048] FIG12 is a schematic diagram of the execution logic of a display screen control method applicable to the method provided in an embodiment of the present application;

[0049] FIG13 is a schematic diagram showing the relationship between an approaching optical signal intensity curve and an approaching optical signal threshold value applicable to the method provided in an embodiment of the present application;

[0050] FIG14 is a flow chart of a display screen control method applicable to the method provided in an embodiment of the present application;

[0051] FIG15 is a schematic diagram of a call setting page applicable to the method provided in an embodiment of the present application;

[0052] FIG16 is a schematic diagram of a structure applicable to the method provided in an embodiment of the present application;

[0053] FIG17 is a structural block diagram applicable to the method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] In the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: the situation where A exists alone, A and B exist at the same time, and B exists alone, wherein A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are a kind of "or" relationship.

[0055] References to "one embodiment" or "some embodiments" etc. described in this specification mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way. The term "connected" includes direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0056] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0057] In application scenarios such as when a user makes a call or receives a voice message, as shown in FIG1(a) and FIG1(b), the user puts the mobile phone to his ear and uses the receiver to answer the sound. Since the user makes this action, the screen of the mobile phone (also called the display) is close to the user's face and ear, which can easily cause accidental touches. In addition, the user has no need to touch the display when putting the mobile phone to his ear. Therefore, in order to prevent accidental touches, the mobile phone will turn off the display when it detects that an object is covering the display, and the display will not respond to the user's touch operation to avoid accidental touches.

[0058] Similar scenarios include: making and receiving phone calls, short video, and translation.

[0059] The short video scenario is represented by a user watching a short video in silent mode. When there is a need to obtain sound, the user can hold the mobile phone to his ear and use the receiver to obtain sound, as shown in Figure 2. Figure 2 (a) shows a user watching a short video while riding public transportation. In this scenario, the user usually lowers the volume to avoid disturbing others. However, when watching exciting content and wanting to understand the sound information here, as shown in Figure 2 (b), the user can pick up the mobile phone and hold it to his ear to obtain sound through the receiver. At this time, the mobile phone controls the display screen to turn off to avoid the user's face or other parts touching the display screen, which causes the short video to be switched.

[0060] The translation scenario is when the user wants to obtain the sound information of the translated content, and can hold the mobile phone to his ear and use the receiver to obtain the sound. In these scenarios, the mobile phone can determine whether to perform the screen-off action based on the posture signal, proximity signal and touch signal, as well as the corresponding judgment conditions, to achieve the purpose of preventing accidental touches. It can be seen that the above application scenarios are only some examples of this method. In other application scenarios, as long as the user needs to pick up the mobile phone and put it to his ear to use the receiver to obtain sound information, the display screen control method provided in the embodiment of the present application can be used. No more examples are given here.

[0061] When a mobile phone determines whether to turn off the display screen, it usually makes a judgment based on signals detected by one or more sensors. For example, it uses an accelerometer or an inertial measurement unit including an accelerometer to detect the posture of the mobile phone, and uses a proximity sensor to detect whether there is an obstructing object on the display screen, the distance between the obstructing object and the display screen, and other information to make a judgment.

[0062] For example, using an accelerometer to detect a phone's posture is used to illustrate this. The accelerometer detects the posture signals generated when the phone's posture changes. The phone then determines the posture change based on the posture signals. This posture change can reflect the user's gestures (including lifting the phone to their ear). For example, in a voice call scenario, when a user lifts the phone to their ear to answer a call, the phone's posture changes with the user's gestures. The phone's posture change can be summarized by the angular changes of three angles. The posture signal includes the angle values ​​of these three angles, and the phone can obtain these angle values ​​by analyzing the posture signals. As shown in Figure 3, the coordinate system is based on the phone's display facing forward and the phone in an upright position. The x-axis is parallel to the short side of the display and passes through the center of the display. The y-axis is parallel to the long side of the display and passes through the center of the display. The z-axis passes perpendicularly through the center of the display. The three angles are: pitch (rotation around the x-axis), roll (rotation around the y-axis), and yaw (rotation around the z-axis). The angular changes of these three angles can be used to determine the phone's posture change and its current posture. As shown in Figures 1 and 2 above, when the user puts the phone to his ear, the posture of the phone changes. The change in posture can be decomposed into the change values ​​of three angles. The phone judges the change in posture of the phone based on the angle change values ​​of the three angles, and then determines whether the change in posture of the phone is consistent with the posture of the phone when the user picks up the phone and puts it to his ear.

[0063] It can be seen that the example in Figure 2 above is only an example of the change in the posture of the mobile phone when the user picks up the mobile phone and puts it to the ear in a standing posture. When the user picks up the mobile phone and puts it to the ear in standing, walking, sitting or lying down, the change in the posture of the mobile phone is different. The specific setting can be made according to the actual situation, and no examples will be given here one by one.

[0064] In the process of identifying whether the user has raised the phone to their ear, the phone uses the posture signal detected by the accelerometer to determine the change in the phone's posture. If the change in the phone's posture satisfies a preset first posture condition (also referred to as a preset second condition), it indicates that the user has raised the phone to their ear. Exemplarily, determining, based on the posture signal, that the phone's posture change satisfies the preset first posture condition includes: a roll angle change greater than a first roll angle determination threshold, and a pitch angle change greater than a first pitch angle determination threshold; optionally, a heading angle change less than the first heading angle determination threshold. With reference to the examples in Figures 1 and 2 above, the user is facing forward, the ground is considered downward, and the top of the head is considered upward. When determining the change in the phone's posture, if the roll angle change exceeds the first roll angle determination threshold, the phone's posture changes from display facing upward to display facing left or right (depending on whether the user is answering the phone with their left or right hand). If the pitch angle change exceeds the first pitch angle determination threshold, the phone's posture changes from top of body facing forward to top of body facing upward. When the course angle change value is less than the first heading angle judgment threshold, the bottom edge of the fuselage is slightly inclined to the ground or parallel to the ground.

[0065] As can be seen, as shown in the example above in Figure 2, when the user takes out the phone and holds it to their ear, the roll angle change and pitch angle change values ​​alone can be used to determine whether the phone's posture change meets the preset first posture condition. However, for more accurate identification and to address other usage scenarios (e.g., sitting, lying, walking, etc.), the heading angle change value can also be determined. The specific setting depends on the actual application and will not be given in detail here.

[0066] For example, using a proximity sensor to detect whether the display is obscured can detect proximity signals. Based on these proximity signals, the phone can determine the distance between the display and the obstructing object. Examples of proximity sensors include optical proximity sensors and ultrasonic proximity sensors. Optical proximity sensors detect proximity light signals, while ultrasonic proximity sensors detect ultrasonic signals. Both proximity light signals and ultrasonic signals are types of proximity signals.

[0067] As shown in Figure 4(a), the optical proximity sensor includes an infrared light source and an infrared light detector disposed below the display screen. The infrared light signal emitted by the infrared light source is reflected and detected by the infrared light detector. The infrared light signal detected by the infrared light detector (also called the proximity light signal) can be divided into two parts. As shown in the optical path L1 in Figure 4(a), the first part is the infrared light signal detected by the infrared light detector after being reflected and diffracted by the display screen or internal structural components. The black isolation foam disposed between the infrared light source and the infrared light detector can reduce the intensity of this part of the infrared light signal. As shown in the optical path L2 in Figure 4(a), the second part is the infrared light signal detected by the infrared light detector after passing through the display screen and being reflected by an external obstructing object. This part of the infrared light signal is used to determine the distance between the mobile phone display screen and the obstructing object covering the display screen. Without considering the air gap between the infrared light source and the display screen and the thickness of the display screen, the greater the intensity of the infrared light signal detected by the infrared light detector, the closer the distance between the display screen and the obstructing object.

[0068] In the process of identifying whether the display screen is obscured by an obstructing object, a first proximity light signal threshold can be set based on the relationship between the intensity of the proximity light signal and the distance between the display screen and the obstructing object. The mobile phone uses the proximity light signal detected by the optical proximity sensor to determine the distance between the display screen and the obstructing object covering the display screen. If the intensity of the proximity light signal is equal to the first proximity light signal threshold, the distance between the display screen and the obstructing object is equal to a preset first distance threshold. The preset first distance threshold indicates that if the distance between the display screen and the obstructing object is less than or equal to the preset first distance threshold, the mobile phone determines that the display screen is obscured. For example, in some voice call scenarios, when the user picks up the phone and puts it to their ear, the distance between the display screen and the user's face gradually approaches. As shown in Figure 5 (a), the distance between the mobile phone display screen and the user's face is d51. The mobile phone compares the proximity light signal detected by the optical proximity sensor with the first proximity light signal threshold. The comparison result is: the intensity of the proximity light signal is less than the first proximity light signal threshold. At this time, the mobile phone determines that the display screen is not obscured by the obstructing object. In (b) of Figure 5, the distance between the mobile phone display and the user's face is d52. The mobile phone compares the proximity light signal detected by the optical proximity sensor with the first proximity light signal threshold value. The comparison result is: the intensity value of the proximity light signal is greater than the first proximity light signal threshold value. At this time, the mobile phone determines that the display screen is blocked.

[0069] As shown in Figure 6, the ultrasonic proximity sensor includes an earpiece capable of transmitting ultrasonic waves and a microphone capable of receiving ultrasonic waves. The ultrasonic waves emitted by the earpiece hit an obstructing object, reflect, and are received by the microphone. The distance between the display screen and the obstructing object can be determined based on the intensity of the ultrasonic signal received by the microphone. The greater the intensity of the ultrasonic signal, the closer the display screen is to the obstructing object. It can be seen that, similar to the above-mentioned example of a mobile phone using an optical proximity sensor to determine whether the display screen is obstructed by an obstructing object, a first ultrasonic signal threshold can be set based on the relationship between the ultrasonic signal intensity and the distance between the display screen and the obstructing object. The mobile phone uses the ultrasonic signal detected by the ultrasonic proximity sensor to determine the distance between the display screen and the obstructing object covering the display screen. If the ultrasonic signal intensity equals the first ultrasonic signal threshold, the distance between the display screen and the obstructing object is equal to a preset first distance threshold. If the ultrasonic signal intensity is greater than the first ultrasonic signal threshold, the distance between the display screen and the obstructing object is less than the preset first distance threshold. When the distance between the display screen and the obstructing object is equal to or less than the preset first distance threshold, the mobile phone determines that the display screen is obstructed.

[0070] It should be noted that since the ultrasonic proximity sensor and the optical proximity sensor have similar specific judgment processes when determining the distance between the display screen and the obstructing object, in the implementation of the optical proximity sensor mentioned in the following embodiments of this application, the optical proximity sensor can be replaced with an ultrasonic proximity sensor, or the ultrasonic proximity sensor can be applied on the basis of the optical proximity sensor, and the embodiments of this application will no longer specifically explain it.

[0071] In some current display screen anti-mistouch solutions, the mobile phone uses an acceleration sensor to detect changes in the phone's posture and an optical proximity sensor to determine the distance between the display screen and the obstructing object. When it is determined that the phone's posture change meets a preset first posture condition and the distance between the display screen and the obstructing object is less than or equal to the preset first distance, the display screen is controlled to turn off.

[0072] However, in some scenarios, when a small black obstructing object (such as hair) is too close to or in contact with the mobile phone display, the reflectivity of the infrared light emitted by the infrared light source when it hits the black obstructing object is greatly reduced. This part of the reflected infrared light cannot be received by the infrared light detector, or only a part of it is received by the detector, resulting in the intensity value of the proximity light signal obtained not being able to accurately reflect the distance between the display and the obstructing object. That is to say, even if the distance between the display and the obstructing object is less than the preset first distance threshold at this time, the mobile phone should determine that the display is obstructed, but because the intensity value of the proximity light signal is less than the first proximity light signal threshold value, the mobile phone does not determine that the display is obstructed. As shown in (b) of Figure 4, d is the distance between the center of the infrared light detector and the center of the infrared light source of the optical proximity sensor. When d is not 0, if the external black obstructing object is close enough to the display screen, when the infrared light emitted by the infrared light source shines through the display screen on the obstructing object, the intensity value of the reflected proximity light signal received by the infrared light detector is far lower than the first proximity light signal threshold value, that is, the infrared light detector and the infrared light source cannot effectively transmit light. In this case, although the distance between the display screen and the obstructing object is less than the preset first distance threshold value, because the intensity value of the proximity light signal is less than the first proximity light signal threshold value, the mobile phone fails to accurately determine that the display screen is blocked, which will cause the display screen to be unable to turn off. This problem is usually called the optical proximity light black hair problem.

[0073] Since the optical proximity sensor is usually installed on the top of the mobile phone, where the earpiece or front camera is located, it is easy to be close to the user's hair. Therefore, when the user picks up the phone and puts it to the ear, the optical proximity light black hair problem is very likely to occur, causing the phone to be unable to make the correct screen-off judgment. In this way, even if the phone has accurately determined that the phone's posture change meets the preset first posture condition based on the posture signal, the phone will not turn off the screen because it incorrectly judges the distance between the display screen and the obstructing object, which greatly increases the possibility of accidental touches and reduces the user experience.

[0074] Embodiments of the present application provide a display screen control method that can be applied to a terminal device, such as a mobile phone. The mobile phone determines whether the display screen is blocked based on a touch signal and a preset touch condition (also referred to as a preset first condition), thereby avoiding the optical proximity light blackout problem that occurs with optical proximity sensors. For example, a valid touch operation performed by a user on a display screen is typically performed using a finger. A valid touch operation here refers to an operation result that the user intends to obtain through the touch operation, such as launching an application, switching interfaces, or inputting information. However, when a user holds the mobile phone to their ear, the user's face, ear, hair, or other parts of the body may come into contact with the display screen. These contacts are not valid contacts, meaning that the user does not expect to obtain a specific operation result by contacting the display screen with the face, ear, hair, or other parts of the body. By analyzing the characteristics of the user's face, ear, hair, or other parts contacting the display screen, as well as the characteristics of the user's finger contacting the display screen, it is determined whether the touch operation was made by the user's face, ear, hair, or other parts of the body. If the touch operation is determined to be made by the user's face, ear, hair, or other parts of the body, the display screen is determined to be blocked.

[0075] For example, preset touch conditions can be set based on the characteristics of the user's face, ears, hair and other parts touching the display screen, as well as the characteristics of the user's fingers touching the display screen. The preset touch conditions can, for example, include judging the signal value of the touch signal, the touch signal area, the number of touch points, etc. and the corresponding touch signal threshold value (also called the preset first threshold value), the area threshold value of the touch area (also called the preset second threshold value), the length threshold value of the touch area (also called the preset third threshold value), the number of touch points threshold value (also called the preset fourth threshold value), etc. If the touch signal meets the preset touch conditions, it is determined that the display screen is blocked.

[0076] In some embodiments, determining, based on the touch signal, that the touch operation on the touch screen is a facial contact by the user is when the touch signal satisfies one of the preset touch conditions.

[0077] Exemplarily, facial contact is represented by the phone determining that a large area of ​​skin, such as the user's face or ear, is in contact with the phone display. When determining whether it is facial contact, the phone determines the area of ​​the touch area or the long axis length of the touch area and the touch signal value based on the touch signal to determine whether it is facial contact. A touch signal schematic diagram is shown in Figure 7. Figure 7 (a) shows that the display screen is composed of multiple touch points, each of which has an equal area. The touch points with numerical values ​​in the figure represent the touch points from which touch signals are collected. The area occupied by the touch points from which touch signals are collected is the touch area. Figure 7 (b) shows that the touch area is approximately elliptical, including the long axis length and the short axis length. The sum of the areas of the touch points from which touch signals are collected is the touch area. The numerical value of the touch point is the normalized capacitance change value, which can also be called the touch signal value. For example, this value is 3000 in the case of good contact. Generally, when the user's hand, face, or other skin parts are in contact with the display screen, the touch signal value is high due to good contact. However, when the user's clothing, or skin through clothing, is in contact with the display screen, the touch signal value is low due to poor contact.

[0078] The phone determines whether facial contact occurs based on the touch area and the touch signal value. The touch signal value is the signal value corresponding to the touch area; for example, the touch signal value can be the maximum value of the signal values ​​of each touch point in the touch area, or the average value of the signal values ​​of each touch point in the touch area.

[0079] In one embodiment, if the touch signal value is greater than or equal to a preset touch signal threshold value, and the area of ​​the touch region is greater than or equal to a first threshold value, it is determined to be facial contact, where the first threshold value may be a touch area threshold value.

[0080] In another embodiment, if the touch signal value is greater than or equal to the touch signal threshold value, and the long axis length of the touch area is greater than or equal to the first threshold value, it is determined to be facial contact, and the first threshold value here may be a length threshold value.

[0081] If either of the above two implementation modes is met, it can be determined as facial contact.

[0082] Among them, the touch signal threshold value can be set according to the touch signal value of the skin directly contacting the display screen (handheld scenario), and the touch signal value of clothing or skin through clothing contacting the display screen (pocket scenario). The touch signal threshold value is greater than the touch signal value of clothing or skin through clothing contacting the display screen, and less than the touch signal value of skin directly contacting the display screen. Here, setting the touch signal threshold value greater than the touch signal value of clothing or skin through clothing contacting the display screen is to distinguish between pocket scenarios and handheld scenarios, or to distinguish whether the display screen is blocked by the user's face or by the user's clothing. Specifically, it has been introduced in the above example that when clothing or skin through clothing contacts the display screen, the touch signal value detected is smaller than the touch signal value detected when the skin directly contacts the display screen. By utilizing this feature, setting the touch signal threshold value greater than the touch signal value of clothing or skin through clothing contacting the display screen, combined with other factors, such as the area judgment of the touch area or the long axis length judgment of the touch area, facial contact can be effectively identified.

[0083] The touch area threshold can be set based on the size of the touch area when the user's finger contacts the display screen, and the size of the touch area when the user's face contacts the display screen. The touch area threshold is greater than the touch area when the finger contacts the display screen, and less than the touch area when the face contacts the display screen. The length threshold can also be set based on the long axis length of the touch area when the user's finger contacts the display screen, and the long axis length of the touch area when the user's face contacts the display screen. The length threshold is greater than the long axis length of the touch area when the finger contacts the display screen, and less than the long axis length of the touch area when the user's face contacts the display screen.

[0084] For example, as shown in FIG8 , an embodiment of the present application further provides a method for determining facial contact in a handheld scenario, which is applied to a terminal device. The determination process includes S801 to S805 , wherein:

[0085] S801: Acquire a touch signal.

[0086] The terminal device obtains a touch signal acting on the touch screen.

[0087] Illustratively, the touch signal acting on the touch screen includes: a touch signal generated by the user's face touching the touch screen, a touch signal generated by the user's fingers touching the touch screen, or a touch signal generated by other parts of the skin touching the touch screen through clothing.

[0088] S802 , determining whether the signal value of the touch signal is greater than the touch signal threshold value, if so, executing S803 ; otherwise, executing S805 .

[0089] The terminal device determines the touch signal value. If the signal value is greater than the touch signal threshold, it indicates that the touch signal value is generated by direct contact between the user's finger, face, ear, or other skin and the touch screen. If the signal value is less than the touch signal threshold, it indicates that the touch signal value is generated by contact between the user's skin and the touch screen through clothing.

[0090] S803. Determine whether the touch area of ​​the continuous signal area is greater than the touch area threshold value or whether the long axis length of the continuous signal area is greater than the length threshold value. If the touch area is greater than the touch area threshold value or the long axis length is greater than the length threshold value, execute S804; otherwise, determine that the touch signal does not meet the preset touch condition and execute S805.

[0091] Here, if there are multiple continuous signal areas, the touch area and the major axis length of the largest continuous signal area are determined.

[0092] After determining that the signal value of the touch signal is greater than the touch signal threshold value, the terminal device further processes the touch signal. This includes two processing methods. The first is to determine whether the touch area of ​​the continuous signal area is greater than the touch area threshold value. If so, it means that the touch signal is a touch signal generated by the user's face, ears, and other skin directly contacting the touch screen. If less than, it means that the touch signal is a signal generated by the user's finger directly contacting the touch screen. The second is to determine whether the long axis length of the continuous signal area is greater than the length threshold value. If greater than, it means that the touch signal is a touch signal generated by the user's face, ears, and other skin directly contacting the touch screen. If less than, it means that the touch signal is a signal generated by the user's finger directly contacting the touch screen. If either of the two processing methods is met, it can be determined that the touch signal meets the preset touch condition.

[0093] S804: Determine that it is facial contact.

[0094] S805: Determine that the contact is not a facial contact.

[0095] For example, the touch area threshold value may be set to 900 mm 2 , and the length threshold value may be set to 30 mm.

[0096] It can be seen that the setting of touch signal, touch area, and length threshold value needs to be considered according to actual factors such as the material and size of the display screen. The embodiments of this application are only for illustration and are not limited to specific values.

[0097] In some embodiments, judging, based on the touch signal, that the touch operation on the touch screen is contact by the user's hair is when the touch signal satisfies one of the preset touch conditions.

[0098] For example, when determining whether the operation on the display screen meets the preset touch condition based on the touch signal, it can be determined based on the touch signal whether it is hair contact. If it is hair contact, it is determined that the preset touch condition is met.

[0099] Optionally, if the number of triggered touch points detected in the second area (hair recognition area) of the display screen is greater than or equal to a preset touch point number threshold, it is determined to be hair contact. The preset touch point number threshold can be set according to actual needs.

[0100] Optionally, the hair recognition area can be set in an area near the top of the display screen.

[0101] Optionally, two hair recognition areas can be set, as shown in Figure 9, with the first hair recognition area being set on the left side of the earpiece and the second hair recognition area being set on the right side of the earpiece. In some embodiments, when a user holds the phone to their ear, if the user holds the phone to their ear with their left hand, the second hair recognition area is more likely to come into contact with the user's hair, while if the user holds the phone to their ear with their right hand, the first hair recognition area is more likely to come into contact with the user's hair. When a touch signal is concentrated in any one of the hair recognition areas, the touch signal can be more accurately identified as a hair contact.

[0102] It can be known that the first hair recognition area and the second hair recognition area are not strictly divided according to the areas shown in Figure 9. The size and position of the first hair recognition area and the second hair recognition area can be adjusted according to actual conditions, and the embodiments of this application will not be repeated.

[0103] In some embodiments, when determining facial contact and hair contact, a facial recognition area (also referred to as a first area) and a hair recognition area (also referred to as a second area) can be set on the display screen. When the touch signal satisfies hair contact or facial contact, the touch signal is determined to have satisfied the preset touch condition. Alternatively, when the touch signal satisfies both hair contact and facial contact, the touch signal is determined to have satisfied the preset touch condition.

[0104] Optionally, it is also possible to determine whether the touch operation is a hair contact or a facial contact within one area (for example, the touch area of ​​the entire display screen of a mobile phone) without distinguishing the areas.

[0105] As shown in the schematic diagram of the touch signal recognition area in Figure 10, the hair recognition area is set on the mobile phone display near the earpiece. The facial recognition area is set below the display and contacts the bottom edge of the hair recognition area.

[0106] In addition, the edges of the hair recognition area and the face recognition area may be set to not touch, or to partially touch, or the two areas may be partially overlapped, and examples are not given here one by one.

[0107] In the above example, the embodiment of the present application details the specific implementation method of using a touch sensor instead of a proximity light sensor to identify whether the display screen is blocked. Since the touch sensor does not have the proximity light blackening problem of the optical proximity sensor, it can more reliably identify whether the display screen is blocked than the optical proximity sensor, thereby reducing the possibility of accidental touch.

[0108] In some practical applications, whether using an optical proximity sensor or an ultrasonic proximity sensor, additional hardware costs are required. Optical proximity sensors require an additional infrared light source and infrared light detector, while ultrasonic proximity sensors require the phone's earpiece to be able to emit ultrasonic waves and the microphone to be able to receive ultrasonic waves. Ultrasonic waves are more susceptible to interference and consume more power. In the display control method provided in the embodiment of the present application, since the touch sensor is an essential component for the phone to be able to perform touch interaction, on a phone with touch function, the touch sensor is used to determine whether the display is blocked, without the need for additional hardware, saving hardware costs and having better economic efficiency.

[0109] An embodiment of the present application provides a display screen control method, in which a mobile phone detects touch operations acting on it through a touch sensor and detects the posture of the mobile phone through an acceleration sensor. When it is determined that the touch operation is a touch operation caused by contact with the user's face, ear, hair, etc., and when it is determined that the posture of the mobile phone is the posture of the user holding the phone to the ear, the display screen is controlled to be turned off. The two judgments are independent of each other and have no correlation. When both judgments are met, the mobile phone performs the screen-off action, which can increase the stability of the screen-off judgment and reduce the probability of erroneous control of the display screen being turned off.

[0110] For example, in some actual scenarios where users answer voice messages, the anti-mistouch method provided in the embodiments of the present application is applied, and the mobile phone controls the display screen to turn off based on the touch signal detected by the touch sensor and the posture signal detected by the acceleration sensor.

[0111] As shown in Figure 11, the mobile phone performs the following process to control the display screen off: when the phone detects that the handset has been called, it obtains a touch signal detected by the touch sensor, judges the touch signal, and determines whether the touch operation on the display screen meets a preset touch condition; it obtains a posture signal detected by the acceleration sensor, judges the posture signal, and determines whether the posture change of the mobile phone meets a preset first posture condition. If it is determined that the touch operation on the display screen meets the preset touch condition and the posture change of the mobile phone meets the preset first posture condition, the display screen is controlled to be off.

[0112] In the display screen control method provided in the embodiments of the present application, an optical proximity sensor can be added to the aforementioned method of determining whether to control the display screen to be turned off using a touch sensor and an accelerometer. The mobile phone detects a proximity light signal through the optical proximity sensor, a touch signal through the touch sensor, and a gesture signal through the accelerometer. The mobile phone then determines whether to control the display screen to be turned off based on the proximity light signal, the touch signal, the gesture signal, and corresponding judgment conditions. In this way, if the optical proximity sensor encounters the problem of optical proximity light blacking, the mobile phone can also determine whether to control the display screen to be turned off based on the touch signal detected by the touch sensor and the gesture signal detected by the accelerometer, thereby avoiding the problem of the optical proximity light blacking causing the display screen to not be turned off due to the optical proximity light blacking problem.

[0113] For example, in some actual scenarios where users answer voice messages, the anti-mistouch method provided in the embodiments of the present application is applied, and the mobile phone controls the display screen to turn off based on the touch signal detected by the touch sensor, the posture signal detected by the acceleration sensor, and the proximity signal detected by the proximity sensor, where the proximity sensor includes an optical proximity sensor and an ultrasonic proximity sensor.

[0114] In some scenarios where users are making or receiving calls, the user takes out the phone to check the incoming call information, clicks the operation control to answer the call, holds the phone to the ear to make a call, and after the call ends, the user moves the phone away from the ear to hang up the call. As shown in (a) of Figure 12, a touch sensor, an optical proximity sensor, and an acceleration sensor are deployed on the mobile phone, and the mobile phone performs the following process: the mobile phone detects that the receiver is called, obtains a touch signal detected by the touch sensor, judges the touch signal, and determines whether the touch operation acting on the display screen meets a preset touch condition; obtains a posture signal detected by the acceleration sensor, judges the posture signal, and determines whether the posture change of the mobile phone meets a preset first posture condition; obtains a proximity light signal detected by the optical proximity sensor, judges the proximity light signal, and determines whether the distance between the display screen and the user's face is less than or equal to a preset first distance threshold. When it is determined that the touch operation meets the preset touch condition and / or when it is determined that the distance between the display screen and the user's face is less than or equal to the preset first distance threshold, the mobile phone determines that the display screen is blocked. When it is determined that the posture of the mobile phone meets the preset first posture condition, the display screen is controlled to be turned off. After the display screen is turned off, the mobile phone obtains the posture signal detected by the acceleration sensor, and determines whether the posture of the mobile phone meets the preset second posture condition (also called the preset third condition) based on the posture signal. If it is determined that the posture change of the mobile phone meets the preset second posture condition, the mobile phone obtains the proximity light signal detected by the optical proximity sensor, and determines whether the distance between the display screen and the user's face is greater than or equal to the preset second distance threshold based on the proximity light signal. If it is determined that the distance between the display screen and the user's face is greater than or equal to the preset second distance threshold, the mobile phone controls the display screen to light up.

[0115] The mobile phone can also replace the optical proximity sensor with an ultrasonic proximity sensor located at the earpiece of the device. For example, as shown in FIG12(b), a touch sensor, an ultrasonic proximity sensor, and an accelerometer are deployed on the mobile phone. The mobile phone performs the following process: the mobile phone detects that the earpiece has been called, obtains a touch signal detected by the touch sensor, judges the touch signal, and determines whether the touch operation on the display screen meets a preset touch condition; obtains a posture signal detected by the accelerometer, judges the posture signal, and determines whether the posture change of the mobile phone meets a preset first posture condition; obtains an ultrasonic signal detected by the ultrasonic proximity sensor, judges the ultrasonic signal, and determines whether the distance between the display screen and the user's face is less than or equal to a preset first distance threshold. If it is determined that the touch operation meets the preset touch condition and / or the distance between the display screen and the user's face is less than or equal to the preset first distance threshold, the mobile phone determines that the display screen is blocked. If it is determined that the posture of the mobile phone meets the preset first posture condition, the display screen is turned off. After the display screen is turned off, the mobile phone obtains the posture signal detected by the acceleration sensor, and determines whether the posture of the mobile phone meets the preset second posture condition based on the posture signal. If it is determined that the posture change of the mobile phone meets the preset second posture condition, the mobile phone obtains the ultrasonic signal detected by the ultrasonic proximity sensor, and determines whether the distance between the display screen and the user's face is greater than or equal to the preset second distance threshold based on the ultrasonic signal. If it is determined that the distance between the display screen and the user's face is greater than or equal to the preset second distance threshold, the mobile phone controls the display screen to light up.

[0116] It can be known that determining whether the distance between the display screen and the user's face is less than or equal to the preset first distance threshold based on the ultrasonic signal is the same as determining whether the distance between the display screen and the user's face is less than or equal to the preset first distance threshold based on the proximity light signal, and determining whether the distance between the display screen and the user's face is greater than or equal to the preset second distance threshold based on the ultrasonic signal is the same as determining whether the distance between the display screen and the user's face is greater than or equal to the preset second distance threshold based on the proximity light signal.

[0117] In the above example, when the mobile phone determines whether to control the display screen to be turned off based on the touch signal, posture signal, proximity light signal and corresponding judgment conditions, there is no specific execution order. It can be judged based on each of the three signals at the same time, or it can be judged based on any one signal or any two signals first to determine whether to control the display screen to be turned off. The embodiments of the present application do not impose any special restrictions.

[0118] After the mobile phone controls the display screen to be off, the embodiment of the present application also provides an example of controlling the display screen to light up. The example of controlling the display screen to light up according to the embodiment of the present application is described in detail below.

[0119] In one embodiment, after the mobile phone controls the display screen to go off, it continues to detect gesture signals via the accelerometer. The mobile phone determines the phone's posture based on the gesture signals. If the phone's posture satisfies a preset second posture condition, it indicates that the user has removed the phone from their ear. After the phone's posture satisfies the preset second posture condition, the mobile phone detects a proximity light signal via the optical proximity sensor. If the intensity of the proximity light signal is less than a second proximity light signal threshold, the mobile phone controls the display screen to illuminate. It should be noted that the second proximity light signal threshold is less than the first proximity light signal threshold.

[0120] In some practical applications, the phone's posture changes when a user hangs up the phone, or when the user locks the screen and then puts the phone in their pocket after the other party hangs up the phone. When the phone controls the display to lock the screen, the phone determines the change in posture based on the posture signal. When the change in posture meets a preset second posture condition, the phone determines the distance between the display and the obstructing object. When the intensity of the proximity light signal is less than the second proximity light signal threshold, that is, the distance between the display and the obstructing object is less than the preset second distance threshold, the display is controlled to light up. Controlling the display to light up based on two judgment conditions, namely, the posture of the phone and the distance between the display and the obstructing object, can increase the stability of anti-accidental touch.

[0121] Here, the preset second posture condition includes: the heading angle change value of the mobile phone is greater than or equal to the second heading angle judgment threshold, the pitch angle change value is greater than or equal to the second pitch angle judgment threshold, and the roll angle change value is greater than or equal to the second roll angle judgment threshold. When any one or more of the three angle change values ​​are met, it is determined that the posture change of the mobile phone meets the preset second posture condition.

[0122] In some examples, when determining whether the distance between the display screen and the obstructing object is greater than or equal to a preset second distance threshold, a second proximity light signal threshold value can be set. If the intensity value of the proximity light signal is equal to the second proximity light signal threshold value, the distance between the display screen and the obstructing object is equal to the preset second distance threshold value, or if the intensity value of the proximity light signal is less than the second proximity light signal threshold value, the distance between the display screen and the obstructing object is greater than the preset second distance threshold value.

[0123] The above examples describe how to compare the intensity of the proximity light signal with the first proximity light signal threshold to determine whether the display is obstructed, and how to compare the intensity of the proximity light signal with the second proximity light signal threshold to determine whether the obstructing object has moved away from the display. The first and second proximity light signal thresholds are described in detail below.

[0124] Exemplarily, the first proximity optical signal threshold value and the second proximity optical signal threshold value are determined as shown in Table 1 below.

[0125] Table 1

[0126] Among them, P0 represents the intensity value of the proximity light signal detected by the optical proximity sensor when there is no object blocking the display screen. This value can be considered as the intensity value of the proximity light signal reflected and diffracted by the external environment interference and the above-mentioned display screen or internal structural parts (also known as background noise); P1 represents the intensity value of the proximity light signal detected by the optical proximity sensor when an object at a first preset distance from the display screen blocks the display screen; P2 represents the intensity value of the proximity light signal detected by the optical proximity sensor when an object at a second preset distance from the display screen blocks the display screen, wherein the first preset distance and the second preset distance are The distance can be set according to the actual application. For example, the first preset distance can be set to 50mm and the second preset distance can be 30mm. P_wave is the first threshold component, which is obtained by P1-P0 and represents the intensity value of the proximity light signal reflected by the object at the first preset distance from the display screen detected by the optical proximity sensor after excluding external environmental interference (subtracting P0). P_window is the second threshold component, which is obtained by P2-P1 and represents the difference between the proximity light signal value (P2) of the object at the second preset distance from the display screen and the proximity light signal value P1 of the object at the first preset distance from the display screen. The first proximity light signal threshold value is the sum of the first threshold component and the second threshold component, which is obtained by P2-P0 and represents the value of the proximity light signal value (P2) reflected by the object at the second preset distance from the display screen detected by the optical proximity sensor after removing external environmental interference and background noise (P0). The second proximity light signal threshold value is the first threshold component, obtained based on P1-P0, and represents the value after removing external environmental interference and background noise (P0) from the signal value (P1) of the proximity light reflected by an object at a first preset distance from the display screen detected by the optical proximity sensor.

[0127] In simple terms, the examples of determining the first proximity light signal threshold value and the second proximity light signal threshold value in Table 1 and the examples above can be expressed as filtering out the influence of external environmental interference and background noise, and obtaining the proximity light signal threshold value corresponding to the actual distance between the display screen and the obstructing object. For example, the value obtained by P2-P0 is the proximity light signal intensity value reflected when the distance between the display screen and the obstructing object is 30 mm. It can be seen that in actual applications, mobile phones with different internal structures, different models of optical proximity sensors, and different test environments all have some influence on the value of P0. The specific value can be set according to the actual application, and the embodiments of this application do not impose any restrictions.

[0128] Exemplarily, a first proximity light signal threshold value and a second proximity light signal threshold value are set, and the first proximity light signal threshold value is greater than the second proximity light signal threshold value. When the mobile phone determines whether the distance between the display screen and the obstructing object is greater than or equal to the second distance threshold value, if the change in the distance between the display screen and the obstructing object is not sufficient to make the signal value of the proximity light signal less than or equal to the second proximity light signal threshold value, the mobile phone does not make a judgment. Taking the scenario of a user answering a call as an example, when the user answers the call and puts the phone to his ear, the distance between the phone display screen and the user's face is gradually approaching. During the call, the distance between the phone display screen and the user's face remains within a certain distance range. When the user hangs up the call and puts the phone away, the distance between the phone display screen and the user's face gradually moves away. For example, as shown in Figure 13, the horizontal axis in Figure 13 represents the time from the user picking up the mobile phone and placing it to the ear to the time the user takes the mobile phone away from the ear, and the vertical axis represents the proximity light signal strength value. The L11 curve in the figure represents the proximity light signal strength value curve detected over a period of time. The T1 line segment is the first proximity light signal threshold value, and the T2 line segment is the second proximity light signal threshold value. In the t1 period, the L11 curve is located in the area below the T1 line segment, indicating that the distance between the display screen and the user's face is greater than the preset first distance threshold value. At this time, the mobile phone does not make a judgment. In the t2 period, the L11 curve is located at the T1 line segment, or the area above the T1 line segment, indicating that the distance between the display screen and the user's face is less than or equal to the preset first distance threshold value. At this time, the mobile phone makes a judgment that the display screen is blocked. During the t3 period, the L11 curve is located below the T1 segment and above the T2 segment, indicating that the distance between the display screen and the user's face is less than the preset second distance threshold. At this time, the mobile phone still maintains the judgment that the display screen is blocked. During the t4 period, the L11 curve is located at or below the T2 segment, indicating that the distance between the display screen and the user's face is greater than or equal to the preset second distance threshold. At this time, the mobile phone determines that the display screen is not blocked.

[0129] In the above example, the embodiment of the present application sets two proximity light signal threshold values. After the mobile phone makes a judgment that the display screen is blocked, a smaller proximity light signal threshold value is used to judge whether the display screen is continuously blocked. The difference between the first proximity light signal threshold value and the second proximity light signal threshold value is used as a margin for judging whether to maintain the display screen blocked, so as to avoid the detected proximity light signal intensity value fluctuating within the first proximity light signal threshold value (that is, the proximity light signal intensity value varies between greater than the first proximity light signal threshold value and less than the first proximity light threshold value) when the distance between the mobile phone and the user's face changes slightly, causing the mobile phone to continuously make a judgment that the display screen is blocked.

[0130] In another example, a proximity light signal threshold value can also be set. If the intensity value of the proximity light signal is greater than or equal to the proximity light signal threshold value, the mobile phone determines that the distance between the display screen and the obstructing object is less than or equal to the preset distance threshold value. If the intensity value of the proximity light signal is less than the proximity light signal threshold value, the mobile phone determines that the distance between the display screen and the obstructing object is greater than the preset distance threshold value.

[0131] The above example introduces in detail the implementation process of using a touch sensor, a proximity sensor, and an acceleration sensor to control the display screen to turn on and off. The following describes an example process of the display screen control method provided in an embodiment of the present application.

[0132] In some embodiments, FIG14 shows an example flow diagram of a display screen control method provided by an embodiment of the present application. As shown in FIG14 , when a user needs to use a handset to obtain a voice message, the method provided by an embodiment of the present application is applied. The method may include:

[0133] S101: The mobile phone detects that the handset component is called and obtains a target signal.

[0134] The handset assembly includes the receiver, handset, etc. mentioned in the above embodiments.

[0135] Exemplarily, applications that call the earpiece component include, but are not limited to: calls, text messages, smart assistants, navigation, translation, music, short videos, videos and other applications. These applications can use the earpiece to play voice information. For example, a navigation application can use the earpiece to play voice information such as guiding the user to choose an intersection, the time and distance to the destination, etc. For another example, a translation application can use the earpiece to play voice information such as the pronunciation of the language the user wants to translate. Here, we will not give examples one by one of each application using the earpiece to play its own voice information. When these applications need to use the earpiece to play voice information, they need to request permission to use the earpiece. When using the earpiece component, the status flag of the earpiece component is changed to occupied. When use is completed, the permission to use the earpiece is released, and the status flag of the earpiece component is changed to unoccupied. When the mobile phone detects that the status flag of the earpiece component is occupied, it means that the mobile phone has detected that the earpiece component has been called.

[0136] Exemplarily, the target signal includes, but is not limited to: a gesture signal detected by an acceleration sensor, a proximity signal detected by a proximity sensor, and a touch signal detected by a touch sensor.

[0137] S102: The mobile phone determines whether to execute the screen off action, and if so, executes S103.

[0138] In one implementation, the mobile phone determines whether the distance between the display screen and the obstructing object is less than or equal to a preset first distance threshold based on the proximity signal, and determines whether the posture of the mobile phone meets the preset first posture condition based on the posture signal. When it is determined that the distance between the display screen and the obstructing object is less than or equal to the preset first distance threshold and meets the preset first posture condition, the display screen is controlled to be turned off.

[0139] In another implementation, the mobile phone determines whether the touch operation on the display screen meets the preset touch conditions based on the touch signal, and determines whether the mobile phone meets the preset first posture conditions based on the posture signal. When it is determined that the preset touch conditions and the preset first posture conditions are met, the display screen is controlled to turn off.

[0140] The above two implementation methods can be judged separately, and any one of them that meets the judgment conditions will trigger the screen off action.

[0141] For example, when the mobile phone determines whether the touch operation on the display screen meets the preset touch conditions based on the touch signal, it can use the above example of this application to determine whether the touch operation on the display screen is a facial touch based on the touch signal, and if it is a facial touch, it is determined that the preset touch conditions are met.

[0142] In another example, the above example of the present application may be used to determine whether the touch operation on the display screen is hair contact based on the touch signal, and if it is hair contact, determine that the preset touch condition is met.

[0143] It can be known that, for a set of touch signals, it may be determined that the touch operation acting on the display screen is both a face contact and a hair contact. Therefore, when it is determined based on the touch signals that the touch operation acting on the display screen is both a face contact and a hair contact, it can be determined that the preset touch conditions are met.

[0144] S103: Execute the screen-off action to control the display screen to be off.

[0145] In some possible embodiments, when the mobile phone is in the screen-off state, the mobile phone does not process touch signals and proximity signals. When the display screen is off, the touch sensor does not respond to the user's touch operation. For example, when the user touches the display screen with a finger or face, the display screen does not light up. The proximity sensor does not respond to changes in the distance between the display screen and the obstructing object. For example, the user moves his head away so that there is no obstruction in front of the display screen and the display screen does not light up. Specifically, if the proximity sensor is an optical proximity sensor, then when the display screen is off, the infrared light source stops emitting infrared light to achieve no response to changes in the distance between the display screen and the obstructing object. If the proximity sensor is an ultrasonic proximity sensor, then when the display screen is off, the earpiece stops emitting ultrasonic waves to achieve no response to changes in the distance between the display screen and the obstructing object.

[0146] S104: The mobile phone determines whether the posture change meets a preset second posture condition. If so, execute S105; otherwise, the screen remains off.

[0147] For example, after the screen is off, the phone continues to acquire gesture signals to determine whether the user has changed the phone's gesture. For example, if the user moves the phone from their ear to their chest to continue browsing messages, holds it in their hand, or places it on a table, the phone's gesture may change. The phone uses the gesture signals to determine whether the change in gesture meets a preset second gesture condition. If the preset second gesture condition is met, it indicates that the user has moved the phone away from their ear.

[0148] S105: judging the exit posture of the mobile phone.

[0149] Here, the mobile phone no longer judges the posture change of the mobile phone based on the posture signal, and resumes judgment when the mobile phone performs the above step S103 next time.

[0150] In some embodiments, the mobile phone exiting posture judgment indicates that the user has moved the mobile phone away from the face. The next time the mobile phone executes S103, it means that the mobile phone has again turned off the screen due to recognizing the user's action of placing the mobile phone on the face. Therefore, the mobile phone resumes judging the posture change of the mobile phone based on the posture signal.

[0151] S106. The mobile phone determines whether the distance between the display screen and the blocking object is greater than or equal to a preset second distance threshold. If so, execute S107; otherwise, the screen remains off.

[0152] For example, if the mobile phone controls the proximity sensor to stop detecting proximity signals when the screen is off, then after exiting the gesture judgment, the mobile phone continues to obtain the proximity signal detected by the proximity sensor. If the user moves the mobile phone away from the face, the distance between the display screen and the obstructing object will change. If the proximity signal is a proximity light signal, then when the intensity value of the proximity light signal is less than or equal to the second proximity light signal threshold value, the mobile phone determines that the distance between the display screen and the obstructing object is greater than or equal to the preset second distance threshold.

[0153] S107. Exit the false touch prevention judgment and light up the control display screen.

[0154] Exemplarily, exiting the anti-mistouch judgment includes: the mobile phone no longer judges whether to execute the screen-off action based on the posture signal, touch signal, or proximity signal.

[0155] In some embodiments, after exiting the false touch prevention judgment, the receiver status is checked. If the receiver is still in the activated state, that is, the user has not hung up the call during a call, the process returns to step S101. If the receiver is not in the activated state, that is, the user has hung up the call during a call, the process waits for the next time the receiver is activated and then resumes the judgment in step S101.

[0156] For example, after exiting the anti-mistouch judgment, the mobile phone can directly control the display screen to light up, or wait for the user's operation to control the display screen to light up. The user's operation includes: the user clicks on the display screen. If the "look at the screen to light up" function is set, the user's operation also includes looking at the display screen.

[0157] In addition, in some possible embodiments, after the mobile phone controls the display screen to be off in step S103, the mobile phone can simultaneously process the touch signal, the proximity signal, and the gesture signal, and control the display screen to light up when any one or more of the signals meet the corresponding judgment conditions. In other words, after the mobile phone controls the display screen to be off in step S103, it does not need to wait for the gesture signal to first meet the preset second gesture condition before judging the touch signal and the proximity signal. Instead, the mobile phone can simultaneously judge all three signals and control the display screen to light up when any one or more of the signals meet the corresponding conditions.

[0158] In addition, in some embodiments, if the mobile phone determines based on the touch signal that the touch operation acting on it meets the preset touch condition, the display screen is triggered to be delayed off. At this time, the display screen is turned off after a first preset time period. During the delayed screen off process, if the mobile phone determines based on the posture signal that the posture change of the mobile phone meets the preset first posture condition, the display screen is immediately controlled to be turned off.

[0159] Exemplarily, the delayed screen off can be judged when the mobile phone executes step S102. If the mobile phone determines that the touch operation acting on the display screen meets the preset touch conditions based on the touch signal, and the touch operation that meets the preset touch conditions continues for a certain period of time, the display screen is controlled to be turned off. That is to say, if the touch operation is a touch operation in which the user's face touches the display screen, the display screen is controlled to be turned off after the user's face touches the display screen for the first preset period of time (for example, 2 seconds).

[0160] In addition, the delayed screen off can also be judged after the mobile phone executes step S107. If the mobile phone determines that the touch operation acting on the display screen meets the preset touch conditions based on the touch signal and lasts for the first preset time, the display screen is turned off.

[0161] In some embodiments, after executing step S103 to control the display screen to be off, the mobile phone can also directly determine whether to perform a screen-on operation based on the touch signal. For example, when controlling the display screen to be off, the mobile phone continues to determine whether the triggering operation on the display screen meets the preset touch condition based on the touch signal. When it is determined that the preset touch condition is not met, and after a second preset time period, the display screen is controlled to be turned on. The second preset time period here can be equal to the first preset time period. In addition, when it is determined that the preset touch condition is not met, the display screen can be immediately controlled to be turned on, and the specific setting depends on the actual application.

[0162] In some actual methods, after executing step S103 to control the display screen to turn off, the mobile phone can also directly determine whether to perform the screen light-up operation based on the proximity signal, which is similar to the above example of determining whether to perform the screen light-up operation based on the touch signal, and will not be repeated here.

[0163] In addition, in some embodiments, priorities can be set for different scenarios, and more judgment methods can be applied to scenarios with higher priorities. For example, the call scenario is set as a higher priority scenario. When the user answers the call, the mobile phone can determine whether to control the display screen to turn off based on the proximity light signal, ultrasonic signal, touch signal and gesture signal. The translation scenario is set as a lower priority scenario. When the user uses the mobile phone receiver to obtain the transliterated content, it can be determined only by the touch signal or only by the proximity light signal whether to control the display screen to turn off.

[0164] In addition, in some embodiments, the display screen control method provided in the embodiment of the present application can be directly updated to the system of the mobile phone through a system upgrade, and an "anti-mistouch enhancement" option can be added to the mobile phone, as shown in the example diagram of the call settings page in Figure 15. Figure 15 (a) shows the call settings page. After the user clicks the "call anti-mistouch" option, the anti-mistouch option page is entered, as shown in Figure 15 (b). The user can click the "anti-mistouch enhancement" option to turn on or off the anti-mistouch function that can be achieved by the display screen control method provided in the above embodiment of the present application. When the anti-mistouch enhancement option is turned on, all applications in the mobile phone that can call the earpiece and display can use the display screen control method provided in the embodiment of the present application.

[0165] In addition, as shown in the anti-mistouch option page in (c) of Figure 15, the user can enter the custom anti-mistouch page by clicking the "Custom anti-mistouch" option. As shown in (d) of Figure 15, the user can open a pop-up window by clicking the "Custom anti-mistouch application" option. As shown in (e) of Figure 15, in the pop-up window, the user can customize the function usage permissions of the application that needs to be protected against mistouch, or close the function usage permissions of the application that has already been enabled for anti-mistouch.

[0166] In addition, as shown in (f) of Figure 15, the user clicks the "Customize anti-mistouch recognition area" option in the custom anti-mistouch page to set the anti-mistouch recognition area. As shown in (g) of Figure 15, the user can select the size, position, shape, etc. of the hair recognition area and the face recognition (large object recognition) area in the window.

[0167] In the display screen control method provided by the embodiment of the present application, the mobile phone detects the touch operation acting on it through the touch sensor and detects the posture of the mobile phone through the acceleration sensor. When it is determined that the touch operation is a touch operation caused by contact with the user's face, ear, hair, etc., it is determined that the display screen is blocked. When it is determined that the posture of the mobile phone is the posture of the user picking up the phone and putting it to the ear, it is determined that the user has made an action of picking up the phone and putting it to the ear. When the mobile phone determines that the display screen is blocked and the user has made an action of picking up the phone and putting it to the ear, the display screen is controlled to be turned off. The problem of optical proximity light black hair caused by the use of optical proximity sensors is avoided. Furthermore, because the two judgments are independent of each other and have no correlation, the mobile phone makes the screen-off action when both judgments are met, which can increase the stability of the screen-off judgment and reduce the probability of false touches.

[0168] The display screen control method provided in the embodiment of the present application can be applied to terminal devices, wherein the terminal devices can be mobile phones, tablet computers, wearable devices (such as smart watches, smart bracelets, etc.), vehicle-mounted devices, virtual reality devices, and electric vehicle control panels, etc., which are terminal devices with display screens. The embodiment of the present application does not impose any special restrictions on the specific form of the terminal device.

[0169] For example, FIG16 shows a schematic diagram of the structure of a terminal device 1100. The terminal device 1100 may include: a processor 1110, an external memory interface 1120, an internal memory 1121, an audio module 1130, a display screen 1140, a communication module 1150, a power module 1160, an input device 1170, a sensor module 1180, etc. The sensor module 1180 may include an acceleration sensor 1180A, an optical proximity sensor 1180B, an ultrasonic proximity sensor 1180C, a touch sensor 1180D, etc.

[0170] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the terminal device 1100. In other embodiments of the present application, the terminal device 1100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0171] The processor 1110 may include one or more processing units. For example, the processor 1110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0172] The controller may be the nerve center and command center of the terminal device 1100. The controller may generate an operation control signal based on the instruction operation code and the timing signal to complete the control of instruction fetching and execution.

[0173] Processor 1110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 1110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 1110. If processor 1110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 1110 latency, and thus improves system efficiency.

[0174] In some embodiments, the processor 1110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0175] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the terminal device 1100. In other embodiments of the present application, the terminal device 1100 may also adopt a different interface connection method from the above embodiments, or a combination of multiple interface connection methods.

[0176] The terminal device 1100 can implement audio functions through the audio module 1130, the earpiece 1131, the microphone 1132, and the application processor. For example, music playback, recording, etc. The audio module 1130 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 1130 can also be used to encode and decode audio signals. In some embodiments, the audio module 1130 can be provided in the processor 1110, or some functional modules of the audio module 1130 can be provided in the processor 1110.

[0177] The earpiece 1131 is used to convert audio electrical signals into sound signals. In the embodiment of the present application, the earpiece is used to play voice information provided by applications such as calls, text messages, short videos, navigation, and translation. It is also used to transmit ultrasonic signals.

[0178] The microphone is used to convert sound signals into electrical signals. The user can speak by bringing their mouth close to the microphone to input the sound signal into the microphone. In the embodiment of the present application, the microphone is used to receive the user's voice and is also used to receive ultrasonic signals.

[0179] The communication module 1150 can provide wireless communication solutions including cellular, Wi-Fi, Bluetooth (BT), wireless data transmission modules (for example, 433MHz, 868MHz, 915MHz) applied to the terminal device 1100. The communication module 1150 can be one or more devices integrating at least one communication processing module. The communication module 1150 receives electromagnetic waves via antenna 1 or antenna 2, filters and frequency modulates the electromagnetic wave signals, and sends the processed signals to the processor 1110. The communication module 1150 can also receive the signal to be transmitted from the processor 1110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through antenna 1 or antenna 2.

[0180] Terminal device 1100 implements display functions through a GPU, display screen 1140, and an application processor. The GPU is a microprocessor for image processing that connects display screen 1140 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 1110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0181] The display screen 1140 is used to display images, videos, etc. The display screen 1140 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 200 may include 1 or N display screens 1140, where N is a positive integer greater than 1. In the embodiment of the present application, the display screen 1140 can be used to display a UI and receive user operations on the UI.

[0182] In some embodiments, the display screen 1140 is provided with a pressure sensor, a touch sensor, etc. The pressure sensor is used to sense pressure signals and convert them into electrical signals. When a touch operation is applied to the display screen 1140, the terminal device 1100 detects the intensity of the touch operation using the pressure sensor. The terminal device 1100 can also calculate the location of the touch based on the detection signal from the pressure sensor.

[0183] Touch sensor 1180D, also known as a "touch panel," can form a touch screen with display screen 1140. Touch sensor 1180D is configured to detect touch operations applied to or near the touch sensor. Touch sensor 1180D can communicate the detected touch operations to an application processor to determine the type of touch event. Display screen 1140 can also provide visual output related to the touch operations.

[0184] The power module 1160 can be used to supply power to various components included in the terminal device 1100. In some embodiments, the power module 1160 can be a battery, such as a rechargeable battery.

[0185] Input device 1170 may include a keyboard, a mouse, and the like. The keyboard is used to input English letters, numbers, punctuation marks, and the like into terminal device 1100, thereby issuing commands to terminal device 1100 and inputting data. The mouse, which indicates the vertical and horizontal coordinates of the terminal device 1100 display system, is used to input commands to terminal device 1100. Input device 1170 may be connected to terminal device 1100 via a wired connection, for example, via a GPIO interface, a USB interface, or the like. Input device 1170 may also be connected to terminal device 1100 wirelessly, for example, via Bluetooth, infrared, or the like.

[0186] The sensor module 1180 may include an acceleration sensor 1180A, an optical proximity sensor 1180B, an ultrasonic proximity sensor 1180C, a touch sensor 1180D, an ultrasonic proximity sensor, and the like.

[0187] Accelerometer 1180A can detect the magnitude of acceleration of terminal device 1100 in all directions (generally three axes). When terminal device 1100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the terminal's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0188] In the embodiment of the present application, the acceleration sensor 1180A is used to detect angle change information and transmit the angle change information to the application processor. The angle change information is used to describe the posture change of the terminal device 1100 and determine whether the user needs to touch the display screen 1194.

[0189] The optical proximity sensor 1180B may include, for example, a light emitting diode (LED) and a light detector, the light emitting diode may be an infrared light emitting diode, and the light detector may be a photodiode. The terminal device 1100 emits infrared light outward through the light emitting diode. The terminal device 1100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 1100. When insufficient reflected light is detected, the terminal device 1100 can determine that there is no object near the terminal device 1100. The terminal device 1100 can use the optical proximity sensor 1180B to detect when the user holds the terminal device 1100 close to the ear to talk, so as to automatically turn off the display screen to save power. The optical proximity sensor 1180B can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0190] The ultrasonic proximity sensor 1180C may include an ultrasonic generator and an ultrasonic receiver. The ultrasonic generator may be the receiver 1170B, and the ultrasonic receiver may be the microphone 1170C. The terminal device 1100 uses the receiver 1170B to emit ultrasonic waves, and the microphone 1170C receives ultrasonic waves reflected from nearby objects. The intensity of the reflected ultrasonic signal can be used to determine whether there is an object near the terminal device 1100 and the distance between the object and the terminal device 1100. The terminal device 1100 can use the ultrasonic proximity sensor 1180C to detect when a user holds the terminal device 1100 close to their ear to make a call, so that the display screen can be automatically turned off to save power.

[0191] In the embodiment of the present application, the optical proximity sensor 1180B and the ultrasonic proximity sensor 1180C are both used to detect the distance information between the mobile phone display screen and the blocking object covering the display screen.

[0192] The software system of the terminal device 1100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the terminal device 1100.

[0193] Figure 17(a) is a structural block diagram of the terminal device 1100 according to an embodiment of the present application.

[0194] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the software system is divided into four layers: application layer (APP), application framework layer (FWK), hardware abstraction layer (HAL), and kernel layer.

[0195] The application layer can include a series of application packages.

[0196] As shown in FIG17(a), the application package may include applications such as call and instant messaging. Call applications are used for dialing and making calls, while instant messaging applications are used for video and voice communications. In some embodiments, the application package may also include applications such as calendar, gallery, music, and short messaging.

[0197] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0198] As shown in (a) of FIG17 , the application framework layer may include: an activity manager service (AMS), a content provider, a phone manager, a resource manager, a notification manager, a view system, and the like.

[0199] AMS uniformly schedules the interface activities of the above applications.

[0200] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the display screen, capture the display screen, etc.

[0201] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history, bookmarks, phone books, etc.

[0202] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0203] The phone manager is used to provide communication functions for terminal devices, such as call status management (including answering, hanging up, etc.).

[0204] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0205] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically, without requiring user interaction. For example, the Notification Manager can be used to notify users of completed downloads, message reminders, and so on. The Notification Manager can also display notifications in the form of icons or scrolling text in the top status bar, such as notifications from background applications, or in the form of dialog windows on the display. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating the terminal device, and flashing indicator lights.

[0206] The hardware abstraction layer (HAL) is an interface layer between the operating system and the hardware circuitry, aiming to abstract the hardware. As shown in Figure 17(a), the HAL may include a recognition unit and a logic judgment unit. The recognition unit includes a gesture recognition unit, a touch recognition unit, and a distance recognition unit.

[0207] The kernel layer is the layer between hardware and software. It includes at least sensor drivers, display drivers, and audio drivers. Sensor device drivers include touch sensor drivers, accelerometer drivers, and proximity sensor drivers.

[0208] The following is an illustrative introduction to a display screen control method provided in an embodiment of the present application in conjunction with the software architecture of the terminal device 1100.

[0209] As shown in FIG17( b ), the display screen control method provided in the embodiment of the present application includes:

[0210] S1701: The call application receives a call operation from the user.

[0211] Illustratively, the user's call operation includes the user making a call and the user answering a call.

[0212] S1702: The call application sends a start request to the audio driver.

[0213] The call application sends a start request to the audio driver, so that the audio driver starts the microphone and the earpiece to input and receive voice information.

[0214] S1703: The audio driver starts the microphone and the earpiece.

[0215] The audio driver controls the microphone and earpiece to start up. The earpiece plays the other party's voice information, and the microphone receives the user's voice information.

[0216] S1704: The audio driver sends a message to the call application indicating that the microphone and receiver have been started.

[0217] The audio driver notifies the call application that the microphone and earpiece are activated.

[0218] S1705: The call application sends a start request to the sensor driver.

[0219] The calling application sends a start request to the sensor driver to start the sensor to collect signals.

[0220] S1706: The sensor driver starts the touch sensor, acceleration sensor, and proximity sensor.

[0221] The touch sensor collects touch signals acting on the display screen, the acceleration sensor collects posture signals of changes in the phone's posture, and the proximity sensor collects proximity signals of the distance between the display screen and the obstructing object.

[0222] S1707: The touch sensor sends the collected touch signal to the touch recognition unit, the acceleration sensor sends the collected posture signal to the gesture recognition unit, and the proximity sensor sends the collected proximity signal to the distance recognition unit.

[0223] S1708. The touch recognition unit recognizes the user's touch operation according to the touch signal, the gesture recognition unit recognizes the user's gesture operation according to the posture signal, and the distance recognition unit recognizes the distance between the display screen and the blocking object according to the proximity signal.

[0224] S1709. The touch recognition unit sends the recognition result of the user's touch operation to the logic judgment unit, the gesture recognition unit sends the recognition result of the user's gesture operation to the logic judgment unit, and the distance recognition unit sends the recognition result of the distance between the display screen and the blocking object to the logic judgment unit.

[0225] S1710. The logic judgment unit outputs a judgment result according to the user's touch operation, the user's gesture operation, and the distance between the display screen and the blocking object.

[0226] For example, the logic judgment unit may adopt the example of judging whether to control the display screen to turn off in the above example of the present application, for example,

[0227] Based on the proximity signal, it is determined whether the distance between the display screen and the obstructing object is less than or equal to a preset first distance threshold; based on the posture signal, it is determined whether the posture of the mobile phone meets the preset first posture condition; when it is determined that the distance between the display screen and the obstructing object is less than or equal to the preset first distance threshold and meets the preset first posture condition, the display screen is controlled to be turned off.

[0228] Determine whether the touch operation on the display screen meets the preset touch conditions based on the touch signal, and determine whether the mobile phone meets the preset first posture conditions based on the posture signal. When it is determined that the preset touch conditions and the preset first posture conditions are met, control the display screen to be turned off.

[0229] The above two implementation methods can be judged separately, and if any one of the methods meets the judgment conditions, the judgment result of turning off the display screen is output.

[0230] S1711. The logic judgment unit sends the judgment result to the call application.

[0231] Exemplarily, the judgment result includes: recognizing that the user makes a gesture of placing the mobile phone to the ear, and the mobile phone display screen is blocked.

[0232] S1712: The call application sends a control request to the display driver according to the determination result.

[0233] Exemplarily, the control request includes: requesting the display screen to be turned off.

[0234] S1713: The display driver controls the display screen to turn off according to the control request.

[0235] An embodiment of the present application provides a terminal device, which may include: a memory and one or more processors, wherein the memory is configured to store computer program code, the computer program code comprising computer instructions. When the processor executes the computer instructions, the terminal device may perform the functions or steps performed by the mobile phone in the above-described method embodiment. The structure of the terminal device may refer to the structure of the terminal device shown in FIG16 .

[0236] An embodiment of the present application further provides a computer-readable storage medium comprising computer instructions, which, when executed on a terminal device, causes the terminal device to execute the display screen control method as described above.

[0237] An embodiment of the present application further provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute the display screen control method as described above.

[0238] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0239] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0240] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0241] In addition, the functional units in the various embodiments of the present application may be integrated into some processing units, or each unit may exist physically separately, or two or more units may be integrated into some units. The above-mentioned integrated units may be implemented in the form of hardware or software functional units.

[0242] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in some readable storage media. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in some storage media and includes several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program code, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0243] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A display screen control method, characterized in that: Applied to a terminal device, the terminal device includes an acceleration sensor and a touch sensor provided on a display screen, and the method includes: Acquiring a touch operation performed by a user on the display screen according to a touch signal collected by the touch sensor; Acquiring a posture change of the terminal device according to a posture signal collected by the acceleration sensor; When the display screen is on, if the touch operation on the display screen meets a preset first condition and the posture change of the terminal device meets a preset second condition, the display screen is controlled to be off.

2. The method according to claim 1, characterized in that The touch operation is performed on a first area preset on the display screen, and the touch operation performed on the display screen satisfies a first preset condition, including: The touch signal value is greater than or equal to a preset first threshold value, and the area of ​​the touch area is greater than or equal to a preset second threshold value; wherein, the touch signal value is the signal value of the touch operation acting on the display screen, and the touch area is the area where the touch operation is applied.

3. The method according to claim 1, characterized in that The touch operation is performed on a first area preset on the display screen, and the touch operation performed on the display screen satisfies a first preset condition, including: The touch signal value is greater than or equal to a preset first threshold value, and the major axis length of the touch area is greater than or equal to a preset third threshold value.

4. The method according to claim 2 or 3, characterized in that The touch signal value is a maximum value among the signal values ​​of each touch point in the touch area, or an average value of the signal values ​​of each touch point in the touch area.

5. The method according to any one of claims 2 to 4, characterized in that: The touch operation is performed on a second area preset on the display screen, the second area does not overlap with the first area, and the touch operation performed on the display screen satisfies a preset first condition, including: The number of touch points acted on the display screen by the touch operation is greater than or equal to a preset fourth threshold value.

6. The method according to claim 5, characterized in that The second area includes a first sub-area and a second sub-area, and the first sub-area and the second sub-area are respectively located on two sides of the earpiece.

7. The method according to any one of claims 1 to 6, characterized in that The posture includes a roll angle and a pitch angle, and the posture change of the terminal device satisfies a preset second condition including: The roll angle change value of the terminal device is greater than or equal to the first roll angle judgment threshold, and the pitch angle change value of the terminal device is greater than or equal to the first pitch angle judgment threshold.

8. The method according to claim 7, characterized in that After controlling the display screen to be off, the method further includes: If it is determined that the distance between the object generating the touch operation and the display screen is greater than or equal to a preset second distance threshold, and it is determined that the posture change of the terminal device satisfies a preset third condition, the display screen is controlled to light up.

9. The method according to claim 8, characterized in that The posture includes a heading angle, a roll angle, and a pitch angle. The posture change of the terminal device satisfies a preset third condition, which includes: The heading angle change value of the terminal device is greater than or equal to the second roll angle judgment threshold, and / or the pitch angle change value is greater than or equal to the second pitch angle judgment threshold, and / or the roll angle change value is greater than or equal to the second roll angle judgment threshold.

10. The method according to claim 8 or 9, characterized in that After controlling the display screen to light up, the method further includes: When the touch operation on the display screen meets a preset first condition and lasts for a first preset time period, the display screen is controlled to be off.

11. The method according to any one of claims 1 to 10, characterized in that: If the touch operation on the display screen satisfies a preset first condition and the posture change of the terminal device satisfies a preset second condition, before controlling the display screen to be off, the method further includes: It is detected that the handset is called.

12. The method according to claim 1, characterized in that The terminal device further includes a proximity sensor, and the method further includes: Acquiring the distance between the display screen and the obstructing object according to the proximity signal collected by the proximity sensor; When the display screen is on, if the distance between the display screen and the blocking object is less than or equal to a preset first distance threshold, and the posture change of the terminal device meets a preset second condition, the display screen is controlled to be off.

13. A terminal device, characterized in that: The terminal device includes: a processor and a memory, the processor is coupled to the memory; the memory is used to store computer program code; the computer program code includes computer instructions, and when the processor executes the above-mentioned computer instructions, the terminal device executes the method according to any one of claims 1 to 12.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium includes computer instructions, and when the computer instructions are executed on a terminal device, the terminal device executes the method according to any one of claims 1 to 12.

15. A computer program product, characterized in that When the computer program product is run on a terminal device, the terminal device is enabled to execute the method according to any one of claims 1 to 12.

Images