Device control method, electronic device, and computer-readable storage medium
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HONOR DEVICE CO LTD
- Filing Date
- 2023-11-23
- Publication Date
- 2026-05-29
AI Technical Summary
Electronic devices are prone to erroneous responses when accidentally touched in a pocket, resulting in a poor user experience, such as accidental dialing or entering an incorrect interface.
The system uses sensor data on ambient light, device posture, and motion to determine if the device is in a pocket scenario, displays an anti-mistouch interface, restricts non-predefined operations, and prompts the user to exit the anti-mistouch mode.
It effectively prevents accidental touches of electronic devices in pockets, improves user experience, avoids erroneous responses, and reduces power consumption.
Smart Images

Figure CN120075357B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to a device control method, electronic device, and computer-readable storage medium. Background Technology
[0002] With the widespread use of large-screen electronic devices such as smartphones, users may casually place them in their pockets while using them. The pocket itself, or other items within it, can easily touch the electronic device's touchscreen. If the electronic device is unlocked in the pocket, it may respond incorrectly to touches from the pocket or other items, resulting in erroneous control responses.
[0003] It is evident that there is a lack of solutions to prevent accidental touches in pockets. Summary of the Invention
[0004] This application provides a device control method, an electronic device, and a computer-readable storage medium to solve the technical problem that electronic devices are prone to erroneous responses when accidentally touched in a pocket.
[0005] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:
[0006] Firstly, a device control method is provided, applied to an electronic device including a large touchscreen capable of receiving user touch operations and providing corresponding feedback. The electronic device includes a lock screen mode and an unlock mode. In lock screen mode, the screen is locked, and the touchscreen does not respond to user touch operations. In existing electronic devices, the touchscreen can receive touch operations in unlock mode. These operations can include those performed by the user's finger or by other objects touching the touchscreen. If a user puts the unlocked electronic device in their pocket, the pocket or other items inside may also touch the touchscreen, causing the electronic device to erroneously respond to these touch operations, leading to uncontrolled situations such as incorrect dialing or entering shopping interfaces, affecting user experience and even causing inconvenience.
[0007] Pocketing is a common scenario for accidental touches on electronic devices. In a pocket, the relatively enclosed environment typically results in low ambient light levels. The device pre-records a first preset brightness value as a reference for the pocket scenario. Furthermore, when a user normally holds the device, it is upright. Inserting the device downwards into a pocket changes its orientation from upright to inverted. Additionally, movement increases the likelihood of contact and friction with the pocket or other items, leading to accidental touches. In short, pocketing typically involves several characteristics: ambient light levels below the first preset brightness value, an inverted orientation, and movement. These characteristics can be used to determine if an electronic device is in a scenario prone to accidental touches. The multi-sensor data processing module within the electronic device can continuously monitor whether the brightness value collected by the ambient light sensor is lower than a first preset brightness value, simultaneously monitor whether the body posture data collected by the gyroscope sensor meets the requirements for an inverted posture, and monitor whether the acceleration data collected by the accelerometer sensor meets the requirements for acceleration in motion. When all three types of data are simultaneously satisfied, it can be determined that the electronic device may be in a pocket scenario, and at this time, the first type of event is reported.
[0008] The device control method provided in this application is a device control scheme for electronic devices in unlocked mode or non-locked screen mode. After the electronic device is unlocked, it is currently displaying a first interface. This first interface may be the main interface of the electronic device or an application interface, such as the interface of a drawing application or a video playback application. It should be noted that there is no limitation on a certain type of interface to be the first interface; rather, any interface displayed by the electronic device after unlocking can be used as the first interface.
[0009] If an electronic device detects a Type I event based on ambient light levels, device posture, and motion, it can be assumed that the device is in a pocket scenario in unlock mode, potentially triggering accidental touches. In this case, the electronic device can directly display a first anti-accidental touch interface on the first screen, with the corresponding layer of the first anti-accidental touch interface displayed on top of the corresponding layer on the first screen. That is, both the first screen and the first anti-accidental touch interface are visible to the user, and the first anti-accidental touch interface has a higher priority than the first screen.
[0010] When the electronic device displays the first anti-mistouch interface, it also displays a first prompt message to indicate that the device is currently in the first anti-mistouch mode. In this mode, the device cannot respond to various touch operations like in normal unlocking mode; instead, it can only respond to a few predefined first-type input operations to achieve the anti-mistouch effect through the first anti-mistouch interface. Specifically, the first-type input operation can be an operation to exit the first anti-mistouch mode, such as swiping to exit the mode in a designated area, tapping to exit, swiping a custom graphic to exit, or using fingerprint verification to exit the mode.
[0011] The device control method provided in this application, after the electronic device enters the unlock mode, can detect whether a first type of event has occurred based on the ambient light level, body posture, and body movement state of the electronic device's environment. This first type of event determines whether the electronic device is in a scenario that may trigger accidental touch. Subsequently, the electronic device displays a first anti-accidental touch interface on top of the currently displayed first interface to notify the user that the electronic device has entered the first anti-accidental touch mode, thus protecting the electronic device from accidental touches. The corresponding layer of the first anti-accidental touch interface is displayed on top of the corresponding layer of the first interface, making both the currently displayed first interface and the first anti-accidental touch interface visible to the user. This ensures that the electronic device continues to display the original first interface while still effectively indicating the first anti-accidental touch mode. Even in unlock mode, the electronic device will not randomly respond to various touch operations when it enters the first anti-accidental touch mode, effectively preventing accidental touches. Furthermore, displaying a first prompt message to indicate that the user can exit the first type of input operation in the first anti-accidental touch mode ensures that the user can choose to exit the anti-accidental touch protection according to actual needs, further improving the user experience while enhancing the anti-accidental touch protection capability.
[0012] In one possible implementation of the first aspect, the implementation scheme for detecting the first type of event by the electronic device is further defined. Specifically, when the touchscreen of the electronic device switches from lock screen mode to unlock mode, it receives a screen unlock event reported by the internal lock screen management module. Upon receiving the screen unlock event, the electronic device begins listening for the detection of the first type of event. Specifically, the electronic device can register a first listening event, which is used to monitor various sensor data, determine whether the first type of event is met based on the various sensor data, and report the first type of event if it is met. Upon receiving the reported first type of event, the electronic device controls the touchscreen to enter the first anti-mistouch mode and displays the first anti-mistouch interface.
[0013] When an electronic device enters unlock mode, it begins listening for the detection of a first type of event. Upon detection of such an event, it quickly enters the first anti-mistouch mode for protection against accidental touches. The device continuously acquires sensor data from various sensors and uses this data to monitor for first-type events, minimizing power consumption and providing comprehensive protection against accidental touches even in unlock mode, thus enhancing the user experience.
[0014] In one possible implementation of the first aspect, a scheme for the electronic device to display the first anti-mistouch interface on the first interface is further defined. Specifically, the scheme for the electronic device to display the first anti-mistouch interface on the first interface involves displaying the layer corresponding to the first anti-mistouch interface on top of the corresponding layer on the first interface, and controlling the transparency of the first anti-mistouch interface within a preset range.
[0015] In this way, both the primary interface and the primary anti-mistouch interface are visible to the user, allowing the user to easily view the currently displayed primary interface, while the primary anti-mistouch interface serves as a prompt. The transparency of the primary anti-mistouch interface is controlled within a preset range, ensuring that the primary anti-mistouch interface is visible to the user without completely obscuring the primary interface. Typically, the transparency of the primary interface is zero, while the transparency of the primary anti-mistouch interface is greater than zero but less than the maximum transparency.
[0016] The display area of the first anti-mistouch interface can completely cover the display area of the first interface, or it can not completely cover the display area of the first interface. For example, the first anti-mistouch interface can be displayed on top of the first interface as a small pop-up, without limitation.
[0017] In one possible implementation of the first aspect, another solution is provided for the electronic device to display a first anti-mistouch interface. Specifically, the electronic device determines that it is in a pocket scenario upon detecting a first type of event. At this time, the electronic device can first generate the first anti-mistouch interface, but does not directly display it to the user. For example, the electronic device can first set the first anti-mistouch interface to be invisible or to maximum transparency. Simultaneously, the electronic device enters a first anti-mistouch mode, in which the electronic device does not respond to touch operations other than the first type of input.
[0018] The electronic device simultaneously begins detecting whether there are any obstruction events or touch screen events. Obstruction events refer to situations where a hand, pocket, or other object blocks the touchscreen; touch screen events refer to touch events that affect the touchscreen. Both types of events can lead to accidental touches in a pocket-like environment. When the electronic device detects the second type of event, confirming that an accidental touch has occurred, it will make the first anti-accidental touch interface visible. The electronic device can adjust the transparency from its maximum value to a preset range, making this first anti-accidental touch interface visible to the user to achieve a notification effect.
[0019] The device control method provided in this embodiment generates a first anti-mistouch interface when a first type of event corresponding to a possible accidental touch scenario is detected, but does not immediately make it visible to the user, allowing the first interface to be displayed normally. Only when a second type of event corresponding to the accidental touch operation is detected is the first anti-mistouch interface made visible to the user. This achieves anti-mistouch protection while ensuring the normal operation of the electronic device as much as possible, thus improving the user experience.
[0020] In one possible implementation of the first aspect, the electronic device may also generate a first anti-mistouch interface for backup upon receiving a reported screen unlock event, and only set the first anti-mistouch interface to be visible to the user upon detecting a first type of event or a second type of event.
[0021] In one possible implementation of the first aspect, the scheme for detecting the second type of event by the electronic device is further defined. Specifically, when the electronic device receives the first type of event, it enters a first anti-mistouch mode and simultaneously begins listening for the detection of the second type of event. Specifically, the electronic device can register a second listening event, which is used to monitor touchscreen sensing data, determine whether the second type of event, such as a large object occlusion event or a touchscreen event, is met based on various sensing data, and report the second type of event when it is met. Upon receiving the reported second type of event, the electronic device controls the touchscreen to display the first anti-mistouch interface, indicating to the user that the electronic device is currently in the first anti-mistouch mode and will not respond to current touchscreen operations.
[0022] When an electronic device enters the first anti-mistouch mode, it begins to listen for the detection of the second type of event. If the second type of event is detected, the first anti-mistouch interface will be displayed quickly to provide an anti-mistouch prompt, thus improving the user experience.
[0023] In one possible implementation of the first aspect, the first anti-mistouch interface displayed by the electronic device is further defined. Specifically, when displaying the first anti-mistouch interface, the electronic device also displays a second prompt message within the first anti-mistouch interface. The second prompt message is used to indicate the operation mode of the first type of input operation. The first type of input operation indicating exiting the first anti-mistouch mode can be a system-preset operation mode or an operation mode that the user customizes or selects within the settings application. For example, the first type of input operation can be a single or double swipe operation in the lower area of the screen, a tap operation in any or a specified area of the screen, a swipe operation with a specific pattern, or a fingerprint verification operation or an iris verification operation, etc., without limitation.
[0024] In one possible implementation of the first aspect, the device control method for switching an electronic device from unlock mode to lock screen mode is further defined. In unlock mode, the electronic device displays a first anti-mistouch interface based on a first type of event and a second type of event, thus entering a first anti-mistouch mode. At this time, if the electronic device switches from unlock mode to lock screen mode, the electronic device can directly terminate the anti-mistouch protection scheme in the unlock mode and cancel the display of the first anti-mistouch interface.
[0025] When an electronic device enters lock screen mode, it no longer needs to execute the device control method in unlock mode provided in this application embodiment. The electronic device can directly cancel the first anti-mistouch interface that was previously displayed, thus avoiding causing subsequent error prompts to the user.
[0026] In one possible implementation of the first aspect, after the electronic device switches from unlock mode to lock screen mode, it can also directly exit the first anti-mistouch mode. The operating state of the first anti-mistouch mode may differ upon receiving a screen lock event, and the operation to exit the first anti-mistouch mode may also differ.
[0027] In one scenario, under the first accidental touch prevention mode, if the electronic device is listening for and detecting a second type of event, and the electronic device is not currently displaying the first accidental touch prevention interface, the electronic device needs to cancel the listening for and detection of the second type of event to exit the first accidental touch prevention mode. Without the triggering of a second type of event, the electronic device will not trigger the display of the first accidental touch prevention interface.
[0028] In another scenario, if the electronic device has detected a second type of event and is displaying the first accidental touch prevention interface in this first accidental touch prevention mode, the electronic device needs to de-display the first accidental touch prevention interface to exit the first accidental touch prevention mode.
[0029] In other cases, when an electronic device receives a screen unlock event, it may be listening for but not yet detecting the first type of event (i.e., it has not yet entered the first anti-mistouch interface). If a screen lock event is received at this time, the electronic device can directly cancel listening for the first type of event and will not continue listening for the second type of event or displaying the first anti-mistouch interface.
[0030] In one possible implementation of the first aspect, the specific implementation process of the device control method provided in this embodiment is further defined by combining the various functional layers within the software framework of the electronic device. Specifically, the electronic device includes a framework layer and a hardware abstraction layer. The framework layer includes an input management module, a screen lock management module, and an interface service module. The hardware abstraction layer includes a multi-sensor data processing module and an anti-mistouch module. The specific process of the electronic device executing the device control method may include:
[0031] The input management module registers a first listening event with the lock screen management module, so that the lock screen management module can listen for whether the screen unlock event occurs and notify the input management module of the detected screen unlock event.
[0032] When the input management module receives the screen unlock event, it registers a second listening event with the multi-sensor data processing module so that the multi-sensor data processing module can listen for whether the first type of event is detected and notify the input management module of the first type of event it has detected.
[0033] When the input management module receives the first type of event, it notifies the anti-mistouch module.
[0034] The accidental touch prevention module notifies the interface service module to display the first accidental touch prevention interface.
[0035] In one possible implementation of the first aspect, the method further includes:
[0036] When the screen lock management module detects a screen lock event, it notifies the input management module of the detected screen lock event.
[0037] When the input management module receives the screen lock event, it notifies the anti-mistouch module.
[0038] The accidental touch prevention module notifies the interface service module to cancel the display of the first accidental touch prevention interface.
[0039] In one possible implementation of the first aspect, the case where the electronic device is a foldable screen device is further defined. The electronic device is a foldable screen device, and the device usage states of the foldable screen device include an unfolded state and a folded state. In the unfolded state, the foldable screen device is relatively large and usually cannot be directly placed in a pocket; therefore, the possibility of accidental touches in a pocket scenario is relatively small. In the folded state, the foldable screen device is relatively small, and users typically place it in a pocket in the folded state; therefore, the possibility of accidental touches in a pocket scenario is relatively large. Performing different device control operations for different device usage states of the foldable screen device can both achieve accidental touch protection and reduce unnecessary operations and power consumption.
[0040] When an electronic device receives a reported screen unlock event, it first determines its device usage status. If the device is in a folded state, it indicates a high probability of accidental touch due to being in a pocket. In response to the screen unlock event, the electronic device can begin listening for the detection of the first type of event. Upon detection of the first type of event, the electronic device can promptly enter the first anti-accidental touch mode to achieve accidental touch protection.
[0041] If an electronic device determines that its usage state is in the unfolded state, it does not need to perform the operation of listening to whether the first type of event has been detected, so as to reduce operation and power consumption and improve the operating efficiency of the electronic device in the unfolded state.
[0042] In one possible implementation of the first aspect, the device control method executed by the electronic device in screen lock mode is further defined. Upon receiving a reported screen lock event, the electronic device, in response to the screen lock event, begins to execute the anti-mistouch scheme corresponding to the screen lock mode. Specifically, the electronic device begins to listen for the detection of a third type of event. The monitored third type of event may include the ambient light brightness of the electronic device being less than or equal to a second preset brightness value, the device being in an inverted position, and the screen being obstructed by a large object. If the electronic device detects the third type of event, it enters a second anti-mistouch mode. In the second anti-mistouch mode, the electronic device only responds to a predefined second type of input operation, which is used to instruct the electronic device to exit the second anti-mistouch mode.
[0043] Secondly, this application provides an electronic device with external accessories. The electronic device includes a touch screen, a memory, and a processor, wherein the touch screen and the memory are coupled to the processor.
[0044] The memory stores computer-executed instructions;
[0045] The processor executes computer execution instructions stored in the memory, causing the electronic device to perform the device control method as described in any one of the first aspects.
[0046] In one possible implementation of the second aspect, the electronic device is used for:
[0047] Display a first interface; wherein, the first interface is the application interface or main interface displayed after the electronic device is unlocked;
[0048] Upon detecting a first type of event, a first anti-accidental touch interface is displayed on the first interface; wherein, the first type of event includes the ambient light brightness of the electronic device being less than or equal to a first preset brightness value, the device being in an inverted posture, and the device being in motion.
[0049] The first anti-mistouch interface includes a first prompt message, which indicates that the electronic device is in a first anti-mistouch mode. In the first anti-mistouch mode, the electronic device only responds to a predefined first type of input operation, which triggers the electronic device to exit the first anti-mistouch mode.
[0050] In one possible implementation of the first aspect, the method further includes:
[0051] In response to a screen unlock event, listen for whether the first type of event is detected.
[0052] In one possible implementation of the second aspect, the electronic device is used for:
[0053] The layer corresponding to the first anti-accidental touch interface is displayed on top of the layer corresponding to the first interface, and the transparency of the first anti-accidental touch interface is within a preset range.
[0054] In one possible implementation of the second aspect, the electronic device is used for:
[0055] Upon detecting the first type of event, the first anti-mistouch interface is generated and set to invisible;
[0056] If a second type of event is detected, the first anti-accidental touch interface is made visible; wherein, the second type of event includes large object occlusion event or touch screen event.
[0057] In one possible implementation of the second aspect, the electronic device is used for:
[0058] If the first type of event is detected, listen for whether the second type of event is detected.
[0059] In one possible implementation of the second aspect, the first anti-accidental touch interface further includes a second prompt message, which is used to indicate the operation mode of the first type of input operation.
[0060] In one possible implementation of the second aspect, the electronic device is used for:
[0061] When the first anti-mistouch interface is displayed, in response to the screen lock event, the display of the first anti-mistouch interface is cancelled.
[0062] In one possible implementation of the second aspect, the electronic device is used for:
[0063] In response to a screen lock event, exit the first anti-mistouch mode.
[0064] In one possible implementation of the second aspect, the electronic device includes a framework layer and a hardware abstraction layer. The framework layer includes an input management module, a screen lock management module, and an interface service module. The hardware abstraction layer includes a multi-sensor data processing module and an anti-mistouch module.
[0065] The input management module registers a first listening event with the lock screen management module, so that the lock screen management module listens for whether the screen unlock event occurs and notifies the input management module of the detected screen unlock event.
[0066] When the input management module receives the screen unlock event, it registers a second listening event with the multi-sensor data processing module so that the multi-sensor data processing module can listen for whether the first type of event is detected and notify the input management module of the first type of event it has detected.
[0067] When the input management module receives the first type of event, it notifies the anti-mistouch module.
[0068] The accidental touch prevention module notifies the interface service module to display the first accidental touch prevention interface.
[0069] In one possible implementation of the second aspect, the electronic device is used for:
[0070] When the screen lock management module detects a screen lock event, it notifies the input management module of the detected screen lock event.
[0071] When the input management module receives the screen lock event, it notifies the anti-mistouch module.
[0072] The accidental touch prevention module notifies the interface service module to cancel the display of the first accidental touch prevention interface.
[0073] In one possible implementation of the second aspect, the electronic device is a foldable screen device, and the device usage states of the foldable screen device include an unfolded state and a folded state;
[0074] The electronic device is used for:
[0075] If the device is in a folded state, in response to a screen unlock event, it listens for whether the first type of event is detected;
[0076] If the device is in an expanded state, the operation of listening to whether the first type of event has been detected is not performed.
[0077] The electronic device is used for:
[0078] In response to a screen lock event, listen for whether a third type of event is detected; wherein, the third type of event includes the ambient light brightness of the electronic device being less than or equal to a second preset brightness value, the device being in an inverted position, and the screen being obstructed by a large object.
[0079] If the third type of event is detected, the device enters the second anti-mistouch mode; wherein, in the second anti-mistouch mode, the electronic device only responds to a predefined second type of input operation, which is used to instruct the electronic device to exit the second anti-mistouch mode.
[0080] Thirdly, an electronic device is provided, which has the function of implementing the device control method described in the first aspect. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the aforementioned function.
[0081] Fourthly, a first device is provided, comprising: a processor; the processor being coupled to a memory and, after reading instructions from the memory, executing, according to the instructions, a device control method as described in any one of the first aspects above.
[0082] Fifthly, a computer-readable storage medium is provided that stores instructions which, when executed on a computer, enable the computer to perform the device control method described in any one of the first aspects.
[0083] In a sixth aspect, a computer program product containing instructions is provided, which, when run on a computer, enables the computer to perform the device control method described in any one of the first aspects.
[0084] In a seventh aspect, a control device (e.g., a chip system) is provided, the device including a processor for supporting the control device in implementing the functions involved in the first aspect above.
[0085] In one possible design, the device also includes a memory for storing program instructions and data necessary for controlling the device. When the device is a chip system, it can be composed of chips or may include chips and other discrete components.
[0086] The technical effects of any of the design methods in aspects two through seven can be found in the technical effects of different design methods in aspect one, and will not be repeated here. Attached Figure Description
[0087] Figure 1 One of the schematic diagrams of the interface of the device control method provided in the embodiments of this application;
[0088] Figure 2 A second schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0089] Figure 3 A third schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0090] Figure 4 One of the scenario diagrams for the device control method provided in the embodiments of this application;
[0091] Figure 5 Fourth schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0092] Figure 6 Fifth schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0093] Figure 7 One of the schematic flowcharts of the device control method provided in the embodiments of this application;
[0094] Figure 8 A second scenario illustration of the device control method provided in the embodiments of this application;
[0095] Figure 9 A third scenario illustration of the device control method provided in the embodiments of this application;
[0096] Figure 10 A sixth schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0097] Figure 11 Seventh schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0098] Figure 12 Eighth schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0099] Figure 13 A ninth schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0100] Figure 14 The tenth schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0101] Figure 15 Eleventh schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0102] Figure 16 Fourth scenario illustration of the device control method provided in the embodiments of this application;
[0103] Figure 17 A schematic diagram of the software framework of the electronic device provided in the embodiments of this application;
[0104] Figure 18 A second schematic flowchart illustrating the device control method provided in this application embodiment;
[0105] Figure 19 The third schematic flowchart of the device control method provided in the embodiments of this application;
[0106] Figure 20 Fourth flowchart illustrating the device control method provided in this application embodiment;
[0107] Figure 21 The twelfth schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0108] Figure 22 Thirteenth schematic diagram of the interface of the device control method provided in the embodiments of this application;
[0109] Figure 23 This is a hardware structure diagram of the electronic device provided in the embodiments of this application. Detailed Implementation
[0110] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of this application, including various details to aid understanding. These should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this application. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.
[0111] To facilitate understanding, some technical common sense involved in the embodiments of this application will be introduced first.
[0112] like Figure 1 The image shows one of the interface diagrams of an electronic device. The electronic device 100 has a touchscreen (TP) 110 mounted on its surface. The touchscreen 110 can receive touch operations applied to its surface and collect the operation parameters of the touch operations, including the operation point, operation pressure, and operation time. The electronic device 100 responds accordingly based on the collected operation parameters of the touch operations. For example... Figure 1 As shown, the electronic device 100 receives a user's touch operation and opens a drawing application. The electronic device 100 displays the interface of the drawing application, and the user applies a drawing operation with a corresponding drawing trajectory on the touch screen 110. In response to the user's drawing operation, the electronic device 100 displays an image with the corresponding drawing trajectory.
[0113] Electronic device touchscreens have two operating modes: lock screen mode and unlock mode. Unlock mode can also be called unlocked screen mode. The above... Figure 1 The interface shown is the normal user interface after the electronic device enters unlock mode. For example... Figure 2 The image shows the interface of the touchscreen 110 of electronic device 100 when it is switched to unlock mode. Electronic device 100 can display a marker indicating that it has entered unlock mode on the interface (e.g., ...). Figure 2 (as shown in A) and / or text prompts (such as...) Figure 2 (As shown in B). After an electronic device enters unlock mode, its touchscreen can respond to various types of touch operations, such as tapping, swiping, and clicking.
[0114] like Figure 3 The image shows the interface of the touchscreen 110 of electronic device 100 when switching from unlock mode to lock screen mode. Electronic device 100 can display lock screen mode indicator information on the interface (such as...). Figure 3 (as shown in A) and / or text prompts (such as...) Figure 3 (As shown in B). In lock screen mode, the touchscreen 110 of electronic device 100 can only respond to a few predefined touch operations, such as slide-to-unlock operations (e.g., ...). Figure 3 (As shown in C) to indicate exiting lock screen mode. Additionally, in lock screen mode, electronic devices can still respond to touch operations applied to a limited number of applications, such as those applied to the camera application (e.g., ...). Figure 3 Touch operation, etc. (as shown in D).
[0115] Touch operations on electronic device touchscreens can include not only touch operations from the user's fingertips or other skin on the touchscreen surface, but also touch operations from fabric or other objects touching the touchscreen. Therefore, even if the user's finger is not touching the touchscreen, contact with clothing, pocket fabric, or cosmetics within the pocket can potentially cause accidental touches. In unlocked mode, the touchscreen responds to various touch operations, thus increasing the likelihood of accidental touches and incorrect responses from the electronic device.
[0116] like Figure 4 The image shows a scenario illustrating the accidental touch of an electronic device while it is in a pocket. Figure 4 As shown in (a), when a user places an unlocked electronic device directly into their pocket, the device's interface can be displayed as shown in [image 1]. Figure 4 As shown in (b) above. The pockets mentioned here can include clothing pockets, handbags, waist bags, or backpacks, etc.
[0117] like Figure 4 As shown in (c), when a user is moving and the electronic device is in unlocked mode, the device itself or items inside the pocket may accidentally touch the touchscreen, causing the electronic device to respond incorrectly. Figure 4 As shown in (d), the electronic device may make a call based on accidental touches from the storage bag itself or items inside the storage bag. Figure 4 The interface (b) in the middle Figure 4 As can be seen from the interface (d), electronic devices are easily accidentally touched and respond incorrectly in unlock mode, leading to abnormal device control, affecting user experience, and even causing trouble for users.
[0118] Based on this, this application provides a device control method for monitoring and responding to accidental touch scenarios of electronic devices in unlock mode (or non-locked screen mode), so as to minimize accidental touches of the electronic device in unlock mode and improve user experience. In this embodiment, considering that accidental touches are more likely to occur when the electronic device is in a pocket after entering unlock mode, the pocket scenario is taken as the scenario to be monitored for accidental touch prevention. When the electronic device is detected to be in a pocket scenario, the method enters the accidental touch prevention mode and restricts touch response.
[0119] The device control method provided in this embodiment is applied to electronic devices, which may include personal computers (PCs), tablets, laptops, portable computers (such as mobile phones), wearable electronic devices (such as smartwatches), augmented reality (AR) / virtual reality (VR) devices, in-vehicle computers, and other electronic devices with touch screens. The following embodiments do not impose any special limitations on the specific form of the electronic device. In this embodiment, the electronic device can be a mobile phone, especially a relatively small touchscreen mobile phone that can fit in a pocket.
[0120] The device control method provided in this application embodiment is used to control electronic devices to implement an anti-accidental touch function. This anti-accidental touch function can be a system application pre-configured before the electronic device leaves the factory and automatically activated after the electronic device is powered on. Alternatively, this anti-accidental touch function can also be a setting application that the user can selectively activate according to their individual needs.
[0121] like Figure 5 The image shown is a schematic diagram of an electronic device's interface, illustrating how to enable the accidental touch prevention function within the settings app. Figure 5 As shown in (a), the electronic device displays an icon for the settings application on the desktop (such as...). Figure 5 As shown in A), when the icon of this settings application receives a click action from the user, it enters... Figure 5 The settings interface is shown in (b). An input box for searching settings items is displayed on the settings interface so that users can enter information in the input box for searching settings items (such as...). Figure 5 Search for "anti-accidental touch function" or "anti-accidental touch mode" within (as shown in B). After the electronic device receives the text content entered by the user in the search settings input box, it searches and displays the results within all settings options using the text content as keywords.
[0122] like Figure 5 As shown in (b), electronic devices can also access accessibility options (such as...). Figure 5 (As shown in C), enter Figure 6 The accessibility settings interface is shown in (a) above. It should be noted that in addition to the accessibility options, there may be other settings options within the settings application, and the accessibility options may include quick launch and gesture options or other settings options in addition to the anti-mistouch mode, without limitation.
[0123] Electronic devices can also display an anti-mistouch mode option (such as...) in the accessibility settings interface. Figure 6 As shown in A), this accidental touch prevention mode option receives the user's selection and displays... Figure 6The interface shown in (b) is shown in the image. Under the anti-mistouch mode option, the electronic device provides an unlock mode anti-mistouch function option (such as...). Figure 6 (as shown in B), and the lock screen mode anti-mistouch function option (such as...) Figure 6 (As shown in C). If an electronic device receives a tap operation that applies to the anti-mistouch function option in unlock mode, the anti-mistouch protection scheme in unlock mode will be activated. If an electronic device receives a tap operation that applies to the anti-mistouch function option in lock screen mode, the anti-mistouch protection scheme in lock screen mode will be activated.
[0124] Users can choose to enable the anti-mistouch function in either unlock mode or lock screen mode only, depending on their habits or needs. Alternatively, users can enable both functions simultaneously for comprehensive protection against accidental touches. In this embodiment, the electronic device will only execute the provided device control method to perform anti-mistouch protection in unlock mode after receiving a tap operation that activates the anti-mistouch function option in unlock mode.
[0125] In other implementations, the electronic device may also add a shortcut control to the control center of the top drop-down menu of the system to enable the accidental touch prevention function in unlock mode. When this shortcut control receives a user's selection, it activates the accidental touch prevention protection scheme. Alternatively, the electronic device may invoke a voice assistant to collect the user's voice commands and quickly activate the accidental touch prevention function based on those commands. The electronic device may also provide a different scheme for enabling the accidental touch prevention function in unlock mode; this is not limited.
[0126] See Figure 7 This is one of the flowcharts illustrating a device control method provided in this application. The provided device control method mainly includes the following steps:
[0127] Step S701: Display the first interface;
[0128] Step S702: A first type of event is detected, and a first anti-accidental touch interface is displayed on the first interface.
[0129] Electronic devices have two operating modes for their touchscreens: locked mode and unlocked mode. These devices contain modules for monitoring the screen's lock state, such as a lockscreen management module or a Keyguard Service module. The lockscreen management module can monitor the screen's lock state and report the corresponding event to the device's controller when it detects a switch in the lock state. For example, if the lockscreen management module detects the touchscreen switching from lock mode to unlock mode, it reports a screen unlock event to the controller. Alternatively, if the lockscreen management module detects the touchscreen switching from unlock mode to lock mode, it reports a screen lock event. It should be noted that the monitoring actions mentioned in this application embodiment are all based on the reuse of operational data collected by the device's inherent control module. The monitored data is used for device control of the touchscreen and does not involve obtaining or disclosing user personal information.
[0130] When an electronic device receives a screen unlock event reported by the lock screen management module and determines that the touchscreen has entered unlock mode, it needs to start monitoring for accidental touch scenarios. If an accidental touch scenario is detected, it needs to control the touchscreen to enter the accidental touch prevention mode. For ease of distinction, the accidental touch prevention mode in unlock mode is defined as the first accidental touch prevention mode.
[0131] The applicant collected a large amount of user experience feedback data and analyzed potential accidental touch scenarios. Table 1 below shows some of the user experience feedback data. A common accidental touch scenario in the user experience feedback data is the "pocket scenario." That is, when an electronic device is placed in a pocket in unlocked mode, the pocket itself or items inside the pocket may come into contact with the touchscreen, triggering an accidental touch. Pockets here may include clothing pockets, backpacks, handbags, waist bags, etc.
[0132] Table 1
[0133]
[0134] When using a mobile phone, the user should hold the phone upright with the head facing upwards, such as... Figure 8 As shown in (a) above. Here, "head" refers to the standard top of the phone, usually the end where the camera is located. Users typically hold the phone downwards into their pockets, and the phone's orientation changes from upright to inverted. (See below for further details.) Figure 8 As shown in (b) above. In other words, a key characteristic of a mobile phone in a pocket is that the phone is in an inverted position.
[0135] Since pockets are typically sealed containers with a certain thickness and are opaque, the ambient light level is usually low when a phone is in a pocket. In other words, another key characteristic of a phone in a pocket is the low ambient light level.
[0136] Additionally, if the phone is stationary in the user's pocket, the touchscreen will not move relative to the pocket wall or items inside the pocket, making it less likely for the touchscreen to be accidentally touched. Figure 9 As shown, the user is running (e.g.) Figure 9 As shown in (a)), playing ball (as shown in the image). Figure 9 (as shown in (b)) or walking (as shown in (b)) Figure 9 As shown in (c) above, when a phone is in motion, the phone itself is also in motion inside the pocket. This motion can easily cause the touchscreen to come into contact with and rub against the inside of the pocket or other items, leading to accidental touches. In other words, another key characteristic of a phone in a pocket is that the phone is in motion.
[0137] Based on the above analysis, the scenario of a phone being in a pocket typically meets three conditions: low ambient light brightness, the phone being inverted, and the phone being in motion. Therefore, to detect whether an electronic device is in a pocket, it can register a first listening event after entering unlock mode. This event uses parameters such as ambient light brightness, phone orientation, and motion to detect whether the device is in a pocket. For ease of description, the event of an electronic device being in a pocket is defined as a first type of event. A first type of event includes ambient light brightness less than or equal to a first preset brightness value, the phone being inverted, and the phone being in motion.
[0138] It should be noted that the first preset brightness value is a pre-set pocket ambient brightness threshold. This threshold value can be a fixed value pre-configured by the electronic device's system before shipment, or a fixed or variable value set by the user according to their usage habits. Figure 10 The image shown is a schematic diagram of the electronic device's interface. Users can customize the ambient light threshold for the anti-mistouch mode within the device's settings application. The electronic device can provide ambient light threshold setting options for darker and generally darker environments, such as an option to enable anti-mistouch mode (≤10 lux) in darker environments (e.g.,...). Figure 10 The settings options (as shown in A) and the settings for enabling accidental touch prevention (≤30 lux) in general dark environments (as shown in A) are as follows: Figure 10 As shown in B), users can directly select the option. If the user's pocket color is usually dark, they can choose to enable the accidental touch prevention feature in a darker environment. If the user's pocket color is usually light, they can choose to enable the accidental touch prevention feature in a normal dark environment.
[0139] Of course, electronic devices can also provide a customizable dark environment threshold brightness value (lux) setting axis (such as... Figure 10 As shown in C), the user can select any critical brightness value within the range of 0 lux to 50 lux as the first preset brightness value.
[0140] The electronic device contains various sensors to collect data, which is used to determine whether a first-type event has been detected. For example, the device includes an ambient light sensor to collect ambient light brightness values and determine if these values are less than or equal to a preset brightness value. Additionally, it includes a gyroscope sensor to collect body posture data and determine if the device is inverted. Furthermore, it contains an accelerometer to collect body acceleration data and determine if the device is in motion.
[0141] It should be noted that these sensors within electronic devices are inherent sensors, and the corresponding sensing parameters are data that the system already collects. The device control method provided in this application does not require adding new sensors; it only needs to reuse the sensor data collected by the system.
[0142] The method for determining the motion state of an electronic device can be achieved through acceleration data from a triaxial accelerometer (Accelerometer, Acc-Sensor) configured within the device. The triaxial accelerometer measures the electronic device's acceleration along three spatial directions (X, Y, and Z axes). Taking the Z-axis data as an example of motion state detection, the Z-axis represents the axis perpendicular to the ground, i.e., the axis opposite to the direction of gravity. For example, the Z-axis data value can determine whether the electronic device is in portrait or landscape mode. Furthermore, the comparison between the Z-axis data value change within a preset collection period (e.g., the average Z-axis data value within 0.5 seconds before the determined moment, which could be the moment the electronic device triggers the screen-on / lock state or 2 seconds after) and a preset acceleration threshold (e.g., if the Z-axis data value change falls within the preset acceleration threshold range) determines whether the electronic device is moving vertically in portrait or landscape mode, indicating whether the user is walking, running, cycling, etc.
[0143] Electronic devices can be equipped with ambient light sensors, proximity sensors, three-axis accelerometers, and three-axis gyroscopes (Gyro), etc. Input data can include: the three-axis acceleration (X, Y, and Z axes) of the electronic device acquired by the three-axis accelerometer, and the three-axis angular velocity of the electronic device acquired by the three-axis gyroscope.
[0144] Electronic devices can combine triaxial acceleration and triaxial angular velocity data acquired by a triaxial accelerometer and a triaxial gyroscope, using filtering algorithms (such as Kalman filtering) to integrate the input data. By fusing data from these two sensors, their respective shortcomings can be compensated for, improving the accuracy and stability of the measurement.
[0145] For example, "head down" here can refer to an electronic device being vertically upside down. To determine if an electronic device is upside down, it can compare the fused triaxial acceleration and triaxial angular velocity with a head-down threshold. For instance, the head-down threshold could be 0 for both the X-axis and Y-axis data, and -9.8 m / s² for the Z-axis data, indicating that the electronic device is experiencing upward gravitational acceleration from the Earth.
[0146] Of course, the specific implementation schemes for electronic devices to determine whether the body posture is inverted by using the body posture data collected by the gyroscope sensor, and to determine whether the body is in motion by using the acceleration data collected by the accelerometer sensor, can also refer to other conventional implementation schemes, which will not be elaborated here.
[0147] When the electronic device is in unlocked mode, it displays the main interface or any application interface, while simultaneously listening for the detection of a first-type event. The interface displayed by the electronic device when a first-type event is detected is defined as the first interface (e.g., ...). Figure 7 (As shown in (a)). It should be noted that the first interface referred to here may display a static or dynamic screen, without limitation.
[0148] The electronic device uses sensor data collected from various sensors to determine whether it has detected a first type of event, namely, whether it has entered a pocket scenario. If a first type of event is detected, the electronic device is considered to be in a pocket scenario, and accidental touch protection needs to be activated. Accidental touch protection can be activated by entering a first accidental touch protection mode within the unlock mode. In the first accidental touch protection mode, the electronic device can only respond to predefined operations such as exiting the accidental touch protection mode or unlocking, and will not respond to other input operations.
[0149] In other words, when an electronic device is in unlock mode, it can respond to various touch operations if it has not entered the first anti-mistouch mode. If the electronic device enters the first anti-mistouch mode while in unlock mode, it cannot respond to various touch operations as it does in normal unlock mode; instead, it only responds to a few predefined input operations. For ease of description, the operations that can be responded to in the first anti-mistouch mode are defined as the first type of input operation, which is used to instruct the electronic device to exit the first anti-mistouch mode.
[0150] Electronic devices can directly enter the first anti-mistouch mode to avoid accidental touches. In addition, the electronic device can also display an anti-mistouch interface (such as...). Figure 7 As shown in (b) of the diagram), the first prompt message (such as...) is displayed in the anti-accidental touch interface. Figure 7 As shown in A), this prompts the user that the electronic device is in the first anti-mistouch mode. For ease of distinction, the anti-mistouch interface in unlock mode is defined as the first anti-mistouch interface.
[0151] In one specific embodiment, the first anti-mistouch interface may further include a second prompt message, which indicates the operation mode of the first type of input operation. The second prompt message may be text-based (e.g., ...). Figure 7 As shown in B), it can also provide operation path prompts (such as...). Figure 7 (As shown in C), without limitation.
[0152] like Figure 11 As shown in (a) above, the electronic device displays the first interface. Then, as... Figure 11 As shown in (b), the electronic device directly displays the first anti-mistouch interface on the first interface. In this way, the electronic device retains the first interface currently being displayed in unlock mode, ensuring that the first anti-mistouch mode does not affect the original operation of the electronic device displaying the first interface. Simultaneously, the display of the first anti-mistouch interface prompts the user that the electronic device is in the first anti-mistouch mode and that anti-mistouch protection is enabled.
[0153] Specifically, such as Figure 11 (b) Figure 12 , Figure 13 and Figure 14 As shown, one possible scheme for an electronic device to display a first anti-mistouch interface on a first interface is to display the corresponding layer of the first anti-mistouch interface on top of the corresponding layer of the first interface, and to control the transparency of the first anti-mistouch interface within a preset range. In these cases, the display area of the first anti-mistouch interface can completely cover the display area of the first interface.
[0154] In this way, both the primary interface and the primary anti-mistouch interface are visible to the user, allowing the user to easily view the currently displayed primary interface, while the primary anti-mistouch interface serves as a prompt. The transparency of the primary anti-mistouch interface is controlled within a preset range, ensuring that the primary anti-mistouch interface is visible to the user without completely obscuring the primary interface. Typically, the transparency of the primary interface is zero, while the transparency of the primary anti-mistouch interface is greater than zero but less than the maximum transparency.
[0155] like Figure 15 As shown, the electronic device displays a first interface (such as...) Figure 15 As shown in (a) in the image, switch to display the second interface (as shown in the image). Figure 15As shown in (b) above, the display area of the first anti-mistouch interface may not completely cover the display area of the first interface. For example, the first anti-mistouch interface can be displayed on top of the first interface as a small pop-up, without limitation.
[0156] Furthermore, upon detecting the first type of event, the electronic device determines that it is in a pocket scenario. At this point, the electronic device can first generate a first anti-mistouch interface, but does not directly display it to the user. For example, the electronic device can first set the first anti-mistouch interface to be invisible or to maximum transparency. Simultaneously, the electronic device enters a first anti-mistouch mode, in which the electronic device does not respond to touch operations other than the first type of input.
[0157] In one specific implementation, if the first interface displayed by the electronic device is a dynamic image, such as the electronic device playing a video within a video playback application, then when the electronic device detects a first type of event, it can directly pause the screen switching of the first interface and display the first anti-mistouch interface on the layer of the currently paused static image. Alternatively, the electronic device can also display the first anti-mistouch interface directly on the layer of the dynamic image of the first interface without pausing the screen switching.
[0158] In practice, there can be multiple types of first-type input operations for exiting the first-level anti-mistouch mode. These operations can be pre-configured by the system or user-defined. For example... Figure 11 and Figure 15 The image shows a schematic diagram of the first anti-mistouch interface of an electronic device. The first type of input operation is a double swipe down. Figure 12 The diagram shows a schematic of the first anti-mistouch interface of an electronic device. The first type of input operation is a double tap with a knuckle. Figure 13 The image shown is another schematic diagram of the first anti-accidental touch interface of an electronic device. The first type of input operation is sliding along a preset trajectory, which can be "√", "W", or other types of patterns, without limitation. Figure 14 The image shown is another schematic diagram of the first anti-mistouch interface of an electronic device, where the first type of input operation is fingerprint verification. Of course, besides... Figures 11 to 15 In addition to the cases shown, electronic devices can also be configured with other types of Class I input operations, such as voice input, to match the needs of different users and enhance the interactive experience.
[0159] Based on the above embodiments, after entering the first anti-mistouch mode, the electronic device can also listen for the detection of a second type of event; the second type of event includes events such as large object obstruction or touch screen events. Upon detecting the second type of event, the first anti-mistouch interface is then displayed.
[0160] In this implementation, when the electronic device is detected entering a pocket scenario, it enters the first anti-mistouch mode, but it does not need to display the first anti-mistouch interface immediately; the original interface can still be displayed normally. The first anti-mistouch interface is only displayed when a second type of event that may cause a mis-touch is received, to inform the user that the electronic device is currently in the first anti-mistouch mode.
[0161] The "large object obstruction event" mentioned in this embodiment refers to an event in which the touch screen of an electronic device in a pocket scenario is covered or touched by the pocket itself or an item in the pocket.
[0162] In some embodiments, detecting occlusion events can be achieved by detecting and analyzing touch events on the touchscreen of an electronic device, including: dividing the screen of the electronic device into multiple adjacent sub-regions; when a touch event is detected on the screen, detecting whether there is a touch point on each sub-region; if so, calculating the values corresponding to the major and minor axes of the touch area (e.g., an elliptical area) forming the touch point, and calculating the area of the touch area based on the obtained major and minor axis values; further calculating the ratio of the area of the touch area to the area of the sub-region; if the ratio meets a ratio threshold, determining the sub-region as a valid touch sub-region. After detecting each sub-region of the screen, calculating the target number of valid touch sub-regions; if the target number meets a touch number threshold, determining that a large object occlusion event exists on the touchscreen of the electronic device. For example, if the screen of the electronic device is divided into 100 sub-regions, and 30 valid touch sub-regions are detected, then a large object occlusion event is determined to exist.
[0163] When an electronic device enters the first accidental touch prevention mode, it can choose not to generate the first accidental touch prevention interface, but instead display the original interface while simultaneously listening for the presence of a second type of event. Upon detecting a second type of event, the electronic device will then generate and display the first accidental touch prevention interface, which can be placed on top of the original interface.
[0164] Of course, in another implementation, the electronic device can also set the first accidental touch prevention interface to be invisible when entering the first accidental touch prevention mode. Upon detecting a second type of event, the first accidental touch prevention interface is then made visible. When the electronic device displays the first accidental touch prevention interface, it can be displayed directly on top of the original interface. Furthermore, the electronic device can also set the layer of the first accidental touch prevention interface to be higher than the layer of the original interface, and make the transparency of the first accidental touch prevention interface slightly lower than the transparency of the original interface, so that the first accidental touch prevention interface does not completely obscure the display of the original interface, allowing the user to see the content of the original interface.
[0165] In some other implementations, such as when the electronic device is a foldable phone, different processing solutions need to be selected for different device usage states. For example... Figure 16 As shown in (a), foldable phones are in an unfolded state, which is relatively large. Users typically don't put electronic devices in their pockets in this unfolded state, thus avoiding accidental touches while in a pocket. Figure 16 As shown in (b), foldable screen phones are in a folded state and are relatively small. Users often put electronic devices in their pockets in the folded state, which makes them prone to accidental touches. Therefore, the device control method provided in this embodiment can implement different control schemes depending on the device's usage state when the electronic device is a foldable screen phone.
[0166] In one scenario, if the electronic device is in a folded state, when the electronic device enters the unlock mode, it begins to listen for the detection of a first type of event, and when the first type of event is detected, it activates the first anti-mistouch mode and displays the first anti-mistouch interface.
[0167] In another scenario, if the electronic device is in the unfolded state, even if the electronic device detects that it has entered the unlock mode, it does not need to listen for the first type of event and does not need to enter the first anti-accidental touch mode.
[0168] This eliminates the need for accidental touch monitoring when the electronic device is in the unfolded state, further reducing device power consumption.
[0169] Based on the above embodiments, this embodiment further adds a control scheme for switching the electronic device from unlock mode to lock screen mode. Specifically, after the electronic device enters the first anti-mistouch mode, if a screen lock event is detected, it can directly exit the first anti-mistouch mode and cancel the display of the first anti-mistouch interface. In other words, the device control method initiated after the electronic device detects a screen unlock event can end the current process once a screen lock event is detected, whether before or after entering the first anti-mistouch mode.
[0170] like Figure 17 The diagram shows a schematic of the software framework of an electronic device. The software system of an electronic device can adopt a layered architecture, which divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the software is divided into three layers, from top to bottom: the Application Layer, the Framework Layer, and the Hardware Abstraction Layer (HAL).
[0171] The application layer can include a series of application packages, such as a settings application, a camera application, a drawing application, etc. In this embodiment, the application that enables the accidental touch prevention function can be the settings application or a standalone accidental touch prevention application, etc., without limitation. This embodiment uses the settings application as an example.
[0172] The framework layer provides the Application Programming Interface (API) and programming framework for applications in the application layer. The application framework layer includes predefined functions. It can include a window manager, content providers, a view system, a phone manager, a resource manager, a notification manager, etc. The window manager manages window programs. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture the screen. The content provider stores and retrieves data, making this data accessible to applications. Data can include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build applications. The display interface can consist of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images. The resource manager provides various resources to the application, such as localized strings, icons, images, layout files, video files, etc. The notification manager allows applications to display notification information in the status bar, which can be used to convey informative messages and can disappear automatically after a short pause without user interaction.
[0173] In practical use, the window manager, content provider, view system, notification manager, etc. work together to implement a variety of services. For example, the interface service module required in the embodiments of this application can display the first anti-accidental touch interface and related prompts on the interface, without limitation.
[0174] In addition, the framework layer includes an Input Manager Service (IMS) module and a lock screen management module. The Input Manager Service can be a system-level service configured by the operating system, used to handle user input events such as touch, key presses, and gestures. The Input Manager Service can obtain user input events by calling other modules, such as obtaining touch events applied to the touchscreen through the screen touch module.
[0175] The framework layer may also include a lock screen management module, which can be implemented by a dedicated module for managing the lock screen state, used to monitor whether the touchscreen is locked or unlocked. The lock screen management module can be implemented by other functional modules, such as a keyboard service module with unlock screen management capabilities; there are no restrictions.
[0176] A hardware abstraction layer (HAL) can encapsulate lower-level hardware and provide interfaces for calling higher-level framework layers, shielding them from the implementation details of the lower-level hardware. For example... Figure 17As shown, the hardware layer may include sensors, etc. The hardware abstraction layer includes a multi-sensor data processing module, which is connected to the sensors and used to acquire various types of sensor data.
[0177] The hardware abstraction layer also includes an anti-mistouch module, which is used to control electronic devices to enter the anti-mistouch module and can also instruct the interface service module to display the first anti-mistouch interface.
[0178] like Figure 18 The diagram shown is a thread diagram of the device control method provided in this embodiment. Figure 17 and Figure 18 As shown, the specific process of implementing the device control method using software modules within the electronic device includes:
[0179] The input management module registers a first listening event with the lock screen management module, enabling the lock screen management module to monitor for screen unlock events. If the user unlocks the electronic device screen, the lock screen management module will detect the screen unlock event and notify the input management module.
[0180] When the input management module receives a screen unlock event, it registers a second monitoring event with the multi-sensor data processing module. This allows the multi-sensor data processing module to monitor whether a first type of event has been detected, namely, whether the ambient light intensity is less than or equal to a first preset brightness value, whether the device is in a neutral position, and whether the device is in motion. The integrated sensor information module then notifies the input management module of the detected first type of event.
[0181] When the input management module receives the first type of event, it notifies the anti-mistouch module to enter the first anti-mistouch mode.
[0182] When the input management module receives a touch screen event or an event where a large object obstructs the screen, it notifies the anti-mistouch module, which in turn notifies the interface service module to display the first anti-mistouch interface.
[0183] When the screen lock management module detects a screen lock event, it sends a notification of the detected screen lock event to the management module.
[0184] When the input management module receives a screen lock event, it notifies the anti-mistouch module to exit the first anti-mistouch mode.
[0185] The notification interface service module for the accidental touch prevention module has disabled the display of the first accidental touch prevention interface.
[0186] like Figure 19The diagram shown is another flowchart illustrating the device control method provided in this application embodiment. When the electronic device detects that it is in a screen-on unlocked scenario, it subscribes to the Multi-Sensor Data Platform (MSDP) Unlock Headdown capability from its internal functional modules to monitor whether it is in the Unlock Headdown state. The Unlock Headdown state refers to the state where the screen is not locked and the device is upside down. If the device is detected to be in the Unlock Headdown state, it further monitors for any obstruction events or touch events. If an obstruction event or touch event is detected, a first anti-mistouch interface is displayed. If the electronic device is not in the Unlock Headdown state, the first anti-mistouch interface is not displayed.
[0187] like Figure 20 As shown, this application embodiment also adds a device control scheme in a lock screen scenario. Specifically, as... Figure 20 As shown, the equipment control method also includes:
[0188] Step S2001: In response to the screen lock event, listen for whether a third type of event is detected. The third type of event includes: the ambient light brightness of the electronic device is less than or equal to a second preset brightness value, the device is in an inverted position, and the screen is obstructed by a large object.
[0189] Step S2002: If a third type of event is detected, enter the second anti-mistouch mode. In the second anti-mistouch mode, the electronic device only responds to predefined second type of input operations, which are used to instruct the electronic device to exit the second anti-mistouch mode.
[0190] This embodiment adds a device control scheme for screen lock scenarios. After detecting a screen lock event, it further monitors for the presence of a second type of event. Upon detecting a second type of event, it enters a second anti-mistouch mode. In this second anti-mistouch mode, the electronic device does not respond to most touch operations applied to the touchscreen, effectively preventing accidental touches.
[0191] After entering the second anti-mistouch mode, the electronic device can also display the anti-mistouch interface, defining the anti-mistouch interface in lock screen mode as the second anti-mistouch interface. For example... Figure 21 As shown, electronic devices can directly display this second anti-mistouch interface on the lock screen, instead of displaying the interface before locking the screen. Or as... Figure 22 As shown, electronic devices can display only the second anti-mistouch interface, without the lock screen interface or without displaying the interface before the lock screen.
[0192] In addition, electronic devices can also control the screen to turn off, in order to reduce accidental touches and power consumption when the screen is on.
[0193] Furthermore, embodiments of this application also provide an electronic device, including a touch screen, a memory, and a processor, wherein the touch screen and the memory are both coupled to the processor;
[0194] The memory stores the instructions that the computer executes;
[0195] The processor executes computer execution instructions stored in the memory, causing the electronic device to perform the device control method provided in the above embodiments. In addition to these main components, the electronic device also includes components for implementing basic functions, which will be discussed below. Figure 23 Please provide a detailed explanation.
[0196] like Figure 23 The diagram shown is a structural schematic of the electronic device 2300 provided in an embodiment of this application. The electronic device 2300 may include a processor 2310, a memory 2320, an input / output interface 2330, a charging management module 2340, a power management module 2341, a battery chip 2342, a touchscreen 2350, a communication module 2360, an audio module 2370, and a sensor module 2380, etc. The sensor module 2380 may include a pressure sensor 2381, a gyroscope sensor 2382, an accelerometer sensor 2383, a proximity sensor 2384, a proximity light sensor 2385, a fingerprint sensor 2386, a touch sensor 2387, and an ambient light sensor 2388, etc.
[0197] The structure illustrated in this embodiment of the invention does not constitute a limitation on the electronic device 2300. It may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of both.
[0198] Processor 2310 may include one or more processing units. For example, processor 2310 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0199] The aforementioned controller can be the decision-maker that directs the various components of the electronic device 2300 to work in a coordinated manner according to instructions. It is the nerve center and command center of the electronic device 2300. The controller generates operation control signals based on the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0200] The processor 2310 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 2310 is a cache memory, which can store instructions or data that the processor 2310 has just used or that are used repeatedly. If the processor 2310 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 2310, and thus improves the efficiency of the system.
[0201] In some embodiments, the processor 2310 may include an input / output interface 2330. The interface may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI) interface, a General-Purpose Input / Output (GPIO) interface, a SIM interface, and / or a USB interface, etc.
[0202] The interface connection relationships between the modules illustrated in this embodiment of the invention are merely illustrative and do not constitute a structural limitation on the electronic device 2300. The electronic device 2300 may employ different interface connection methods or a combination of multiple interface connection methods as described in this embodiment of the invention.
[0203] The charging management module 2340 can be a rechargeable management module or a disposable charging management module. As a rechargeable management module, it can receive charging input via a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 2340 can receive charging input from the wired charger via the USB interface 2330. In some wireless charging embodiments, the charging management module 2340 can receive wireless charging input via the wireless charging coil of the electronic device 2300. While charging the battery chip 2342, the charging management module 2340 can also supply power to the electronic device 2300 via the power management module 2341.
[0204] The power management module 2341 connects the battery chip 2342, the charging management module 2340, and the processor 2310. The power management module 2341 receives input from the battery chip 2342 and / or the charging management module 2340, providing power to the processor 2310, memory 2321, external memory interface 2320, touchscreen 2350, camera 2393, and communication module 2360, etc. The power management module 2341 can also monitor parameters such as the charging management module capacity, charging cycle count, and charging management module health status (leakage current, impedance). In some embodiments, the power management module 2341 can also be located within the processor 2310. In some embodiments, the power management module 2341 and the battery chip 2342 can also be located in the same device.
[0205] The wireless communication function of electronic device 2300 can be realized through antenna, radio frequency module, communication module 2360, modem and baseband processor, etc.
[0206] Antennas are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 2300 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, a cellular network antenna can be reused as a wireless local area network diversity antenna. In some embodiments, the antenna can be used in conjunction with a tuning switch.
[0207] The radio frequency module can provide communication processing modules for wireless communication solutions, including 2G / 3G / 4G / 5G, used in electronic devices 2300.
[0208] Communication module 2360 provides a communication processing module for wireless communication solutions applied to electronic device 2300, including Wireless Local Area Networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Fodulation (FM), Near Field Communication (NFC), and Infrared (IR) technologies. Communication module 2360 can be one or more devices integrating at least one communication processing module. Communication module 2360 receives electromagnetic waves via an antenna, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 2310. Communication module 2360 can also receive signals to be transmitted from processor 2310, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via the antenna.
[0209] In some embodiments, the antenna of the electronic device 2300 is coupled to the communication module 2360, enabling the electronic device 2300 to communicate with networks and other devices via wireless communication technologies. Wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. GNSS can include Global Positioning System (SBAS), Global Navigation Satellite System (GLONASS), BeiDou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation System (SBAS).
[0210] Electronic device 2300 implements display functions through a GPU, touch screen 2350, and application processor. The GPU is a microprocessor for image processing, connected to the touch screen 2350 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 2310 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0211] The touchscreen 2350 is used to display images, videos, etc. The touchscreen 2350 includes a display panel. The display panel can be a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), an Active-Matrix Organic Light-Emitting Diode (AMOLED), a Flexible Light-Emitting Diode (FLED), MiniLED, MicroLED, Micro-OLED, Quantum Dot Light-Emitting Diodes (QLED), etc.
[0212] The electronic device 2300 may also include a memory 2320, which may include internal memory or connect to an external memory card, such as a Micro SD card, via an external memory interface to expand the storage capacity of the electronic device 2300. The external memory card communicates with the processor 2310 through the external memory interface to perform data storage functions. For example, music, video, and other files can be stored on the external memory card.
[0213] Memory 2320 can be used to store computer executable program code, which includes instructions. Processor 2310 executes various functional applications and data processing of electronic device 2300 by running the instructions stored in memory 2320. Memory 2320 may include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc. The data storage area may store data created during the use of electronic device 2300 (such as audio data, phone book, etc.). In addition, memory 2321 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, other volatile solid-state storage devices, Universal Flash Storage (UFS), etc.
[0214] Electronic device 2300 can implement audio functions through audio module 2370, speaker, receiver, microphone, headphone jack, and application processor, such as music playback and recording.
[0215] The audio module 2370 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 2370 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 2370 may be located in the processor 2310, or some functional modules of the audio module 2370 may be located in the processor 2310.
[0216] In addition, the electronic device 2300 may also include a sensor module 2380. The sensor module 2380 may include a pressure sensor 2381, a gyroscope sensor 2382, an accelerometer sensor 2383, a proximity sensor 2384, a proximity light sensor 2385, a fingerprint sensor 2386, a touch sensor 2387, an ambient light sensor 2388, etc. The pressure sensor 2381 can collect pressure data on the surface of the touchscreen. The gyroscope sensor 2382 can collect the posture data of the electronic device. The accelerometer sensor 2383 can collect the acceleration data of the electronic device. The proximity sensor 2384 can collect the distance to other object surfaces. The proximity light sensor 2385 is typically located in the upper right corner of the touchscreen and is used to detect whether an object is approaching the touchscreen surface. The fingerprint sensor 2386 is located in a fixed area under the touchscreen and is used to collect fingerprint data entered by the user. Touch sensor 2387 is typically located over the entire effective touch area of a touchscreen to collect touch data within that area. Ambient light sensor 2388 is typically located on the top surface of an electronic device to collect parameters such as the brightness of the ambient light in the environment in which the electronic device is located.
[0217] Of course, in addition to the main components mentioned above, electronic devices may also include other components that implement basic functions, which will not be elaborated here.
[0218] The device control methods described in the foregoing embodiments can all be implemented in the terminal device 2300 with the aforementioned hardware structure.
[0219] Based on the above embodiments, this application also provides a device control apparatus, which includes a processor for executing the device control method provided in the above embodiments.
[0220] This application also provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to execute the device control method provided in the above embodiments.
[0221] This application also provides a computer program product containing instructions that, when run on a computer, enable the computer to execute the device control method provided in the above embodiments.
[0222] The specific implementation methods of the terminal device, computer-readable storage medium, and computer program product containing instructions provided in this application, as well as their technical effects, can be found in the specific implementation process of the device control method provided in the foregoing embodiments and its technical effects, which will not be repeated here.
[0223] In some embodiments, as described above, those skilled in the art will clearly understand that, for the sake of convenience and brevity, the division of the functional modules described above is merely an example. In practical applications, the functions described above can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0224] In the embodiments of this application, the functional units can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0225] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as flash memory, portable hard disk, read-only memory, random access memory, magnetic disk, or optical disk.
[0226] The above are merely specific embodiments of this application, but the protection scope of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be covered within the protection scope of this application. Therefore, the protection scope of this application should be determined by the scope of the claims.
Claims
1. A device control method, characterized in that, The device control method, applied to electronic devices, includes: In response to a screen unlock event, listen for whether a first type of event is detected; wherein, the first type of event is used to trigger entry into a first anti-mistouch mode, and the first type of event includes the ambient light brightness of the electronic device being less than or equal to a first preset brightness value, the device being in an inverted posture, and the device being in motion. Display a first interface; wherein, the first interface is the application interface or main interface displayed after the electronic device is unlocked, and the display screen of the first interface is a static screen or a dynamic screen; Upon detecting the first type of event, a first anti-mistouch interface is displayed on the currently displayed first interface, and the first anti-mistouch interface is set to be invisible; wherein, the first anti-mistouch interface includes a first prompt message, the first prompt message being used to indicate that the electronic device is in the first anti-mistouch mode; in the first anti-mistouch mode, the electronic device only responds to a predefined first type of input operation, the first type of input operation being used to trigger the electronic device to exit the first anti-mistouch mode; If a second type of event is detected, the first anti-accidental touch interface is made visible; wherein, the second type of event includes large object occlusion event or touch screen event.
2. The equipment control method according to claim 1, characterized in that, The step of displaying the first anti-accidental touch interface on the currently displayed first interface includes: The layer corresponding to the first anti-accidental touch interface is displayed on top of the layer corresponding to the first interface, and the transparency of the first anti-accidental touch interface is within a preset range.
3. The equipment control method according to claim 1, characterized in that, The method further includes: If the first type of event is detected, listen for whether the second type of event is detected.
4. The equipment control method according to claim 1 or 3, characterized in that, The first anti-accidental touch interface also includes a second prompt message, which is used to indicate the operation mode of the first type of input operation.
5. The equipment control method according to claim 1 or 3, characterized in that, The method further includes: When the first anti-mistouch interface is displayed, in response to the screen lock event, the display of the first anti-mistouch interface is cancelled.
6. The equipment control method according to claim 1 or 3, characterized in that, The method further includes: In response to a screen lock event, exit the first anti-mistouch mode.
7. The equipment control method according to claim 1, characterized in that, The electronic device includes a framework layer and a hardware abstraction layer. The framework layer includes an input management module, a screen lock management module, and an interface service module. The hardware abstraction layer includes a multi-sensor data processing module and an anti-mistouch module. The method includes: The input management module registers a first listening event with the lock screen management module, so that the lock screen management module listens for whether the screen unlock event occurs and notifies the input management module of the detected screen unlock event. When the input management module receives the screen unlock event, it registers a second listening event with the multi-sensor data processing module so that the multi-sensor data processing module can listen for whether the first type of event is detected and notify the input management module of the first type of event it has detected. When the input management module receives the first type of event, it notifies the anti-mistouch module. The accidental touch prevention module notifies the interface service module to display the first accidental touch prevention interface.
8. The equipment control method according to claim 7, characterized in that, The method further includes: When the screen lock management module detects a screen lock event, it notifies the input management module of the detected screen lock event. When the input management module receives the screen lock event, it notifies the anti-mistouch module. The accidental touch prevention module notifies the interface service module to cancel the display of the first accidental touch prevention interface.
9. The equipment control method according to any one of claims 1, 3, 7 or 8, characterized in that, The electronic device is a foldable screen device, and the device usage states of the foldable screen device include an unfolded state and a folded state. The step of listening for the detection of the first type of event in response to a screen unlock event includes: If the device is in a folded state, in response to a screen unlock event, it listens for whether the first type of event is detected; If the device is in an expanded state, the operation of listening to whether the first type of event has been detected is not performed.
10. The equipment control method according to claim 7 or 8, characterized in that, The method further includes: In response to a screen lock event, listen for whether a third type of event is detected; wherein, the third type of event includes the ambient light brightness of the electronic device being less than or equal to a second preset brightness value, the device being in an inverted position, and the screen being obstructed by a large object. If the third type of event is detected, the device enters the second anti-mistouch mode; wherein, in the second anti-mistouch mode, the electronic device only responds to a predefined second type of input operation, which is used to instruct the electronic device to exit the second anti-mistouch mode.
11. An electronic device, characterized in that, The electronic device is externally connected to accessories. The electronic device includes a touch screen, a memory, and a processor. The touch screen and the memory are both coupled to the processor. The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the electronic device to perform the device control method as described in any one of claims 1 to 10.
12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a computer, causes the computer to perform the device control method as described in any one of claims 1 to 10.