Frozen screen detection method and electronic equipment

Abstract

The embodiment of the invention discloses a frozen screen detection method and electronic equipment, and the method can comprise the steps: responding to a condition that a frozen screen detection function is in an on state, and determining a first feature set based on touch data and operation parameters of a touch event in a first time period, the first feature set comprises touch statistical features corresponding to each time window in at least one time window in the first time period, and the touch statistical features indicate time-dependent covariables and non-time-dependent covariables in the corresponding time windows; generating a prediction feature set corresponding to the first feature set based on the first feature set; the prediction feature set comprises prediction features corresponding to each time window; generating a frozen screen detection result based on the loss parameter corresponding to the prediction feature corresponding to each time window; the frozen screen detection result indicates whether the electronic equipment has frozen screen or not in the first time period. In this way, whether the frozen screen exists in the electronic equipment in a certain time period or not can be detected, and the accuracy and efficiency of frozen screen detection can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and in particular to a frozen screen detection method and electronic equipment. Background Art

[0002] With the rapid development of electronic technology, touch technology is widely used in various electronic devices. For example, the display screens of electronic devices such as mobile phones, tablet computers, wearable devices and all-in-one teaching machines are all integrated with touch panels, so that the electronic devices have touch functions while displaying.

[0003] These electronic devices with touch functions may freeze their screens after detecting a touch event. Frozen screen means that the electronic device can detect a touch event but cannot jump to the user interface corresponding to the touch event. For example, the electronic device detects a click operation on the application icon of an application but fails to display the corresponding interface of the application. Frozen screen of electronic devices will lead to a poor user experience. Therefore, it is a very necessary technology to detect whether the electronic device has frozen screen. Summary of the invention

[0004] The embodiments of the present application provide a frozen screen detection method and an electronic device, which can detect whether the electronic device has a frozen screen, thereby helping to improve the accuracy and efficiency of frozen screen detection.

[0005] In a first aspect, an embodiment of the present application provides a frozen screen detection method, which can be applied to an electronic device, the method comprising: in response to a frozen screen detection function being in an on state, acquiring touch data and operating parameters of a touch event within a first time period; determining a first feature set based on the touch data and operating parameters of the touch event, the first feature set comprising touch statistical features corresponding to each time window in at least one time window, the touch statistical features indicating time-dependent covariates and time-independent covariates within the corresponding time window; the first time period comprises at least one time window; based on the first feature set, generating a predicted feature set corresponding to the first feature set; the predicted feature set comprises predicted features corresponding to each time window; generating a frozen screen detection result based on the loss parameters corresponding to the predicted features corresponding to each time window; the frozen screen detection result indicates whether the electronic device has a frozen screen within the first time period.

[0006] It can be seen that when the frozen screen detection function of the electronic device is turned on, the electronic device can determine the first feature set based on the touch data and operating parameters of the touch event, and finally generate a frozen screen detection result based on the predicted feature set corresponding to the first feature set. This can detect whether the electronic device has a frozen screen, which helps to improve the accuracy and efficiency of frozen screen detection.

[0007] In combination with the first aspect, in one possible manner, the time-dependent covariates include one or more of the following: touch frequency, average touch movement distance, average CPU usage, memory growth rate, and screen refresh rate change; the non-time-dependent covariates include one or more of the following: screen touch sensitivity, application type, and network status.

[0008] In combination with the first aspect, in one possible manner, the touch data includes one or more of the following: event end time, event type, touch start coordinates, and touch end coordinates; the operating parameters include one or more of the following: CPU usage, memory usage, screen refresh rate, screen touch sensitivity, network status, and application type.

[0009] In combination with the first aspect, in one possible manner, based on the first feature set, a prediction feature set corresponding to the first feature set is generated, including: determining a first input feature set based on time-dependent covariates corresponding to each time window, and determining a second input feature set based on time-independent covariates corresponding to each time window; determining a prediction feature set corresponding to the first feature set based on the first input feature set and the second input features.

[0010] It can be seen that the present application can determine the first input feature set based on the time-dependent covariates corresponding to each time window, and determine the second input feature set based on the time-independent covariates corresponding to each time window, and determine the prediction feature set based on the first input feature set and the second input feature set, and distinguish between time-dependent covariates and non-time-dependent covariates based on whether the covariates change over time, and perform differentiated processing on the time-dependent covariates and non-time-dependent covariates to ensure the accuracy of the prediction feature set, thereby improving the accuracy of freeze screen detection.

[0011] In combination with the first aspect, in one possible manner, a frozen screen detection result is generated based on the loss parameters corresponding to the predicted features corresponding to each time window, including: comparing the predicted features corresponding to each time window with the reference features respectively to obtain an abnormality score corresponding to each time window, the abnormality score indicating the degree of difference between the predicted features and the reference features in the corresponding time window; generating a frozen screen detection result based on the abnormality score corresponding to each time window.

[0012] It can be seen that by comparing the predicted features corresponding to the time window with the reference features to determine the abnormality score corresponding to the time window, the degree of difference between the predicted features and the reference features within the time window can be quantified, which can further improve the accuracy of the generation of frozen screen detection results.

[0013] In combination with the first aspect, in one possible manner, a frozen screen detection result is generated based on the abnormality scores corresponding to each time window, including: in response to the existence of an abnormality score greater than a threshold, a frozen screen detection result is generated, and the frozen screen detection result indicates that the electronic device has a frozen screen within a first time period; or, in response to the absence of an abnormality score greater than the threshold, a frozen screen detection result is generated, and the frozen screen detection result indicates that the electronic device has not a frozen screen within the first time period.

[0014] It can be seen that by introducing the threshold and generating the frozen screen detection result based on the comparison result between the abnormality score corresponding to each time window and the threshold, the convenience of generating the frozen screen detection result can be improved, thereby improving the efficiency of frozen screen detection.

[0015] In combination with the first aspect, in one possible manner, based on the first feature set, a predicted feature set corresponding to the first feature set is generated, including: inputting the first feature set into a feature processing module in a freeze screen detection model, and obtaining a predicted feature set corresponding to the first feature set output by the feature processing module.

[0016] It can be seen that the present application can determine the prediction feature set corresponding to the first feature set through the feature processing module in the freeze screen detection model to improve the accuracy of the prediction feature set.

[0017] In combination with the first aspect, in one possible manner, a frozen screen detection result is generated based on the loss parameters corresponding to the prediction features corresponding to each time window, including: inputting the prediction features corresponding to each time window into the prediction module in the frozen screen detection model to obtain the loss parameters corresponding to the prediction features corresponding to each time window output by the prediction module; inputting the loss parameters corresponding to the prediction features corresponding to each time window into the frozen screen analysis module in the frozen screen detection model to obtain the frozen screen detection result output by the frozen screen analysis module.

[0018] It can be seen that the present application can output the loss parameters corresponding to the prediction features corresponding to each time window through the prediction module in the frozen screen detection model to improve the accuracy of the loss parameters corresponding to the prediction features corresponding to each time window, and output the frozen screen detection results through the frozen screen analysis module in the frozen screen detection model to further improve the accuracy of the frozen screen detection results.

[0019] In combination with the first aspect, in one possible manner, the method also includes: in response to the screen being frozen on the electronic device within a first time period and the system mode of the electronic device being a simple mode, restarting the target application or restarting the electronic device; wherein the target application is the application running in the foreground on the electronic device within the first time period.

[0020] It can be seen that when the electronic device has a frozen screen within the first time period and the system mode of the electronic device is a simple mode, the electronic device can automatically restart the target application or restart the electronic device to unfreeze the frozen screen, thereby improving the intelligence of the electronic device and further improving the user experience.

[0021] In combination with the first aspect, in one possible manner, the method also includes: in response to the electronic device having a frozen screen within a first time period and the system mode of the electronic device is not a simple mode, displaying a first window; wherein the first window includes a first prompt message, the first prompt message prompting the electronic device that the screen is frozen and whether to unfreeze the screen; in response to receiving a confirmation to unfreeze the screen operation, restarting the target application or restarting the electronic device; wherein the target application is the application running in the foreground on the electronic device within the first time period.

[0022] It can be seen that the electronic device can, when the screen of the electronic device is frozen within the first time period and the system mode of the electronic device is not the simple mode, remind the user that the screen of the electronic device is frozen and ask whether to unfreeze the screen. Based on the user's confirmation, the user can restart the target application or restart the electronic device to unfreeze the screen, thereby improving the user's human-computer interaction experience and the flexibility of unfreezing the screen.

[0023] In a second aspect, the present application provides an electronic device, which includes: one or more processors, a display screen and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute: in response to the frozen screen detection function being in an on state, obtaining touch data and operating parameters of touch events within a first time period; based on the touch data and operating parameters of the touch events, determining a first feature set, the first feature set includes touch statistical features corresponding to each time window in at least one time window, the touch statistical features indicate time-dependent covariates and non-time-dependent covariates within the corresponding time window; the first time period includes at least one time window; based on the first feature set, generating a predicted feature set corresponding to the first feature set; the predicted feature set includes predicted features corresponding to each time window; based on the loss parameters corresponding to the predicted features corresponding to each time window, generating a frozen screen detection result; the frozen screen detection result indicates whether the electronic device has a frozen screen within the first time period.

[0024] In combination with the second aspect, in one possible manner, the time-dependent covariates include one or more of the following: touch frequency, average touch movement distance, average CPU usage, memory growth rate, and screen refresh rate change; the non-time-dependent covariates include one or more of the following: screen touch sensitivity, application type, and network status.

[0025] In combination with the second aspect, in one possible manner, the touch data includes one or more of the following: timestamp, event type, touch start coordinates, touch end coordinates, and touch movement distance; the operating parameters include one or more of the following: CPU usage, memory usage, screen refresh rate, screen touch sensitivity, network status, and application type.

[0026] In combination with the second aspect, in one possible manner, the one or more processors call the computer instructions to cause the electronic device to execute: determine a first input feature set based on time-dependent covariates corresponding to each time window, and determine a second input feature set based on time-independent covariates corresponding to each time window; determine a prediction feature set corresponding to the first feature set based on the first input feature set and the second input feature set.

[0027] In combination with the second aspect, in one possible manner, the one or more processors call the computer instructions to enable the electronic device to execute: comparing the predicted features corresponding to each time window with the reference features respectively, to obtain an abnormality score corresponding to each time window, the abnormality score indicating the degree of difference between the predicted features and the reference features in the corresponding time window; and generating a frozen screen detection result based on the abnormality score corresponding to each time window.

[0028] In combination with the second aspect, in one possible manner, the one or more processors call the computer instructions to cause the electronic device to execute: in response to the existence of an abnormality score greater than a threshold, generate a frozen screen detection result, and the frozen screen detection result indicates that the electronic device has a frozen screen within a first time period; or, in response to the absence of an abnormality score greater than a threshold, generate a frozen screen detection result, and the frozen screen detection result indicates that the electronic device has not a frozen screen within the first time period.

[0029] In combination with the second aspect, in one possible manner, the one or more processors call the computer instructions to cause the electronic device to execute: inputting the first feature set into the feature processing module in the freeze screen detection model, and obtaining a predicted feature set corresponding to the first feature set output by the feature processing module.

[0030] In combination with the second aspect, in one possible manner, the one or more processors call the computer instructions to cause the electronic device to execute: inputting the prediction features corresponding to each time window into the prediction module in the frozen screen detection model to obtain the loss parameters corresponding to the prediction features corresponding to each time window output by the prediction module; inputting the loss parameters corresponding to the prediction features corresponding to each time window into the frozen screen analysis module in the frozen screen detection model to obtain the frozen screen detection results output by the frozen screen analysis module.

[0031] In combination with the second aspect, in one possible manner, the one or more processors call the computer instructions to cause the electronic device to execute: in response to the electronic device having a frozen screen within a first time period and the system mode of the electronic device being a simple mode, restarting the target application or restarting the electronic device; wherein the target application is the application running in the foreground on the electronic device within the first time period.

[0032] In combination with the second aspect, in one possible manner, the one or more processors call the computer instructions to cause the electronic device to execute: in response to the electronic device having a frozen screen within a first time period and the system mode of the electronic device being a non-simple mode, displaying a first window; wherein the first window includes a first prompt message, and the first prompt message prompts the electronic device that the screen is frozen and whether to unfreeze the screen; in response to receiving a confirmation to unfreeze the screen operation, restarting the target application or restarting the electronic device; wherein the target application is the application running in the foreground on the electronic device within the first time period.

[0033] In a third aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the method described in the first aspect above.

[0034] In a fourth aspect, the present application provides a chip system, which is coupled to a memory, and the chip system is used to read and execute a computer program stored in the memory to implement the method described in the first aspect above.

[0035] In a fifth aspect, the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A schematic diagram of a frozen screen provided in an embodiment of the present application; Figure 2A-2D A schematic diagram of an interface for enabling a frozen screen detection function provided in an embodiment of the present application; Figure 2E-2G A schematic diagram of an interface for opening a simple mode provided in an embodiment of the present application; Figure 3 A schematic diagram of a frozen screen detection method provided in an embodiment of the present application; Figure 4 A schematic diagram of an interface for performing a frozen screen release reminder in a simple mode provided in an embodiment of the present application; Figure 5 A schematic diagram of an interface for unfreezing the screen in a first non-simple mode provided in an embodiment of the present application; Figure 6A schematic diagram of an interface for unfreezing the screen in a second non-simple mode provided in an embodiment of the present application; Figure 7 A schematic diagram of an interface for unfreezing the screen in a third non-simple mode provided in an embodiment of the present application; Figure 8 A schematic diagram of an interface for unfreezing the screen in a fourth non-simple mode provided in an embodiment of the present application; Fig. 9 A schematic diagram of a flow chart of another frozen screen detection method provided in an embodiment of the present application; Fig.10 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application; Fig.11 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0037] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0038] The terms "first", "second", "third", etc. in the embodiments of the present application are distinguished from different objects, rather than being used to describe a specific order. In addition, the terms "include" and "have" and any variation thereof are intended to cover non-exclusive inclusions. For example, a series of steps or units are included, or alternatively, steps or units not listed are also included, or other steps or units inherent to these processes, methods, products or devices are optionally included. The terms "one embodiment" or "some embodiments", etc. mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in the differences in the embodiments of the present application are not necessarily all with reference to the same embodiment, but mean "one or more but not all embodiments", unless otherwise particularly emphasized.

[0039] In the embodiments of the present application, the words "such as" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "such as" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "such as" or "for example" is intended to present related concepts in a specific way.

[0040] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can represent: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c, where a, b, c can be single or multiple.

[0041] The terms "component", "module", "system" and the like in the following embodiments of the present application are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component may be, but is not limited to, a process, a processor, an object, an executable file, an execution thread, a program and / or a computer running on a processor. By way of illustration, both the application and the computing device running on a computing device may be components. One or more components may reside in a process and / or an execution thread, and a component may be located on a computer and / or distributed between two or more computers. In addition, these components may be executed from various computer-readable media having various data structures stored thereon. Components may, for example, communicate through local and / or remote processes according to signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system and / or a network, such as the Internet interacting with other systems through signals).

[0042] Below, some terms in this application are explained to facilitate understanding by those skilled in the art.

[0043] 1. Touch screen and touch data A touch screen (TP), also known as a touch screen or touch panel, is a display device that can receive input information. For example, on electronic devices such as mobile phones and tablet computers, the touch screen of the electronic device can receive user touch operations such as clicking, sliding, zooming, and dragging on icons, text, and other graphic elements displayed on the touch screen.

[0044] The touch screen detects whether there is a touch operation by scanning. The touch screen can generate a corresponding electrical signal based on the detected touch operation, and transmit the electrical signal to the touch device corresponding to the touch screen. The touch device can generate initial touch data according to the change of the electrical signal. The initial touch data includes touch position data, pressure data, touch time, etc. The touch drive module corresponding to the touch screen can identify the touch event occurring on the touch screen based on the initial touch data, and collect the touch data of the touch event. In the embodiment of the present application, the touch data of the touch event may include data such as the event end time, event type, touch start coordinates, and touch end coordinates of the touch event. The event type may include but is not limited to click events, slide events, drag events, etc.

[0045] 2. Frozen screen A frozen screen means that the electronic device can detect a touch event but cannot jump to the user interface corresponding to the touch event.

[0046] like Figure 1 As shown, the electronic device can display the interface 101 of the main screen, and the interface 101 includes multiple application icons, such as a live application icon 1011, a weather application icon, a stock application icon, a calculator application icon, a setting application icon, an email application icon, a gallery application icon, a Facebook application icon, a browser application icon, a music application icon, a video application icon, an application store icon, etc. A page indicator is also included below the multiple application icons to indicate the positional relationship between the currently displayed page and other pages. The electronic device can detect the user's selection operation 1012 (such as a click operation) for the live application icon 1011. If the electronic device does not have a frozen screen, the electronic device can respond to the selection operation 1012 and display the user interface 102 of the live application. If the electronic device has a frozen screen, it cannot respond to the selection operation 1012. In this case, the electronic device cannot display the user interface 102 of the live application, for example, it may stay on the interface 101 of the main screen.

[0047] A frozen screen on an electronic device will result in a poor user experience, so the frozen screen detection method provided in the embodiment of the present application can be used to accurately and quickly determine whether the electronic device has a frozen screen.

[0048] In an embodiment of the present application, an electronic device such as a smart phone may provide a frozen screen detection function, wherein the frozen screen detection function may detect a frozen screen, that is, detect whether the electronic device has a frozen screen, or may be described as detecting whether the electronic device has a risk of a frozen screen.

[0049] It is understandable that frozen screen detection may also be referred to as screen freeze detection, screen status detection or other terms, and the embodiments of the present application are not limited to this.

[0050] 3. How to enable the frozen screen detection function In actual applications, users can decide whether to enable the frozen screen detection function according to their own needs. Figure 2A-2D This section describes the process of enabling the frozen screen detection function.

[0051] like Figure 2A As shown, the electronic device can display the interface of the home screen, which includes multiple application icons, such as a settings application icon 2011, a live broadcast application icon, a gallery application icon, a weather application icon, a stock application icon, a calculator application icon, an email application icon, a Facebook application icon, a browser application icon, a music application icon, an application store icon, a video application icon, etc. A page indicator is also included below the multiple application icons to indicate the positional relationship between the currently displayed page and other pages. The electronic device can detect a user's selection operation 2012 (click operation) on the settings application icon 2011, and in response to the selection operation 2012, display a Figure 2B A user interface 202 of a settings application is shown.

[0052] like Figure 2B As shown, the user interface 202 may include multiple common function icons of the electronic device, such as a freeze screen detection function logo 2021, a system and update function logo 2022, an airplane mode function logo, a Wi-Fi function logo, a Bluetooth function logo, a personal hotspot function logo, a mobile network function logo, a Honor account function logo, etc.

[0053] like Figure 2C As shown, the electronic device can detect the user's Figure 2B In response to the selection operation 2023 (such as a click operation) of the freeze screen detection function identifier 2021, the display Figure 2D The user interface 203 of the freeze screen detection function is shown.

[0054] like Figure 2D As shown, the user interface 203 includes a confirmation and activation item 2031 of the frozen screen detection function, and the electronic device can detect a confirmation and activation operation 2032 (such as a click operation) of the user on the confirmation and activation item 2031, and activate the frozen screen detection function in response to the confirmation and activation operation 2032. The user interface 203 can also include a functional introduction of the frozen screen detection function to facilitate the user to understand the frozen screen detection function.

[0055] 4. Easy mode and non-easy mode Simple mode is a mode that simplifies complex functions and interfaces, and is designed to provide a simple, easy-to-operate user experience. By reducing the operating steps and configuration options, users can quickly get started and perform basic operations. Simple mode is implemented by simplifying the interface layout, hiding advanced functions, and providing intuitive guidance and help. In an embodiment of the present application, after the simple mode is turned on, the electronic device can automatically restart the application running in the foreground on the electronic device when the frozen screen occurs or restart the electronic device after detecting that the screen is frozen, and the screen can be unfrozen without user participation.

[0056] The non-simple mode corresponds to the simple mode. If the simple mode of the electronic device is not turned on, the system mode of the electronic device is the non-simple mode. In the embodiment of the present application, in the non-simple mode, after the electronic device detects that the screen is frozen, it will prompt the user whether the electronic device has a frozen screen and whether to unfreeze the screen. After the user confirms to unfreeze the screen, the application running in the foreground of the electronic device when the frozen screen occurs will be restarted or the electronic device will be restarted.

[0057] 5. How to start the simple mode In actual applications, users can decide whether to enable the simple mode according to their own needs. Figure 2E-2G The process of opening the simple mode is introduced in detail.

[0058] like Figure 2E As shown, the electronic device can detect a selection operation 2024 (such as a click operation) of the user on the system and update function identifier 2022 in the user interface 202, and in response to the selection operation 2024, display Figure 2F The user interface 204 of the system and update function shown. The display path and interface content of the user interface 202 have been described in detail in the above-mentioned reference to the opening process of the frozen screen detection function. Please refer to the section for FIG. 2A to FIG. 2B The description of the relevant content will not be repeated here.

[0059] like Figure 2F As shown, the user interface 204 includes multiple sub-function identifiers under the system and update function, such as the simple mode function identifier 2041, the software update function identifier, the system navigation mode function identifier, the language and input method function identifier, the date and time function identifier, the replacement cloning function identifier, the reset function identifier, the user experience improvement plan function identifier, etc. The electronic device can detect the user's selection operation 2042 (such as a click operation) for the simple mode function identifier 2041, and in response to the selection operation 2042, display Figure 2G The user interface 205 of the easy mode function is shown.

[0060] like Figure 2GAs shown, the user interface 205 includes a confirmation and activation item 2051 of the simple mode, and the electronic device can detect a confirmation and activation operation 2052 (such as a click operation) of the user on the confirmation and activation item 2051, and activate the simple mode in response to the confirmation and activation operation 2052. The user interface 205 can also include a functional introduction (i.e., a functional description) of the simple mode, for example, the functional description includes text information such as "larger display", "simpler desktop layout, larger text and icons, and automatic unfreezing of the screen when frozen", so that the user can understand the simple mode.

[0061] Based on the above explanation, the following Figure 3 Introduce the frozen screen detection method provided by the embodiment of the present application. Figure 3 , Figure 3 A flowchart of a frozen screen detection method provided in an embodiment of the present application.

[0062] The frozen screen detection method can be applied to electronic devices, can be executed by the electronic devices, can be executed by a processor in the electronic devices, can be executed by a chip or chip system with a processor function, etc. Figure 3 As shown, the frozen screen detection method may include but is not limited to the following steps: S301, in response to the freeze screen detection function being in an on state, acquiring touch data and operating parameters of touch events within a first time period.

[0063] Among them, the first time period refers to the duration from one moment to another moment. The length of the first time period can be 1 minute, 5 minutes, 10 minutes, etc. The embodiment of the present application does not specifically limit the length of the first time period. A touch event within the first time period refers to a touch event that occurs on the touch screen of an electronic device within the first time period. A touch event includes at least one of the following process events: touch start (Touchstart), touch move (Touchmove), touch end (Ttouchend), etc. Touch start corresponds to a finger touching the screen, touch move corresponds to a finger moving on the screen, and touch end corresponds to a finger leaving the screen.

[0064] In an embodiment of the present application, the touch data of a touch event may include, but is not limited to, one or more of the following: timestamp, event type, touch start coordinates, touch end coordinates, and touch moving distance. Among them, the content recorded by the timestamp includes the event occurrence time of the touch event, and the event occurrence time may be the event end time, or the event start time, or any time between the event end time and the event start time. Event types may include, but are not limited to, click events (Click), sliding events (Swipe), drag events (Drag), and the like. The touch start coordinates refer to the screen coordinates corresponding to the start of the touch in the touch event, and the touch start coordinates are also called the touch start position. The touch end coordinates refer to the screen coordinates corresponding to the end of the touch in the touch event, and the touch end coordinates are the touch end position. Optionally, the screen coordinates can be represented by a rectangular coordinate system, such as (x, y), and the unit can be pixels. Optionally, the touch moving distance can be the actual moving distance of the finger from the touch start coordinates to the touch end coordinates in the touch event. In this case, the touch moving distance can be obtained during the touch movement process. Optionally, the touch moving distance may be a straight-line distance from a touch start position to a touch end position in a touch event. In this case, the touch moving distance may be calculated from the touch start position and the touch end position.

[0065] In an embodiment of the present application, the operating parameters of a touch event may include, but are not limited to, one or more of the following: central processing unit (CPU) usage, memory usage, screen refresh rate, screen touch sensitivity, network status, and application type. CPU usage refers to the amount of processing time consumed by the CPU of an electronic device. It indicates how much CPU capacity is utilized at any given time. It is measured as a percentage, with 100% representing full utilization of the CPU processing power. The CPU usage of a touch event is the CPU usage at the end of the touch event. Memory usage refers to the proportion of physical memory being used by an electronic device at a certain moment to the total available memory. It is one of the indicators for measuring the memory resource utilization of an electronic device. Memory usage refers to the ratio of the used memory of an electronic device to the total memory of the electronic device. The memory usage of a touch event is the memory usage at the end of the touch event. The screen refresh rate refers to the number of times the display of the electronic device updates the image per second, in Hertz (Hz). The screen refresh rate of a touch event is the average screen refresh rate in the second time period after the event end time of the touch event. The length of the second time period can be 2s, 3s, etc., and the length of the second time period is not specifically limited. The screen touch sensitivity refers to the response speed and accuracy of the screen to the touch operation when the user uses the device. The screen touch sensitivity is related to the hardware configuration of the electronic device and can be obtained through a touch test. The network status includes the network being connected (Connected) and the network being not connected (NoConnection). Optionally, Connected can be used to indicate that the network status is the network being connected, and NoConnection can be used to indicate that the network status is the network being not connected. Optionally, a network status number can be used to indicate the corresponding network status, for example, Connected is indicated by 1 and No Connection is indicated by 0. The application type is used to distinguish applications, and the application type can include game applications, video applications, social applications, office applications, etc. Optionally, a type number can be used to indicate the corresponding application type, for example, game applications are indicated by 1, video applications are indicated by 2, and social applications are indicated by 3.

[0066] In the embodiment of the present application, acquiring touch data and operating parameters of touch events within the first time period refers to acquiring touch data and operating parameters of each touch event in at least one touch event within the first time period.

[0067] Below, the touch data of a touch event includes timestamp, event type, touch start coordinates, touch end coordinates, and the operating parameters of the touch event include CPU usage, memory usage, screen refresh rate, network status, and application type. The touch data and operating parameters of the touch event are arranged in the following order: timestamp, event type, touch start coordinates, touch end coordinates, CPU usage, memory usage, screen refresh rate, network status, and application type. Take touch event TE1 as an example to explain the touch data and operating parameters of the touch event.

[0068] For example, the touch data and operating parameters corresponding to the touch event TE1 are: 2024-01-01 10:00:00.123, Click, (320, 480), (320, 480), 45%, 60%, 60Hz, Connected, 1. Among them, the first data 2024-01-01 10:00:00.123 indicates the timestamp of the touch event TE1, the second data Click indicates that the event type of the touch event TE1 is a click event, the third data (320, 480) refers to the touch start coordinates of the touch event TE1, the fourth data (320, 480) refers to the touch start coordinates of the touch event TE1, the fifth data 45% refers to the CPU usage rate of the touch event TE1, the sixth data 60% refers to the screen refresh rate of the touch event TE1, the seventh data Connected refers to the network status of the touch event TE1 is the connected status, and the eighth data 1 refers to the application type of the touch event TE1 is a game application.

[0069] Optionally, the electronic device may provide a frozen screen detection setting option, which may be added to a system function list of the electronic device (for example, see the above Figure 2B The user interface shown in FIG. 1 may also be added to a function list of any application (such as a video playback application). Accordingly, the frozen screen detection setting option may include an on button, and the user may trigger the electronic device to turn on the frozen screen detection function by clicking the on button. The on-screen detection function turn-on process has been described above and will not be repeated here.

[0070] S302: Determine a first feature set based on touch data and operating parameters of the touch event.

[0071] Among them, the first time period may include at least one time window. The time window refers to the time range used to determine whether the electronic device has a frozen screen. When the first time period includes a time window, the time window can be any time period in the first time period (including the first time period itself). When the first time period includes multiple time windows, the multiple time windows can be continuous and equal-length time windows in the first time period, or non-continuous time windows in the first time period. Multiple time windows in the first time period can also be defined in other ways, and the correspondence between time periods and time windows is not specifically limited. For example, the time of the first time period is ten minutes, and the first time period is divided into 10 parts to obtain 10 sub-time periods. If these 10 sub-time periods are all used as time windows, it is obvious that the first time period includes 10 time windows, and the duration of each time window is 1 minute. Multiple time windows can also be non-continuous time windows in the first time period. For example, the first time period is 6 minutes, and the first minute, the third minute, and the fifth minute of the first time period can be determined as 3 time windows of the first time period. The time windows within the first time period may be indicated by a time window unique code (Identity document, Id), for example, the first time window within the first time period is indicated by W001, the second time window is indicated by W002, the third time window is indicated by W003, and so on.

[0072] In an embodiment of the present application, when the network status of the electronic device changes and / or the application type of the application running in the foreground of the electronic device changes, the time window is re-divided from the moment the change occurs.

[0073] Among them, the first feature set includes touch statistical features corresponding to each time window in at least one time window, and the touch statistical features indicate time-dependent covariates and non-time-dependent covariates in the corresponding time window. Time-dependent covariates refer to covariates that change with time. Time-dependent covariates are also called time-dependent covariates or intrinsic time-dependent covariates or time-varying covariates. Non-time-dependent covariates refer to covariates that do not change with time.

[0074] In an embodiment of the present application, the time-dependent covariate may include, but is not limited to, one or more of the following: touch frequency, average touch movement distance, average CPU usage, memory growth rate, and screen refresh rate change value. The touch frequency within the time window refers to the average number of touch events that occur per second within the time window. The average touch movement distance within the time window refers to the average value of the touch movement distance of the touch events within the time window. The average CPU usage within the time window refers to the average value of the CPU usage of the touch events within the time window.

[0075] The memory growth rate within the time window can be calculated using the following formula (1): y) / y formula (1) In formula (1), is the memory growth rate of the i-th time window, is the average memory usage in the i-th time window, and y is the average memory usage in the i-1-th time window.

[0076] The screen refresh rate change value within the time window can be obtained by the following formula (2): Formula (2) In formula (2), is the screen refresh rate change value within the time window, r is the average screen refresh rate within the time window, and s is the baseline refresh rate within the time window.

[0077] In formula (2), the base refresh rate is the minimum refresh rate required for the display or screen to ensure stable display of the image and avoid flickering under normal working conditions. The base refresh rate can be determined according to specific application scenarios and user needs. For example, the base refresh rate in daily office and web browsing scenarios (such as daily text reading, document processing, or surfing the Internet, etc.) can be 60Hz; since most movie and video content is recorded at 24 frames per second or 30 frames per second, the base refresh rate in watching movies and videos can be 60Hz to provide a smooth and flicker-free viewing experience; e-sports and first-person shooting games (First-person shooting games, FPS) require a higher refresh rate to reduce latency and make the action look more natural and smooth, so their base refresh rate can be a refresh rate of 144Hz or above. Based on this, the application scenario can be indicated by the application type, and then the base refresh rate in the time window can be determined by the application type in the time window. Obviously, the base refresh rates of different application types can be the same or different. For example, the base refresh rates of office applications, web applications, and video applications are all 60Hz, and the base refresh rate of game applications is 144Hz. Furthermore, the application scenarios may be indicated in the form of a combination of application type and application function, so as to subdivide the application scenarios.

[0078] In the specific implementation, application types can be divided according to user needs, and the benchmark refresh rates corresponding to different application types can be determined. A set of correspondences between application types and benchmark refresh rates can also be obtained in advance. When the benchmark refresh rate of a time window needs to be determined, the correspondence set can be searched based on the application type of the time window.

[0079] In the embodiment of the present application, the non-time-dependent covariate may include, but is not limited to, one or more of the following: screen touch sensitivity, application type, and network status.

[0080] In the embodiment of the present application, taking the time-dependent covariates including touch frequency, average touch movement distance, average CPU usage rate, memory growth rate, and screen refresh rate change value, and the non-time-dependent covariates including application type and network status as an example, the touch statistical features of each time window (including time-dependent covariates and non-time-dependent covariates) are arranged in the following order: touch frequency, average touch movement distance, average CPU usage rate, memory growth rate, screen refresh rate change value, network status, application type. Below, taking time window W001 as an example, the touch statistical features in the time window are explained.

[0081] The touch statistical features of the time window W001 are: 2.5, 150, 47%, 2%, -0.1, 1, 1. Among them, the first data 2.5 represents the touch frequency in the time window W001, the second data 150 represents the average touch movement distance in the time window W001, the third data 47% refers to the average CPU usage rate in the time window W001, the fourth data 2% refers to the memory growth rate in the time window W001, the fifth data -0.1 refers to the screen refresh rate change value in the time window W001, the sixth data 1 indicates that the network status in the time window W001 is the connected status, and the seventh data 1 indicates that the application type in the time window W001 is a game application.

[0082] In some embodiments, after acquiring the touch data and operating parameters of the touch event, the acquired data may be preprocessed to obtain preprocessed data, and then feature extraction may be performed on the preprocessed data to obtain a first feature set. The preprocessing process may include the following steps: Step A1, data cleaning. Data cleaning can be performed in the following ways: 1) Remove / complete missing data: fill in by calculation, experience or business, other fields, or fill in with unified indicators, such as filling missing touch frequency values ​​with the mean, median, mode, etc. of touch frequency; 2) Remove / modify data with format and content errors (i.e. invalid data): for example, remove line breaks, spaces, data before a touch event occurs, etc.; 3) Remove / modify data with logical errors: that is, remove unreasonable values, such as remove screen refresh rate abnormalities or touch frequency abnormalities, and correct contradictory content; 4) Remove unnecessary data: for example, delete unnecessary fields. For example, when the touch movement distance is the straight-line distance between the touch start coordinate and the touch end coordinate, the touch start coordinate and the touch end coordinate can be deleted after the touch movement distance is obtained.

[0083] Step A2: Time alignment: Align the touch data and operation parameters of the touch event to the same time axis.

[0084] S303: Based on the first feature set, generate a prediction feature set corresponding to the first feature set.

[0085] The prediction feature set includes prediction features corresponding to each time window.

[0086] In some embodiments, after acquiring the first feature set, the electronic device can determine the first input feature set based on the time-dependent covariates corresponding to each time window in the first feature set, and determine the second input feature set based on the non-time-dependent covariates corresponding to each time window in the first feature set; and determine the prediction feature set corresponding to the first feature set based on the first input feature set and the second input feature set. The present application distinguishes between time-dependent covariates and non-time-dependent covariates based on whether the covariates change over time, and performs differentiated processing on the time-dependent covariates and non-time-dependent covariates to ensure the accuracy of the prediction feature set determination, thereby improving the accuracy of frozen screen detection.

[0087] Among them, the first input feature set includes input vectors corresponding to each time window, and the input vectors are obtained by splicing the time-dependent covariates of the corresponding time windows. For example, the window end time of the i-th time window is t, then the input vector of the i-th time window is expressed as X_t, the window end time of the i-1-th time window is t-1, then the input vector of the i-1-th time window is expressed as X_t-1.

[0088] X_t = [ Touch frequency, / / x1: Range [0-10], unit: times / second Average touch movement distance, / / x2: range [0-1000], unit: pixel Average CPU usage, / / x3: range [0-100]% Memory growth rate, / / x4: range [-1,1] Screen refresh rate change value / / x5: range [-1,1] ] Among them, the second input feature set includes the control vectors corresponding to each time window, and the control vectors are obtained by splicing the non-time-dependent covariates of the corresponding time windows. Similarly, the window end time of the i-th time window is t, then the control vector of the i-th time window is expressed as u_t, the window end time of the i-1-th time window is t-1, then the control vector of the i-1-th time window is expressed as u_t-1.

[0089] u_t = [ Application type, / / u1: value [1-5], application type represents different types of applications (games, videos, social networking, etc.) Touch sensitivity, / / u2: value [0-1], touch sensitivity is related to the device hardware configuration and can be obtained through touch testing; Network status / / u3: value [0,1], 1 means the network is connected, 0 means the network is not connected ] When X_t-1 and u_t are determined, Y_t can be determined based on X_t-1, u_t and the first corresponding relationship, where the first corresponding relationship refers to the corresponding relationship between Y_t and X_t-1, u_t. For example, the first corresponding relationship can be: X_t = A * X_t-1+ B * u_t + w_t Y_t = H * X_t + v_t Where A is the state transfer matrix, which is defined as follows: A = [ [0.8, 0.1, 0.0, 0.0, 0.1], [0.1, 0.7, 0.1, 0.0, 0.1], [0.0, 0.1, 0.8, 0.1, 0.0], [0.0, 0.0, 0.1, 0.8, 0.1], [0.1, 0.1, 0.0, 0.1, 0.7] ] B is the control input matrix, which is defined as follows: B = [ [0.1, 0.0, 0.0], / / Impact of application type on touch frequency [0.0, 0.2, 0.0], / / The impact of touch sensitivity on the average touch movement distance [0.0, 0.0, 0.1], / / Impact of network status on average CPU usage [0.1, 0.0, 0.1], / / The impact of application type and network status on memory growth rate [0.1, 0.1, 0.0] / / The impact of application type and touch sensitivity on the screen refresh rate change value ] H is the observation matrix, which is defined as follows: H = [ [1.0, 0.0, 0.0, 0.0, 0.0], [0.0, 1.0, 0.0, 0.0, 0.0], [0.0, 0.0, 1.0, 0.0, 0.0], [0.0, 0.0, 0.0, 1.0, 0.0], [0.0, 0.0, 0.0, 0.0, 1.0] ] w_t ~ N(0, Q) / / Q is the process noise covariance matrix. In general, the influence of w_t can be ignored, that is, w_t=0.

[0090] v_t ~ N(0, R) / / R is the observation noise covariance matrix. In general, the influence of v_t can be ignored, that is, v_t = 0.

[0091] In some embodiments, after acquiring the first feature set, the electronic device may process the acquired first feature set through a feature processing module in a frozen screen detection model to obtain a predicted feature set corresponding to the first feature set. The frozen screen detection model including the feature processing module may be, for example, a model pre-stored locally by the electronic device. After the first feature set is input into the feature processing module, the feature processing module may output a predicted feature set corresponding to the first feature set based on the first feature set. The embodiment of the present application determines the predicted feature set corresponding to the first feature set through the feature processing module in the frozen screen detection model, which can improve the accuracy of the predicted feature set.

[0092] In some embodiments, the electronic device may send a processing request including a first feature set to a cloud-side server to request the cloud-side server to generate a prediction feature set corresponding to the first feature set based on the first feature set. Similarly, the cloud-side server may store a trained frozen screen detection model, and the trained frozen screen detection model includes a feature processing module. The first feature set is input into the feature processing module, and the feature processing module may output a prediction feature set corresponding to the first feature set based on the first feature set. In this way, the electronic device does not need to pre-store the frozen screen detection model of the feature processing module, which is conducive to saving storage space.

[0093] The frozen screen detection model including the feature processing module is obtained by comparative learning based on positive samples, negative samples and frozen screen labels in the training sample set. The frozen screen label is used to characterize whether the electronic device has a frozen screen. The touch data and operating parameters of the touch operation within a period of time (for example, one minute) before the frozen screen occurs can be obtained from the operation log of the existing frozen screen problem (referred to as data 1), and the first feature set determined based on data 1 is used as a negative sample. The touch data and operating parameters of the touch operation within a period of time (for example, one minute) after the frozen screen occurs are obtained from the reporting log of the existing frozen screen problem (referred to as data 2), and the first feature set determined based on data 2) is used as a positive sample, thereby obtaining a positive and negative sample pair. The initial model is supervised and learned using multiple positive and negative samples, and the generalization ability and detection accuracy of the initial model are improved through multiple rounds of iterative optimization. The initial model is optimized with the goal of minimizing the loss function until the loss function of the model converges (for example, the loss value change amplitude is less than the set amplitude threshold) or the preset training round is reached, and the feature processing module is obtained. The model structure of the feature processing module can be a state space model network, and the basic equation of the state space model is the same as the first corresponding relationship mentioned above. Please refer to the description of the first corresponding relationship above, which will not be repeated here. In some embodiments, the feature processing module is a frozen screen detection model.

[0094] S304: Generate a frozen screen detection result based on the loss parameters corresponding to the prediction features corresponding to each time window.

[0095] The loss parameter may be an abnormality score. The frozen screen detection result indicates whether the electronic device has a frozen screen within the first time period.

[0096] In order to generate the frozen screen detection result, the predicted features corresponding to each time window can be compared with the reference features respectively to obtain the abnormality scores corresponding to each time window. The abnormality score indicates the degree of difference between the predicted features and the reference features in the corresponding time window. The larger the abnormality score, the smaller the degree of difference between the predicted features and the reference features, and the smaller the abnormality score, the smaller the degree of difference between the predicted features and the reference features. Then, the frozen screen detection result can be generated based on the abnormality scores corresponding to each time window.

[0097] Specifically, in order to obtain the abnormality scores corresponding to each time window, the following operations may be performed on the prediction features corresponding to each time window in turn: Step B1: Obtain the Euclidean distance between the prediction feature and the reference feature corresponding to the current processing time window using the following formula (3).

[0098] Formula (3) In formula (3), D is and The Euclidean distance between the two time windows is also called the distance score. y_t is the predicted feature corresponding to the current processing time window, y_expected is the reference feature, ^2 is for square, sum() is for summation, and sqrt() is for square root. The reference feature refers to the cluster center of the m predicted features corresponding to the m time windows of the electronic device in the normal state (that is, the non-frozen state). m is a positive integer, and the larger m is, the better. The larger m is, the more predicted features there are, and the cluster center corresponding to the sample is closer to the true value, that is, the smaller the error between the sample and the true value.

[0099] Step B2: Obtain the Euclidean distance and the reference distance corresponding to the time window currently being processed by the following formula (4), perform normalization processing, and obtain the abnormality score corresponding to the time window currently being processed.

[0100] Formula (4) In formula (4), Abnormality score, D is and The Euclidean distance between them is calculated by formula (1): represents the reference distance, () is the minimum value. The reference distance refers to the cluster center (such as average, median, mode, etc.) of n Euclidean distances in n time windows when the electronic device is in a normal state (non-frozen screen state). n is a positive integer. n can be the same as or different from the aforementioned m. The larger n is, the better. The larger n is, the more Euclidean distances there are, and the closer the obtained cluster center is to the true value, that is, the smaller the error between the true value and the true value.

[0101] It can be seen that by comparing the predicted features corresponding to the time window with the reference features to determine the abnormality score corresponding to the time window, the degree of difference between the predicted features and the reference features in the time window can be quantified, which can further improve the accuracy of the generation of the frozen screen detection results.

[0102] In some embodiments, after obtaining the abnormality scores corresponding to the respective time windows, the abnormality scores corresponding to the respective time windows can be compared with the thresholds to obtain the frozen screen detection results. The threshold is used to distinguish whether the electronic device has a frozen screen or not.

[0103] Optionally, in response to the presence of an abnormality score greater than a threshold, a frozen screen detection result may be generated, the frozen screen detection result indicating that the electronic device has a frozen screen during the first time period.

[0104] For example, time period T1 includes four time windows, namely time window W001, time window W002, time window W003, and time window W004. The abnormality score of time window W001 is 49, the abnormality score of time window W002 is 30, the abnormality score of time window W003 is 55, and the abnormality score of time window W004 is 80. Both 80 and 55 are greater than 50. At this time, the generated frozen screen detection result indicates that the electronic device has a frozen screen in the time period T1.

[0105] Optionally, in response to the absence of an abnormality score greater than a threshold, a frozen screen detection result may be generated, the frozen screen detection result indicating that the electronic device does not have a frozen screen during the first time period.

[0106] For example, time period T2 includes three time windows, namely time window W001, time window W002, and time window W003. The abnormality score of time window W004 is 49, the abnormality score of time window W005 is 30, and the abnormality score of time window W006 is 21. 49, 30, and 21 are all less than 50. At this time, the generated frozen screen detection result indicates that the electronic device does not have a frozen screen within the time period T2.

[0107] It can be seen that the present application generates frozen screen detection results based on the comparison results of the abnormality scores corresponding to each time window and the threshold by introducing a threshold, which can improve the convenience of generating frozen screen detection results and thus improve the efficiency of frozen screen detection.

[0108] For ease of understanding, in the case where a time period includes a time window, the prediction feature corresponding to the time window is taken as the processing object, and an example is given to illustrate the implementation process of generating the frozen screen detection result of the time period.

[0109] Assume that time period T3 includes time window W001, the prediction feature P1 corresponding to time window W001 is: [0.5, 50, 85%, 0.08, -0.4]; the reference feature P2 is: [2.3, 120, 45%, 0.02, -0.1]; based on the above formula (1) and formula (2), it can be calculated that the abnormality score between the prediction feature P1 and the reference feature P2 is 70; if the current threshold is 50; since 70>50, it can be determined that the electronic device has a frozen screen in time window W001 (i.e., time period T3).

[0110] For the case where a time period includes multiple time windows, the implementation process for generating the frozen screen detection result of the time period is as follows. The abnormality score of each time window in the multiple time windows can be obtained respectively to obtain multiple abnormality scores. If there is an abnormality score greater than the threshold value among the multiple abnormality scores, a frozen screen detection result indicating that the electronic device has a frozen screen during the time period is generated. If there is no abnormality score greater than the threshold value among the multiple abnormality scores, a frozen screen detection result indicating that the electronic device does not have a frozen screen during the time period is generated. In addition, in this case, the process of obtaining the abnormality score of a time window refers to the process of obtaining the abnormality score in the case where a time period includes a time window, and will not be repeated here.

[0111] In some embodiments, after obtaining the prediction features corresponding to each time window, the electronic device may output the loss parameters corresponding to the prediction features corresponding to each time window based on the prediction features corresponding to each time window through the prediction module in the frozen screen detection model. The frozen screen detection model including the feature processing module may be, for example, a model pre-stored locally by the electronic device. After the prediction features corresponding to each time window are input into the prediction module, the prediction module may output the loss parameters corresponding to the prediction features corresponding to each time window based on the prediction features corresponding to each time window. The embodiment of the present application outputs the loss parameters corresponding to the prediction features corresponding to each time window through the prediction module in the frozen screen detection model, which can improve the accuracy of the loss parameters corresponding to the prediction features corresponding to each time window.

[0112] Optionally, the electronic device may send a processing request including the prediction features corresponding to the various time windows to the cloud-side server, requesting the cloud-side server to determine the loss parameters corresponding to the prediction features corresponding to the various time windows based on the prediction features corresponding to the various time windows. Similarly, the cloud-side server may store a frozen screen detection model that has been trained, and the frozen screen detection model includes a prediction module. After the prediction features corresponding to the various time windows are input into the prediction module, the prediction module may output the loss parameters corresponding to the prediction features corresponding to the various time windows, and the frozen screen detection results may be determined based on the loss parameters corresponding to the prediction features corresponding to the various time windows. In this way, the electronic device may not need to pre-store the frozen screen detection model including the prediction module, which is beneficial for saving storage space.

[0113] In some embodiments, the frozen screen detection model may include a frozen screen analysis module. After obtaining the loss parameters corresponding to the predicted features corresponding to the various time windows, they may be input into the frozen screen analysis module to obtain the frozen screen detection results output by the frozen screen analysis module. It can be seen that by outputting the frozen screen detection results through the frozen screen analysis module in the frozen screen detection model, the accuracy of the frozen screen detection results is further improved. The frozen screen detection model including the frozen screen analysis module may be, for example, a module pre-stored locally by the electronic device. The loss parameters corresponding to the predicted features corresponding to the various time windows are input into the frozen screen analysis module to obtain the frozen screen detection results output by the frozen screen analysis module. In this way, it is helpful to improve the accuracy of the frozen screen detection results.

[0114] Optionally, the electronic device may send a processing request including loss parameters corresponding to the prediction features corresponding to the respective time windows to the cloud-side server, so as to request the cloud-side server to output a frozen screen detection result based on the loss parameters corresponding to the prediction features corresponding to the respective time windows. Similarly, the cloud-side server may store a frozen screen detection model that has been trained, and the frozen screen detection model includes a frozen screen analysis module. After the loss parameters corresponding to the prediction features corresponding to the respective time windows are processed, the prediction module may output a frozen screen detection result. In this way, the electronic device may not need to pre-store a frozen screen detection model including a frozen screen analysis module, which is beneficial for saving storage space.

[0115] The aforementioned frozen screen detection model including the feature processing module, the frozen screen detection model including the prediction module, and the frozen screen detection model including the frozen screen analysis module can be the same frozen screen detection model, or can be three different frozen screen detection models, or two of them can be the same frozen screen detection model and the other one can be another frozen screen detection model, and the embodiments of the present application do not make specific limitations on this.

[0116] After the frozen screen detection result is generated, if the electronic device has a frozen screen within the first time period, the following processing methods can be used to present the value of the frozen screen detection result.

[0117] Mode 1: Output frozen screen reminder information to remind the user that the current device has frozen screen. The frozen screen reminder information can be broadcast in the form of voice, for example, playing "no response" in the form of voice; or it can be displayed in the user interface in the form of text or animation, for example, displaying the text message "no response" in the user interface, or displaying an animation effect in the user interface to indicate that the user device has frozen screen. In this mode, the user can find a way to unfreeze the screen based on the frozen screen reminder information.

[0118] Method 2: defrost the screen. Since the system modes of the electronic device include a simple mode and a non-simple mode, the defrost screen methods are different in different system modes. Based on the system mode of the electronic device, the defrost screen methods in the corresponding system modes are introduced.

[0119] Next, we will introduce how to release the frozen screen in simple mode.

[0120] In some embodiments, in response to the electronic device having a frozen screen in a first time period and the system mode of the electronic device being a simple mode, the electronic device can restart the target application or restart the electronic device to unfreeze the screen, thereby improving the intelligence of the electronic device and further improving the user experience. In the embodiment of the present application, the target application is the application running in the foreground on the electronic device in the first time period.

[0121] In some embodiments, the electronic device may first restart the target application, and if the restart of the target application fails, restart the electronic device. Specifically, the electronic device may obtain the application restart result after restarting the target application, and the application restart result includes the failure to restart the target application and the success to restart the target application; in response to the failure to restart the target application, restart the electronic device. In actual applications, the number of times the target application is restarted can be set as needed, and the present application does not specifically limit the number of times the target application is restarted. Optionally, the number of times the target application is restarted is once, that is, after a target application fails to restart once, the electronic device is restarted. Optionally, the number of times the target application is restarted can be at least twice. For example, if the number of times the target application is restarted is 3 times, the electronic device will restart the target application 3 times. If all 3 restarts fail, the electronic device is restarted.

[0122] In some embodiments, the electronic device may display a second window in response to the electronic device having a frozen screen and the system mode of the electronic device being a simple mode. The second window may include a second prompt message and a third prompt message. The second prompt message is used to prompt that the electronic device has a frozen screen, and the third prompt message is used to prompt an upcoming frozen screen release operation. If the display time of the second window exceeds a certain time (first time), the target application may be restarted or the electronic device may be restarted to release the frozen screen. The first time may be, for example, 3 seconds, 5 seconds, etc., and there is no specific limitation on the first time. This method is beneficial for users to learn that the electronic device has a frozen screen, and to learn that the electronic device will restart the target application or restart the electronic device, further improving the intelligence of the electronic device and improving the user experience.

[0123] For example, the second window can be Figure 4 The window 401 shown may include a text prompt message 402 (second prompt message) of "the electronic device has a frozen screen" and a text prompt message 403 (third prompt message) of "an upcoming frozen screen release operation". After displaying the window 401, the electronic device may obtain the display duration of the window 401, and restart the target application or restart the electronic device if the display duration of the window 401 exceeds 5 seconds.

[0124] Next, we will introduce how to release the frozen screen in non-simple mode.

[0125] In some embodiments, the electronic device may display a first window in response to the electronic device having a frozen screen in the first time period and the system mode of the electronic device being a non-simple mode. The first window may include a first prompt message, which prompts the electronic device whether to unfreeze the screen. After displaying the first window, the electronic device may receive a confirmation unfreeze screen operation. If the confirmation unfreeze screen operation is received, the target application may be restarted or the electronic device may be restarted. The target application is an application running in the foreground of the electronic device in the first time period. Optionally, after displaying the first window, the electronic device may also receive a confirmation unfreeze screen operation. If the confirmation unfreeze screen operation is received, the first window will no longer be displayed. It can be seen that the electronic device may remind the user that the electronic device has a frozen screen in the first time period and the system mode of the electronic device is a non-simple mode, whether to unfreeze the screen, and based on the user's confirmation unfreeze screen operation, restart the target application or restart the electronic device to unfreeze the screen, thereby improving the user's human-computer interaction experience and improving the flexibility of unfreezing the screen.

[0126] Optionally, the first window may further include a confirmation control for confirming to unfreeze the screen and a cancel control for confirming not to unfreeze the screen. The operation of confirming to unfreeze the screen may be a click operation on the confirmation control, and the operation of confirming not to unfreeze the screen may be a click operation on the cancel control.

[0127] Optionally, the electronic device may display an interactive area while displaying the first window. The interactive area may include a text input box and a voice input box. The text input box is used to obtain text instructions, and the voice input box is used to obtain voice instructions. The interactive area may be set independently of the first window, and the interactive area may also be set in the first window. The embodiments of the present application do not specifically limit this. To confirm the unfreeze screen operation, a text instruction for confirming unfreeze screen may be entered in the text input box. To confirm the non-unfreeze screen operation, a voice instruction for confirming non-unfreeze screen may be entered in the voice input box. If both the first window and the interactive area are displayed, the first window and the interactive area will no longer be displayed after the confirmation of the unfreeze screen operation is detected.

[0128] For example, the first window can be Figure 5 As shown in window 501, the interactive area can be Figure 5The interactive area 504 shown. The window 501 may include a prompt message 502 (first prompt message) of "The electronic device has a frozen screen, do you want to unfreeze the screen?", a confirmation control 503 for confirming to unfreeze the screen, and a cancel control 507 for confirming not to unfreeze the screen. The interactive area 504 includes a text input box 505 and a voice input box 506. After the prompt message 502 is output, if a click operation on the confirmation control 503, or a text instruction similar to "yes" input in the text input box 505, or a voice instruction similar to "yes" input in the voice input box 506 is obtained, the target application will be restarted or the electronic device will be restarted. If a click operation on the cancel control 507, or a text instruction similar to "no" input in the text input box 505, or a voice instruction similar to "no" input in the voice input box 506 is obtained, the window 501 and the interactive area 504 will no longer be displayed.

[0129] Optionally, the first window may also be Figure 6 The window 601 shown in the figure includes a prompt message 602 of "No response, do you want to restart the application?", a control 603 for confirming to restart the application, and a control 604 for waiting for the application to respond. In response to receiving a click operation on the control 603, the target application is restarted. In response to receiving a click operation on the control 604, the display of the first window ends. Optionally, the first window can also be a window A as shown below, which includes a prompt message of "No response, do you want to restart the machine?", a control 1 for confirming to restart the device, and a control 2 for waiting for the application to respond. If a click operation is received on the control 1, the electronic device is restarted. If a click operation is received on the control 2, the first window is no longer displayed.

[0130] In some embodiments, after restarting the target application, the electronic device can obtain the application restart result, the application restart result includes the failure to restart the target application and the success to restart the target application; in response to the failure to restart the target application, display a third window; wherein the third window includes a fourth prompt message, the fourth prompt message prompting the electronic device to restart the target application failed, whether to restart the device; in response to receiving a confirmation to restart the electronic device operation, restart the electronic device. The third window can be as follows Figure 7 The window 701 shown includes a prompt message 702 of "Failed to restart the application, do you want to restart the device", a control 703 for confirming to restart the device, and a control 704 for waiting for the application response. In response to receiving a click operation on the control 703, the electronic device is restarted, and in response to receiving a click operation on the control 704, the display of the third window ends.

[0131] In some embodiments, if the electronic device has a frozen screen during the first time period, and the system mode of the electronic device is not the simple mode, it can be determined whether the electronic device meets the setting conditions of the frozen screen release function. The frozen screen release function is used to trigger restarting the target application or restarting the electronic device when a frozen screen is detected. After the frozen screen release function is turned on, if the electronic device is subsequently monitored to have a frozen screen, the target application can be restarted or the electronic device can be restarted even if the system mode of the electronic device is not the simple mode. If the electronic device meets the setting conditions of the frozen screen release function, it can be displayed as follows Figure 8 The freeze screen release function setting window 801 includes prompt information 802 indicating whether the electronic device has a freeze screen release function and whether to turn on the freeze screen release function, a confirmation control 803, and a cancel control 804. At the same time, it can detect and confirm the operation of turning on the freeze screen release function (for example, for Figure 8 In the case of detecting a click operation of the confirmation control 803 in the middle, the freeze screen release function is enabled, and the target application is restarted or the electronic device is restarted. The operation of enabling the freeze screen release function can be detected and confirmed (for example, for Figure 8 Cancel the click operation of control 804 in the control), and when the operation of confirming the start of the frozen screen release function is detected, the frozen screen release function is turned on, and the target application or the electronic device is restarted. The setting condition of the frozen screen release function can be, for example, one of the following: (1) the first time that the electronic device is detected to have a frozen screen; (2) the time interval between the current system time and the first reference time exceeds the first time interval, the first time interval can be, for example, 10 days, 15 days, 30 days, etc., and the first time interval is not specifically limited. The first reference time is the time when the frozen screen release function was last turned off from the current system time; (3) the time interval between the current system time and the second reference time exceeds the second time interval, the second time interval can be, for example, seven days, 15 days, 30 days, etc., and the second time interval is not specifically limited. The second reference time is the time when the frozen screen release function was last turned on from the current time; (4) the number of frozen screen detections from the time when the frozen screen release function was last turned on or off to the current system time exceeds a preset number of times, for example, the preset number of times can be 3 times, 4 times, 6 times, etc., and the preset number of times is not specifically limited.

[0132] See also Fig. 9 , Fig. 9 is a flow chart of another frozen screen detection method provided in an embodiment of the present application, from Fig. 9 It can be seen that the frozen screen detection method provided in the embodiment of the present application can be summarized into three parts: the first part is how to start frozen screen detection; the second part is how to detect frozen screen; and the third part is how to unfreeze the screen.

[0133] Starting the frozen screen detection function Electronic devices can add the frozen screen detection setting option to the system function list of the electronic device. When the user needs to use the frozen screen detection function, he can turn it on in the system function list. The process of turning on the frozen screen detection function has been described in detail in the terminology description section. Please refer to the contents of that section and will not be repeated here.

[0134] 2) Perform a frozen screen test When the frozen screen detection function is turned on, the electronic device can collect and process data. Specifically, the touch data and operating parameters of the touch events within the first time period can be collected, and then the acquired data can be preprocessed to obtain preprocessed data, and the comparison algorithm can be started to extract features of the preprocessed data to obtain a first feature set, and then based on the first feature set, a prediction feature set corresponding to the first feature set is generated, and then the prediction features corresponding to each time window in the prediction feature set are compared with the reference features to obtain the abnormality scores corresponding to each time window. If there is an abnormality score greater than the threshold, that is, the frozen screen is detected, the frozen screen will be unfrozen.

[0135] 3) Unfreeze the screen The process of unfreezing the screen is to first determine whether the simple mode is turned on. If the simple mode is turned on, the target application is restarted. If the simple mode is not turned on (non-simple mode), the user will be prompted that the electronic device has a frozen screen and whether to unfreeze the screen. After receiving confirmation of the unfreezing screen operation, the target application will be restarted. Regardless of whether the simple mode is turned on or not, after restarting the target application, it can be determined whether the restart of the target application is successful. If the restart of the target application is successful, the current process ends. If the restart of the target application fails, the electronic device is restarted.

[0136] Fig.10 It is a software structure diagram of an electronic device. The software structure adopts a layered architecture, which divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. Taking the Android system, the Android system running on the AP as an example, in some embodiments, the Android system is divided into five layers, from top to bottom, namely the application layer, the application framework layer (framework), the system runtime layer, the hardware abstract layer (hard abstract layer, HAL) and the kernel layer (kernel).

[0137] The application layer may include a series of application packages. The application package may include live broadcast, camera, gallery, calendar, call, map, news, Bluetooth, music, video, setting and other APPs. In the embodiment of the present application, the electronic device provides a frozen screen detection function setting entrance and a simple mode setting entrance through the setting program, so that the user can enable the frozen screen detection function and the simple mode through the setting program.

[0138] The application layer may also include a system user interface (system UI), which is used to display the interface of the electronic device, such as displaying the signal icon corresponding to the SIM card, displaying the call interface, etc. In the embodiment of the present application, the system UI is used to display Figure 2A-2G The user interface shown, Figure 4-Figure 8 The user interface shown.

[0139] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. For example, the application framework layer may include window manager, content provider, view system, telephony manager, resource manager, notification manager, etc. The telephony manager (telephony) is used to provide call functions for electronic devices, such as management of call status (including connecting, hanging up, etc.).

[0140] The system runtime layer is divided into two parts, namely C / C++ program library and Android runtime library. C / C++ program library mainly includes multimedia library (media framework), surface manager, 3D image processing library, 2D graphics engine, etc. Android runtime library mainly includes runtime environment (Android rontime, ART), etc.

[0141] The hardware abstraction layer is used to isolate the application framework layer from the kernel layer, preventing the Android system from being overly dependent on the kernel layer, so that the application framework layer can be developed without considering the driver. The hardware abstraction layer can include multiple functional modules. For example, display HAL, camera HAL, audio HAL, sensor HAL and other modules.

[0142] The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, a sensor driver, and a shared memory driver. In the embodiment of the present application, the display driver can be used to drive the system UI to display such as Figure 2A-2G The user interface shown, Figure 4-Figure 8In the user interface shown, the sensor driver can be used to obtain touch data and operating parameters of touch events.

[0143] In addition, some embodiments of the present application provide an electronic device, which includes: one or more processors and a memory; the memory is used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the above-mentioned image processing method.

[0144] Some embodiments of the present application provide a chip system, which is applied to an electronic device, and the chip system includes at least one processor and an interface, wherein the interface is used to receive instructions and transmit them to the at least one processor; the at least one processor executes the instructions so that the electronic device executes the above-mentioned image processing method. The chip system may be a modem processor, or a system on chip (SOC) including a modem processor, and the above-mentioned image processing method may be implemented by a modem processor.

[0145] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0146] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0147] In the several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the above-mentioned units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0148] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0149] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0150] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to perform all or part of the steps of the above-mentioned methods in each embodiment of the present application. Among them, the aforementioned storage medium may include: U disk, mobile hard disk, magnetic disk, optical disk, read-only memory (ROM) or random access memory (RAM) and other media that can store program codes.

[0151] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

[0152] like Fig.11As shown, the electronic device may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0153] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processor (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0154] NPU is a neural network computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. NPU can realize applications such as intelligent cognition of electronic devices, such as image recognition, face recognition, voice recognition, text understanding, etc. In this application, NPU can be used to build a frozen screen detection model.

[0155] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0156] The electronic device implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0157] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0158] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0159] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to electronic devices. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0160] The wireless communication module 160 can provide wireless communication solutions for electronic devices, including wireless local area networks (WLAN) (such as WiFi networks), Bluetooth (BT), BLE broadcasting, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0161] The electronic device implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0162] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (AMOLED), a flexible light emitting diode (FLED), Miniled, MicroLed, MicrooLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device may include 1 or N display screens 194, where N is a positive integer greater than 1. In the embodiment of the present application, the display screen 194 can be used to display, for example, Figure 2A-2G The user interface shown, Figure 4-Figure 8 The user interface shown.

[0163] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be arranged on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". Visual output related to touch operations can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be arranged on the surface of the electronic device, which is different from the position of the display screen 194. In an embodiment of the present application, the touch sensor 180K is used to detect touch events acting on or near it. The touch sensor 180K can pass the detected touch events to the application processor to determine the touch event type, touch frequency, touch movement distance, etc.

[0164] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0165] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in this application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk), etc.

[0166] It should be noted that, for the above-mentioned various method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

[0167] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0168] The modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0169] A person of ordinary skill in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by instructing the relevant hardware through a program, and the program may be stored in a computer-readable storage medium, which may include a flash drive, ROM, RAM, a magnetic disk or an optical disk, etc.

[0170] The above disclosure is only a preferred embodiment of the present application, which is only a part of the embodiments of the present application and cannot be used to limit the scope of rights of the present application.

Claims

1. A frozen screen detection method, characterized in that: The method is applied to an electronic device, and the method comprises: In response to the freeze screen detection function being in an on state, acquiring touch data and operating parameters of touch events within a first time period; Determine a first feature set based on the touch data and operating parameters of the touch event, the first feature set comprising touch statistical features corresponding to each time window in at least one time window, the touch statistical features indicating time-dependent covariates and time-independent covariates in the corresponding time window; the first time period includes the at least one time window; Based on the first feature set, generating a prediction feature set corresponding to the first feature set; the prediction feature set includes prediction features corresponding to each time window; A frozen screen detection result is generated based on the loss parameters corresponding to the prediction features corresponding to the respective time windows; the frozen screen detection result indicates whether the electronic device has a frozen screen within the first time period.

2. The method according to claim 1, characterized in that The time-dependent covariates include one or more of the following: touch frequency, average touch movement distance, average CPU usage, memory growth rate, and screen refresh rate change value; The non-time-dependent covariates include one or more of the following: screen touch sensitivity, application type, and network status.

3. The method according to claim 2, characterized in that The touch data includes one or more of the following: timestamp, event type, touch start coordinates, touch end coordinates, and touch moving distance; The operating parameters include one or more of the following: CPU usage, memory usage, screen refresh rate, screen touch sensitivity, network status, and application type.

4. The method according to claim 1, characterized in that: The generating, based on the first feature set, a prediction feature set corresponding to the first feature set includes: Determining a first input feature set based on the time-dependent covariates corresponding to the respective time windows, and determining a second input feature set based on the time-independent covariates corresponding to the respective time windows; Based on the first input feature set and the second input feature set, a prediction feature set corresponding to the first feature set is determined.

5. The method according to claim 1, characterized in that The generating the frozen screen detection result based on the loss parameter corresponding to the prediction feature corresponding to each time window includes: Comparing the prediction features corresponding to each time window with the reference features respectively, to obtain an abnormality score corresponding to each time window, the abnormality score indicating the degree of difference between the prediction features in the corresponding time window and the reference features; A frozen screen detection result is generated based on the abnormality scores corresponding to the respective time windows.

6. The method according to claim 5, characterized in that The generating a frozen screen detection result based on the abnormality scores corresponding to each time window includes: In response to the presence of an abnormality score greater than a threshold, generating a frozen screen detection result, wherein the frozen screen detection result indicates that the electronic device has a frozen screen during the first time period; or, In response to the absence of an abnormality score greater than a threshold, a frozen screen detection result is generated, wherein the frozen screen detection result indicates that the electronic device does not have a frozen screen during the first time period.

7. The method according to claim 1, characterized in that The generating, based on the first feature set, a prediction feature set corresponding to the first feature set includes: The first feature set is input into a feature processing module in a frozen screen detection model to obtain a prediction feature set corresponding to the first feature set output by the feature processing module.

8. The method according to claim 1, characterized in that The generating the frozen screen detection result based on the loss parameter corresponding to the prediction feature corresponding to each time window includes: Inputting the prediction features corresponding to the respective time windows into a prediction module in the freezing screen detection model, and obtaining loss parameters corresponding to the prediction features corresponding to the respective time windows output by the prediction module; The loss parameters corresponding to the prediction features corresponding to the respective time windows are input into the frozen screen analysis module in the frozen screen detection model to obtain the frozen screen detection result output by the frozen screen analysis module.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: In response to the screen being frozen on the electronic device within the first time period and the system mode of the electronic device being the simple mode, restarting the target application or restarting the electronic device; wherein the target application is the application running in the foreground on the electronic device within the first time period.

10. The method according to any one of claims 1 to 8, characterized in that The method further comprises: In response to the electronic device having a frozen screen within the first time period and the system mode of the electronic device being a non-simple mode, displaying a first window; wherein the first window includes a first prompt message, the first prompt message prompting the electronic device having a frozen screen and whether to unfreeze the screen; In response to receiving a confirmation to unfreeze the screen, restarting the target application or restarting the electronic device; wherein the target application is an application running in the foreground on the electronic device during the first time period.

11. An electronic device comprising a memory, one or more processors, a plurality of applications, and one or more programs; wherein: The one or more programs are stored in the memory; it is characterized in that when the one or more processors execute the one or more programs, the electronic device implements the method as described in any one of claims 1-10.

12. A chip system, characterized in that: The chip system includes at least one processor, a memory and an interface circuit, the memory, the interface circuit and the at least one processor are interconnected by lines, and program instructions are stored in the at least one memory; when the program instructions are executed by the processor, the chip system executes the method as described in any one of claims 1-10.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

Images