Abnormal detection and recovery method, system and equipment for user interface and storage medium

Abstract

The invention provides a user interface anomaly detection and recovery method and system, equipment and a storage medium, and the anomaly detection method comprises the steps: building a virtual screen matched with an actual screen in the equipment, and building a plurality of first to-be-displayed interfaces associated with a current display interface in the actual screen in the virtual screen in advance; the plurality of first to-be-displayed interfaces are arranged by taking the same set position as a reference, responding to a user interface switching instruction, and determining whether the switched current display interface in the actual screen is abnormal or not based on the current display interface, the plurality of first to-be-displayed interfaces and the virtual screen. The method has the advantages of being accurate in anomaly detection, high in compatibility, good in expandability and the like while the efficient performance is guaranteed, real-time monitoring and recovery of the user interface can be achieved by introducing the virtual screen concept and simple coordinate judgment, and the quality of the user interface and the user experience are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a method, system, device and storage medium for detecting and recovering anomalies of a user interface. Background Art

[0002] In embedded devices, the UI (user interface) is the key interface for users to interact with the device. However, due to UI engine failure or operating system abnormalities, various abnormalities may occur in the UI interface, such as interface overlap, incomplete display, etc. These abnormalities will prevent users from operating the device normally and affect user experience and system stability.

[0003] Currently, most of the methods used in the market to deal with this type of problem are several methods, such as anomaly detection based on image processing, anomaly detection based on user feedback, anomaly detection based on log analysis, etc. These methods have several limitations. For example, image processing and analysis require a large amount of system resources, while resources in embedded devices are very precious and limited, and it is almost impossible to provide additional system resources for this method. Therefore, the method based on image processing and analysis is not suitable for embedded devices with limited resources; and the response methods of other methods are mostly based on passive detection, and they will only be changed after user feedback, that is, human intervention is required to discover the problem and then modify it, and it is impossible to avoid it in real time, which seriously affects the user experience. Summary of the invention

[0004] The technical problem to be solved by the present invention is to overcome the defects of the prior art in that the resource consumption is large and the abnormal display of the user interface cannot be automatically identified and restored. The purpose is to provide a solution for real-time monitoring and recovery of the user interface with high performance so as to automatically identify and restore the abnormal display of the user interface. Specifically, a method, system, device and storage medium for detecting and recovering abnormalities of the user interface are provided.

[0005] The present invention solves the above technical problems through the following technical solutions:

[0006] According to a first aspect of the present disclosure, a method for detecting anomalies in a user interface is provided, the method comprising:

[0007] Create a matching virtual screen based on the actual screen in the device;

[0008] Pre-constructing a plurality of first interfaces to be displayed in the virtual screen;

[0009] Wherein, the first interface to be displayed is associated with the current display interface in the actual screen, and a plurality of the first interfaces to be displayed are arranged based on the same set position;

[0010] In response to a user interface switching instruction, based on the current display interface, the first interfaces to be displayed, and the virtual screen, it is determined whether there is an abnormality in the current display interface after switching in the actual screen.

[0011] Preferably, the step of responding to the user interface switching instruction includes:

[0012] Based on the currently displayed interface, determining one of the plurality of first to-be-displayed interfaces as an interface to be transmitted;

[0013] In response to the user interface switching instruction, the current display interface before the switching is moved to the virtual screen, and the interface to be transmitted is moved to the actual screen, so as to update the current display interface after the switching.

[0014] Preferably, the step of moving the interface to be transmitted to the actual screen to update the currently displayed interface after switching includes:

[0015] Rendering the interface to be transmitted to obtain the rendered interface to be transmitted;

[0016] The rendered interface to be transmitted is moved to the actual screen to obtain a new current display interface.

[0017] Preferably, the step of determining whether there is an abnormality in the current display interface after switching in the actual screen based on the current display interface, the first interfaces to be displayed, and the virtual screen includes:

[0018] Acquire the first coordinate of the current display interface after the switching;

[0019] Determining whether the first coordinate is a preset coordinate;

[0020] If the first coordinates are preset coordinates, determining that the current display interface after switching in the actual screen is displayed normally;

[0021] Otherwise, determining that the current display interface after switching in the actual screen has a first abnormal display;

[0022] and / or,

[0023] Moving the current display interface before switching to the virtual screen as the second interface to be displayed;

[0024] Acquire the second coordinates of the second interface to be displayed;

[0025] Determining whether the second coordinate is within a preset coordinate range;

[0026] If the second coordinate is within the preset coordinate range, determining that the current display interface after switching in the actual screen is displayed normally;

[0027] Otherwise, it is determined that the current display interface after switching in the actual screen has a second abnormal display.

[0028] Preferably, the first coordinate is the coordinate information of the position of the upper left corner of the current display interface after switching;

[0029] The preset coordinates are the coordinate information of the position of the upper left corner of the actual screen;

[0030] and / or,

[0031] The second coordinates are coordinate information of the position of the upper left corner of the second interface to be displayed;

[0032] The preset coordinate range is the left edge coordinate range of the virtual screen.

[0033] Preferably, the first abnormality is displayed as the current display interface after switching is incomplete;

[0034] The second abnormal display is that the current display interface after switching displays overlap.

[0035] According to a second aspect of the present disclosure, a method for recovering from an abnormality of a user interface is provided, the method comprising:

[0036] When the abnormality detection method described in the first aspect of the present disclosure detects that the current display interface after switching in the actual screen has an abnormality, the current display interface after switching is moved to a preset position in the actual screen until the current display interface after switching is displayed normally;

[0037] and / or,

[0038] The current display interface before switching is used as the second interface to be displayed, and the second interface to be displayed is moved to a set position in the virtual screen until the current display interface after switching is displayed normally.

[0039] According to a third aspect of the present disclosure, there is provided a user interface anomaly detection system, the anomaly detection system comprising a creation module, a construction module and a user interface switching module;

[0040] The creation module is used to create a matching virtual screen based on the actual screen in the device;

[0041] The construction module is used to construct a plurality of first interfaces to be displayed in the virtual screen in advance;

[0042] Wherein, the first interface to be displayed is associated with the current display interface in the actual screen, and a plurality of the first interfaces to be displayed are arranged based on the same set position;

[0043] The user interface switching module is used to respond to a user interface switching instruction, and determine whether there is an abnormality in the current display interface after switching in the actual screen based on the current display interface, the first interfaces to be displayed, and the virtual screen.

[0044] According to a fourth aspect of the present disclosure, a user interface abnormality recovery system is provided, the abnormality recovery system comprising an abnormality recovery module and the abnormality detection system according to the third aspect of the present disclosure;

[0045] The abnormality recovery module is used to move the switched current display interface to a preset position in the actual screen when the abnormality detection system detects that the switched current display interface in the actual screen has an abnormality, until the switched current display interface is displayed normally;

[0046] and / or,

[0047] The current display interface before switching is used as the second interface to be displayed, and the second interface to be displayed is moved to a set position in the virtual screen until the current display interface after switching is displayed normally.

[0048] According to a fifth aspect of the present disclosure, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the anomaly detection method described in the first aspect of the present disclosure and / or the anomaly recovery method described in the second aspect of the present disclosure are implemented.

[0049] According to a sixth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the anomaly detection method described in the first aspect of the present disclosure and / or the anomaly recovery method described in the second aspect of the present disclosure are implemented.

[0050] On the basis of being in accordance with the common sense in the art, the above-mentioned preferred conditions can be arbitrarily combined to obtain the preferred embodiments of the present disclosure.

[0051] The positive and progressive effects of the present disclosure are: by adding a virtual screen space and determining whether the active area of ​​the user interface is abnormal through simple coordinate judgment, it is possible to detect incomplete or overlapping user interface display in real time with high precision, and restore the user interface to ensure the smoothness and response speed of user operation and improve user experience. In addition, the technical solution of the present disclosure can be compatible, integrated, and applied with any user interface framework, without the need to modify the original user interface framework code, and can be customized and expanded according to specific needs to adapt to the user interface management needs of different platforms and devices, without the need for additional development work, reducing the difficulty and cost of implementation, and providing a good foundation for subsequent user interface optimization and improvement. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 is a flow chart of the anomaly detection method in Embodiment 1 of the present disclosure;

[0053] Figure 2 This is a schematic diagram of the user interface structure in Embodiment 1 of the present disclosure;

[0054] Figure 3 This is a first schematic diagram of an abnormal structure of a user interface in Embodiment 1 of the present disclosure;

[0055] Figure 4 This is a second schematic diagram of the abnormal structure of the user interface in Embodiment 1 of the present disclosure;

[0056] Figure 5 This is a flow chart of the abnormal recovery method in Embodiment 2 of the present disclosure;

[0057] Figure 6 This is a module diagram of an anomaly detection system in Embodiment 3 of the present disclosure;

[0058] Figure 7 This is a module diagram of the abnormal recovery system in Example 4 of the present disclosure. DETAILED DESCRIPTION

[0059] The present disclosure is further described below by way of examples, but the present disclosure is not limited to the scope of the examples.

[0060] Currently, the abnormal recovery of user interfaces on the market consumes too much resources, and most of the response methods are passive, which cannot be avoided in real time. Human intervention is required to discover the problem and then modify it. It is impossible to automatically identify and restore abnormal display of user interfaces.

[0061] In view of this, the present disclosure provides a method, system, device and storage medium for detecting and recovering an abnormality of a user interface to solve the problem that a solution for high-performance real-time monitoring and recovery of the user interface to automatically identify and avoid abnormal display of the user interface cannot automatically identify and recover abnormal display of the user interface.

[0062] Example 1

[0063] In a specific embodiment of the present disclosure, a method for detecting abnormalities in a user interface is provided. Figure 1 As shown, the anomaly detection method includes:

[0064] S1. Create a matching virtual screen based on the actual screen in the device;

[0065] S2, constructing a plurality of first interfaces to be displayed in the virtual screen in advance;

[0066] Wherein, the first interface to be displayed is associated with the current display interface in the actual screen, and a plurality of the first interfaces to be displayed are arranged based on the same set position;

[0067] S3. In response to a user interface switching instruction, based on the current display interface, the first interfaces to be displayed, and the virtual screen, determine whether there is an abnormality in the current display interface after switching in the actual screen.

[0068] Specifically, the prior art generally uses a user interface overlay method to implement page switching, but this method easily leads to abnormal situations such as incomplete display or overlap of pages, and is not conducive to abnormal detection of user interfaces. Figure 2 , this embodiment creates a virtual screen that matches the actual screen. For example, a graphics library or an interface framework can be used to create the virtual screen, wherein the size of the virtual screen is exactly the same as the actual screen. Then, a currently displayed user interface (i.e., UI interface) is created in the actual screen. The user interface includes various user interaction elements and graphic components. For example, buttons, text boxes, icons, etc. can be used to build the user interface. Several first interfaces to be displayed are created in the virtual screen, and the several first interfaces to be displayed are arranged based on the same set position. For example, the upper left corner coordinates of several first interfaces to be displayed are consistent with the upper left corner coordinates of the virtual screen, wherein the first interface to be displayed is an interface associated with the currently displayed user interface. In a specific application, several first interfaces to be displayed in the virtual screen can be prepared in advance, or the first interfaces to be displayed associated with the current display interface can be dynamically generated in the virtual screen at runtime to prepare for subsequent page switching jumps.

[0069] When a user interface switching instruction is obtained, indicating that the user switches the user interface to be displayed, the currently displayed user interface is first moved to the virtual screen, that is, the position of the currently displayed interface is set to the position of the virtual screen, and the current interface is hidden. At the same time, the first interface to be displayed in the virtual screen is moved to the actual screen. This ensures that there is only the current display interface in the actual screen and no other user interfaces. Then, by detecting the current display interface, several of the first interfaces to be displayed, and the virtual screen, it is possible to quickly detect whether there is a display abnormality in the current display interface in the actual screen.

[0070] In this embodiment, by adding a virtual screen space, the first interface to be displayed is pre-set or dynamically generated in the virtual screen space. When the user interface is switched, the first interface to be displayed can be quickly moved to the actual screen for display without waiting for the generation of the interface to be displayed, thereby improving the interface switching efficiency and further improving the user experience.

[0071] In a specific implementation, the step of responding to the user interface switching instruction includes:

[0072] Based on the currently displayed interface, determining one of the plurality of first to-be-displayed interfaces as an interface to be transmitted;

[0073] In response to the user interface switching instruction, the current display interface before the switching is moved to the virtual screen, and the interface to be transmitted is moved to the actual screen, so as to update the current display interface after the switching.

[0074] Specifically, the current display interface usually provides multiple function selection areas, allowing users to make selections based on their own functional needs. Different functions correspond to different user interfaces. When switching user interfaces, it is necessary to switch to the user interface corresponding to the function selected by the user.

[0075] For example, the current display interface has three function selection areas A, B, and C, and their corresponding jump user interfaces are a, b, and c, among which the three user interfaces a, b, and c have been pre-set or dynamically generated in the virtual screen. In response to the user's selection of function A, user interface a is determined as the interface to be transmitted from several interfaces to be displayed. In response to the user interface switching instruction (for example, after selecting function A, clicking the OK button), the current display interface is moved to the virtual screen for hiding, and user interface a is moved to the actual screen for display as the current display interface.

[0076] In one implementable method, when the user selects a corresponding function, that is, it is determined that the user needs to switch the user interface (for example, clicking on a function in a smart device, that is, determining that the user needs to switch the selected function), then in response to the user's user interface switching instruction for function A, user interface a is determined as the interface to be transmitted from several interfaces to be displayed, the currently displayed interface is moved to a virtual screen for hiding, and user interface a is moved to the actual screen for display as the currently displayed interface.

[0077] In a specific implementation, the step of moving the interface to be transmitted to the actual screen to update the currently displayed interface after switching includes:

[0078] Rendering the interface to be transmitted to obtain the rendered interface to be transmitted;

[0079] The rendered interface to be transmitted is moved to the actual screen to obtain a new current display interface.

[0080] Specifically, after determining the user interface to be transmitted, the interface to be transmitted is rendered, and then the rendered interface to be transmitted is moved to the actual screen for display, so that the user can see the new interface. Thus, while ensuring the user experience, the space occupied by the virtual screen is reduced and the running speed is improved.

[0081] In an implementable manner, the interface to be transmitted may be moved to the actual screen and then rendered, or the interface to be transmitted may be rendered during the moving process, which is not specifically limited in this embodiment.

[0082] In a specific implementation, the step of determining whether there is an abnormality in the current display interface after switching in the actual screen based on the current display interface, the first interfaces to be displayed, and the virtual screen includes:

[0083] Acquire the first coordinate of the current display interface after the switching;

[0084] Determining whether the first coordinate is a preset coordinate;

[0085] If the first coordinates are preset coordinates, determining that the current display interface after switching in the actual screen is displayed normally;

[0086] Otherwise, determining that the current display interface after switching in the actual screen has a first abnormal display;

[0087] Moving the current display interface before switching to the virtual screen as the second interface to be displayed;

[0088] Acquire the second coordinates of the second interface to be displayed;

[0089] Determining whether the second coordinate is within a preset coordinate range;

[0090] If the second coordinate is within the preset coordinate range, determining that the current display interface after switching in the actual screen is displayed normally;

[0091] Otherwise, it is determined that the current display interface after switching in the actual screen has a second abnormal display.

[0092] Wherein, the first abnormal display is that the current display interface after switching is not fully displayed;

[0093] The second abnormal display is that the current display interface after switching displays overlap.

[0094] For details, see Figure 3 and Figure 4 During the process of switching user interfaces, for example, when switching user interface a to user interface b, user interface b may not be fully displayed on the actual screen, or user interface a may not be fully hidden, so that user interface a is partially displayed on the actual screen, resulting in an abnormal situation in which user interface b overlaps with user interface a.

[0095] Based on this, this embodiment obtains the first coordinates of the current display interface and compares them with the preset coordinates. For example, the midpoint coordinates of the actual screen are used as the preset coordinates, and the midpoint coordinates of the user interface b are obtained and compared with the preset coordinates. If the midpoint coordinates of the user interface b are different from the preset coordinates, it can be determined that there is a display abnormality in the user interface b.

[0096] This embodiment also compares the second coordinate with the preset coordinate range. For example, if the virtual screen is set on the left side of the actual screen, a vertical line is drawn along the middle point of the upper and lower edges of the virtual screen, and the range to the left of the vertical line is used as the preset coordinate range. By obtaining the coordinates of the middle point of the user interface a, it is determined whether the coordinates of the middle point of the user interface are within the preset coordinate range. If they are not within the preset coordinate range, that is, the middle point coordinates are on the left side of the vertical line, then it can be determined that part of the interface on the right side of user interface a appears on the actual screen, so that the user interface display of the actual screen is abnormal.

[0097] The above is only an example. The specific preset coordinate settings (such as coordinate position, number of coordinates, etc.) and preset coordinate range settings can be limited according to the actual application scenario, as long as the coordinates of the current display interface and the coordinates of the interface to be displayed can be used to determine whether there is any display abnormality in the current display interface on the actual screen.

[0098] In a specific practicable manner, the first coordinate is the coordinate information of the position of the upper left corner of the current display interface after switching;

[0099] The preset coordinates are the coordinate information of the position of the upper left corner of the actual screen;

[0100] The second coordinates are coordinate information of the position of the upper left corner of the second interface to be displayed;

[0101] The preset coordinate range is the left edge coordinate range of the virtual screen.

[0102] In actual applications, most screens are quadrilaterals, and their user interfaces are also quadrilaterals. Therefore, the coordinates of the upper left corner of the actual screen can be used as the preset coordinates. The coordinates of the upper left corner of the user interface b are obtained and compared with the preset coordinates. The left side of the virtual screen is used as the preset coordinate range. The coordinates of the upper left corner of the user interface a are obtained and compared with the preset coordinate range to determine whether there is any abnormality in the current display interface.

[0103] In this specific implementation, the virtual screen is a hidden screen, and as long as the coordinates of the upper left corner of the user interface a are on the left side of the virtual screen, the user interface a can be completely hidden, without ensuring that the user interface a is completely in the virtual screen, that is, whether the coordinates of the upper left corner of the user interface a are consistent with the coordinates of the upper left corner of the virtual screen does not affect the normal display of the current display interface. Of course, if the preset coordinate range is set to the coordinates of the upper left corner of the virtual screen, it is also possible to compare the coordinates of the upper left corner of the user interface a with the coordinates of the upper left corner of the virtual screen (-width, 0) to determine whether there is an abnormality in the current display interface.

[0104] In this specific implementation method, by monitoring whether the coordinates of the upper left corner of the currently displayed user interface are within the actual screen, if it is detected that the coordinates of the upper left corner of the currently displayed interface are not within the actual screen, it indicates that an abnormal situation of incomplete display of the user interface has occurred. Similarly, by monitoring the position of the user interface within the virtual screen, if it is found that the coordinates of the upper left corner of the user interface to be displayed are not (-width, 0), it indicates that an abnormal situation of overlapping display of the user interface has occurred.

[0105] In this embodiment, by adding a virtual screen space and obtaining the first coordinates of the current display interface in the actual screen and the second coordinates of the interface to be displayed in the virtual screen and the corresponding preset coordinates to perform a simple coordinate judgment, it is determined whether the active area of ​​the user interface is abnormal, and the incomplete or overlapping display of the user interface can be detected in real time with high precision. Moreover, it can be compatible, integrated, and applied with any user interface framework, without modifying the original user interface framework code, and can be customized and expanded according to specific needs to adapt to the user interface management needs of different platforms and devices. No additional development work is required, which reduces the difficulty and cost of implementation and provides a good foundation for subsequent user interface optimization and improvement.

[0106] Example 2

[0107] In another specific embodiment of the present disclosure, Figure 5 As shown, a method for recovering from an abnormality of a user interface is provided, and the method for recovering from an abnormality of a user interface includes:

[0108] S4. When the abnormality detection method described in Example 1 detects that the current display interface after switching in the actual screen is abnormal, the current display interface after switching is moved to a preset position in the actual screen until the current display interface after switching is displayed normally;

[0109] The current display interface before switching is used as the second interface to be displayed, and the second interface to be displayed is moved to a set position in the virtual screen until the current display interface after switching is displayed normally.

[0110] Specifically, when it is detected that the current display interface after switching in the actual screen has an abnormal situation of incomplete display, that is, the first coordinate of the current display interface is different from the preset coordinate, at this time, the current display interface is moved to the actual screen to ensure its complete display, that is, the position of the current display interface is adjusted to the position of the actual screen. For example, when it is detected that the upper left corner coordinates of the user interface b are different from the upper left corner coordinates of the actual screen, it can be determined that the user interface b has an abnormal situation of incomplete display. At this time, moving the upper left corner coordinates of the user interface b to the upper left corner coordinates of the actual screen can make the user interface b fully displayed.

[0111] Similarly, when an abnormal situation of overlapping user interface displays occurs, the user interface to be displayed is forced to be moved to the virtual screen. This can avoid overlap between interfaces. For example, when the coordinates of the upper left corner of user interface a are not within the left edge range of the virtual screen, it can be determined that user interface a is partially displayed on the actual screen, resulting in an abnormal situation of overlapping display of user interface b. At this time, the coordinates of the upper left corner of user interface a are moved to the virtual screen, and the coordinates of the upper left corner are kept at (-width, 0), which can ensure that user interface b is displayed normally.

[0112] In a specific implementable method, when there are abnormal situations of incomplete user interface display and display overlap at the same time, the first coordinates of the current display interface after switching are moved to a preset position in the actual screen, and the second coordinates of the current display interface before switching are moved to a set position in the virtual screen, so that the current display interface after switching can be displayed normally.

[0113] In this embodiment, by creating a virtual screen, managing and switching the user interface to be displayed, and monitoring and solving the abnormal situation of incomplete display and overlapping of the user interface, the normal display of the user interface can be ensured and the user experience can be improved. In addition, while ensuring high efficiency, this embodiment has rich advantages such as accurate abnormality detection, strong compatibility and good scalability. By introducing the concept of virtual screen and simple coordinate judgment, real-time monitoring and recovery of the UI interface can be achieved, improving the quality of the user interface and user experience.

[0114] Since the present invention only needs to add a new virtual screen space, its resource consumption is extremely small and will not have a significant impact on system performance. At the same time, through simple coordinate judgment, the UI interface can be monitored and restored in real time to ensure the smoothness and response speed of user operations.

[0115] The present disclosure uses coordinates to determine whether the active area of ​​the UI interface is abnormal, and can detect incomplete or overlapping displays with high accuracy. This accurate abnormality detection can quickly attract the attention of developers, and take timely measures to solve the problem and improve the user experience.

[0116] Since the present disclosure does not require modification of the original UI framework code, it is compatible with any UI framework. Whether it is based on a traditional graphics library or a modern interface framework, the present disclosure can be easily integrated and applied without additional development work, thus reducing implementation difficulty and cost.

[0117] The present invention is easy to implement and promote, and has scalability. It can be customized and expanded according to specific needs to adapt to the UI interface management needs of different platforms and devices. At the same time, the concept of virtual screen also provides a good foundation for subsequent UI interface optimization and improvement.

[0118] Example 3

[0119] In a specific embodiment, a user interface anomaly detection system is also provided. Figure 6 As shown, the anomaly detection system includes a creation module 100, a construction module 200 and a user interface switching module 300;

[0120] The creation module 100 is used to create a matching virtual screen based on the actual screen in the device;

[0121] The construction module 200 is used to construct a plurality of first interfaces to be displayed in the virtual screen in advance;

[0122] Wherein, the first interface to be displayed is associated with the current display interface in the actual screen, and a plurality of the first interfaces to be displayed are arranged based on the same set position;

[0123] The user interface switching module 300 is used to respond to a user interface switching instruction, and determine whether there is an abnormality in the current display interface after switching in the actual screen based on the current display interface, the first interfaces to be displayed, and the virtual screen.

[0124] In a specific implementation, the user interface switching module 300 is further used to determine, based on the current display interface, one of the first to-be-displayed interfaces as the to-be-transmitted interface;

[0125] In response to the user interface switching instruction, the current display interface before the switching is moved to the virtual screen, and the interface to be transmitted is moved to the actual screen, so as to update the current display interface after the switching.

[0126] In a specific implementation, the user interface switching module 300 is further used to render the interface to be transmitted to obtain the rendered interface to be transmitted;

[0127] The rendered interface to be transmitted is moved to the actual screen to obtain a new current display interface.

[0128] In a specific implementation, the user interface switching module 300 is further used to obtain the first coordinate of the current display interface after the switching;

[0129] Determining whether the first coordinate is a preset coordinate;

[0130] If the first coordinates are preset coordinates, determining that the current display interface after switching in the actual screen is displayed normally;

[0131] Otherwise, determining that the current display interface after switching in the actual screen has a first abnormal display;

[0132] Moving the current display interface before switching to the virtual screen as the second interface to be displayed;

[0133] Acquire the second coordinates of the second interface to be displayed;

[0134] Determining whether the second coordinate is within a preset coordinate range;

[0135] If the second coordinate is within the preset coordinate range, determining that the current display interface after switching in the actual screen is displayed normally;

[0136] Otherwise, it is determined that the current display interface after switching in the actual screen has a second abnormal display.

[0137] In a specific implementation, the first coordinate is the coordinate information of the position of the upper left corner of the current display interface after switching;

[0138] The preset coordinates are the coordinate information of the position of the upper left corner of the actual screen;

[0139] The second coordinates are coordinate information of the position of the upper left corner of the second interface to be displayed;

[0140] The preset coordinate range is the left edge coordinate range of the virtual screen.

[0141] In a specific implementation, the first abnormality is displayed as the current display interface after switching is incomplete;

[0142] The second abnormal display is that the current display interface after switching displays overlap.

[0143] It should be noted that the working principle of the user interface anomaly detection system in this embodiment is the same as the working principle of the user interface anomaly detection method in Example 1, so it will not be repeated here.

[0144] In this embodiment, by adding a virtual screen space, and obtaining the first coordinates of the current display interface in the actual screen and the second coordinates of the interface to be displayed in the virtual screen through the user interface switching module and performing simple coordinate judgment with the corresponding preset coordinates, it is determined whether the active area of ​​the user interface is abnormal, and the incomplete or overlapping display of the user interface can be detected in real time with high precision. Moreover, it can be compatible, integrated, and applied with any user interface framework, without modifying the original user interface framework code, and can be customized and expanded according to specific needs to adapt to the user interface management needs of different platforms and devices, without additional development work, reducing the difficulty and cost of implementation, and providing a good foundation for subsequent user interface optimization and improvement.

[0145] Example 4

[0146] In a specific embodiment, a user interface abnormality recovery system is also provided. Figure 7 As shown, the abnormality recovery system includes an abnormality recovery module 400 and the abnormality detection system described in Example 3;

[0147] The abnormality recovery module 400 is used to move the switched current display interface to a preset position in the actual screen when the abnormality detection system detects that the switched current display interface in the actual screen has an abnormality, until the switched current display interface is displayed normally;

[0148] The current display interface before switching is used as the second interface to be displayed, and the second interface to be displayed is moved to a set position in the virtual screen until the current display interface after switching is displayed normally.

[0149] It should be noted that the working principle of the user interface abnormality recovery system in this embodiment is the same as the working principle of the user interface abnormality recovery method in Example 2, so it will not be repeated here.

[0150] In this embodiment, the user interface to be displayed is managed and switched through the abnormal recovery module, and the abnormal situations of incomplete display and overlap of the user interface are monitored and resolved, so that the normal display of the user interface can be ensured and the user experience can be improved. Moreover, while ensuring high efficiency, this embodiment has rich advantages such as accurate abnormality detection, strong compatibility and good scalability. By introducing the concept of virtual screen and simple coordinate judgment, real-time monitoring and recovery of the UI interface can be achieved, and the quality of the user interface and the user experience can be improved.

[0151] Example 5

[0152] In a specific embodiment, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the anomaly detection method described in Embodiment 1 of the present disclosure and / or the anomaly recovery method described in Embodiment 2 of the present disclosure are implemented.

[0153] In one practicable manner, the electronic device may be an embedded device.

[0154] For general embedded device UI interface abnormality recovery, most of them adopt human feedback recovery, that is, users passively repair the problem after discovering it. This method has a long response cycle and slow recovery. There are also image recognition methods for detection and recovery, which consumes a lot of resources and is not suitable for application in resource-scarce embedded devices.

[0155] In this embodiment, a virtual screen space is added to the embedded device to store the UI interface in split screen, the position of each interface element is accurately monitored in real time, and the coordinates of the UI interface are judged to determine whether it is displayed normally on the screen, and any abnormal situation is discovered in time. Once the coordinates of the UI interface are found to be abnormal, the system will immediately respond and restore the correct position of the UI interface, thereby ensuring that the user can operate and use the application normally, avoiding problems such as incomplete display and overlap of the UI interface, which can achieve real-time performance and greatly reduce resource consumption, ensuring the stability and integrity of the user interface.

[0156] In this embodiment, through simple coordinate judgment, it is determined whether the active area of ​​the user interface is abnormal, and the incomplete or overlapping display of the user interface can be detected in real time with high precision and in real time, and the user interface can be restored to ensure the smoothness and response speed of user operations and improve user experience. It can also be compatible, integrated, and applied with any user interface framework without modifying the original user interface framework code. It can be customized and expanded according to specific needs to adapt to the user interface management needs of different platforms and devices without additional development work, reducing the difficulty and cost of implementation, and providing a good foundation for subsequent user interface optimization and improvement.

[0157] Example 6

[0158] In a specific embodiment, a computer-readable storage medium is also provided, on which a computer program is stored. When the computer program is executed by a processor, the anomaly detection method described in Example 1 of the present disclosure and / or the anomaly recovery method described in Example 2 of the present disclosure are implemented.

[0159] In this embodiment, by adding a new virtual screen space in the computer-readable storage medium and determining whether the active area of ​​the user interface is abnormal through simple coordinate judgment, it is possible to detect incomplete or overlapping user interface display with high precision and in real time, and restore the user interface to ensure the smoothness and response speed of user operations and improve user experience. It can also be compatible, integrated, and applied with any user interface framework without modifying the original user interface framework code, and can be customized and expanded according to specific needs to adapt to the user interface management requirements of different platforms and devices without requiring additional development work, thereby reducing the difficulty and cost of implementation and providing a good foundation for subsequent user interface optimization and improvement.

[0160] Although the specific embodiments of the present disclosure are described above, those skilled in the art should understand that this is only an example, and the protection scope of the present disclosure is defined by the appended claims. Those skilled in the art may make various changes or modifications to these embodiments without departing from the principles and essence of the present disclosure, but these changes and modifications all fall within the protection scope of the present disclosure.

Claims

1. A method for detecting abnormality in a user interface, characterized in that: The anomaly detection method comprises: Create a matching virtual screen based on the actual screen in the device; Pre-constructing a plurality of first interfaces to be displayed in the virtual screen; Wherein, the first interface to be displayed is associated with the current display interface in the actual screen, and a plurality of the first interfaces to be displayed are arranged based on the same set position; In response to a user interface switching instruction, based on the current display interface, the first interfaces to be displayed, and the virtual screen, it is determined whether there is an abnormality in the current display interface after switching in the actual screen.

2. The anomaly detection method according to claim 1, characterized in that: The step of responding to the user interface switching instruction includes: Based on the currently displayed interface, determining one of the plurality of first to-be-displayed interfaces as an interface to be transmitted; In response to the user interface switching instruction, the current display interface before the switching is moved to the virtual screen, and the interface to be transmitted is moved to the actual screen, so as to update the current display interface after the switching.

3. The anomaly detection method according to claim 2, characterized in that: The step of moving the interface to be transmitted to the actual screen to update the currently displayed interface after switching includes: Rendering the interface to be transmitted to obtain the rendered interface to be transmitted; The rendered interface to be transmitted is moved to the actual screen to obtain a new current display interface.

4. The abnormality detection method according to any one of claims 1 to 3, characterized in that: The step of determining whether there is an abnormality in the current display interface after switching in the actual screen based on the current display interface, the first interfaces to be displayed, and the virtual screen includes: Acquire the first coordinate of the current display interface after the switching; Determining whether the first coordinate is a preset coordinate; If the first coordinates are preset coordinates, determining that the current display interface after switching in the actual screen is displayed normally; Otherwise, determining that the current display interface after switching in the actual screen has a first abnormal display; and / or, Moving the current display interface before switching to the virtual screen as the second interface to be displayed; Acquire the second coordinates of the second interface to be displayed; Determining whether the second coordinate is within a preset coordinate range; If the second coordinate is within the preset coordinate range, determining that the current display interface after switching in the actual screen is displayed normally; Otherwise, it is determined that the current display interface after switching in the actual screen has a second abnormal display.

5. The anomaly detection method according to claim 4, characterized in that: The first coordinate is the coordinate information of the position of the upper left corner of the current display interface after switching; The preset coordinates are the coordinate information of the position of the upper left corner of the actual screen; and / or, The second coordinates are coordinate information of the position of the upper left corner of the second interface to be displayed; The preset coordinate range is the left edge coordinate range of the virtual screen.

6. The anomaly detection method according to claim 4, characterized in that: The first abnormality is displayed as the current display interface after switching is incomplete; The second abnormal display is that the current display interface after switching displays overlap.

7. A method for recovering from abnormality of a user interface, characterized in that: The abnormality recovery method comprises: When an abnormality is detected in the current display interface after switching in the actual screen by using the abnormality detection method according to any one of claims 1 to 6, the current display interface after switching is moved to a preset position in the actual screen until the current display interface after switching is displayed normally; and / or, The current display interface before switching is used as the second interface to be displayed, and the second interface to be displayed is moved to a set position in the virtual screen until the current display interface after switching is displayed normally.

8. A user interface anomaly detection system, characterized in that: The anomaly detection system includes a creation module, a construction module and a user interface switching module; The creation module is used to create a matching virtual screen based on the actual screen in the device; The construction module is used to construct a plurality of first interfaces to be displayed in the virtual screen in advance; Wherein, the first interface to be displayed is associated with the current display interface in the actual screen, and a plurality of the first interfaces to be displayed are arranged based on the same set position; The user interface switching module is used to respond to a user interface switching instruction, and determine whether there is an abnormality in the current display interface after switching in the actual screen based on the current display interface, the first interfaces to be displayed, and the virtual screen.

9. A user interface abnormality recovery system, characterized in that: The anomaly recovery system comprises an anomaly recovery module and the anomaly detection system as claimed in claim 7; The abnormality recovery module is used to move the switched current display interface to a preset position in the actual screen when the abnormality detection system detects that the switched current display interface in the actual screen has an abnormality, until the switched current display interface is displayed normally; and / or, The current display interface before switching is used as the second interface to be displayed, and the second interface to be displayed is moved to a set position in the virtual screen until the current display interface after switching is displayed normally.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the processor implements the abnormality detection method described in any one of claims 1 to 6 and / or the abnormality recovery method described in claim 7.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the abnormality detection method described in any one of claims 1 to 6 and / or the abnormality recovery method described in claim 7 are implemented.

Images