Page display method, device and electronic device
By identifying and filtering the display nodes in the smart device page and re-laying the page, the problem of user experience decline caused by too many smart device display nodes is solved, personalized user interface settings are realized, adapting to the needs of different user groups, and improving users Experience and security.
Patent Information
- Application Number
- CN202110182889.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-02-08
- Publication Date
- 2024-12-24
- Estimated Expiration
- 2041-02-08
AI Technical Summary
Too many nodes displayed on the display page of smart devices lead to a decline in user experience, especially the elderly and children find it difficult to understand the functions in the control center, which can easily lead to misoperation.
By crawling the drawing instructions of the page to be displayed, the display node is identified, and the layout configuration file is generated according to the user's display strategy, unnecessary display nodes are filtered, and the page is re-layout to generate user pages that meet user needs.
Improve user experience, simplify page display, reduce the risk of misoperation, adapt to the personalized needs of different user groups, and reduce development costs and implementation difficulties.
Smart Images

Figure CN114911549B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of intelligent terminals, and in particular to a page display method, device and electronic device. Background Art
[0002] Currently, many smart devices have more and more functions and their interactions are becoming more and more complex, which results in more and more display nodes displayed on the display pages of smart devices. With the increase of display nodes displayed on the display pages, the user experience is often reduced.
[0003] In actual application scenarios, for some users, a large number of display nodes in a display page will lead to a decrease in visual experience, seriously affecting their visual experience and operation experience. For example, the increase in display nodes in a display page will lead to a reduction in the font size of the page text and a reduction in the spacing between display nodes, which will make it difficult for users to identify and increase the probability of finger click misoperation.
[0004] Furthermore, in actual application scenarios, not everyone can use all the functions of smart devices, and there are a large number of useless elements in the display nodes displayed on the interactive interface of smart devices. The existence of these useless elements will not only greatly reduce the user's visual experience, but also easily cause misoperation.
[0005] For example, the elderly and children do not know what each icon in the control center represents, and do not even know what is on and what is off. The existence of many buttons in the control center is not only useless to the elderly and children, but often leads to the situation where they turn off WIFI, turn on data traffic, and mute the sound but do not know how to restore it. Summary of the invention
[0006] In order to solve the problem of how to improve the user experience of page display under the prior art, the present application provides a page display method, device and electronic device, and the present application also provides a computer-readable storage medium.
[0007] The present application embodiment adopts the following technical solutions:
[0008] In a first aspect, the present application provides a page display method, comprising:
[0009] Capture the drawing instructions of the page to be displayed;
[0010] Identifying display nodes included in the page to be displayed based on the drawing instruction of the page to be displayed;
[0011] Based on the display strategy for the current user and according to the recognition result of the display node, the display nodes to be retained in the to-be-displayed page and the corresponding page layout are confirmed, and a layout configuration file is generated;
[0012] According to the layout configuration file, the drawing instruction of the page to be displayed is restored to draw the user page.
[0013] In a feasible implementation manner of the first aspect, the identifying the display nodes included in the to-be-displayed page based on the drawing instruction includes:
[0014] According to the drawing instruction, a picture to be identified is generated in units of display nodes;
[0015] The image to be identified is identified using a recognition model, wherein:
[0016] The sample library for training the recognition model includes a display node picture set composed of different display node pictures;
[0017] The display node image is an image generated by restoring the display node drawing instruction of the terminal device;
[0018] The display node pictures in the display node picture set are marked with corresponding node descriptions.
[0019] In a feasible implementation of the first aspect, the step of restoring the drawing instruction of the page to be displayed to draw the user page according to the layout configuration file includes:
[0020] Loading the layout configuration file;
[0021] In the display window, according to the page layout in the layout configuration file, the drawing instructions corresponding to the display nodes marked in the layout configuration file are restored.
[0022] In a feasible implementation manner of the first aspect above, the method further includes:
[0023] Performing machine learning based on the current user's click operation on the display node, confirming the current user's operation habits, and generating a corresponding page display strategy based on the current user's operation habits;
[0024] and / or,
[0025] The corresponding page display strategy is called according to the user type of the current user.
[0026] In a feasible implementation manner of the first aspect above, the method further includes:
[0027] Transferring the control events of the page to be displayed to the user page.
[0028] In a feasible implementation manner of the first aspect above, the page to be displayed includes a system interface, and the display node includes a system control and / or an application icon.
[0029] In a feasible implementation manner of the first aspect above, the page to be displayed includes an application interface displayed when the application is running.
[0030] In a feasible implementation manner of the first aspect above, the application control of the application includes layout attributes, and the layout attributes are used to support the re-layout of the application control in the application interface;
[0031] The method further comprises:
[0032] Obtain the current application control display tree of the application;
[0033] Parsing the application control display tree to confirm the controls that currently support re-layout;
[0034] Above the control that currently supports rearrangement, a corresponding rearrangement operation button is displayed.
[0035] In a feasible implementation of the first aspect, the confirming the controls that currently support re-layout includes:
[0036] Confirming a control including layout attributes, wherein the layout attributes are used to support the re-layout of the application control in the application interface;
[0037] and / or,
[0038] According to the current application layout strategy, the controls that currently support re-layout are determined.
[0039] In a feasible implementation manner of the first aspect above, the method further includes:
[0040] Identifying display attributes and / or display content of a display node in the application interface;
[0041] Based on the page display policy for the current user, confirm the display nodes that need to be hidden in the application interface;
[0042] The display nodes that need to be hidden are hidden in the application interface.
[0043] In a second aspect, the present application provides a display node identification method, comprising:
[0044] Capture drawing instructions and generate images to be recognized based on display nodes;
[0045] The image to be identified is identified using a recognition model, wherein:
[0046] The sample library for training the recognition model includes a display node picture set composed of different display node pictures;
[0047] The display node image is an image generated by restoring the display node drawing instruction of the terminal device;
[0048] The display node pictures in the display node picture set are marked with corresponding node descriptions.
[0049] In a third aspect, the present application provides an application interface display method, comprising:
[0050] Get the current application control display tree of the application;
[0051] Parsing the application control display tree to confirm the controls that currently support re-layout;
[0052] Above the control that currently supports rearrangement, a corresponding rearrangement operation control is displayed.
[0053] In a feasible implementation of the third aspect, the confirming the controls that currently support re-layout includes:
[0054] Confirming a control including layout attributes, wherein the layout attributes are used to support the re-layout of the application control in the application interface;
[0055] and / or,
[0056] According to the current application layout strategy, the controls that currently support re-layout are determined.
[0057] In a fourth aspect, the present application provides an application interface display method, comprising:
[0058] Identify display attributes and / or display content of display nodes in the application interface;
[0059] Based on the page display policy for the current user, determine the display nodes that need to be hidden in the application interface;
[0060] The display nodes that need to be hidden are hidden in the application interface.
[0061] In a fifth aspect, the present application provides a page display device, comprising:
[0062] A drawing instruction capture module, which is used to capture the drawing instructions of the page to be displayed;
[0063] An identification module, which is used to identify display nodes included in the page to be displayed based on the drawing instruction of the page to be displayed;
[0064] A layout configuration generation module, which is used to determine the display nodes that need to be retained in the to-be-displayed page and the corresponding page layout according to the identification result of the display nodes, and generate a layout configuration file based on the display strategy of the current user;
[0065] The page generation module is used to restore the drawing instructions of the page to be displayed according to the layout configuration file to draw the user page.
[0066] In a sixth aspect, the present application provides a display node identification device, comprising:
[0067] An image generation module is used to capture drawing instructions and generate images to be identified in units of display nodes;
[0068] A recognition module, which is used to recognize the image to be recognized using a recognition model, wherein:
[0069] The sample library for training the recognition model includes a display node picture set composed of different display node pictures;
[0070] The display node image is an image generated by restoring the display node drawing instruction of the terminal device;
[0071] The display node pictures in the display node picture set are marked with corresponding node descriptions.
[0072] In a seventh aspect, the present application provides an application interface display device, comprising:
[0073] The control parsing module is used to parse the current application control display tree of the application and confirm the controls that currently support re-layout;
[0074] The display control module is used to control the display module to display the corresponding layout operation control above the control currently supporting layout.
[0075] In an eighth aspect, the present application provides an application interface display device, comprising:
[0076] An identification module, which is used to identify display attributes and / or display content of a display node in an application interface;
[0077] An interface element analysis module, which is used to confirm the display nodes that need to be hidden in the application interface based on the page display strategy for the current user;
[0078] The display control module is used to control the display module to hide the display nodes that need to be hidden in the application interface.
[0079] In a ninth aspect, the present application provides an electronic device, comprising a display screen, a memory for storing computer program instructions, and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method steps described in the first aspect above.
[0080] In a tenth aspect, the present application provides an electronic device, comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method steps described in the second aspect above.
[0081] In the eleventh aspect, the present application provides an electronic device, comprising a display screen, a memory for storing computer program instructions, and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method steps described in the third aspect above.
[0082] In the twelfth aspect, the present application provides an electronic device, comprising a display screen, a memory for storing computer program instructions, and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method steps described in the fourth aspect above.
[0083] In a thirteenth aspect, the present application provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer executes the method as described in the embodiment of the present application. According to the above technical solution proposed in the embodiment of the present application, at least the following technical effects can be achieved:
[0084] According to the method of one embodiment of the present application, the page to be displayed is re-layouted according to the page display strategy of the current user, unnecessary display nodes (page elements) are filtered out, only necessary display nodes are drawn, and the page display is streamlined to generate a user page that meets the current user's usage requirements, realize personalized settings of page display, and thus greatly improve the user experience.
[0085] Furthermore, in the page display method of the embodiment of the present application, a page layout adjustment scheme that can improve the user experience of page display is confirmed based on the capture of the drawing instructions of the page and the analysis of the drawing instructions, and the user page is drawn according to the page layout adjustment scheme based on the restoration of the drawing instructions, thereby realizing personalized adjustment of the page display without modifying the application, greatly reducing the implementation difficulty and development cost of the scheme. BRIEF DESCRIPTION OF THE DRAWINGS
[0086] Figure 1The figure is a schematic diagram of an application scenario according to an embodiment of the present application;
[0087] Figure 2 The figure is a schematic diagram of an application scenario according to an embodiment of the present application;
[0088] Figure 3 The figure is a schematic diagram of an application scenario according to an embodiment of the present application;
[0089] Figure 4 The figure is a flow chart of a page display method according to an embodiment of the present application;
[0090] Figure 5 Shown is a structural block diagram of a page display system according to an embodiment of the present application;
[0091] Figure 6 The figure is a partial execution flow chart of a page display method according to an embodiment of the present application;
[0092] Figure 7 The figure is a partial execution flow chart of a page display method according to an embodiment of the present application;
[0093] Figure 8 The figure is a partial execution flow chart of a page display method according to an embodiment of the present application;
[0094] Fig. 9 The figure is a flow chart of a page display method according to an embodiment of the present application;
[0095] Fig.10 The figure is a schematic diagram of an application scenario according to an embodiment of the present application;
[0096] Fig.11 The figure is a flowchart of an application interface display method according to an embodiment of the present application;
[0097] Fig.12 The figure is a flowchart of an application interface display method according to an embodiment of the present application;
[0098] Fig.13 The figure is a flowchart of an application interface display method according to an embodiment of the present application;
[0099] Fig.14 The figure is a schematic diagram of an application scenario according to an embodiment of the present application;
[0100] Fig.15 The figure is a schematic diagram of an application scenario according to an embodiment of the present application;
[0101] Fig.16 The figure is a flowchart of an application interface display method according to an embodiment of the present application;
[0102] Fig.17 The figure is a schematic diagram of an application scenario according to an embodiment of the present application;
[0103] Fig.18 Shown is a schematic diagram of an application scenario according to an embodiment of the present application. DETAILED DESCRIPTION
[0104] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.
[0105] The terms used in the implementation section of this application are only used to explain the specific embodiments of this application and are not intended to limit this application.
[0106] In view of the problem of how to improve the user experience of page display under the existing technology, a feasible application solution is to develop different UI controls and interfaces for different users. Figure 1 As shown, 101 is the default system display interface. By selecting simplified desktop in the setting interface (102) and applying the simplified desktop in the simplified desktop interface (103), the system display interface can be configured as the system display interface designed for the elderly as shown in 104. Compared with the system display interface 101, the application icons that are not usually used by the elderly are deleted in the system display interface 104, and the display size of the application icons and fonts is increased.
[0107] Figure 1 Although the solution shown can realize personalized display page settings for different groups of people, thereby solving the problem of useless elements in the display page, the adaptation workload of developers is large and the development cost is high because the UI controls and interfaces need to be redeveloped. In addition, the UI control template is relatively single and cannot meet the personalized needs of more user groups.
[0108] In view of the problem of how to improve the user experience of page display under the existing technology, a feasible application solution is to provide users with an adjustment interface for adjusting the size of display nodes (for example, the size of system or service fonts). Figure 2 As shown, the user can adjust the font size by dragging the control bar 201, and the user can adjust the display size by dragging the control bar 202. Among them, "font size" only controls the size of the font, and "display size" controls the size of interface elements such as text and pictures.
[0109] Figure 2Although the solution shown allows users to adjust the display size of display nodes according to their own visual needs, this solution cannot change the size of controls. Many operation-type UI interfaces are composed of controls, not text, and cannot be enlarged; and in many application scenarios, the size of the display node cannot be expanded due to the limitation of the page display space.
[0110] Furthermore, in actual application scenarios, the interface content of applications (APPs) is increasing, and many of them will not be used by users. It is difficult to display and layout the internal interface content and layout of the App according to user preferences. For children's mode, some mobile phones only limit the time children use the phone and the applications that children can use. Figure 3 As shown, the user can select "Usable duration per time" in the "Child Mode" setting interface 301 to enter the "Usable duration per time" setting interface 302 to set the time for children to use the mobile phone. The user can also select "Apps allowed to access" in the "Child Mode" setting interface 301 to enter the "Apps allowed to access" setting interface 303 to set the applications that children can use. Figure 3 In the application scenario shown, it is not possible to adjust the settings of the display page.
[0111] In view of the above problems, an embodiment of the present application provides a page display method. In the page display method of the embodiment of the present application, according to the page display strategy for the current user, the page to be displayed is re-layouted, unnecessary display nodes (page elements) are filtered, and only necessary display nodes are drawn to simplify the page display, so as to generate a user page that meets the current user's usage requirements, realize personalized settings of page display, and thus greatly improve the user experience.
[0112] Specifically, display nodes (page elements) include but are not limited to user interface (UI) elements such as controls, views, and texts. When filtering display nodes (page elements), filtering can be performed on a single display node, on multiple display nodes, or on a component composed of multiple display nodes.
[0113] Furthermore, in the page display method of the embodiment of the present application, a page layout adjustment scheme that can improve the user experience of page display is confirmed based on the capture of the drawing instructions of the page and the analysis of the drawing instructions, and the user page is drawn according to the page layout adjustment scheme based on the restoration of the drawing instructions, thereby realizing personalized adjustment of the page display without modifying the application, greatly reducing the implementation difficulty and development cost of the scheme.
[0114] Figure 4FIG. 1 is a flowchart of a page display method according to an embodiment of the present application. Figure 4 As shown, in one embodiment of the present application, a terminal device with a display screen performs the following steps to display a page:
[0115] Step 310, capturing the drawing instructions of the page to be displayed;
[0116] Step 320, identifying display nodes included in the page to be displayed based on the drawing instruction of the page to be displayed;
[0117] Step 321, based on the display strategy for the current user and according to the identification result of the display nodes, the display nodes to be retained in the page to be displayed and the corresponding page layout are confirmed, and a layout configuration file is generated;
[0118] Step 330: restore the drawing instructions of the page to be displayed according to the layout configuration file to draw the user page.
[0119] Specifically, in one embodiment, the method of the embodiment of the present application is divided into two stages:
[0120] Phase 1, layout configuration file generation phase (steps 320, 321);
[0121] Phase 2, secondary layout phase (step 330).
[0122] Figure 5 FIG. 1 is a structural block diagram of a page display system according to an embodiment of the present application. Figure 5 As shown, in one embodiment, in stage 1, the layout configuration file can be created in the following two ways:
[0123] Method 1: user edits the page. The user enters the page editing state through the user editing module 401. In the page editing state, according to the drawing instructions of the page to be displayed, the display nodes of the page to be displayed are identified, different page elements are distinguished and presented to the user, and the user manually selects the page elements or moves the element positions to generate a layout configuration file 410;
[0124] Method 2: The element identification module (402) analyzes the page to be displayed, identifies the display nodes of the page to be displayed according to the drawing instructions of the page to be displayed, and confirms the specific display content of different page elements on the page to be displayed; based on the specific display content of different page elements on the page to be displayed and in combination with the display strategy for the current user, the page elements (display nodes) to be displayed are intelligently filtered out; and then the layout recommendation module (403) intelligently generates a layout configuration file 410.
[0125] Specifically, in an implementation of the second method of step 320, the element identification module (402) identifies display nodes with the help of machine learning to analyze the page to be displayed.
[0126] Specifically, an embodiment of the present application further proposes a display node identification method, including:
[0127] According to the drawing instructions of the page to be displayed, the image to be recognized is generated in units of display nodes;
[0128] Use the recognition model to identify the image to be identified, where:
[0129] The sample library for training the recognition model includes a display node image set composed of different display node images;
[0130] The display node image is an image generated by restoring the display node drawing instruction of the terminal device;
[0131] The display node images in the display node image set are labeled with corresponding node descriptions.
[0132] Specifically, the display node identification is divided into two modules: offline and online:
[0133] 1) The offline module is a machine learning training module, which is used to generate a machine learning model for recognition;
[0134] 2) The online module uses the machine learning model generated by the offline module to identify display nodes.
[0135] In one application scenario, the offline and online detailed solutions are as follows:
[0136] Offline:
[0137] 1. Data collection:
[0138] Data is collected through drawing instructions of different mobile phone display (View) nodes and restored to images. The node descriptions are manually marked with the help of existing fixed View node identifiers (ID), for example, the node types are marked, such as marking them as advertisements or invalid nodes, and finally a sample training set for machine learning is generated.
[0139] 2. Data training:
[0140] During training, common data preprocessing is performed, such as removing similarities, adding geometric changes, noise and other interference to expand the sample set and generate a more accurate model.
[0141] Online: that is, how to identify the View node. In one implementation of step 320, the solution for identifying the View node is as follows: Figure 6 As shown:
[0142] Step 510, capturing drawing instructions, and generating a picture to be identified in units of nodes;
[0143] Step 520, the UI recognition module uses the offline generated model to determine the category of the image, such as advertisement, etc.;
[0144] Step 530, after all nodes are identified, the identified results are stored in the database. The keyword (Key) of data query is composed of the unique ID of the View and the application information. The next time the user uses this function, the type of View node is first determined from the stored data to improve the efficiency of marking the View node. The storage format is (Key: node ID + application, Value: node type).
[0145] Furthermore, in an implementation of the second method of step 321, the page display strategy is used to describe the View node mode that matches the current user. For example, in the page display strategy corresponding to the elderly, only the time, date, weather, photo album, photo taking, phone, and photo album are displayed on the system interface. For another example, in the page display strategy corresponding to children, the system settings, application store, and security center are not displayed on the system interface.
[0146] Specifically, the corresponding page display strategy may be called according to the group classification (user type, for example, elderly, children) to which the current user belongs; or the page display strategy previously set by the user may be called.
[0147] Furthermore, in one embodiment of the present application, through machine learning, the user's usage habits are collected, and a page display strategy for the user is generated based on the user's usage habits and recommended to the user. Specifically, machine learning is performed based on the current user's click operation on the display node, the current user's operation habits are confirmed, and the corresponding page display strategy is generated based on the current user's operation habits. For example, the display nodes that the user frequently clicks are marked, and after a period of machine learning, a switchable system / user interface is provided to the user. Alternatively, based on behavioral habits and age-related user operation habits, a switchable system / user interface system is recommended.
[0148] Specifically, Figure 7 As shown, in an application scenario, a user portrait model is established for the user (step 610), and UI element controls frequently used by the user are identified and marked (step 620).
[0149] During the process of displaying the UI interface, the user is identified according to the user portrait model established in step 610; based on the user identification result, the UI element controls frequently used by the user identified and marked in step 620 are called; based on the UI element controls frequently used by the user, the client re-layouts and draws the UI interface, and only retains the UI element controls frequently used by the user in the new UI interface (step 630).
[0150] Further, in an implementation of the second mode of step 321, for any View node, execute the following Figure 8 The following steps are shown to determine whether to retain the View node:
[0151] Step 700, search the database for the node type of the View node (Key: node ID + application);
[0152] Step 710, determining whether the node type of the View node is found;
[0153] If not found, step 711, identify the node type of the View node and save it to the database (based on Figure 6 process shown);
[0154] If the node type of the View node is found, or the node type of the View node is identified, in step 720, based on the display strategy, it is determined whether the View node needs to be drawn on the page according to the node type;
[0155] If necessary, step 731, mark the View node;
[0156] If not necessary, in step 732, the View node is not marked.
[0157] In this way, after the View nodes are marked, the layout recommendation module (403) intelligently generates a layout configuration file for the marked View nodes, and when drawing the page (restoring the drawing instructions), only the marked View nodes need to be drawn.
[0158] Specifically, in one implementation of step 321, firstly based on the display strategy for the current user and according to the recognition result of the display nodes, the display nodes that need to be retained in the page to be displayed are confirmed; then, for the display nodes that need to be retained in the page to be displayed, a corresponding page layout is generated.
[0159] Furthermore, in an implementation of the second method of step 321, the main function of the layout recommendation module (403) is to generate a new layout configuration file that conforms to the new window size and contains marked View nodes (page elements) based on the original page (page to be displayed) and according to the attributes (position, size, etc.) of the original View node (page element).
[0160] Furthermore, in step 330 (stage 2), the layout configuration file is loaded; in the display window, according to the page layout in the layout configuration file, the drawing instructions corresponding to the display nodes marked in the layout configuration file are restored. Specifically, based on the drawing instructions captured in step 310, a new page window is created to draw the restoration instructions, or the source page window is overwritten. For example, the node attributes (such as scaling attributes and position attributes) of each marked View node described in the layout configuration file generated by the layout recommendation module (403) are drawn in the new window or the source window.
[0161] Furthermore, in step 330 (phase 2), a secondary layout framework is implemented in the system, based on which the application can be customized into a new display style; it can support adaptation of different display effects for different types of remote devices, or different models and sizes of the same type of remote devices.
[0162] For example, Figure 5 As shown, in the original Android process, the system or application (for example, APP 420) is started, and the Android View system 421 loads the layout configuration file 410 through the secondary layout framework 422, and the Android View system 421 performs layout and rendering, and finally presents the UI interface 430 on the screen. Figure 4 The method flow of the illustrated embodiment modifies the processing procedure of the AndroidView system 421, based on the source page (for example, with the system interface layout or the application layout as the source), and loads the built-in layout configuration file at the same time to generate a new display page (user page, user UI).
[0163] Furthermore, to ensure that the user can use the controls on the page normally, after step 330, the method further includes:
[0164] Transfer the control events of the page to be displayed to the user page.
[0165] According to the page display method of the embodiment of the present application, a user page matching the current user can be generated. In the specific implementation process, the page display method of the present application can be applied to different display application scenarios.
[0166] For example, in an application scenario, the page to be displayed may be a system interface, and the display nodes in the page to be displayed may be system controls and / or application icons. Taking the application scenario of realizing the display of the elderly / children system interface as an example, the following is performed: Fig. 9 The following steps are shown:
[0167] Step 800, start the elderly (children) mode;
[0168] Step 810, capturing the drawing instructions of the current system interface;
[0169] Step 820, start the interface restoration window;
[0170] Step 830, marking the display nodes that need to be retained in the current system interface;
[0171] Step 840, extracting a list of marked display nodes and related attributes of the display nodes (e.g., size, position);
[0172] Step 850, the layout recommendation module generates a layout configuration file;
[0173] Step 860: Draw the marked display nodes one by one in the interface restoration window according to the layout configuration file.
[0174] Take the mobile phone pull-down control center as an example. Fig.10 As shown, users can Fig.10 The Wi-Fi switch, Bluetooth switch, ring mode and other elements of the control center shown in the left picture are not displayed after setting. Only the switches that the elderly and children need to set or turn on are displayed. After entering the elderly / child mode, the displayed interface is Fig.10 The left picture changes to Fig.10 The UI on the right avoids misoperation caused by too many buttons. The flashlight element can also be enlarged when drawing to make it easier for the elderly to view and operate.
[0175] Furthermore, in another application scenario, the page to be displayed may be an application interface displayed when the application is running. According to the page display method of the embodiment of the present application, the display nodes in the application interface may be rearranged.
[0176] Furthermore, in an embodiment of the present application, a method for displaying an application interface is also proposed.
[0177] Specifically, when the application interface is displayed, the following is executed: Fig.11 The following process is described:
[0178] Step 1010, obtaining the current application control display tree of the application;
[0179] Step 1020, parsing the application control display tree (View Tree), confirming the controls that currently support re-layout;
[0180] Step 1030: Display the corresponding layout operation control above the control that currently supports layout.
[0181] Specifically, in one implementation of step 1010, the ViewTree of the current interface is obtained based on an existing Android interface.
[0182] Furthermore, before step 1010, the user performs a start editing operation to enter the editing mode. Specifically, the way to enter the editing mode can be diversified. For example, in an application scenario, long pressing a blank space is set to enter the editing mode.
[0183] Further, after step 1030, after selecting the re-layout operation, the user can delete or shift the control through the parent control of the control, and save the property modification of the control to a file, which can automatically take effect when the interface is opened next time.
[0184] Furthermore, in a display solution for an application interface, the Android control attributes are extended to provide an interface to third-party developers, who adapt the attributes of their layout as needed to support the implementation of step 1020. Fig.12 As shown, in the APP coding stage:
[0185] Step 1200, modifying the Android control and adding new attributes (layout attributes) to support the re-layout function;
[0186] Step 1201, when implementing XML layout, the third-party application declares new attributes according to requirements.
[0187] During the APP running stage:
[0188] Step 1210, Changan blank space (or other set start editing operation);
[0189] Step 1220, entering edit mode;
[0190] Step 1230, obtaining the View Tree of the current interface;
[0191] Step 1240, analyzing the View Tree;
[0192] Step 1250, marking the control / component that supports re-layout, and floating the operation mode on the control / component, where the operation mode corresponds to the new property of the control / component (for example, moving position, deleting);
[0193] Step 1260, after the user selects the operation mode, the View Tree is refreshed to apply the presentation effect of the operation selected by the user to the application interface;
[0194] Step 1270, persistence, saves the property changes of the control / component to a file, and automatically takes effect the next time the interface is opened.
[0195] Specifically, in step 1200, the control properties of the application control are extended to enable it to support control re-layout. Moreover, the components composed of components that can support control re-layout support component re-layout. That is, the control that supports re-layout includes layout properties, and the layout properties are used to support the re-layout of application controls in the application interface. The layout properties include but are not limited to the following properties:
[0196] Delete: android:delete
[0197] Shift: android:translate
[0198] Change size: android:customTextSize
[0199] Change color: android:customTextColor
[0200] Change text content: android:customText
[0201] Furthermore, in an implementation of step 1240, the controls that currently support re-layout may be all controls that contain layout attributes in the current application control display tree.
[0202] Specifically, in an implementation of step 1240, when analyzing the ViewTree, the control set that declares the above-mentioned newly added attribute can be found by traversing the ViewTree.
[0203] Specifically, in one implementation of step 1250, the control set is marked, and those that support the delete function may display x, and those that support the shift function may display ←↑→↓. The shift direction supported by the control can be determined by the position of the control in the ViewTree and the positions of controls at the same level.
[0204] Furthermore, in a display solution of an application interface, no third-party adaptation is required, and step 1020 is implemented by system customization rules. Fig.13 As shown, during the system customization phase:
[0205] Step 1300: presetting rules supporting the re-layout function (application layout strategy).
[0206] During the APP running stage:
[0207] Step 1310, Changan blank space (or other set start editing operation);
[0208] Step 1320, entering edit mode;
[0209] Step 1330, obtaining the View Tree of the current interface;
[0210] Step 1340, analyzing the View Tree based on the rules supporting the re-layout function;
[0211] Step 1350, marking the control / component that supports re-layout, floating the operation mode on the control / component, and determining the corresponding operation mode (for example, moving position, deleting) according to the preset rule of the control / component;
[0212] Step 1360, after the user selects the operation mode, refresh the View Tree to apply the presentation effect of the operation selected by the user to the application interface;
[0213] Step 1370, persistence, saves the property changes of the control to a file, and the changes will automatically take effect the next time the interface is opened.
[0214] Specifically, in step 1300, the application layout strategy may analyze a large number of layout samples for extraction. For example, in an application scenario, the application layout strategy includes:
[0215] If the parent control is of RecycleView, ListView, or GridView type, its child controls all support the re-layout function;
[0216] If the control includes icons and text, it is processed as a whole and supports the re-layout function.
[0217] For example, in an application scenario, suppose an application interface of an e-commerce application is as follows Fig.14 As shown in the left figure. The application layout strategy is generated based on the user's operating habits. Since users rarely click "Mobile" and "Home", it is determined that the controls that currently support re-layout are "Mobile" and "Home". The re-layout operation control for deleting controls is displayed on the "Mobile" and "Home" controls. The application interface after the control is deleted is as follows Fig.14 As shown in the picture on the right.
[0218] For example, in an application scenario, the application interface is as follows: Fig.15As shown in the left figure. The user type is elderly. Since elderly people rarely use the "Game" component, the "Game" component is hidden in the application layout strategy for the elderly. According to the application layout strategy for the elderly, the component that currently supports re-layout is determined to be "Game", and the re-layout operation control for deleting the component is displayed on the "Game" component. The application interface after the component is deleted is as follows Fig.15 As shown in the picture on the right.
[0219] Furthermore, in one embodiment of the present application, a method for displaying an application interface is also proposed. In the method for displaying an application interface of the present application, in the application interface, display nodes (interface elements) are split and updated in real time according to user characteristics. Specifically, when displaying the application interface, the following is executed: Fig.16 The following process is described:
[0220] Step 1610, identifying display attributes and / or display content of a display node in the application interface;
[0221] Step 1620, based on the page display policy for the current user, confirm the display nodes that need to be hidden in the application interface;
[0222] Step 1630: Hide the display nodes that need to be hidden in the application interface.
[0223] For example, in an application scenario, the user type is elderly, and by identifying Fig.17 The left figure shows the display properties (font size) of each display node in the application interface. It is determined that the font size of the display nodes in the dotted boxes 1710 and 1720 is too small to be suitable for elderly people to read. Therefore, the display nodes in the dotted boxes 1710 and 1720 are hidden. The application interface after the display nodes are hidden is as follows Fig.17 As shown in the picture on the right.
[0224] For example, in an application scenario, the user type is a child, and by identifying Fig.18 The left figure shows the display content (font size) of each display node in the application interface. It is determined that the display nodes in the dotted boxes 1810 and 1820 are not suitable for children to read (contain advertisements, paid or restricted elements). Therefore, the display nodes in the dotted boxes 1810 and 1820 are hidden. The application interface after the display nodes are hidden is as follows Fig.18 As shown in the picture on the right.
[0225] It is to be understood that some or all of the steps or operations in the above embodiments are merely examples, and the present application embodiments may also perform other operations or variations of various operations. In addition, the various steps may be performed in different orders presented in the above embodiments, and it is possible that not all of the operations in the above embodiments need to be performed.
[0226] Furthermore, in the 1990s, improvements to a technology could be clearly distinguished as hardware improvements (for example, improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the method flow). However, with the development of technology, many improvements to the method flow today can be regarded as direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented using a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the access party programming the device. Designers can "integrate" a digital device on a PLD by programming it themselves, without having to ask a chip manufacturer to design and produce a dedicated integrated circuit chip. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.
[0227] The controller can be implemented in any appropriate manner, for example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) that can be executed by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that in addition to implementing the controller in a purely computer-readable program code manner, the controller can be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, this controller can be considered as a hardware component, and the devices included therein for implementing various functions can also be regarded as structures within the hardware component. Or even, the devices for implementing various functions can be regarded as both software modules for implementing the method and structures within the hardware component.
[0228] Therefore, based on the page display method proposed in an embodiment of the present application, an embodiment of the present application further proposes a page display device, which includes:
[0229] A drawing instruction capture module, which is used to capture the drawing instructions of the page to be displayed;
[0230] A layout configuration generation module, which is used to confirm the display nodes that need to be retained in the page to be displayed and the corresponding page layout, and generate a layout configuration file;
[0231] The page generation module is used to restore the drawing instructions of the page to be displayed according to the layout configuration file to draw the user page.
[0232] Furthermore, in one embodiment, the layout configuration generation module includes:
[0233] A node identification submodule, which is used to identify display nodes contained in the page to be displayed based on the drawing instructions of the page to be displayed;
[0234] A node filtering submodule, which is used to confirm the display nodes that need to be retained in the page to be displayed based on the display strategy for the current user and the recognition result of the display nodes;
[0235] The node layout submodule is used to generate a corresponding page layout for display nodes that need to be retained in the page to be displayed.
[0236] Further, based on the display node identification method proposed in an embodiment of the present application, an embodiment of the present application also proposes a display node identification device, and the display node identification device includes:
[0237] An image generation module is used to capture drawing instructions and generate images to be identified in units of display nodes;
[0238] The recognition module is used to recognize the image to be recognized using the recognition model, wherein:
[0239] The sample library for training the recognition model includes a display node image set composed of different display node images;
[0240] The display node image is an image generated by restoring the display node drawing instruction of the terminal device;
[0241] The display node images in the display node image set are labeled with corresponding node descriptions.
[0242] Further, based on the application interface display method proposed in one embodiment of the present application, one embodiment of the present application also proposes an application interface display device, and the application interface display device includes:
[0243] A control parsing module, which is used to parse the current application control display tree of the application and confirm the controls that currently support re-layout, wherein the controls that currently support re-layout include layout attributes, and the layout attributes are used to support the re-layout of application controls in the application interface;
[0244] The display control module is used to control the display module to display the corresponding re-layout operation control above the control that currently supports re-layout.
[0245] Further, based on the application interface display method proposed in one embodiment of the present application, one embodiment of the present application also proposes an application interface display device, and the application interface display device includes:
[0246] An identification module, which is used to identify display attributes and / or display content of a display node in an application interface;
[0247] An interface element analysis module, which is used to confirm the display nodes that need to be hidden in the application interface based on the page display strategy for the current user;
[0248] The display control module is used to control the display module to hide the display nodes that need to be hidden in the application interface.
[0249] In the description of the embodiments of the present application, for the convenience of description, the device is described by being divided into various modules / units according to their functions. The division of each module / unit is merely a division of logical functions. When implementing the embodiments of the present application, the functions of each module / unit can be implemented in the same or one or more software and / or hardware.
[0250] Specifically, the device proposed in the embodiment of the present application can be fully or partially integrated into a physical entity during actual implementation, or it can be physically separated. And these modules can all be implemented in the form of software calling through processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software calling through processing elements, and some modules can be implemented in the form of hardware. For example, the detection module can be a separately established processing element, or it can be integrated in a chip of an electronic device. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together, or they can be implemented independently. In the implementation process, each step of the above method or each of the above modules can be completed by an integrated logic circuit of hardware in a processor element or instructions in the form of software.
[0251] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more digital signal processors (DSP), or one or more field programmable gate arrays (FPGA), etc. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
[0252] An embodiment of the present application also proposes an electronic device (for example, a mobile phone), which includes a display screen, a memory for storing computer program instructions, and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the page display method steps described in the embodiment of the present application.
[0253] An embodiment of the present application further proposes an electronic device (e.g., a mobile phone), which includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the steps of the display node identification method as described in the embodiment of the present application.
[0254] An embodiment of the present application also proposes an electronic device (for example, a mobile phone), which includes a display screen, a memory for storing computer program instructions, and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the application interface display method steps as described in the embodiment of the present application.
[0255] Specifically, in one embodiment of the present application, the above-mentioned one or more computer programs are stored in the above-mentioned memory, and the above-mentioned one or more computer programs include instructions. When the above-mentioned instructions are executed by the above-mentioned device, the above-mentioned device executes the method steps described in the embodiment of the present application.
[0256] Specifically, in one embodiment of the present application, the processor of the electronic device may be a SOC device on a chip, which may include a central processing unit (CPU), and may further include other types of processors. Specifically, in one embodiment of the present application, the processor of the electronic device may be a PWM control chip.
[0257] Specifically, in an embodiment of the present application, the processor involved may include, for example, a CPU, a DSP, a microcontroller or a digital signal processor, and may also include a GPU, an embedded neural network processor (Neural-network Process Units, NPU) and an image signal processor (Image Signal Processing, ISP). The processor may also include necessary hardware accelerators or logic processing hardware circuits, such as ASICs, or one or more integrated circuits for controlling the execution of the program of the technical solution of the present application. In addition, the processor may have the function of operating one or more software programs, and the software programs may be stored in a storage medium.
[0258] Specifically, in one embodiment of the present application, the memory of the electronic device may be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), a magnetic disk storage medium or other magnetic storage devices, or may be any computer-readable medium that can be used to carry or store desired program codes in the form of instructions or data structures and can be accessed by a computer.
[0259] Specifically, in an embodiment of the present application, the processor and the memory can be combined into a processing device, more commonly, they are independent components, and the processor is used to execute the program code stored in the memory to implement the method described in the embodiment of the present application. In specific implementation, the memory can also be integrated into the processor, or independent of the processor.
[0260] Furthermore, the devices, apparatuses, modules or units described in the embodiments of the present application may be implemented by computer chips or entities, or by products having certain functions.
[0261] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, devices, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program code.
[0262] In the several embodiments provided in the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application.
[0263] Specifically, in one embodiment of the present application, a computer-readable storage medium is further provided, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the method provided in the embodiment of the present application.
[0264] An embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program is run on a computer, the computer executes the method provided by the embodiment of the present application.
[0265] The embodiments described in this application are described with reference to the flowcharts and / or block diagrams of the methods, devices (apparatus), and computer program products according to the embodiments of the application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0266] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0267] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0268] It should also be noted that in the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, c can be single or multiple.
[0269] In the embodiments of the present application, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other identical elements in the process, method, commodity or device including the element.
[0270] The present application may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.
[0271] Each embodiment in this application is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0272] Those skilled in the art will appreciate that the various units and algorithm steps described in the embodiments of the present application can be implemented by a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0273] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, apparatuses and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0274] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A page display method, characterized in that: include: Capturing a drawing instruction of a display system of an operating system of a terminal device for a page to be displayed, wherein when the display system restores the drawing instruction for the page to be displayed, the terminal device displays the page to be displayed; According to the drawing instruction, a picture to be identified is generated in units of display nodes; Identify the image to be identified, so as to identify specific display contents of different display nodes included in the page to be displayed; Based on the page display strategy for the current user, according to the specific display contents of different display nodes on the page to be displayed, the display nodes to be retained in the page to be displayed and the corresponding page layout are determined, and a layout configuration file is generated; The display system restores the drawing instructions corresponding to the display nodes that need to be retained in the page to be displayed in the drawing instructions for the page to be displayed according to the page layout in the layout configuration file, so as to draw the display nodes that need to be retained in the page to be displayed, and generate a user page; Transferring the control events of the page to be displayed to the user page.
2. The method according to claim 1, characterized in that The identifying the picture to be identified includes: The image to be identified is identified using a recognition model, wherein: The sample library for training the recognition model includes a display node picture set composed of different display node pictures; The display node image is an image generated by restoring the display node drawing instruction of the terminal device; The display node pictures in the display node picture set are marked with corresponding node descriptions.
3. The method according to claim 1, characterized in that The display system restores, in the drawing instructions for the page to be displayed, the drawing instructions corresponding to the display nodes to be retained in the page to be displayed according to the page layout in the layout configuration file, so as to draw the display nodes to be retained in the page to be displayed, and generates a user page, including: Loading the layout configuration file; In the display window, according to the page layout in the layout configuration file, the drawing instructions corresponding to the display nodes marked in the layout configuration file are restored.
4. The method according to claim 1, characterized in that The method further comprises: Performing machine learning based on the current user's click operation on the display node, confirming the current user's operation habits, and generating a corresponding page display strategy based on the current user's operation habits; and / or, The corresponding page display strategy is called according to the user type of the current user.
5. The method according to any one of claims 1 to 4, characterized in that The page to be displayed includes a system interface, and the display node includes a system control and / or an application icon.
6. The method according to any one of claims 1 to 4, characterized in that The page to be displayed includes an application interface displayed when the application is running.
7. The method according to claim 6, characterized in that The application control of the application includes layout attributes, and the layout attributes are used to support the re-layout of the application control in the application interface; The method further comprises: Obtain the current application control display tree of the application; Parsing the application control display tree to confirm the controls that currently support re-layout; Above the control that currently supports rearrangement, a corresponding rearrangement operation button is displayed.
8. The method according to claim 7, characterized in that The control that currently supports re-layout is confirmed to include: Confirming a control including layout attributes, wherein the layout attributes are used to support the re-layout of the application control in the application interface; and / or, According to the current application layout strategy, the control currently supporting re-layout is determined.
9. The method according to claim 6, characterized in that The method further comprises: Identifying display attributes and / or display content of a display node in the application interface; Based on the page display policy for the current user, determine the display nodes that need to be hidden in the application interface; The display nodes that need to be hidden are hidden in the application interface.
10. The method according to claim 1, characterized in that The method further comprises: Get the current application control display tree of the application; Parsing the application control display tree to confirm the controls that currently support re-layout; Above the control that currently supports rearrangement, a corresponding rearrangement operation control is displayed.
11. The method according to claim 10, characterized in that The control that currently supports re-layout is confirmed to include: Identify controls that include layout attributes, wherein the layout attributes are used to support rearrangement of application controls in an application interface; and / or, According to the current application layout strategy, the control currently supporting re-layout is determined.
12. The method according to claim 1, characterized in that The method further comprises: Identify display attributes and / or display content of display nodes in the application interface; Based on the page display policy for the current user, determine the display nodes that need to be hidden in the application interface; The display nodes that need to be hidden are hidden in the application interface.
13. A page display device, characterized in that: include: A drawing instruction capture module, which is used to capture a drawing instruction of a display system of an operating system of a terminal device for a page to be displayed, wherein when the display system restores the drawing instruction for the page to be displayed, the terminal device displays the page to be displayed; A picture generation module, which is used to generate a picture to be identified in units of display nodes according to the drawing instruction; An identification module, which is used to identify the image to be identified, so as to identify the specific display content of different display nodes included in the page to be displayed; A layout configuration generation module, which is used to determine the display nodes that need to be retained in the page to be displayed and the corresponding page layout based on the page display strategy for the current user and the specific display content of different display nodes on the page to be displayed, and generate a layout configuration file; A page generation module is used to restore the drawing instructions corresponding to the display nodes that need to be retained in the page to be displayed in the drawing instructions for the page to be displayed according to the page layout in the layout configuration file, so as to draw the display nodes that need to be retained in the page to be displayed and generate a user page; and transfer the control events of the page to be displayed to the user page.
14. The device according to claim 13, characterized in that The recognition module is used to recognize the image to be recognized using a recognition model, wherein: The sample library for training the recognition model includes a display node picture set composed of different display node pictures; The display node image is an image generated by restoring the display node drawing instruction of the terminal device; The display node pictures in the display node picture set are marked with corresponding node descriptions.
15. The device according to claim 13, characterized in that The device also includes: The control parsing module is used to parse the current application control display tree of the application and confirm the controls that currently support re-layout; The display control module is used to control the display module to display the corresponding layout operation control above the control currently supporting layout.
16. The device according to claim 13, characterized in that The device also includes: An identification module, which is used to identify display attributes and / or display content of a display node in an application interface; An interface element analysis module, which is used to confirm the display nodes that need to be hidden in the application interface based on the page display strategy for the current user; The display control module is used to control the display module to hide the display nodes that need to be hidden in the application interface.
17. An electronic device, characterized in that: The electronic device comprises a display screen, a memory for storing computer program instructions, and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method as described in any one of claims 1-12.
18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the method according to any one of claims 1 to 12.
Citation Information
Patent Citations
Method and device for dynamically changing page
CN106156101A
Skin file generating method, device and equipment for achieving interface layout and equipment
CN108829393A
A display test method and device and equipment for visual elements in a page and a storage medium
CN109815156A
Page display control method and device
CN110275746A
Page display method and device, computer equipment and storage medium
CN110458646A
