Display method and device for control on human-computer interaction interface and storage medium

Abstract

The embodiment of the invention provides a display method and device for a control on a human-computer interaction interface and a storage medium, and belongs to the technical field of industrial control. The method comprises the following steps: acquiring target user information and interface use data of a currently logged-in target user; the interface use data represents use data generated by clicking and using each preset control on the human-computer interaction interface; inputting the target user information and the corresponding interface use data into a preset operation prediction model, and determining a prediction score of classifying each preset control into each preset display category; according to each prediction score and the current menu level of each control, determining a corresponding target menu path of each control; and according to the target menu path of each control, rendering each control in a preset display interface. According to the embodiment of the invention, the control layout on the human-computer interaction interface can be automatically adapted to the login user, so that the operation efficiency of the control on the human-computer interaction interface is improved.

Description

Technical Field

[0001] The present application relates to the field of industrial control technology, and in particular to a display method, device and storage medium for controls on a human-computer interaction interface. Background Art

[0002] In the field of industrial control technology, with the popularization of intelligence, interface operation is becoming more and more popular in industrial equipment control. However, in actual applications, due to the complexity of industrial scenarios, the corresponding industrial automation software is often more complicated. Therefore, when controlling industrial equipment in the human-computer interaction interface of the terminal device, the layout of the various controls on the human-computer interaction interface is often messy, and it is difficult for users to quickly obtain the corresponding information. In addition, due to the different operating requirements of different types of users, in related technologies, the operating efficiency of the controls on the human-computer interaction interface is low. Therefore, how to improve the display layout of the controls on the human-computer interaction interface to improve the operating efficiency of the controls on the human-computer interaction interface and improve the user experience is a technical problem that needs to be solved urgently. Summary of the invention

[0003] The main purpose of the embodiments of the present application is to propose a display method, device and storage medium for controls on a human-computer interaction interface, which can enable the control layout on the human-computer interaction interface to automatically adapt to the logged-in user to improve the operating efficiency of the controls on the human-computer interaction interface.

[0004] To achieve the above-mentioned purpose, a first aspect of an embodiment of the present application provides a method for displaying a control on a human-computer interaction interface, the method comprising: Obtaining target user information and interface usage data of the currently logged-in target user; the interface usage data represents usage data generated by clicking on each preset control on the human-computer interaction interface; Input the target user information and the corresponding interface usage data into a preset operation prediction model to determine the prediction scores of each preset control classified into each preset display category; the operation prediction model is used to predict the prediction scores of each control classified into each display category used by different users on the same human-computer interaction interface; Determining a target menu path corresponding to each of the controls according to the prediction scores and the current menu level of each of the controls; According to the target menu path of each of the controls, each of the controls is rendered in a preset display interface.

[0005] To achieve the above-mentioned purpose, the second aspect of an embodiment of the present application proposes an electronic device, which includes a memory and a processor, the memory stores a computer program, and when the processor executes the computer program, it implements the method for displaying controls on the human-computer interaction interface described in any one of the first aspects above.

[0006] To achieve the above-mentioned purpose, the third aspect of an embodiment of the present application proposes a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the method for displaying controls on a human-computer interaction interface as described in any one of the first aspects.

[0007] The display method, device and storage medium of controls on the human-computer interaction interface proposed in the present application perform feature extraction on the target user information and interface usage data of the target user through an operation prediction model, and obtain prediction scores for classifying each control on the human-computer interaction interface into each display category, so as to determine the controls that need to be re-divided into menu levels and display categories based on the prediction scores, and then determine the target menu path of each control. After rendering based on each target menu path is completed, the layout of each rendered control is more in line with the habits of the target user, so the operation efficiency of the target user is higher. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 It is a flowchart of a method for displaying controls on a human-computer interaction interface provided by an embodiment of the present application; Figure 2 It is a schematic diagram of the principle of a single-layer perceptron system in the process of constructing a multi-layer perceptron in the method for displaying controls on a human-computer interaction interface provided in an embodiment of the present application; Figure 3 It is a network architecture diagram of a multilayer perceptron in one embodiment of a method for displaying controls on a human-computer interaction interface provided by an embodiment of the present application; Figure 4 It is a schematic diagram of changes in a control list of an embodiment of a method for displaying controls on a human-computer interaction interface provided in an embodiment of the present application; Figure 5 It is a schematic diagram of an interface implementation of a control list of another embodiment of a method for displaying controls on a human-computer interaction interface provided in an embodiment of the present application; Figure 6 It is a structural diagram of the hardware structure corresponding to the display method of controls on the human-computer interaction interface provided in the embodiment of the present application. DETAILED DESCRIPTION

[0009] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0010] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0011] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0012] The display method, device and storage medium of controls on the human-computer interaction interface provided in the embodiments of the present application are specifically described through the following embodiments. First, the display method of controls on the human-computer interaction interface in the embodiments of the present application is described.

[0013] The display method of the control on the human-computer interaction interface of the present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0014] Refer to the following Figure 1 As shown, according to the method for displaying controls on a human-computer interaction interface provided by an embodiment of the present application, the method for displaying controls on a human-computer interaction interface includes: S100, obtaining target user information and interface usage data of the currently logged-in target user; the interface usage data represents usage data generated by clicking on each preset control on the human-computer interaction interface; S200, inputting the target user information and the corresponding interface usage data into a preset operation prediction model, and determining the prediction scores of each preset control classified into each preset display category; the operation prediction model is used to predict the prediction scores of each control used by different users on the same human-computer interaction interface classified into each display category; S300, determining the target menu path of each corresponding control according to each prediction score and the current menu level of each control; S400: Render each control in a preset display interface according to the target menu path of each control.

[0015] Therefore, the target user information and interface usage data of the target user are subjected to feature extraction through the operation prediction model, and the prediction score of each control on the human-computer interaction interface being classified into each display category is obtained, so that the controls that need to be re-divided into menu levels and display categories can be determined based on the prediction score, and then the target menu path of each control can be determined. After the rendering based on each target menu path is completed, the layout of each rendered control is more in line with the habits of the target user, and therefore, the operation efficiency of the target user is higher.

[0016] The interface usage data is the usage data generated by the preset time or the first N logins before the target user logs into the human-computer interaction interface. The embodiment of the present application does not limit the preset time or the number of logins, and can be selectively set according to actual needs. The embodiment of the present application does not limit the type of interface usage data, such as the operation frequency of each control within the preset operation time threshold, the single operation time, etc.

[0017] The target user information is used to identify the target user, and may be an account number or an index of the target user, to which the embodiments of the present application do not impose any limitation.

[0018] Display categories can represent the operation attributes of different controls, such as system management, application management, network management, data management, time configuration, etc. Display categories are pre-configured in the terminal device, and those skilled in the art can selectively set them according to actual needs.

[0019] Each display category corresponds to a predicted score range. Therefore, based on the predicted scores belonging to each display category, a display category with a higher score can be selected as the target display category of the corresponding control. The embodiment of the present application does not display the menu hierarchy under each display category. In some embodiments, the hierarchy under each display category is set with one level, and each control is displayed in the corresponding display category in a list form. At this time, after the target display category of each control is determined, the target menu path can also be determined. In other embodiments, multiple levels can be set under each display category. At this time, the corresponding categories can be divided according to the range of predicted scores, so that the target menu path can be determined. When the predicted scores do not meet the predicted score range corresponding to each display category, a new display category based on the control is displayed. For each control of the same display category, in some embodiments, the order of arrangement can be set according to the predicted scores of each control in the same display category.

[0020] The embodiment of the present application does not limit how to render each target menu path, and those skilled in the art can selectively set it according to actual needs.

[0021] In some embodiments, step S100 may be triggered only after a preset interface update condition is met. The embodiment of the present application does not limit the interface update condition, and technical personnel in this field may selectively set it according to actual needs, such as when the usage permissions of the same user are changed or the display interface corresponding to the logged-in user account lasts for more than a preset time threshold.

[0022] It is understandable that in the embodiments of the present application, in implementation scenarios such as: Scenario 1: Initialize the categories of each control for users with different roles. When one of the users frequently operates controls on another path without changing his role, and the control search time is long, the controls can be rearranged through the above steps S100 to S400, thereby shortening the operation time of the controls that take a long time to search and improving the operation speed.

[0023] Scenario 2: The user role of the same user has changed, such as a job title change or the addition of a temporary task, etc., and the controls that need to be operated will change. The controls can be rearranged through the above steps S100 to S400 to improve the operation efficiency.

[0024] It is understandable that the parameters related to the human-computer interaction interface rendered in step S400 will be saved in the database, so that when the next login is made, when it is determined that the interface update conditions are not met, the human-computer interaction interface displayed last time can be displayed.

[0025] For example, refer to Figure 2As shown, in the terminal display interface, after user 1 logs in, a first-level menu of function A, function B, function C, function D and function E is displayed, wherein function A, function B, function C, function D and function E correspond to a display category respectively. When it is determined based on the above steps S100 to S400 that user 1's predicted score for control B.5 under function B does not belong to function A, function B, function C, function D and function E, that is, the operation on control B.5 is more frequent, and functions A, function B, function C, function D and function E are more frequent. If the operation frequencies of most of the display categories in function E are similar, then B.5 will be directly used as a new display category and displayed in parallel with function A, function B, function C, function D and function E, and based on the above steps S100 to S400, it is determined that the predicted scores of each control under function C all show that they can be classified into function B (such as operating the controls under function B will often be followed by operating the controls under function C, that is, the controls under function B and the controls under function C are strongly related), then the entire function C will be used as a sublist of function B.

[0026] It is understandable that the interface usage data includes a plurality of interface usage records corresponding to each control; the operation prediction model includes at least two hidden layers, and the target user information and the corresponding interface usage data are input into the preset operation prediction model to determine the prediction scores of the preset controls classified into the preset display categories, including: Determine the first neurons corresponding to the target user information and each interface usage record in the first hidden layer; wherein at least some of the first neurons correspond to different interface usage records, and the weights configured in the first neurons inputting the same interface usage record are different; Extracting features from target user information and corresponding interface usage records through the first neuron to obtain first features corresponding to the first neuron one by one; Input the first feature into a second neuron corresponding to the first neuron in the second hidden layer; Extracting the corresponding first feature through the second neuron to obtain a second feature corresponding to the second neuron one by one; According to each second feature, a prediction score of each control being classified into each preset display category is determined; wherein the combination of second neurons corresponding to each display category is different.

[0027] The interface usage record may include the number of operations per unit time and the search time data of the control; wherein, the search time data is the time from the time when the stay time of the menu list in the human-computer interaction interface is greater than the preset first time threshold and less than the preset second time threshold to the time when the control is triggered as the search time of the triggered control, and the first time threshold and the second time threshold can be selectively set according to the actual situation. For example, the time that an experienced user stays in the menu list during operation and the time that a novice stays in the menu list during operation are counted to determine the first time threshold and the second time threshold respectively.

[0028] By combining different interface usage records and user information and assigning them to different first neurons for calculation, feature learning can be performed on interface usage records under different combinations, and the weights of the first neurons for the same interface usage records are different. Feature extraction is performed on the first features of different combinations through the second neurons, so that the hidden layer can perform multi-dimensional feature extraction on each interface usage record and user information, thereby ensuring that the predicted score of the display category of each control based on the interface usage record and user information can be strongly correlated with the target user information, thereby further ensuring that the rendered page is more in line with the usage habits of the target user, and improving the target user's operating efficiency on the terminal display interface.

[0029] It is understandable that the interface usage data includes usage permissions, a list of common controls, operation frequency data corresponding to each control, equipment maintenance records, and equipment operation records; the operation prediction model includes an input layer, a first hidden layer, a second hidden layer, and an output layer; the target user information and the corresponding interface usage data are input into the preset operation prediction model to determine the prediction scores of the preset controls classified into the preset display categories, including: The target user information, usage permissions, common control list, operation frequency data, equipment maintenance records and equipment operation records are input into the input layer; wherein the input layer combines the target user information and usage permissions, common control list, operation frequency data, equipment maintenance records and equipment operation records respectively to form multiple first record groups; the input layer is also used to combine the target user information, usage permissions and operation frequency data to obtain a second record group, and the input layer is also used to combine the target user information, common control list and equipment maintenance records to obtain a third record group, Input each of the first record group, the second record group, the third record group and the target user information into at least one first neuron in the first hidden layer through the input layer, and obtain a first feature corresponding to the first neuron one by one; Inputting each first feature into a second neuron corresponding to the first neuron in the second hidden layer, wherein each second neuron corresponds to at least two first neurons, and the combination of the first neurons in any two second neurons is different; Each second feature is input into the output layer to obtain the prediction score of each control being classified into each preset display category.

[0030] Usage permissions record the target user's permissions for each control set on the human-computer interaction interface. For example, ordinary technicians and senior technicians are allowed to operate different controls.

[0031] The common control list records a collection of various controls that are allowed to be displayed to the target user on the human-computer interaction interface.

[0032] The operation frequency data records the number of times each control is used and / or the search time on the human-computer interaction interface.

[0033] The equipment operation record records the execution order of different controls when the target user operates the equipment based on the human-computer interaction interface. The equipment maintenance record records the equipment maintenance performed by the target user on the human-computer interaction interface to assist in identifying the user role.

[0034] It is understandable that the target user information and usage permissions, common control lists, operation frequency data, device maintenance records, and device operation records are combined to form multiple first record groups, thereby extracting features that are strongly related to the target user information from the usage permissions, common control lists, operation frequency data, device maintenance records, and device operation records, thereby further ensuring that the obtained prediction score matches the actual usage habits of the target user. At the same time, by extracting features from the target user information separately and combining the first features of the first record group, the second record group, and the third record group through different second neurons, the prediction score can be made more accurate.

[0035] The embodiment of the present application does not limit the number of first neurons corresponding to the first record group, the second record group, the third record group, and the target user information, and those skilled in the art can selectively set them according to actual needs. If the first record group is input into two first neurons, and the weights on the two first neurons are set differently, then the first record group can be subjected to feature extraction in different dimensions, making the features more diverse.

[0036] In the field of industrial control, due to the differences in functional requirements of different user roles, the layout of controls displayed on the human-computer interaction interface for the same account will be different. For example, the user roles are divided into maintenance roles and operation roles. Figure 4 As shown, neurons for extracting the first feature of equipment maintenance records and accounts (i.e., target user information) are added, so that the influence of different user roles and user behavior habits on the display of controls on the human-computer interaction interface can be comprehensively considered. For example, Figure 4As shown, the first hidden layer is provided with 12 first neurons, and the second hidden layer is provided with 12 second neurons. Figure 4 As shown, the second record group and the third record group each correspond to a first neuron, the target user information corresponds to a first neuron, and the first record group, except for the record group consisting of the equipment maintenance record and the target user information, each record group corresponds to a first neuron, and the record group consisting of the equipment maintenance record and the target user information corresponds to two first neurons. Figure 4 As shown, the first feature of the third record group corresponds to one second neuron, and the remaining second neurons combine at least two different first features to perform feature extraction.

[0037] It can be understood that the operation prediction model is trained through the following steps: Acquire user information of each user to be registered, multiple sample interface usage data corresponding to the user information, and operation interface expected view data corresponding to the user information; Determine the expected display category of each control corresponding to the user information one by one according to the expected view data of the operation interface; Obtaining an initial operational prediction model; Input each user information and the corresponding sample interface usage data as a group of sample data into the initial operation prediction model for training, and perform error calculation based on the training results and the display expected category corresponding to the input sample data to determine the prediction error corresponding to each user information; When each prediction error satisfies a preset error threshold or the number of training times is greater than or equal to a preset number threshold, the training of the operation prediction model is stopped to obtain a trained operation prediction model.

[0038] The expected view data of the operation interface is a drawn display view. By converting the drawn expected view data into a display expected category, the convenience of sample data collection can be improved.

[0039] It can be understood that the operation prediction model is set as a multi-layer perceptron, and the operation steps of the operation prediction model also include: When the prediction error does not meet the error threshold and the number of training times is less than the number threshold, the prediction error is gradient-solved using a preset stochastic gradient algorithm to determine the weight update gradient; Get the preset learning rate, perform weighted processing on the learning rate and weight update gradient, and get the target weight update gradient; Update the individual weights configured in the multilayer perceptron according to the target weight update gradient.

[0040] By combining the gradient algorithm with the multi-layer perceptron, rapid convergence can be achieved during the training process.

[0041] It is understandable that in industrial scenarios, the number of users registered in the same human-computer interaction interface is often large. Therefore, there is a lot of sample interface usage data generated by users. Therefore, how to improve the speed of convergence during training is very critical. At the same time, considering that the frequency of changes in the control requirements of the same user in industrial scenarios is low, the learning rate can be directly introduced to increase the amplitude of each gradient change, so that the prediction accuracy can be ensured while meeting the convergence requirements. The embodiment of the present application does not limit the specific value of the learning rate, and it can be adjusted synchronously through simulation experiments or during the training process (such as initially setting a larger value and determining it by gradually decreasing it).

[0042] It is understandable that the initial multi-layer perceptron can be constructed by the following steps: Step 1: First, build a system operation as a sensor in the terminal device: Suppose a single perceptron with n-dimensional input is Figure 3 As shown, to are the components of the n-dimensional input vector (i.e., the parameters and user information in the sample interface usage data), to are the weights connecting each input component to the perceptron, is the bias, f(.) is the transfer function, is the expected output. Output The mathematical description is: ; in , and f(x) is an antisymmetric sign function defined as: ; in, is the weight; if the weight of a certain input value of the current neuron is zero, then whether the current neuron is excited or not has nothing to do with this input value; if the weight of a certain input value is positive, it has a positive effect on the excitation value of the current neuron. Conversely, if the weight is negative, it has a negative effect on the excitation value.

[0043] in, The offset defines the spatial offset of the critical value of the firing of each neuron in the hidden layer, which has a translation effect on the decision boundary, just like the effect of a constant on a linear or quadratic function. When the perceptron is represented as the inner product of the input vector and the weight vector, the bias is extended to the weight, and the corresponding input value is 1.

[0044] Step 2: Build a multi-layer perceptron based on the single-layer perceptron in step 1, as follows: Using the back-propagation algorithm and the gradient descent method to converge the operation process; adding at least one hidden layer to the perceptron in step 1 can enhance the learning ability of the multi-layer perceptron model terminal. The gradient propagation algorithm is a gradient descent method. As long as the direction of the gradient can be calculated, the weight of the multi-layer perceptron can move in the direction with the fastest energy decrease.

[0045] Step 3: Determine the direction of gradient descent, as follows: Output error is defined as the error between the output obtained based on any set of weight vectors and the expected output. For example, the error is calculated using mean square error, where the mean square error calculation formula is as follows: ; In the above formula, D represents all input conditions, and d represents a sample instance. represents the output of the perceptron, Represents the expected output; Represents the output error.

[0046] Based on finding a set of weights such that The idea of ​​minimizing the error value is to take the derivative of the error with respect to the weight as the gradient. At this time, the gradient can be expressed by the following gradient formula: ; Step 4: Calculate the convergence of the gradient, as follows: Update the gradient to a stochastic gradient to update the weights according to each individual training sample. At this point, the following gradient formula can be obtained: ; in, Indicates the expected output, represents the output of the perceptron.

[0047] At the same time, in order to further improve the convergence speed, the learning rate can be set. At this time, the update formula for each weight can be obtained as follows: ; ; in, represents the learning rate, represents the current weight, represents the updated weight. ; Indicates input, represents the target segmentation function. is a real number, which is the result calculated based on the training sample data during the weight update process, so that Determine And update the weights.

[0048] It is understandable that, according to the target menu path of each control, each control is rendered in a preset display interface, including: Compare the target menu path of each control with the original menu path to determine the target control to move the menu path upward; Obtain preset enhanced rendering parameters, and render the target control according to the enhanced rendering parameters; the enhanced rendering parameters include at least one of a format parameter and an effect parameter.

[0049] Understandably, formatting parameters such as size, font, bold, etc.; Effect parameters such as adding marks or dynamically displaying text on controls.

[0050] For example, refer to Figure 5 As shown, the hardware performance test is the target control of the upward menu path. At this time, the font of the target control is bold and a mark is added on one side. At this time, when the target user enters the submenu of system maintenance, the control can be quickly obtained.

[0051] By enhancing the rendering to make the changed target controls more conspicuous, users can be further accelerated to become familiar with the updated human-computer interaction interface, thereby improving operational efficiency.

[0052] It is understandable that after rendering each control in the preset display interface, the method further includes: The rendered display interface is saved to the storage record corresponding to the target user in the preset interface storage database; When the target user logs in again, the display interface in the storage record corresponding to the target user is extracted from the interface storage database and displayed; When there is a target control with enhanced rendering parameters, determining the display duration of the target control; Cancel the enhanced rendering parameters of the target control based on the display duration.

[0053] By recording the display duration of the target control, the normal display of the interface can be restored when the target user has adapted to the new interface.

[0054] When the display duration is longer than the preset display threshold, the enhanced rendering parameters of the target control can be canceled. The display duration statistics can be calculated from the first triggering of the target control when the target user logs in, and end when the target user logs out. When the cumulative display duration of the same target user is longer than the display threshold, the enhanced rendering parameters of the target control can be canceled.

[0055] It is understandable that obtaining the target user information and interface usage data of the currently logged in target user includes: When the preset interface update conditions are met, the target user information and interface usage data of the currently logged-in target user are obtained; The interface update condition includes at least one of the following: The similarity between the currently operated device list and the historical device list corresponding to the same target user is less than a preset first threshold; The usage rights of the same target user are changed and the degree of change in the usage rights is greater than a preset second threshold; The shortening trend of the operation time of the same target user in the same display interface is smaller than the preset operation trend curve.

[0056] The embodiments of the present application do not limit how to calculate the similarity. Those skilled in the art can selectively set it according to actual needs, such as using feature comparison or direct type comparison. For example, for a series of devices of the same model, most of their functions are not very different. Therefore, when the model of the device operated by the same target user changes, the interface needs to be updated. The same method can also be used to determine the usage authority.

[0057] The operation trend curve can be set according to actual needs. Different devices can set different operation trend curves, and users of different levels can set different thresholds, thereby eliminating the impact caused by device differences and user skills.

[0058] In actual use, when the interface layout of the control is relatively reasonable, as the user becomes more familiar with the interface, the change in operation time should gradually shorten and stabilize. When the operation time changes repeatedly, it can be determined that the operation is more complicated due to the control interface layout.

[0059] The embodiment of the present application also provides an electronic device, the electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the display method of the control on the human-computer interaction interface when executing the computer program. The electronic device can be any intelligent terminal including a tablet computer, a car computer, etc.

[0060] See also Figure 6 , Figure 6 The hardware structure of an electronic device of another embodiment is illustrated, and the electronic device includes: The processor 601 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application; The memory 602 may be a NAND flash, and the relevant program code is stored in the memory 602, and the processor 601 calls and executes the method for displaying the controls on the human-computer interaction interface of the embodiment of the present application; Input / output interface 603, used to implement information input and output; Communication interface 604, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.); A bus 605 that transmits information between various components of the device (e.g., processor 601, memory 602, input / output interface 603, and communication interface 604); The processor 601 , the memory 602 , the input / output interface 603 and the communication interface 604 are connected to each other in communication within the device via a bus 605 .

[0061] An embodiment of the present application also provides a computer-readable storage medium, which is a computer-readable storage medium that stores a computer program. When the computer program is executed by a processor, it implements the display method of the controls on the above-mentioned human-computer interaction interface.

[0062] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0063] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0064] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0065] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0066] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0067] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0068] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0069] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0070] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0071] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0072] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0073] The preferred embodiments of the present application are described above with reference to the accompanying drawings, but the scope of the rights of the present application is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present application should be within the scope of the rights of the present application.

Claims

1. A method for displaying controls on a human-computer interaction interface, characterized in that: The method comprises: Obtaining target user information and interface usage data of the currently logged-in target user; the interface usage data represents usage data generated by clicking on each preset control on the human-computer interaction interface; Input the target user information and the corresponding interface usage data into a preset operation prediction model to determine the prediction scores of each preset control classified into each preset display category; the operation prediction model is used to predict the prediction scores of each control classified into each display category used by different users on the same human-computer interaction interface; Determining a target menu path corresponding to each of the controls according to the prediction scores and the current menu level of each of the controls; According to the target menu path of each of the controls, each of the controls is rendered in a preset display interface.

2. The method for displaying controls on a human-computer interaction interface according to claim 1, characterized in that: The interface usage data includes a plurality of interface usage records corresponding to each of the controls; the operation prediction model includes at least two hidden layers, and the target user information and the corresponding interface usage data are input into a preset operation prediction model to determine the prediction scores of the preset controls classified into the preset display categories, including: Determine the first neurons corresponding to the target user information and each of the interface usage records in the first hidden layer; wherein at least some of the first neurons correspond to different interface usage records, and the weights configured in the first neurons inputting the same interface usage records are different; Extracting features from the target user information and the corresponding interface usage record through the first neuron to obtain first features corresponding to the first neuron one by one; Inputting the first feature into a second neuron in a second hidden layer corresponding to the first neuron; Extracting the first feature corresponding to the second neuron through the second neuron to obtain a second feature corresponding to the second neuron one by one; According to each of the second characteristics, a prediction score of each control being classified into each preset display category is determined; wherein the combination of second neurons corresponding to each display category is different.

3. The method for displaying controls on a human-computer interaction interface according to claim 1, characterized in that: The interface usage data includes usage permissions, a list of common controls, operation frequency data corresponding to each of the controls, equipment maintenance records, and equipment operation records; the operation prediction model includes an input layer, a first hidden layer, a second hidden layer, and an output layer; the target user information and the corresponding interface usage data are input into a preset operation prediction model to determine the prediction scores of each preset control classified into each preset display category, including: The target user information, the usage rights, the common control list, the operation frequency data, the device maintenance record and the device operation record are all input into the input layer; wherein the input layer combines the target user information and the usage rights, the common control list, the operation frequency data, the device maintenance record and the device operation record respectively to form a plurality of first record groups; the input layer is also used to combine the target user information, the usage rights and the operation frequency data to obtain a second record group, and the input layer is also used to combine the target user information, the common control list and the device maintenance record to obtain a third record group, Inputting each of the first record group, the second record group, the third record group and the target user information into at least one first neuron in the first hidden layer through the input layer, respectively, to obtain first features corresponding to the first neurons one by one; Inputting each of the first features into a second neuron in the second hidden layer corresponding to the first neuron, wherein each of the second neurons corresponds to at least two first neurons, and the combination of the first neurons in any two of the second neurons is different; Each of the second features is input into the output layer to obtain a prediction score for classifying each control into each preset display category.

4. The method for displaying controls on a human-computer interaction interface according to claim 1, characterized in that: The operation prediction model is trained through the following steps: Acquire user information of each user to be registered, multiple sample interface usage data corresponding to the user information, and operation interface expected view data corresponding to the user information; Determine, according to the expected view data of the operation interface, the expected display category of each of the controls corresponding to the user information one by one; Obtaining an initial operational prediction model; Input each of the user information and the corresponding sample interface usage data as a group of sample data into the initial operation prediction model for training, and perform error calculation based on the training results and the display expected category corresponding to the input sample data to determine the prediction error corresponding to each of the user information; When each of the prediction errors satisfies a preset error threshold or the number of training times is greater than or equal to a preset number threshold, the training of the operation prediction model is stopped to obtain a trained operation prediction model.

5. The method for displaying controls on a human-computer interaction interface according to claim 4, characterized in that: The operation prediction model is set as a multi-layer perceptron, and the operation steps of the operation prediction model also include: When the prediction error does not meet the error threshold and the number of training times is less than the number threshold, the prediction error is gradient solved by a preset stochastic gradient algorithm to determine the weight update gradient; Obtaining a preset learning rate, performing weighted processing on the learning rate and the weight update gradient, and obtaining a target weight update gradient; Each weight configured in the multilayer perceptron is updated according to the target weight update gradient.

6. The method for displaying controls on a human-computer interaction interface according to claim 1, characterized in that: Rendering each of the controls in a preset display interface according to the target menu path of each of the controls includes: Compare the target menu path of each control with the original menu path to determine the target control to move the menu path upward; Acquire preset enhanced rendering parameters, and render the target control according to the enhanced rendering parameters; the enhanced rendering parameters include at least one of a format parameter and an effect parameter.

7. The method for displaying controls on a human-computer interaction interface according to claim 6, characterized in that: After rendering each of the controls in the preset display interface, the method further includes: The rendered display interface is saved in a storage record corresponding to the target user in a preset interface storage database; When the target user logs in again, the display interface in the storage record corresponding to the target user is extracted from the interface storage database and displayed; When there is a target control with enhanced rendering parameters, determining the display duration of the target control; According to the display duration, the enhanced rendering parameters of the target control are canceled.

8. The method for displaying controls on a human-computer interaction interface according to claim 1, characterized in that: The step of obtaining target user information and interface usage data of the currently logged-in target user includes: When the preset interface update conditions are met, the target user information and interface usage data of the currently logged-in target user are obtained; The interface update condition includes at least one of the following: The similarity between the currently operated device list and the historical device list corresponding to the same target user is less than a preset first threshold; The usage authority of the target user is changed and the degree of change in the usage authority is greater than a preset second threshold; The duration of operation of the same target user in the same display interface decreases in a trend that is smaller than a preset operation trend curve.

9. An electronic device, characterized in that: The electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the method for displaying controls on a human-computer interaction interface as described in any one of claims 1 to 8 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method for displaying controls on a human-computer interaction interface according to any one of claims 1 to 8 is implemented.

Images