Interface display information layout evaluation method and device

Abstract

The invention discloses an interface display information layout evaluation method and device, and relates to the field of interface layout evaluation and design, and the method comprises the steps: building an interface layout task matching degree evaluation function based on an information element execution sequence network and an information element eye movement Fitts network, and obtaining a current interface layout task matching degree evaluation result; determining an attention distribution proportion of each information element in the current interface; according to the attention distribution proportion of each information element, establishing an interface layout view field suitability evaluation function, and obtaining a current interface view field suitability evaluation result; and combining the current interface layout task matching degree evaluation result with the current interface view field suitability evaluation result to obtain a current interface layout comprehensive evaluation result. According to the method, the matching degree of the execution sequence network and the eye movement Fitts network and the adaptability of the attention distribution proportion and the view field are combined, and evaluation of interface display information layout perfection is achieved.

Description

Technical Field

[0001] The present application relates to the field of interface layout evaluation and design, and in particular to a method and device for evaluating interface display information layout. Background Art

[0002] When operating complex human-machine systems, operators' browsing patterns and cognitive behaviors are closely linked to the information displayed on the interface. Efficient information acquisition directly impacts operator performance and safety. Visual information displayed on the interface is a significant factor influencing the operator's information load. Furthermore, among the many factors influencing the usability of complex information interfaces, layout design provides cognitive guidance for interface information, influencing operators' information search efficiency, visual attention behavior, and comfort. A reasonable interface display information layout can effectively control the intensity of information flow interacting with operators within cognitively acceptable limits, improving their operational efficiency and task performance. Therefore, evaluating interface display information layout is essential.

[0003] However, for complex human-computer systems, existing interface display information layout evaluation methods require evaluation only after the interface layout has been formed, and cannot perform pre-evaluation during the interface design stage. Summary of the Invention

[0004] The purpose of this application is to provide an interface display information layout evaluation method and device, which can quantitatively evaluate potential interface layout design schemes in the design stage before the product is formed, so that the final design can better meet the established requirements, which is conducive to improving the information search efficiency, task performance and safety of complex system operators.

[0005] To achieve the above objectives, this application provides the following solutions:

[0006] In a first aspect, the present application provides a method for evaluating an interface display information layout, comprising:

[0007] The information displayed on the current interface is obtained; the information displayed on the current interface includes all information elements in the interface, the position of each information element, and the execution order of the information elements in each task.

[0008] Based on the information displayed on the current interface, an information element execution sequence network is constructed.

[0009] Based on the information displayed on the current interface, an information element eye movement Fitts network is constructed.

[0010] According to the information element execution sequence network and the information element eye movement Fitts network, an interface layout task matching evaluation function is established, and the matching degree between the position of the information element and the execution order of the information element in the task is evaluated by the interface layout task matching evaluation function to obtain the current interface layout task matching evaluation result.

[0011] Determine the attention allocation ratio of each information element in the current interface.

[0012] According to the information attention allocation ratio of each information element in the current interface, an interface layout field of view adaptability evaluation function is established, and the interface layout field of view adaptability evaluation function is used to evaluate the degree of matching between the attention allocation ratio of the information element and the position of the information element to obtain the current interface field of view adaptability evaluation result.

[0013] The task matching evaluation result of the current interface layout is combined with the visual field adaptability evaluation result of the current interface to obtain a comprehensive evaluation result of the current interface layout.

[0014] In a second aspect, the present application provides another method for evaluating the layout of interface display information, comprising:

[0015] The first operation is performed on each interface in the entire layout design to obtain a layout comprehensive evaluation result corresponding to each interface.

[0016] Determine the importance of each interface.

[0017] The importance of each interface is multiplied by the comprehensive layout evaluation result corresponding to each interface to obtain the product result of each interface.

[0018] The product results of all interfaces are summed up to obtain the overall evaluation result of the entire layout design.

[0019] The first operation is:

[0020] The information displayed on the current interface is obtained; the information displayed on the current interface includes all information elements in the interface, the position of each information element, and the execution order of the information elements in each task.

[0021] Based on the information displayed on the current interface, an information element execution sequence network is constructed.

[0022] Based on the information displayed on the current interface, an information element eye movement Fitts network is constructed.

[0023] According to the information element execution sequence network and the information element eye movement Fitts network, an interface layout task matching evaluation function is established, and the matching degree between the position of the information element and the execution order of the information element in the task is evaluated by the interface layout task matching evaluation function to obtain the current interface layout task matching evaluation result.

[0024] Determine the attention allocation ratio of each information element in the current interface.

[0025] According to the attention allocation ratio of each information element in the current interface, an interface layout field of view adaptability evaluation function is established, and the interface layout field of view adaptability evaluation function is used to evaluate the degree of matching between the attention allocation ratio of the information element and the position of the information element to obtain the current interface field of view adaptability evaluation result.

[0026] The task matching evaluation result of the current interface layout is combined with the visual field adaptability evaluation result of the current interface to obtain a comprehensive evaluation result of the current interface layout.

[0027] In a third aspect, the present application provides a computer device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the interface display information layout evaluation method described in any of the above aspects.

[0028] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0029] The present application provides an interface display information layout evaluation method and device. Based on the information element execution sequence network and the information element eye movement Fitts network, an interface layout task matching evaluation function is established to obtain the current interface layout task matching evaluation result; the attention allocation ratio of each information element in the current interface is determined; according to the attention allocation ratio of each information element in the current interface, an interface layout visual field adaptability evaluation function is established to obtain the current interface visual field adaptability evaluation result; the current interface layout task matching evaluation result is combined with the current interface visual field adaptability evaluation result to obtain the current interface layout comprehensive evaluation result. The present application combines the matching degree of the execution sequence network with the eye movement Fitts network and the adaptability of the attention allocation ratio with the visual field, realizing a comprehensive preliminary evaluation of the interface display information layout, so that the final layout design can better meet the established requirements, which is conducive to improving the information search efficiency, task performance and safety of complex system operators. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0031] Figure 1 This is an application environment diagram of an interface display information layout evaluation method in one embodiment of the present application;

[0032] Figure 2 A flowchart of a method for evaluating an interface display information layout provided in one embodiment of the present application;

[0033] Figure 3 A diagram of an eye movement Fitts network of information elements provided in one embodiment of the present application;

[0034] Figure 4 A diagram of an eye movement Fitts network, another information element, provided in an embodiment of the present application;

[0035] Figure 5 A schematic diagram of the regional division of visual field perception intensity provided by an embodiment of the present application;

[0036] Figure 6 A schematic diagram of the structure of a computer device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0037] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0038] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should have the usual meanings understood by people with ordinary skills in the field to which this application belongs. The "first", "second" and similar words used in the embodiments of the present application do not indicate any order, quantity or importance, but are only used to distinguish different components. The "include" or "comprising" and similar words used in the embodiments of the present application mean that the elements, objects or method steps appearing before the word cover the elements, objects or method steps listed after the word and their equivalents, without excluding other elements, objects or method steps. The "connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0039] As described in the background technology section, when operating a complex human-machine system, the operator's browsing mode and cognitive behavior are related to the display of information in the interface. Whether the information can be obtained efficiently will directly affect the operator's work performance and safety. The visual information displayed on the interface is an important factor affecting the operator's information load. At the same time, among the many factors that affect the usability of a complex information interface, the layout design has cognitive guidance for the interface information, affecting the operator's information search efficiency, visual attention behavior and comfort. A reasonable interface display information layout can effectively control the intensity of the information flow interacting with the operator within the cognitive allowable limit, thereby improving their operational efficiency and task performance. Therefore, it is very necessary to evaluate the interface display information layout. However, for complex human-machine systems, the existing interface display information layout evaluation method requires that the interface layout be formed before evaluation can be completed, and the evaluation cannot be completed during the interface design stage.

[0040] In order to solve the above technical problems, this application combines the matching degree of the execution sequence network and the eye movement Fitts network and the adaptability of the attention allocation ratio and the visual field, thereby realizing a preliminary evaluation of the perfect layout of the interface display information, so that the final layout design can better meet the established requirements, which is conducive to improving the information search efficiency, task performance and safety of complex system operators.

[0041] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.

[0042] Example 1

[0043] The interface display information layout evaluation method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown, the terminal 102 communicates with the server 104 via a network. The data storage system can store data that the server 104 needs to process. The data storage system can be set up separately, integrated on the server 104, or placed on the cloud or other servers. The terminal 102 can send the information displayed on the current interface to the server 104. After the server 104 receives the information displayed on the current interface, for the information displayed on the current interface, the server 104 constructs an information element execution sequence network based on the information displayed on the current interface; constructs an information element eye movement Fitts network based on the information displayed on the current interface; establishes an interface layout task matching evaluation function based on the information element execution sequence network and the information element eye movement Fitts network, and uses the interface layout task matching evaluation function to evaluate the matching degree between the position of the information element and the execution order of the information element in the task, thereby obtaining a current interface layout task matching evaluation result; determines the attention allocation ratio of each information element in the current interface; establishes an interface layout visual field adaptability evaluation function based on the information attention allocation ratio of each information element in the current interface, and uses the interface layout visual field adaptability evaluation function to evaluate the matching degree between the attention allocation ratio of the information element and the position of the information element, thereby obtaining a current interface visual field adaptability evaluation result; combines the current interface layout task matching evaluation result with the current interface visual field adaptability evaluation result to obtain a comprehensive evaluation result of the current interface layout. The server 104 can provide feedback on the comprehensive evaluation results of the current interface layout to the terminal 102. Furthermore, in some embodiments, the interface display information layout evaluation method can also be implemented independently by the server 104 or the terminal 102. For example, the terminal 102 can directly construct an information element execution sequence network and an information element eye movement Fitts network based on the information displayed on the current interface; or the server 104 can obtain the information displayed on the current interface from a data storage system and construct an information element execution sequence network and an information element eye movement Fitts network based on the information displayed on the current interface.

[0044] The terminal 102 may be, but is not limited to, various desktop computers, laptop computers, smartphones, tablet computers, and portable wearable devices. Portable wearable devices may include smart watches, smart bracelets, head-mounted devices, etc. The server 104 may be implemented as a standalone server or a server cluster consisting of multiple servers, or may be a cloud server.

[0045] In an exemplary embodiment, Figure 2 As shown, a method for evaluating the layout of information displayed on an interface is provided. The method is executed by a computer device, specifically a computer device such as a terminal or a server, or a terminal and a server. In the embodiment of the present application, the method is applied to Figure 1The server 104 in the example is used as an example to illustrate the process, including the following steps 201 to 207.

[0046] Step 201: Obtain information displayed on the current interface.

[0047] The information displayed on the current interface includes all information elements in the interface, the position of each information element, and the execution order of the information elements in each task.

[0048] Step 202: construct an information element execution sequence network based on the information displayed on the current interface.

[0049] Step 203: construct an information element eye movement Fitts network based on the information displayed on the current interface.

[0050] In step 204, an interface layout task matching evaluation function is established based on the information element execution sequence network and the information element eye movement Fitts network. The matching degree between the position of the information element and the execution sequence of the information element in the task is evaluated by the interface layout task matching evaluation function to obtain the current interface layout task matching evaluation result.

[0051] Step 205: Determine the attention allocation ratio of each information element in the current interface.

[0052] Step 206: Establish an interface layout field of view adaptability evaluation function based on the information attention allocation ratio of each information element in the current interface, and use the interface layout field of view adaptability evaluation function to evaluate the degree of matching between the attention allocation ratio of the information element and the position of the information element to obtain the current interface field of view adaptability evaluation result.

[0053] Step 207 : Combining the task matching evaluation result of the current interface layout with the visual field adaptability evaluation result of the current interface layout to obtain a comprehensive evaluation result of the current interface layout.

[0054] By implementing the above-mentioned steps 201 to 207, the present application combines the matching degree of the execution sequence network with the eye movement Fitts network and the adaptability of the attention allocation ratio with the visual field, thereby realizing a preliminary evaluation of the perfect layout of the interface display information, so that the final layout design can better meet the established requirements, which is conducive to improving the information search efficiency, task performance and safety of complex system operators.

[0055] As an optional implementation, step 202 specifically includes:

[0056] Step 202.1, define all information elements in the current interface as network graph vertices (vertices for short).

[0057] Step 202.2: Determine all tasks on the current interface, the execution order of the tasks, and the execution order of the information elements in each task.

[0058] Step 202.3, based on all the tasks in the current interface, the execution order of the tasks, and the execution order of the information elements in each task, determine whether any two network diagram vertices are adjacent during the task execution process, and if so, establish an edge between any two of the network diagram vertices.

[0059] Step 202.4: Determine the first edge weight of each edge based on the connection strength between the two network graph vertices corresponding to each edge.

[0060] The maximum connection strength among all connection strengths is recorded as MaxC,

[0061] Step 202.5: Establish an information element execution sequence network based on the network graph vertices, edges and first edge weights in the current interface.

[0062] Furthermore, in step 202.4, the connection strength between two vertices in the current interface is determined as follows:

[0063] 1) For each task in the current interface, based on the information elements contained in the task and the execution order of the information elements, determine the number of times two network graph vertices are adjacent during the execution of the task, and determine the number as the local connection strength of the two network graph vertices in the task.

[0064] 2) The local connection strengths of the two network graph vertices in each task are summed to obtain the connection strength of the two network graph vertices.

[0065] Alternatively, the process of determining the connection strength between every two vertices in the current interface can be described as follows:

[0066] 1) According to the execution order of tasks, the first task on the current interface is determined as the current task.

[0067] 2) Determine the order of the information elements contained in the current task.

[0068] 3) Determine whether two vertices are adjacent during task execution. If not, the connection strength of the two vertices remains unchanged; if so, the connection strength of the two vertices is increased by 1; the initial value of the connection strength of the two vertices is 0.

[0069] 4) Traverse all vertices in the current task and obtain the local connection strength between every two vertices in the current task.

[0070] 5) Repeat steps 1) to 4) above to calculate the local connection strength between every two vertices in each task until all tasks in the current interface are traversed.

[0071] 6) Sum the local connection strengths of every two vertices in each task to obtain the connection strength of every two vertices in the current interface.

[0072] As an optional implementation, step 203 specifically includes:

[0073] Step 203.1: Define all information elements in the current interface as network graph vertices.

[0074] Step 203.2: Determine all tasks on the current interface, the execution order of the tasks, and the execution order of the information elements in each task.

[0075] Step 203.3, based on all the tasks in the current interface, the execution order of the tasks, and the execution order of the information elements in each task, determine whether any two network diagram vertices are adjacent during the task execution process. If so, establish an edge between any two of the network diagram vertices.

[0076] Step 203.4, calculate the strength of each edge; the strength of the edge is the pointing time MT obtained by studying Fitts' law of eye movement.

[0077] In step 203.4, an eye tracker is used to record the time the gaze is directed toward different targets (i.e., information elements). The start time of the recording is the appearance of the target, and the end time of the recording is the end of the secondary correction saccade following the primary saccade. The independent variables of the target in this experiment include area, shape, movement amplitude, and movement direction.

[0078] By statistically analyzing the experimental data, the calculation formula for the pointing time MT is obtained as follows:

[0079] MT = a + blog2(αβ(d / s)+1);

[0080] Where MT is the pointing time, a and b are constants, α is the direction coefficient, β is the aspect ratio coefficient, d is the amplitude between two information elements, and s is the area of ​​the information element.

[0081] Step 203.5: Determine the second edge weight of each edge based on the strength of each edge.

[0082] In step 203.5, the edge weight is calculated as follows: w = 1-MT / MaxMT, where MaxMT represents the maximum value among all MTs.

[0083] Step 203.6: Based on the connection edge and the second edge weight, construct the information element eye movement Fitts network.

[0084] As an optional implementation, step 204 specifically includes:

[0085] Step 204.1: extract the first adjacency matrix A1 from the information element execution sequence network. The element a in the first adjacency matrix A1 is 1ij The definition is as follows:

[0086]

[0087] Among them, w 1ij It is the first edge weight of the edge connecting vertex i and vertex j in the information element execution sequence network.

[0088] Step 204.2: Extract the second adjacency matrix A2 from the information element eye movement Fitts network. The element a in the second adjacency matrix A2 is 2ij The definition is as follows:

[0089]

[0090] Among them, w 2ij It is the second edge weight of the edge connecting vertex i and vertex j in the information element eye movement Fitts network.

[0091] Step 204.3: Substitute the α of the first adjacency matrix A1 1ij and α of the second adjacency matrix A2 2ij As feature points, the modified cosine similarity between the row vectors in the two matrices is calculated; the calculation formula of the modified cosine similarity is:

[0092]

[0093] Among them, a 1i is the i-th row vector of the first adjacency matrix A1, a 2i is the i-th row vector of the second adjacency matrix A2; a 1ij is the first edge weight of the edge connecting information element i and information element j in the first adjacency matrix; a 2ij is the second edge weight of the edge connecting information element i and information element j in the second adjacency matrix; is the average value of the i-th row vector of the first adjacency matrix A1; is the average value of the i-th row vector of the second adjacency matrix A2.

[0094] In step 204.4, the modified cosine similarities between all row vectors in the two matrices are summed and averaged to obtain the interface layout task matching evaluation function:

[0095]

[0096] Where N is the dimension of the adjacency matrix.

[0097] Figure 3 and Figure 4 Two different diagrams of Fitts networks for eye movement of information elements are given. For the information element execution sequence network, for example, the order of information elements in a task is ABAC, then vertex A and vertex B are adjacent in the task execution sequence, there is an edge, and the connection strength is 2, vertex A and vertex C are adjacent in the task execution sequence, there is an edge, and the connection strength is 1, vertex B and vertex C are not adjacent in the task execution sequence, there is no edge, and the connection strength is 0. At this time, for Figure 3 The information element eye movement Fitts network, vertex A and vertex B are closer, vertex B and vertex C are closer, and vertex A and vertex C are farther away; Figure 4 The information element eye movement Fitts network shows that the distance between vertex A and vertex B is closer, the distance between vertex B and vertex C is farther, and the distance between vertex A and vertex C is closer. Figure 3 and Figure 4 It can be seen that when executing task ABAC, Figure 4 The information element layout of the task is more consistent with the information element operation order of the task, so the calculated matching evaluation function value will be higher. That is to say, for the information element execution sequence network, if the order of the information elements in a task is ABAC, then Figure 4 Layout ratio Figure 3 The layout is better.

[0098] It should be understood by those skilled in the art that Figure 3 and Figure 4 This is just a relatively simple example, and the layout effect can be judged intuitively (the areas of the three information elements A, B and C are equal, and the distances between the information elements satisfy a=c, b=d). In actual application, the current interface includes multiple tasks, and the number of information elements in each task will also be greater, and the order of information elements will also be more complicated. At this time, the interface layout task matching evaluation can be completed by calculating the matching evaluation function value. The purpose of the interface layout task matching evaluation is to determine whether the interface elements match the functional module layout of the interface elements (or the position layout of the information elements) in the execution order of the task. The larger the function value of the matching evaluation function, the more reasonable the layout.

[0099] As an optional implementation, Figure 5 As shown, step 205 includes:

[0100] Step 205.1: Determine the important membership degree u of the information element based on the task manual and prior knowledge. k .

[0101] Step 205.2: Determine the priority of the information element according to the importance of the information element.

[0102] The priority of the information element can be expressed by the importance of the information element:

[0103] V k =-ln(1-u k );

[0104] Among them, V k is the priority of information element k, u k is the important membership of information element k.

[0105] Step 205.3: Determine the mixed entropy of the information element based on the probability entropy and the binary fuzzy entropy of the information element.

[0106] The mixed entropy of the information element can be calculated using the probability entropy and binary fuzzy entropy of the information element:

[0107]

[0108] S k =p k +h k ;

[0109] Among them, p k is the probability entropy of information element k, β k is the probability of correctly evaluating information element k, is the binary fuzzy entropy of information element k, S k is the mixing entropy of information element k.

[0110] Step 205.4, based on the mixed entropy of the information element and using the maximum entropy principle, the probability of correctly evaluating the information element is determined.

[0111]

[0112] Step 205.5: Determine the prominence of the information element according to the information prominence model.

[0113] The calculation formula for the prominence of the information element is:

[0114]

[0115] Among them, Sa k is the salience of information element k, c k is the color of information element k, l k is the size of information element k, t k is the character type of information element k.

[0116] Step 205.6, based on the priority of the information element, the probability of correctly evaluating the information element, and the prominence of the information element, the subjective expected effectiveness theory is used to determine the predicted value of attention allocation of the information element.

[0117] The calculation formula of the attention allocation prediction value of the information element is:

[0118] A k =β k V k Sa k ;

[0119] Among them, A k Assign a predicted value to the attention of information element k.

[0120] Step 205.7: Determine the attention allocation ratio F of the information element based on the attention allocation prediction value of the information element. k .

[0121] The attention allocation ratio F of the information element k The calculation formula is:

[0122]

[0123] In this embodiment, the attention allocation prediction value A of the information element k and the attention allocation ratio F of the information element k Compositional information attention allocation prediction model.

[0124] As an optional implementation, step 206 includes:

[0125] Step 206.1: Divide the three-dimensional space into sub-areas of different perception intensities according to the human visual field division model.

[0126] Based on research on human visual behavior, the human visual field is divided into the foveal, parafoveal, juxtafoveal, relaxed eye movement, maximum eye movement, and a combination of relaxed eye movement and relaxed head movement, thus dividing three-dimensional space into sub-regions of varying perceptual intensity. The foveal, parafoveal, and juxtafoveal regions are all cone-shaped, while the relaxed eye movement, maximum eye movement, and relaxed eye movement and relaxed head movement regions are each composed of two halves of an elliptical cone. Figure 5 This is the projection of the field of view partition model on a plane perpendicular to the human eye's line of sight. The values ​​in the figure are the viewing angle values ​​in degrees (°).

[0127] Step 206.2: vertically project the current interface display area onto a plane perpendicular to the line of sight of the human eye to obtain a projection plane, and grid the projection plane to determine the perception intensity level of the current interface display area.

[0128] Among them, the perceptual intensity level of each area is different, and the perceptual intensity level can be calculated by the reaction time and accuracy of the subjects in the eye movement experimental paradigm of judging whether the target (information element) exists.

[0129] Project the current interface display area on a plane perpendicular to the human eye's line of sight. Figure 5 The visual field division model shown in the figure can be used to determine the perceptual intensity level of each area of ​​the plane. The projected plane is gridded to calculate the area of ​​the information element.

[0130] Step 206.3: Calculate the visual perception intensity of information element k in the current interface. The calculation formula for the visual perception intensity is:

[0131]

[0132] Among them, E k is the visual perception intensity of the kth information element; F k is the attention allocation ratio of information element k; x e is the perceptual intensity level of sub-region e; y ke is the number of basic cells of information element k in sub-region e; m is the total number of divided regions.

[0133] Step 206.4: sum the visual perception intensities of all information elements in the current interface to obtain an interface layout visual field adaptability evaluation function Z; the interface layout visual field adaptability evaluation function Z is:

[0134]

[0135] Where n is the total number of information elements.

[0136] As an optional implementation, in step 207, the calculation formula of the comprehensive evaluation result of the current interface layout is:

[0137] T f =R f Z f ;

[0138] Among them, T f is the comprehensive evaluation result of the current interface f layout, R f is the task matching evaluation result of the current interface f layout, Z f is the adaptability evaluation result of the current interface f field of view.

[0139] Example 2

[0140] In another exemplary embodiment of the present application, after obtaining the comprehensive evaluation result of the current interface layout, other interface display information layouts can be further evaluated to obtain the overall evaluation result of the entire layout design. The specific steps are as follows:

[0141] 1) Execute steps 201 to 207 described in Example 1 for each interface in the entire layout design to obtain a comprehensive layout evaluation result corresponding to each interface.

[0142] 2) Determine the importance of each interface.

[0143] The importance of each task scenario (h in total) is obtained through data collection and analysis f The task matching degree and field of view adaptability of the interface display information layout of each task scene are evaluated, and normalized and averaged weighted to obtain the evaluation value T f =R f +Z f .

[0144] 3) Multiply the importance of each interface by the comprehensive layout evaluation result corresponding to each interface to obtain the product result of each interface.

[0145] 4) Sum the product results of all interfaces to obtain the overall evaluation result of the entire layout design. The calculation formula for the overall evaluation result M of the entire layout design is:

[0146]

[0147] Among them, M is the total evaluation result of the entire layout design, h is the number of sub-interfaces in the entire layout design, ω f is the importance of the f-th sub-interface.

[0148] The present application also provides an application scenario, which applies the above-mentioned interface display information layout evaluation method. Specifically, the technical solution provided by the present application is applicable to the display information layout evaluation of complex system display and control interfaces such as train driver's cabs, aircraft cockpits, and nuclear power plant control rooms, and can provide guidance for interface design. It should be noted that the information elements mentioned in this application can be visual information displayed on the display screen in the train driver's cab, aircraft cockpit, or nuclear power plant control room (auditory information is not considered), or switches and buttons on the console.

[0149] It should be noted that, unlike the traditional method of "complete the layout design first and then evaluate", the interface display information layout evaluation method provided in this application can not only evaluate the interface display information layout after the layout design is completed, but also perform pre-evaluation during the design process, and is suitable for all stages of the interface layout design process.

[0150] In an exemplary embodiment, a computer device is provided. The computer device may be a server or a terminal. The internal structure diagram thereof may be as follows: Figure 6 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, abbreviated as I / O) and a communication interface. The processor, memory and input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The database of the computer device is used to store information displayed on the current interface. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it implements a method for evaluating the layout of interface display information.

[0151] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0152] In an exemplary embodiment, a computer device is further provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0153] In an exemplary embodiment, a computer-readable storage medium is provided, storing a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0154] In an exemplary embodiment, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0155] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0156] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM may be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0157] The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processors involved in the various embodiments provided herein may include, but are not limited to, general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic units, data processing logic units based on quantum computing, and the like.

[0158] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0159] This document uses specific examples to illustrate the principles and implementation methods of this application. The description of the above examples is only intended to help understand the method and core concept of this application. At the same time, for those skilled in the art, based on the concept of this application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A method for evaluating interface display information layout, characterized in that: The interface display information layout evaluation method includes: Obtain information displayed on the current interface; the information displayed on the current interface includes all information elements in the interface, the position of each information element, and the execution order of the information elements in each task; Based on the information displayed on the current interface, construct an information element execution sequence network; Constructing an information element eye movement Fitts network based on the information displayed on the current interface; Establishing an interface layout task matching evaluation function based on the information element execution sequence network and the information element eye movement Fitts network, and using the interface layout task matching evaluation function to evaluate the matching between the position of the information element and the execution sequence of the information element in the task, thereby obtaining a current interface layout task matching evaluation result; Determining the attention allocation ratio of each information element in the current interface; Establishing an interface layout visual field adaptability evaluation function based on the information attention allocation ratio of each information element in the current interface, and using the interface layout visual field adaptability evaluation function to evaluate the degree of matching between the information element's attention allocation ratio and the information element's position, thereby obtaining a current interface visual field adaptability evaluation result; The task matching evaluation result of the current interface layout is combined with the visual field adaptability evaluation result of the current interface to obtain a comprehensive evaluation result of the current interface layout.

2. The interface display information layout evaluation method according to claim 1, characterized in that: Based on the information displayed on the current interface, an information element execution sequence network is constructed, specifically including: Define all information elements in the current interface as network graph vertices; Determine all tasks on the current interface, the order in which tasks are executed, and the order in which information elements are executed in each task; Based on all tasks in the current interface, the execution order of tasks, and the execution order of information elements in each task, determine whether any two network graph vertices are adjacent during the task execution process; if so, establish an edge between any two network graph vertices; Determine the first edge weight of each edge based on the connection strength between the two network graph vertices corresponding to each edge; Based on the network graph vertices, edges and first edge weights in the current interface, establish an information element execution sequence network; The process of determining the connection strength between two network graph vertices is as follows: For each task in the current interface, according to the information elements contained in the task and the execution order of the information elements, determine the number of times two vertices of the network graph are adjacent during the execution of the task, and determine the number as the local connection strength of the two vertices of the network graph in the task; The local connection strengths of the two network graph vertices in each task are summed to obtain the connection strengths of the two network graph vertices.

3. The interface display information layout evaluation method according to claim 1, characterized in that: Based on the information displayed on the current interface, an information element eye movement Fitts network is constructed, specifically including: Define all information elements in the current interface as network graph vertices; Determine all tasks on the current interface, the order in which tasks are executed, and the order in which information elements are executed in each task; Based on all tasks in the current interface, the execution order of tasks, and the execution order of information elements in each task, determine whether any two network graph vertices are adjacent during the task execution process; if so, establish an edge between any two network graph vertices; Calculating the strength of each edge; the strength of the edge is the pointing time MT obtained by studying Fitts' law of eye movement; Determine the second edge weight of each edge based on the strength of each edge; Based on the connection edge and the second edge weight, the information element eye movement Fitts network is constructed.

4. The interface display information layout evaluation method according to claim 3, characterized in that: The calculation formula of pointing time MT is: MT=a+b log2(αβ(d / s)+1); Where MT is the pointing time, a and b are constants, α is the direction coefficient, β is the aspect ratio coefficient, d is the amplitude between two information elements, and s is the area of ​​the information element.

5. The interface display information layout evaluation method according to claim 1, characterized in that: An interface layout task matching evaluation function is established based on the information element execution sequence network and the information element eye movement Fitts network. The interface layout task matching evaluation function is used to evaluate the matching between the position of the information element and the execution sequence of the information element in the task, thereby obtaining a current interface layout task matching evaluation result, which specifically includes: Extracting a first adjacency matrix A1 from the information element execution sequence network; Extracting a second adjacency matrix A2 from the information element eye movement Fitts network; The first adjacency matrix A1 a 1ij and a of the second adjacency matrix A2 2ij As feature points, the modified cosine similarity between the row vectors in the two matrices is calculated; the calculation formula of the modified cosine similarity is: Among them, a 1i is the i-th row vector of the first adjacency matrix A1, a 2i is the i-th row vector of the second adjacency matrix A2; a 1ij is the first edge weight of the edge connecting information element i and information element j in the first adjacency matrix; a 2ij is the second edge weight of the edge connecting information element i and information element j in the second adjacency matrix; is the average value of the i-th row vector of the first adjacency matrix A1; is the average value of the i-th row vector of the second adjacency matrix A2; The modified cosine similarities between all row vectors in the two matrices are summed and averaged to obtain the interface layout task matching evaluation function: Where N is the dimension of the adjacency matrix.

6. The interface display information layout evaluation method according to claim 1, characterized in that: Determining the attention allocation ratio of each information element in the current interface specifically includes: Determine the importance of information elements based on the task manual and prior knowledge; Determine the priority of information elements according to their importance; Determine the mixed entropy of the information element according to the probability entropy and binary fuzzy entropy of the information element; According to the mixed entropy of information elements, the probability of correctly evaluating the information elements is determined using the maximum entropy principle; According to the information salience model, determine the salience of information elements; Based on the priority of information elements, the probability of correctly evaluating information elements and the salience of information elements, the subjective expected efficacy theory is used to determine the predicted value of attention allocation to information elements. An attention allocation ratio of the information element is determined according to the attention allocation prediction value of the information element.

7. The interface display information layout evaluation method according to claim 1, characterized in that: Based on the attention allocation ratio of each information element in the current interface, an interface layout visual field adaptability evaluation function is established, and the degree of matching between the attention allocation ratio of the information element and the position of the information element is evaluated by the interface layout visual field adaptability evaluation function to obtain the current interface visual field adaptability evaluation result, which specifically includes: Based on the human visual field partition model, the three-dimensional space is divided into sub-areas with different perception intensities; Vertically projecting the current interface display area onto a plane perpendicular to the line of sight of the human eye to obtain a projection plane, and gridding the projection plane to determine the perceptual intensity level of the current interface display area; Calculate the visual perception intensity of information element k in the current interface. The calculation formula of the visual perception intensity is: Among them, E k is the visual perception intensity of the kth information element; F k is the attention allocation ratio of information element k; x e is the perceptual intensity level of sub-region e; y ke is the number of basic cells of element k in sub-region e; m is the total number of divided regions; The visual perception intensity of all information elements in the current interface is summed to obtain the interface layout visual field adaptability evaluation function Z; the interface layout visual field adaptability evaluation function Z is: Where n is the total number of information elements.

8. The interface display information layout evaluation method according to claim 1, characterized in that: The calculation formula for the comprehensive evaluation result of the current interface layout is: T f =R f Z f ; Among them, T f is the comprehensive evaluation result of the current interface f layout; R f is the task matching evaluation result of the current interface f layout, Z f is the adaptability evaluation result of the current interface f field of view.

9. A method for evaluating interface display information layout, characterized in that: The interface display information layout evaluation method includes: Performing the first operation on each interface in the entire layout design to obtain a comprehensive layout evaluation result corresponding to each interface; Determine the importance of each interface; Multiply the importance of each interface by the comprehensive evaluation result of the layout corresponding to each interface to obtain the product result of each interface; Sum up the product results of all interfaces to get the overall evaluation result of the entire layout design; The first operation is: Obtain information displayed on the current interface; the information displayed on the current interface includes all information elements in the interface, the position of each information element, and the execution order of the information elements in each task; Based on the information displayed on the current interface, construct an information element execution sequence network; Constructing an information element eye movement Fitts network based on the information displayed on the current interface; Establishing an interface layout task matching evaluation function based on the information element execution sequence network and the information element eye movement Fitts network, and using the interface layout task matching evaluation function to evaluate the matching between the position of the information element and the execution sequence of the information element in the task, thereby obtaining a current interface layout task matching evaluation result; Determining the attention allocation ratio of each information element in the current interface; Establishing an interface layout visual field adaptability evaluation function based on the attention allocation ratio of each information element in the current interface, and using the interface layout visual field adaptability evaluation function to evaluate the degree of matching between the attention allocation ratio of the information element and the position of the information element, thereby obtaining a visual field adaptability evaluation result of the current interface; The task matching evaluation result of the current interface layout is combined with the visual field adaptability evaluation result of the current interface to obtain a comprehensive evaluation result of the current interface layout.

10. A computer device comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the interface display information layout evaluation method described in any one of claims 1 to 8 or the interface display information layout evaluation method described in claim 9.

Images