Interface evaluation and comparison system and method based on evaluation indexes and operation states

By designing an interface evaluation and comparison system based on evaluation indicators and operation status, the problem of insufficient integration of refined indicators and situational awareness in interface evaluation is solved, and detailed evaluation of interactive interfaces and multi-interface comparison is realized to guide the interface of complex industrial systems. Design optimization improves personnel efficiency and safety.

CN119204768APending Publication Date: 2024-12-27BEIHANG UNIV +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311501791.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-11-10
Publication Date
2024-12-27

AI Technical Summary

Technical Problem

The existing technology lacks detailed human-software interface evaluation indicators in interface evaluation, does not fully integrate personnel situation awareness and workload status, and the evaluation strategy is insufficient to effectively guide the optimization of interactive interface design of complex industrial systems.

Method used

An interface evaluation and comparison system based on evaluation indicators and operation status was designed, including interface evaluation subsystem and interface comparison subsystem. By importing interface information, relevant evaluation indicators and operation status data, human-caused evaluation and multi-interface comparison are carried out. Use specific formulas to calculate the comprehensive evaluation score and output the evaluation results.

Benefits of technology

It realizes detailed evaluation and multi-interface comparison of the interactive interface, provides direct guidance for human factors evaluation and design optimization in complex industrial systems, and improves personnel operation efficiency and human factors safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119204768A_ABST
    Figure CN119204768A_ABST
Patent Text Reader

Abstract

The invention provides an interface evaluation and comparison system based on evaluation indexes and operation states. The system can achieve interface evaluation based on evaluation indexes and operation states, provides an interface comparison method based on evaluation indexes and operation states, has the advantages of being suitable for first-line engineering practice, wide in comparison range, multiple in index category and the like, can provide technical support for human factor evaluation and design optimization of a complex industrial system interaction interface, and has a wide application prospect. Therefore, operation efficiency of personnel is improved, and human safety is guaranteed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an interface evaluation and comparison system and method based on evaluation indicators and operation status. Background Art

[0002] Conducting human factors assessment and design optimization of interactive interfaces plays an important role in the research and development of complex industrial systems. It can reduce technical risks and costs and improve system performance and human safety.

[0003] At present, there is insufficient research on interface evaluation and comparison based on evaluation indicators and work status. First, most interface evaluation studies are based on limited interface evaluation indicators and lack sufficiently detailed interface-related evaluation indicators for human-software interfaces. Second, related studies rarely involve the integration of interface-related evaluation indicators with personnel work status, especially the integration of personnel situational awareness and workload status; finally, there is a lack of practical research on interface evaluation and comparison based on evaluation indicators and work status, and the corresponding evaluation strategy still needs to be further improved.

[0004] Based on the above situation, an interface evaluation and comparison system based on evaluation indicators and operating status is designed, which can solve the above shortcomings and be applied to the human factors evaluation and optimization design of the interactive interface in the typical R&D stage, so as to provide a certain reference for the integrated design of people and systems throughout the life cycle. Summary of the invention

[0005] The purpose of the present invention is to provide an interface evaluation and comparison system and method based on evaluation indicators and operation status. The system and method provide an interface evaluation system based on evaluation indicators and operation status, and propose an interface comparison method based on evaluation indicators and operation status.

[0006] According to one aspect of the present invention, there is provided an interface evaluation and comparison system based on evaluation indicators and operation status, which includes: an interface evaluation subsystem for completing the import of interface information, relevant evaluation indicators, and operation status data, conducting human factors evaluation of the interface and providing evaluation results; an interface comparison subsystem for adding information of the interface to be compared, completing the comparison of the interface, and outputting the comparison results.

[0007] According to one aspect of the present invention, there is provided an interface evaluation subsystem, which includes: an interface information import module for inputting interface information; an interface-related evaluation index import module for inputting interface-related evaluation indexes; a job status data import module for inputting personnel's job status data; an interface evaluation module for carrying out human factors evaluation of the interface; and an evaluation result output module for outputting the evaluation results of the interface.

[0008] According to a further aspect of the present invention, the interface comparison subsystem includes an interface information adding module, an interface comparison module, and an interface comparison result output module. The interface information adding module is used to add information of the interface to be compared; the interface comparison module is used to perform interface comparison; and the interface comparison result output module is used to output the interface comparison result.

[0009] According to one aspect of the present invention, there is provided an interface evaluation and comparison method based on evaluation indicators and operation status, which includes: an interface evaluation sub-step, used to complete the import of interface information, relevant evaluation indicators, and operation status data, carry out human factors evaluation of the interface and give evaluation results; an interface comparison sub-step, used to add information of the interface to be compared, complete the comparison of the interface, and output the comparison results.

[0010] According to one aspect of the present invention, an interface evaluation sub-step is provided, which includes: an interface information importing step for inputting interface information; an interface-related evaluation index importing step for inputting interface-related evaluation indexes; a job status data importing step for inputting personnel's job status data; an interface evaluation step for conducting a human factors evaluation of the interface; and an evaluation result outputting step for outputting the evaluation results of the interface.

[0011] According to a further aspect of the present invention, the interface comparison sub-step includes an interface information adding step, an interface comparison step, and an interface comparison result outputting step. The interface information adding step is used to add information of the interface to be compared; the interface comparison step is used to perform interface comparison; and the interface comparison result outputting step is used to output the interface comparison result. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 The figure is a general structural diagram of an interface evaluation and comparison system based on evaluation indicators and operation status according to an embodiment of the present invention.

[0013] Figure 2 The figure is a general working flow chart of an interface evaluation and comparison system based on evaluation indicators and operation status according to an embodiment of the present invention.

[0014] Figure 3 The following is a flowchart of the interface evaluation subsystem according to an embodiment of the present invention.

[0015] Figure 4 The following is a flowchart of the interface comparison subsystem according to an embodiment of the present invention.

[0016] Figure 5A-5D The figure is an example diagram of an interface evaluation and comparison system based on evaluation indicators and operation status according to an embodiment of the present invention. DETAILED DESCRIPTION

[0017] like Figure 1 As shown, the interface evaluation and comparison system based on evaluation indicators and operation status according to the present invention includes an interface evaluation subsystem and an interface comparison subsystem. The interface evaluation subsystem includes an interface information import module, an interface related evaluation indicator import module, an operation status data import module, an interface evaluation module and an evaluation result output module. The interface comparison subsystem includes an interface information adding module, an interface comparison module and an interface comparison result output module.

[0018] In such Figure 2 In the embodiment of the interface evaluation and comparison system based on evaluation indicators and operation status shown, the interface information import module of the interface evaluation subsystem is first used to complete the import of interface information; then the interface-related evaluation indicator import module is used to complete the import of interface-related evaluation indicators, and the operation status data import module is used to complete the import of personnel operation status data; then the interface evaluation module is entered to carry out interface evaluation; then the evaluation result output module is entered to output the evaluation result of the interface. The corresponding data is then input into the interface comparison subsystem. First, the interface information addition module is clicked. At this time, for the new interface input, the information input of the interface information import module in the interface evaluation subsystem needs to be re-performed. After the interface information addition module completes the input of all interface information to be compared, the interface comparison module is entered to carry out the comparison of evaluation results of different interfaces; finally, the interface comparison result output module is entered to output the final interface comparison result.

[0019] like Figure 3 The figure shows the working process of the interface evaluation subsystem according to an embodiment of the present invention. The working process is as follows: after completing the interface information import of the interface information import module, the interface-related evaluation index import module is started to import the interface-related evaluation indexes, including operation process import, display and control software automation design import, display layout import, display format import, character import, chart import, control import, color import, information volume import, alarm prompt import, touch screen interaction import, and other interaction methods import; then the job status data import module is entered to start the import of job status data, including attention import, workload import, situational awareness import, fatigue import, and emotion import; then, the imported interface-related evaluation indexes and job status data results are input into the following three equations to obtain the interface evaluation results,

[0020]

[0021] H=0.56y1+0.42y2+0.61y3+0.75y4+0.33y5(2),

[0022] E=0.37D+0.63H (3),

[0023] in:

[0024] x i is the interface-related evaluation index, i=1-12, including operation process x1, automatic design of display and control software x2, display layout x3, display format x4, character x5, chart x6, control x7, color x8, information volume x9, alarm prompt x 10 , touch screen interaction x 11 and additional interaction modes x as optional redundancy 12 , D is the total score of interface-related evaluation indicators;

[0025] y j is the personnel operation status, j = 1 to 5, including attention status y1, workload status y2, situational awareness status y3, fatigue status y4 and emotional status y5, H is the operation status data; E is the comprehensive evaluation score. When the comprehensive evaluation score E>0.8, the interface design is good; when 0.5≤E≤0.8, the interface design needs to be improved; when E<0.5, the interface design is very poor.

[0026] like Figure 4 The figure shows the working process of the interface comparison subsystem according to an embodiment of the present invention. The working process is as follows: click Start Add in the interface information adding module, enter the interface information importing module of the interface evaluation subsystem to carry out new interface evaluation; after all interfaces are added, click End Add, and input the evaluation results of different interfaces into the interface comparison module; respectively carry out interface-related evaluation index comparison, operation status data comparison, and comprehensive evaluation comparison; in the comparison of interface-related evaluation indexes, when Max(x iA , x iB , x iC , ...) = x iB or Min(x iA , x iB , x iC , ...) = x iB , and after the determination and optimization of the interface-related evaluation index comparison strategy is completed, it is shown that for the i-th interface-related index, interface B is the best; in the comparison of operation status data, when Max(y jA ,y jB ,y jC , ...) = y jA or Min(y jA ,y jB ,y jC , ...) = y jA , and after the determination and optimization of the operation status data comparison strategy is completed, it is shown that for the jth operation status indicator, interface A is the best; in the comprehensive evaluation comparison, when Max(E A , EB , E C , ...) = E C After the comprehensive evaluation comparison strategy is determined and optimized, it shows that the overall score of interface C is the best; the corresponding evaluation results are finally input into the interface comparison result output module to visualize the interface and output the interface comparison results.

[0027] like FIG. 5A to FIG. 5D FIG. 1 is a user interface diagram of an interface evaluation and comparison system based on evaluation indicators and operation status according to a specific example of an embodiment of the present invention. After the system enters the interface evaluation and comparison system based on evaluation indicators and operation status, its main interface is as follows: Figure 5A As shown. This interface contains four buttons, namely "Instructions", "Interface Evaluation Subsystem", "Interface Comparison Subsystem" and "Exit System". After entering this interface, the user first clicks the "Instructions" button to enter the Instructions interface, as shown Figure 5B As shown. The user reads the instructions for use of the system to understand how to use the system to evaluate and compare interfaces based on evaluation indicators and job status. After reading the instructions, click the "Return" button to return to the main interface. When performing interface evaluation, the user clicks the "Interface Evaluation Subsystem" button to enter the interface evaluation subsystem interface, as shown Figure 5B As shown. After completing the interface information import of the interface information import module, you can click on the interface-related evaluation index import module to import interface-related evaluation indicators, including operation process import, display and control software automation design import, display layout import, display format import, character import, chart import, control import, color import, information volume import, alarm prompt import, touch screen interaction import, and additional interaction mode import as optional redundancy; then enter the job status data import module to start importing job status data, including attention import, workload import, situational awareness import, fatigue import, and emotion import; on this basis, click on the interface-related evaluation index start evaluation, job status data start evaluation, and interface overall status start evaluation buttons of the interface evaluation module to start the corresponding evaluation; then click the "Start Submission" button, and the evaluation result output module will present the interface-related evaluation indicators, job status data, and overall interface evaluation; at this time, you can perform "data save" to store the data, and click "Next" to return to the main page, as shown. Figure 5CAs shown. After clicking the "Interface Comparison Subsystem" on the main page, click the "Start Adding" button of the interface information adding module to enter the interface information importing module of the interface evaluation subsystem to carry out a new interface evaluation; after all interfaces have been added, click the "End Adding" button to end the addition; further click the "Interface-related Evaluation Index Comparison", "Job Status Data Comparison" and "Comprehensive Evaluation Comparison" buttons of the interface comparison module, as well as their corresponding "Determination and Optimization of Interface-related Evaluation Index Comparison Strategy", "Determination and Optimization of Job Status Data Comparison Strategy" and "Determination and Optimization of Comprehensive Evaluation Comparison Strategy", and click "Start Comparison" to complete the comparison of different interfaces; finally, the comparison results will be visualized in the "Interface Visualization" area of ​​the interface comparison result output module, and the "Interface Comparison Results" area on the right will also display the "Interface-related Evaluation Index Comparison Results", "Job Status Comparison Situation" and "Overall Interface Comparison Situation", as shown in the figure. Figure 5D At this time, you can click "Save Data" to save the data, or click "Exit" to exit the software.

[0028] Advantages and / or beneficial effects of the present invention include:

[0029] (1) An interface evaluation subsystem is provided, which can complete the human factors evaluation of the interactive interface after importing interface information, interface-related evaluation indicators, and operation status data.

[0030] (2) An interface comparison subsystem is provided, which can complete the comparison of human factors evaluation results of multiple interface schemes after adding interface information.

[0031] (3) An interface evaluation and comparison method based on evaluation indicators and operating status is provided. By simply inputting or adding interface information, interface-related evaluation indicators, and operating status data, the human factors evaluation results of a single interface and the evaluation comparison results of multiple interfaces can be directly given.

[0032] (4) Compared with the traditional interface evaluation and comparison method based on evaluation indicators and operating status, the present invention can obtain the corresponding human factors evaluation results of a single interface and the evaluation and comparison results of multiple interfaces based on the collected interface-related evaluation indicators and operating status data in the early stage of complex industrial system research and development, which can be used to directly guide the human factors evaluation and design optimization of the interactive interface of the complex industrial system, thereby improving the work efficiency of personnel and ensuring human safety.

Claims

1. An interface evaluation and comparison system based on evaluation indicators and operation status, characterized in that include: The interface evaluation subsystem is used to complete the import of interface information, relevant evaluation indicators, and operation status data, conduct human factors evaluation of the interface, and provide evaluation results; The interface comparison subsystem is used to add the information of the interface to be compared, complete the interface comparison, and output the comparison results. in: The interface evaluation subsystem includes: Interface information import module, used to input interface information; Interface related evaluation index import module, used to input interface related evaluation index; The operation status data import module is used to input the operation status data of personnel; Interface evaluation module, used to conduct human factors evaluation of interfaces, Evaluation result output module, used to output the evaluation results of the interface, The interface evaluation module includes modules that perform the following processing: Input the imported interface-related evaluation indicators and job status data results into the following three equations to obtain the interface evaluation results: D=0.21x1+0.18x2+0.16x3+0.13x4 0.11x5+0.17x6+0.15x7+0.14x8+ (1),0.16x9+0.22x 10 +0.19x 11 +0.18x 12 H=0.56y1+0.42y2+0.61y3+0.75y4+0.33y5 (2), E=0.37D+0.63H (3), in: x i is the interface-related evaluation index, i=1-12, including operation process x1, automatic design of display and control software x2, display layout x3, display format x4, character x5, chart x6, control x7, color x8, information volume x9, alarm prompt x 10 , touch screen interaction x 11 and additional interaction modes x as optional redundancy 12 , D is the total score of interface-related evaluation indicators; y j is the personnel working state, j = 1-5, including attention state y1, workload state y2, situational awareness state y3, fatigue state y4 and emotional state y5, H is the job status data; E is the comprehensive evaluation score. When the comprehensive evaluation score E>0.8, the interface design is good; when 0.5≤E≤0.8, the interface design needs to be improved; when E<0.5, the interface design is very poor. The interface comparison subsystem includes: An interface information adding module, used to add information of the interface to be compared; Interface comparison module, used to compare interfaces; The interface comparison result output module is used to output the interface comparison result. Among them, the interface comparison module carries out comparison of interface-related evaluation indicators, comparison of operation status data, and comparison of comprehensive evaluation; In the comparison of interface-related evaluation indicators, when Max(x iA , x iB , x iC , ...) = x iB or Min(x iA , x iB , x iC , ...) = x iB , and after the determination and optimization of the comparison strategy of interface-related evaluation indicators are completed, it is shown that for the i-th interface-related indicator, interface B is the best; In the comparison of job status data, when Max(y jA ,y jB ,y jC , ...) = y jA or Min(y jA ,y jB ,y jC , ...) = y jA , and after completing the determination and optimization of the operation status data comparison strategy, it shows that for the jth operation status indicator, interface A is optimal; In the comprehensive evaluation comparison, when Max(E A , E B , E C , ...) = E C , and after completing the comprehensive evaluation comparison strategy determination and optimization, it shows that the overall score of interface C is the best.

2. The interface evaluation and comparison system based on evaluation indicators and operation status according to claim 1, characterized in that: The interface-related evaluation index data of the interface-related evaluation index import module includes 12 interface-related evaluation indicators: Operational procedures, automated design of display and control software, display layout, display format, characters, graphics, controls, colors, information volume, warning prompts, touch screen interaction, and additional interaction methods as optional redundancy; and The work status data of the work status data import module includes five types of personnel work status: attention state, workload state, situational awareness state, fatigue state and emotional state.

3. The indicator system generation and analysis system based on life cycle human factors engineering assessment according to claim 1 is characterized by: The interface evaluation subsystem supports specific storage location settings and can export analysis results in formats including word, excel, etc. The interface comparison subsystem supports specific storage location settings and can export analysis results in formats including word, excel, pdf, etc.

4. A method for generating and analyzing an indicator system based on life cycle human factors engineering assessment, characterized in that include: The interface evaluation sub-step is used to complete the import of interface information, relevant evaluation indicators, and operation status data, conduct human factors evaluation of the interface, and provide evaluation results; The interface comparison sub-step is used to add the information of the interface to be compared, complete the interface comparison, and output the comparison results. in: The interface assessment sub-steps include: An interface information importing step is used to input interface information; an interface related evaluation index importing module is used to input interface related evaluation indexes; The operation status data importing step is used to input the operation status data of personnel; Interface assessment steps, used to conduct human factors assessment of the interface, The evaluation result output step is used to output the evaluation results of the interface. The interface evaluation steps include: Input the imported interface-related evaluation indicators and job status data results into the following three equations to obtain the interface evaluation results: D=0.21x1+0.18x2+0.16x3+0.13x40.11x5+0.17x6+0.15x7+0.14x8+ (1),0.16x9+0.22x 10 +0.19x 11 +0.18x 12 H=0.56y1+0.42y2+0.61y3+0.75y4+0.33y5 (2), E=0.37D+0.63H (3), in: x i is the interface-related evaluation index, i=1-12, including operation process x1, automatic design of display and control software x2, display layout x3, display format x4, character x5, chart x6, control x7, color x8, information volume x9, alarm prompt x 10 , touch screen interaction x 11 And additional interaction methods x 12 , D is the total score of interface-related evaluation indicators, y j is the personnel working state, j = 1-5, including attention state y1, workload state y2, situational awareness state y3, fatigue state y4 and emotional state y5, H is the job status data, E is the comprehensive evaluation score. When the comprehensive evaluation score E>0.8, the interface design is good; when 0.5≤E≤0.8, the interface design needs to be improved; when E<0.5, the interface design is very poor. The interface comparison sub-steps include: An interface information adding step is used to add information of the interface to be compared; Interface comparison step, used to compare interfaces; The interface comparison result output step is used to output the interface comparison result. Among them, the interface comparison step of the interface comparison sub-step can respectively carry out interface-related evaluation index comparison, operation status data comparison, and comprehensive evaluation comparison; In the comparison of interface-related evaluation indicators, when Max(x iA , x iB , x iC , ...) = x iB or Min(x iA , x iB , x iC , ...) = x iB , and after the determination and optimization of the comparison strategy of interface-related evaluation indicators are completed, it is shown that for the i-th interface-related indicator, interface B is the best; In the comparison of job status data, when Max(y jA ,y jB ,y jC , ...) = y jA or Min(y jA ,y jB ,y jC , ...) = y jA , and after completing the determination and optimization of the operation status data comparison strategy, it shows that for the jth operation status indicator, interface A is optimal; In the comprehensive evaluation comparison, when Max(E A , E B , E C , ...) = E C , and after completing the comprehensive evaluation comparison strategy determination and optimization, it shows that the overall score of interface C is the best.

5. The interface evaluation and comparison method based on evaluation indicators and operation status according to claim 4 is characterized in that: The interface-related evaluation index data of the interface evaluation sub-step includes 12 interface-related evaluation indicators: Operational procedures, automated design of display and control software, display layout, display format, characters, graphics, controls, colors, information volume, warning prompts, touch screen interaction, and additional interaction methods as optional redundancy; and The work status data in the work status data import step includes five types of personnel work status: attention state, workload state, situational awareness state, fatigue state and emotional state.

6. The method for generating and analyzing an indicator system based on life cycle human factors engineering assessment according to claim 4 is characterized in that: The interface evaluation sub-step supports specific storage location settings and can export analysis results in formats including Word, Excel, etc. The interface comparison sub-step supports specific storage location settings and can export analysis results in formats including word, excel, pdf, etc.

7. A computer-readable storage medium storing a computer-executable program, wherein the computer-executable program enables a processor to execute the method according to any one of claims 4 to 6.