Human factor safety problem analysis method and device
By acquiring the attribute characteristics of human-computer interaction systems from multiple dimensions and conducting systematic anomaly analysis, the problem of single analysis dimensions in existing technologies is solved, enabling a comprehensive and accurate assessment of human-cause safety issues and improving the safety and reliability of the system.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-02-27
- Publication Date
- 2026-04-03
AI Technical Summary
Existing technologies, when analyzing human-factor safety issues in complex human-machine systems, rely on a single analytical dimension, making it difficult to comprehensively and accurately assess human-factor safety problems.
By acquiring the attribute characteristics of the human-computer interaction system across multiple feature dimensions, including operators, machines, interaction tasks, and environment, a systematic anomaly analysis is conducted. The results are then input into multiple sub-modules of the security issue assessment model for evaluation, generating a comprehensive and hierarchical security issue analysis report.
It improves the safety and reliability of human-computer interaction systems, enables rapid identification of potential risks, and enhances the relevance and accuracy of analysis.
Smart Images

Figure CN121786656A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of computer technology, and more specifically, to a method and apparatus for analyzing human factors safety issues. Background Technology
[0002] In highly complex and risky fields such as aviation, aerospace, shipbuilding, and nuclear power, humans and complex hardware and software systems constitute complex human-machine systems. Due to the complex structure, unique operating environment, and high workload of these systems, human-caused safety issues are prone to arise. Human-caused safety issues refer to various problems that arise from or affect system safety due to human factors, such as human error and conflicts between human operations and machine logic instructions. Human-caused safety issues are not simply "human mistakes," but rather safety hazards arising from human interaction with the system under specific environmental, equipment, task, and organizational conditions.
[0003] Currently, human factors safety analysis typically focuses on a single dimension, making it difficult to comprehensively and accurately assess human factors safety issues in complex human-computer interaction systems. Summary of the Invention
[0004] In view of this, the present disclosure provides a method and apparatus for analyzing human factors safety issues, in order to improve the comprehensiveness and accuracy of human factors safety issue analysis.
[0005] Specifically, this disclosure is achieved through the following technical solution: In a first aspect, embodiments of this disclosure provide a method for analyzing anomalies in human factors problems, including: Acquire the attribute features of the human-computer interaction system under multiple feature dimensions; the feature dimensions include spatial dimensions; the spatial dimensions include operator features, machine features, interaction task features, and environmental features. For the attribute features of each feature dimension, anomaly analysis is performed on the attribute features to obtain the anomaly analysis results corresponding to each feature dimension; The anomaly analysis results are input into a security issue assessment model to determine the assessment results for multiple security issues. The security issue assessment model includes assessment sub-modules corresponding to each of the multiple security issues. The assessment sub-modules are used to generate assessment results for the security issues based on the anomaly analysis results corresponding to one or more feature dimensions. Based on the evaluation results of each evaluation module, a security issue analysis report for the human-computer interaction system is generated.
[0006] Optionally, the operator characteristics include the operator's physiological characteristics; The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: The health status of the operator is assessed based on historical health data and disease diagnosis information in the aforementioned physiological characteristics. Based on the operator's real-time physiological data during the human-computer interaction process and the operator's health status, the operator's fatigue level is determined.
[0007] Optionally, the operator characteristics include the operator's psychological characteristics, which include eye movement trajectory data, facial expression data, and psychological test results; The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: The eye-tracking data was analyzed to obtain results on psychological stress and attention. The facial expression data is analyzed to obtain the emotion state recognition result; Based on the results of the psychological stress and attention analysis, the results of the emotional state recognition, and the results of the psychological test, the abnormal analysis results of the operator's psychological characteristics are determined.
[0008] Optionally, the operator characteristics include the social attribute characteristics of the operator team; The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: Based on the social attribute characteristics of team members, such as communication frequency, information transmission accuracy, and collaborative task completion, a team collaboration relationship network model is constructed. Based on the communication information in the aforementioned social attribute characteristics, the team's decision-making results are obtained; Based on the team's decision-making results, identify the factors that influence team collaboration; Based on the team culture and management system in the social attribute characteristics, the results of the analysis on the influence of the operator team's behavior and attitude were determined. Based on the team collaboration relationship network model, the team decision-making results, the factors affecting team collaboration, and the analysis results of the influence of behavior and attitude, anomaly analysis results of the social attribute characteristics are generated.
[0009] Optionally, the operator characteristics include the impact of the environment on the operator; The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: Based on the task decomposition information, task time information, operator working memory capacity, and operator task processing ability in the characteristics of the impact of the environment on the operator, the task load status information is determined. Based on the operator's fatigue level, the operator's psychological analysis results, and the anomaly analysis results of the social attribute characteristics, the anomaly analysis results corresponding to the influence characteristics of the environment on the operator are determined.
[0010] Optionally, the feature dimension also includes a time dimension; the time dimension includes the user demand characteristics of the human-computer interaction system in the planning stage, the system design characteristics in the design stage, and the system operation characteristics in the system operation stage.
[0011] Optionally, the security assessment model for the human-computer interaction system is constructed through the following steps: Based on the relationship between the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension, a cross-mapping is performed on the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension. Based on the mapping results, an evaluation sub-model is constructed for each security issue.
[0012] Optionally, the step of performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension includes: Based on the user demand characteristics of the human-computer interaction system during the planning stage, the user demand analysis results are determined. The user requirement analysis results are verified to obtain requirement verification results; Based on the user demand analysis results and the demand verification results, the anomaly analysis results corresponding to the user demand characteristics are determined.
[0013] Optionally, the step of performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension includes: Based on the system design characteristics described in the design phase, the design defects of the human-computer interaction system are identified. Based on the aforementioned design flaws, an optimized design scheme for the human-computer interaction system is determined. Based on the aforementioned design flaws and the optimized design scheme, the anomaly analysis results corresponding to the system design features in the design phase are determined.
[0014] Optionally, the step of performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension includes: Based on the real-time system data in the system operation characteristics during the system operation phase, the results of the system operation impact analysis are determined.
[0015] Optionally, inputting the anomaly analysis results into the security issue assessment model to determine the assessment results for multiple security issues includes: The anomaly analysis results of the time dimension are input into the personnel status assessment submodule to obtain the safety assessment results of the personnel status problem; the safety assessment results of the personnel status include the status of the operator, the trend of the operator's status change, and the early warning information matching the operator's status. The anomaly analysis results of the spatial dimension are input into the machine design defect assessment submodule to obtain the security assessment results of the machine design defect problem; the security assessment results of the machine design defect problem include the degree of impact of the defects of the human-computer interaction system on system security; The anomaly analysis results of the spatial dimension are input into the special environment and task impact analysis submodule to obtain the safety assessment results of the special environment and task impact issues; the safety assessment of the special environment and task impact issues includes the safety status prediction information of the human-computer interaction system under different environmental and task conditions; The anomaly analysis results in the time dimension are input into the overall system interaction coupling analysis module to obtain the security assessment results of the overall system interaction coupling problem; the security assessment results of the overall system interaction coupling problem include the impact of the interaction coupling of the human-computer interaction system on system security.
[0016] Optionally, the human-computer interaction system includes at least one of the following: Aircraft cabin external service interaction system, intelligent driving interaction system.
[0017] Secondly, embodiments of this disclosure also provide a human factors safety problem analysis device, comprising: The acquisition module is used to acquire the attribute features of the human-computer interaction system under multiple feature dimensions; the feature dimensions include spatial dimensions; the spatial dimensions include operator features, machine features, interaction task features, and environmental features. The analysis module is used to perform anomaly analysis on the attribute features of each feature dimension, and obtain the anomaly analysis results corresponding to each feature dimension. An evaluation module is used to input the anomaly analysis results into a security issue evaluation model to determine the evaluation results for multiple security issues; the security issue evaluation model includes evaluation sub-modules corresponding to multiple security issues; the evaluation sub-modules are used to generate evaluation results for the security issues based on the anomaly analysis results corresponding to one or more feature dimensions. The generation module is used to generate a security issue analysis report for the human-computer interaction system based on the evaluation results of each evaluation module.
[0018] Optionally, the operator characteristics include the operator's physiological characteristics; The analysis module is specifically used for: The health status of the operator is assessed based on historical health data and disease diagnosis information in the aforementioned physiological characteristics. Based on the operator's real-time physiological data during the human-computer interaction process and the operator's health status, the operator's fatigue level is determined.
[0019] Optionally, the operator characteristics include the operator's psychological characteristics, which include eye movement trajectory data, facial expression data, and psychological test results; The analysis module is specifically used for: The eye-tracking data was analyzed to obtain results on psychological stress and attention. The facial expression data is analyzed to obtain the emotion state recognition result; Based on the results of the psychological stress and attention analysis, the results of the emotional state recognition, and the results of the psychological test, the abnormal analysis results of the operator's psychological characteristics are determined.
[0020] Optionally, the operator characteristics include the social attribute characteristics of the operator team; The analysis module is specifically used for: Based on the social attribute characteristics of team members, such as communication frequency, information transmission accuracy, and collaborative task completion, a team collaboration relationship network model is constructed. Based on the communication information in the aforementioned social attribute characteristics, the team's decision-making results are obtained; Based on the team's decision-making results, identify the factors that influence team collaboration; Based on the team culture and management system in the social attribute characteristics, the results of the analysis on the influence of the operator team's behavior and attitude were determined. Based on the team collaboration relationship network model, the team decision-making results, the factors affecting team collaboration, and the analysis results of the influence of behavior and attitude, anomaly analysis results of the social attribute characteristics are generated.
[0021] Optionally, the operator characteristics include the impact of the environment on the operator; The analysis module is specifically used for: Based on the task decomposition information, task time information, operator working memory capacity, and operator task processing ability in the characteristics of the impact of the environment on the operator, the task load status information is determined. Based on the operator's fatigue level, the operator's psychological analysis results, and the anomaly analysis results of the social attribute characteristics, the anomaly analysis results corresponding to the influence characteristics of the environment on the operator are determined.
[0022] Optionally, the feature dimension also includes a time dimension; the time dimension includes the user demand characteristics of the human-computer interaction system in the planning stage, the system design characteristics in the design stage, and the system operation characteristics in the system operation stage.
[0023] Optionally, the device further includes a building module for: Based on the relationship between the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension, a cross-mapping is performed on the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension. Based on the mapping results, an evaluation sub-model is constructed for each security issue.
[0024] Optionally, the analysis module is specifically used for: Based on the user demand characteristics of the human-computer interaction system during the planning stage, the user demand analysis results are determined. The user requirement analysis results are verified to obtain requirement verification results; Based on the user demand analysis results and the demand verification results, the anomaly analysis results corresponding to the user demand characteristics are determined.
[0025] Optionally, the analysis module is specifically used for: Based on the system design characteristics described in the design phase, the design defects of the human-computer interaction system are identified. Based on the aforementioned design flaws, an optimized design scheme for the human-computer interaction system is determined. Based on the aforementioned design flaws and the optimized design scheme, the anomaly analysis results corresponding to the system design features in the design phase are determined.
[0026] Optionally, the analysis module is specifically used for: Based on the real-time system data in the system operation characteristics during the system operation phase, the results of the system operation impact analysis are determined.
[0027] Optionally, the analysis module is specifically used for: The anomaly analysis results of the time dimension are input into the personnel status assessment submodule to obtain the safety assessment results of the personnel status problem; the safety assessment results of the personnel status include the status of the operator, the trend of the operator's status change, and the early warning information matching the operator's status. The anomaly analysis results of the spatial dimension are input into the machine design defect assessment submodule to obtain the security assessment results of the machine design defect problem; the security assessment results of the machine design defect problem include the degree of impact of the defects of the human-computer interaction system on system security; The anomaly analysis results of the spatial dimension are input into the special environment and task impact analysis submodule to obtain the safety assessment results of the special environment and task impact issues; the safety assessment of the special environment and task impact issues includes the safety status prediction information of the human-computer interaction system under different environmental and task conditions; The anomaly analysis results in the time dimension are input into the overall system interaction coupling analysis module to obtain the security assessment results of the overall system interaction coupling problem; the security assessment results of the overall system interaction coupling problem include the impact of the interaction coupling of the human-computer interaction system on system security.
[0028] Optionally, the human-computer interaction system includes at least one of the following: Aircraft cabin external service interaction system, intelligent driving interaction system.
[0029] Thirdly, an optional implementation of this disclosure also provides a computer device, a processor, and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is configured to execute the machine-readable instructions stored in the memory, wherein when the machine-readable instructions are executed by the processor, they perform the steps of the first aspect above, or any possible implementation of the first aspect.
[0030] Fourthly, an optional implementation of this disclosure also provides a computer-readable storage medium storing a computer program that, when run, performs the steps of the first aspect or any possible implementation of the first aspect.
[0031] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of this disclosure.
[0032] The human factors safety problem analysis method and apparatus provided in this disclosure can comprehensively acquire the attribute characteristics of human-computer interaction systems from multiple dimensions. It not only covers spatial dimension elements such as operators, machines, interaction tasks, and the environment, but also enables systematic anomaly analysis of attribute characteristics across different dimensions, thus avoiding the problem of traditional analysis methods considering only a single element and resulting in biased conclusions. Furthermore, this invention inputs the anomaly analysis results from each dimension into a safety problem assessment model containing multiple assessment sub-modules, allowing various safety problems to be independently assessed and results generated in targeted sub-modules, improving the relevance and accuracy of the analysis. Finally, through the comprehensive processing of multiple assessment results, a comprehensive and clearly hierarchical human factors safety problem analysis report can be automatically generated, helping to quickly locate potential risks and improve the safety and reliability of human-computer interaction systems. Attached Figure Description
[0033] Figure 1 A flowchart of a human factors safety problem analysis method provided in an embodiment of this disclosure is shown; Figure 2 A schematic diagram of a human factors safety problem analysis device provided in an embodiment of this disclosure is shown; Figure 3 A schematic diagram of a computer device provided in an embodiment of this disclosure is shown. Detailed Implementation
[0034] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0035] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The singular forms “a,” “the,” and “the” as used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.
[0036] It should be understood that although the terms first, second, third, etc., may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are used only to distinguish information of the same type from one another. For example, without departing from the scope of this disclosure, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."
[0037] In this document, the term "and / or" merely describes a relationship, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.
[0038] Research has found that existing human factor anomaly analysis methods have shortcomings such as limited analytical dimensions, lack of specificity in results, and over-reliance on human judgment, making it difficult to comprehensively and objectively identify and assess various security issues in human-computer interaction systems.
[0039] In view of this, this disclosure provides a method and apparatus for analyzing human-cause safety issues. It can comprehensively acquire the attribute characteristics of human-computer interaction systems from multiple dimensions, covering not only spatial dimensions such as operators, machines, interactive tasks, and the environment, but also systematically analyzing anomalies in attribute characteristics across different dimensions. This avoids the problem of traditional analysis methods considering only a single factor, leading to biased conclusions. Furthermore, this invention inputs the anomaly analysis results from each dimension into a safety issue assessment model containing multiple evaluation sub-modules. This allows various safety issues to be independently evaluated and results generated in targeted sub-modules, improving the relevance and accuracy of the analysis. Finally, through the comprehensive processing of multiple evaluation results, a comprehensive and clearly structured human-cause safety issue analysis report can be automatically generated, helping to quickly locate potential risks and improve the safety and reliability of human-computer interaction systems.
[0040] The deficiencies of the existing technical solutions are the result of the inventors' practice and careful research. Therefore, the discovery process of the above problems and the solutions proposed in this disclosure below should be considered as the inventors' contributions to this disclosure.
[0041] To facilitate understanding of this embodiment, a detailed description of the human factors safety problem analysis method disclosed in this disclosure embodiment will be provided first. The execution subject of the human factors safety problem analysis method provided in this disclosure embodiment is generally a computer device with a certain computing power.
[0042] See Figure 1 The diagram shown is a flowchart of a human factors safety problem analysis method provided in an embodiment of this disclosure. The method includes: S101. Obtain the attribute features of the human-computer interaction system under multiple feature dimensions; the feature dimensions include spatial dimensions; the spatial dimensions include operator features, machine features, interaction task features, and environmental features.
[0043] Human-computer interaction (HCI) systems refer to the overall system through which people (operators, users) and machines (equipment, computer systems, automation devices, etc.) exchange information and control operations via a specific interface and method. HCI systems exist in many fields such as aviation, automotive, and healthcare. Examples of HCI systems include aircraft cabin crew interaction systems and intelligent driving interaction systems.
[0044] This step allows for the acquisition of attribute information from multiple perspectives (i.e., feature dimensions) for anomaly analysis. These feature dimensions can include spatial dimensions, where attribute information refers to the state and interrelationships of multiple elements within the human-computer interaction system at the same moment, providing a horizontal characterization of the system.
[0045] The spatial dimension can include operator characteristics, machine characteristics, interactive task characteristics, and environmental characteristics. Among them, operator characteristics can include the operator's ability, experience, and psychological and physiological state; machine characteristics can include the equipment's performance, operating status, availability, and system design characteristics; interactive task characteristics can include task objectives, complexity, number of steps, and time constraints; and environmental characteristics can include temperature, noise, lighting, and workspace layout.
[0046] The operator characteristics may include the completeness of personnel parameters and / or the personnel status information of the human-computer interaction system during operation. Personnel parameter completeness refers to the degree of completeness of the physiological, psychological, and social parameters of personnel envisioned during the design and development phases, with indicators including those used in personnel status anomaly analysis. The value range is 0–100%. Personnel status information can refer to the state resulting from physiological, psychological, and social attributes, environmental stimuli, and task load.
[0047] In one possible implementation, operator characteristics may include the operator's physiological characteristics. These physiological characteristics can be collected based on wearable devices and, in addition to basic heart rate, blood pressure, and body temperature, may include real-time physiological data such as heart rate variability, eye movement indicators, and electroencephalogram (EEG) data, as well as historical health data and disease diagnosis data.
[0048] In one possible implementation, the operator characteristics may also include the operator's psychological characteristics, which may include the operator's eye movement data, facial expression data, and psychological test results.
[0049] For example, the results of the above psychological tests may include the results of self-rating anxiety and self-rating depression.
[0050] In one possible implementation, operator characteristics may also include social attributes, such as the frequency of communication among team members, the accuracy of information transmission, the completion of collaborative tasks, communication information, team culture, and management systems.
[0051] In one possible implementation, operator characteristics may further include characteristics related to the impact of the environment on the operator.
[0052] In complex human-computer interaction systems, human safety issues are often not caused by a single factor, but rather the result of the interaction of multiple elements. For example, the superposition of factors such as operator fatigue (human), insufficient alarm volume (machine), tight task deadlines (task), and high environmental noise (environment) can easily lead to misoperation. By acquiring spatial dimension attribute information, features of different dimensions can be standardized and quantified, facilitating subsequent analysis and model input. Considering only the human state may overlook equipment failure risks; conversely, considering only the equipment may ignore the impact of environmental factors on humans. Comprehensively acquiring spatial dimension information ensures the comprehensiveness and accuracy of anomaly analysis results.
[0053] In one possible implementation, the feature dimension may also include a time dimension. The time dimension, as opposed to the spatial dimension, is another type of analytical dimension that refers to the evolution of features of the human-computer interaction system at different stages of its lifecycle. Specifically, the time dimension may include user demand features of the human-computer interaction system during the planning stage (e.g., user functional requirements, security requirements, and convenience requirements during use), system design features during the design stage (e.g., interface layout, operation flow design, fault tolerance mechanisms, and security redundancy schemes), and system operation features during the system operation stage (e.g., actual operation data, device operational stability, task execution status, and security event records).
[0054] Human-related safety issues can persist throughout the entire system lifecycle. Analyzing only the operational phase can easily overlook potential problems in the design phase or deficiencies in the requirements phase. Information over time helps trace the source of problems (such as design flaws leading to high risks during operation) and predict potential future risks. Human-related risk characteristics differ at different stages, and dynamic analysis can reflect the patterns of risk change over time.
[0055] S102. For the attribute features of each feature dimension, perform anomaly analysis on the attribute features to obtain the anomaly analysis results corresponding to each feature dimension.
[0056] In this step, independent risk or security analysis can be performed within each dimension, enabling risks in each dimension to be independently identified and quantified, thereby improving the relevance of the analysis results.
[0057] In one possible implementation, operator characteristics include physiological features. The operator's health status can be assessed based on historical health data and disease diagnosis information within these physiological features. Then, based on real-time physiological data of the operator during human-computer interaction and their overall health status, the operator's fatigue level can be determined. For example, when the heart rate variability value is below the normal threshold, the operator is fatigued; when the alpha wave frequency decreases and the beta wave frequency increases, it indicates that the operator is fatigued or stressed, thus determining the abnormal analysis results of the physiological features.
[0058] By combining historical health data, disease diagnosis information, and real-time physiological data, the condition of operators can be assessed from both long-term and immediate perspectives. This not only identifies potential long-term health risks but also dynamically monitors fatigue levels during operation, thereby comprehensively improving operator safety and reducing the risk of human-related safety issues caused by physiological factors.
[0059] In one possible implementation, the operator characteristics include the operator's psychological characteristics, which include eye movement trajectory data, facial expression data, and psychological test results. The eye movement trajectory data can be analyzed to obtain psychological stress and attention analysis results; the facial expression data can be analyzed to obtain emotional state recognition results; and based on the psychological stress and attention analysis results, the emotional state recognition results, and the psychological test results, anomaly analysis results of the operator's psychological characteristics can be determined.
[0060] In this step, eye-tracking data can be analyzed to assess the operator's attention allocation, psychological stress, and visual search strategies. Frequent, irregular eye movements or prolonged focus on non-critical information areas suggest psychological stress or attention deficit issues, leading to eye-tracking analysis results. Facial expression data can determine the operator's emotional state. By combining eye-tracking analysis, facial expression recognition, and psychological test results, the operator's psychological state can be portrayed from multiple angles, reflecting their attention and cognitive load, as well as identifying their emotional and stress levels. This not only allows for more accurate detection of the impact of psychological factors on safety but also provides early warnings when abnormal psychological states occur, thereby reducing operational errors and human safety risks caused by psychological imbalance.
[0061] In one possible implementation, the operator characteristics include the social attribute characteristics of the operator team. A team collaboration relationship network model can be constructed based on the communication frequency, information transmission accuracy, and collaborative task completion status among team members within these social attribute characteristics. Team decision-making results are obtained based on the communication information within these social attribute characteristics. Factors influencing team collaboration are identified based on these team decision-making results. The influence analysis results on the operator team's behavior and attitudes are determined based on the team culture and management system within these social attribute characteristics. Finally, anomaly analysis results for the social attribute characteristics are generated based on the team collaboration relationship network model, the team decision-making results, the factors influencing team collaboration, and the influence analysis results on behavior and attitudes.
[0062] Among these factors, the social attributes of a team (communication, collaboration, and culture) directly affect overall operational efficiency and security. Based on these characteristics, potential risks at the team level can be identified, collaboration models can be optimized, and overall security can be improved.
[0063] In one possible implementation, the operator characteristics include the influence of the environment on the operator. Task load status information can be determined based on task decomposition information, task time information, the operator's working memory capacity, and the operator's task processing ability in the influence of the environment on the operator. Anomaly analysis results corresponding to the influence of the environment on the operator can be determined based on the operator's fatigue level, the operator's psychological analysis results, and the anomaly analysis results of the social attribute characteristics.
[0064] The environment and task assignments of operators affect their workload and safety performance. Environmental factors and workload can change the operator's state, thereby affecting safety. The above characteristics can help identify potential risks under high load or environmental stress and guide task assignment and environmental optimization.
[0065] In one possible implementation, machine features may include human-computer interaction interface (HCI) design features. These features can be analyzed, and the design elements of the HCI can be evaluated based on cognitive ergonomics principles. Eye-tracking experiments and user operation tests can be combined to analyze the information retrieval efficiency and ease of operation for operators on the HCI, yielding preliminary interface evaluation results. In this step, the distribution of operator gaze points and gaze duration on the HCI can be obtained to assess the rationality of the information layout. Through user operation tests, the time and number of errors for operators to complete specific tasks can be statistically analyzed to determine whether the operation process is simple and efficient.
[0066] Afterwards, the display accuracy and information integrity of the human-computer interaction interface can be checked to determine the interface information. Then, based on the preliminary evaluation results of the interface and the interface information, a quantitative evaluation can be performed to obtain the anomaly analysis results of this feature dimension.
[0067] In one possible implementation, emergency operating conditions of the system can be comprehensively identified and analyzed based on machine characteristics to obtain emergency process analysis results. The rationality and operability of emergency operation procedures can be evaluated. Through simulated emergency drills and operator feedback, the clarity, conciseness, and ease of memorization and execution of emergency operation steps can be checked. Simultaneously, the transmission and processing mechanism of preset emergency information can be analyzed to obtain emergency transmission analysis results, ensuring that operators can obtain timely and accurate emergency information and make correct decisions under emergency conditions. Then, based on the emergency process analysis results and emergency transmission analysis results, emergency operating condition design analysis results can be constructed. Finally, based on the human-machine interface design defect analysis results, human-machine interaction mode analysis results, human-machine function allocation analysis results, and emergency operating condition design analysis results, the human factor defects of the machine can be obtained.
[0068] In one possible implementation, environmental and operator characteristics can be utilized to calculate the amount of information and number of tasks that operators need to process per unit time based on task decomposition and time analysis. Combined with the operator's working memory capacity and processing ability, the task load can be assessed to determine whether it exceeds their capacity, thus obtaining an abnormal task load status result. Analysis based on abnormal results in physiological attributes, psychological attributes, social attributes, environmental stimuli, and task load states yields the causes of the abnormal personnel status.
[0069] In one possible implementation, the spatial dimension can include special environmental impact characteristics. System safety can be modeled and analyzed based on different types of special environments to obtain a correlation model between environmental parameters and system safety. These special environments can include high temperature, high pressure, high radiation, high altitude, and underwater environments. The impact of changes in monitored environmental parameters on personnel's physiological and psychological states, machine performance, and human-computer interaction is analyzed to obtain special environment analysis results. Protective measures under special environments can be effectively evaluated to obtain measure evaluation results. Based on the correlation model between environmental parameters and system safety, the special environment analysis results, and the measure evaluation results, a special environmental impact analysis result can be obtained.
[0070] In one possible implementation, human-computer interaction methods can be evaluated based on the characteristics of the interactive task, analyzing whether they conform to the operator's operating habits and cognitive characteristics to obtain human-computer interaction evaluation results. Then, based on simulated operation experiments and user feedback surveys, the operator's work efficiency and operational comfort under different interaction modes are compared to obtain interaction mode comparison results. In mobile operation scenarios, the convenience of touchscreen interaction and gesture control is analyzed, considering the response speed and feedback mechanism of human-computer interaction to obtain mobile scenario analysis results. This ensures that operators can obtain timely feedback on operation results, improving the smoothness and reliability of the interaction. Finally, based on the human-computer interaction evaluation results, interaction mode comparison results, and mobile scenario analysis results, a human-computer interaction mode analysis result is constructed.
[0071] In one possible implementation, the allocation of human-machine functions can be evaluated using a preset task analysis and capability matching method based on the characteristics of the interactive task, yielding a human-machine function evaluation result. Then, the strengths and weaknesses of operators and machines in different tasks are analyzed to obtain a cost-benefit analysis result. Next, task requirements are quantitatively matched with the capabilities of personnel and machines to establish a human-machine capability evaluation model, determining whether the allocation of human-machine functions is reasonable, and obtaining a matching analysis result. Finally, based on the human-machine function evaluation result, the cost-benefit analysis result, and the matching analysis result, an analysis is performed to obtain the human-machine function allocation analysis result.
[0072] In one possible implementation, the complexity, urgency, and duration of the task can be quantitatively assessed based on the characteristics of the interactive task to obtain a task assessment result. A comprehensive assessment of the task load level is then conducted using a combination of task load assessment indicators, operator subjective evaluation, and objective data measurement to obtain a task load level assessment result. Subsequently, the impact of the task load on personnel status, machine operating status, and human-machine interaction can be analyzed to obtain a status analysis result. Based on the task assessment result, the task load level assessment result, and the status analysis result, further analysis is performed to obtain a task load impact analysis result.
[0073] Subsequently, the spatial structure analysis dimension results are obtained by integrating the results of abnormal personnel status, human-caused defects in machines, special environmental impact analysis, and task load impact analysis.
[0074] In one possible implementation, user requirement analysis results can be determined based on user requirement characteristics of the human-computer interaction system during the planning stage; the user requirement analysis results can be verified to obtain requirement verification results; and based on the user requirement analysis results and the requirement verification results, anomaly analysis results corresponding to the user requirement characteristics can be determined.
[0075] In one possible implementation, based on the system design characteristics at the design stage, scenario simulation and virtual simulation technologies can be used to analyze the scenarios and identify design flaws in the human-computer interaction system. For example, in aviation system design, different flight conditions and mission scenarios can be simulated to evaluate whether the human-computer interface design meets the information acquisition and operation needs of operators under various conditions; in nuclear power system design, accident scenarios can be simulated to analyze whether emergency operation procedures and equipment configurations are reasonable. Based on the design flaws, an optimized design scheme for the human-computer interaction system can be determined, thereby designing an optimized design scheme that conforms to the physiological and psychological characteristics of operators, improving the system's usability and safety. Subsequently, based on the design flaws and the optimized design scheme, the anomaly analysis results corresponding to the system design characteristics at the design stage can be determined.
[0076] In one possible implementation, based on real-time system data (such as personnel operation data, machine operation data, and environmental data) in the system operation characteristics during the system operation phase, big data analysis and machine learning algorithms can be used for dynamic analysis and mining, and the impact of special environments and task loads on system operation can be evaluated to determine the system operation impact analysis results.
[0077] Subsequently, the anomaly analysis results in the time dimension can be determined based on the anomaly analysis results corresponding to the user demand characteristics, the anomaly analysis results corresponding to the system design characteristics in the design phase, and the anomaly analysis results corresponding to the system operation characteristics in the system operation phase.
[0078] S103. Input the anomaly analysis results into the security issue assessment model to determine the assessment results for multiple security issues; the security issue assessment model includes assessment sub-modules corresponding to multiple security issues respectively; the assessment sub-modules are used to generate assessment results for the security issues based on the anomaly analysis results corresponding to one or more feature dimensions.
[0079] In this step, complex human factors safety issues are broken down into several manageable sub-problems through modeling and modularization. The clear classification avoids ambiguity in the overall results and helps to pinpoint the source of the problem.
[0080] In one possible implementation, the security assessment model for the human-computer interaction system is constructed through the following steps: Based on the correlation between the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension, a cross-mapping is performed on the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension; based on the mapping results, an evaluation sub-model corresponding to each security issue is constructed.
[0081] In this step, a modular assessment model is constructed through the cross-mapping of spatial and temporal dimensions. Spatial features (human, machine, task, environment) are mapped to temporal features (planning, design, operation), and assessment sub-modules corresponding to each type of security issue are built based on the mapping results. This step enables cross-mapping of space and time, ensuring the model comprehensively covers different risk sources, identifies vulnerable links and key risk nodes in complex human-computer interaction systems, provides real-time dynamic monitoring and assessment, and improves the relevance and accuracy of the security assessment model.
[0082] One possible implementation method is to determine the security assessment results through the following steps: The anomaly analysis results of the time dimension are input into the personnel status assessment submodule to obtain the safety assessment results of the personnel status problem; the safety assessment results of the personnel status include the status of the operator, the trend of the operator's status change, and the early warning information matching the operator's status. The anomaly analysis results of the spatial dimension are input into the machine design defect assessment submodule to obtain the security assessment results of the machine design defect problem; the security assessment results of the machine design defect problem include the degree of impact of the defects of the human-computer interaction system on system security; The anomaly analysis results of the spatial dimension are input into the special environment and task impact analysis submodule to obtain the safety assessment results of the special environment and task impact issues; the safety assessment of the special environment and task impact issues includes the safety status prediction information of the human-computer interaction system under different environmental and task conditions; The anomaly analysis results in the time dimension are input into the overall system interaction coupling analysis module to obtain the security assessment results of the overall system interaction coupling problem; the security assessment results of the overall system interaction coupling problem include the impact of the interaction coupling of the human-computer interaction system on system security.
[0083] In this step, data fusion technology can be used to comprehensively process the anomaly analysis results in the time dimension; fault tree analysis can be used to analyze human-caused defects in the spatial dimension; the impact analysis data on the safety of the human-machine system can be analyzed based on the results of special environment analysis and task load impact analysis to obtain the special environment and task impact assessment results; and the anomaly analysis results in the time dimension can be analyzed based on the system dynamics method to obtain the overall system interaction coupling assessment results.
[0084] S104. Based on the evaluation results of each evaluation module, generate a security issue analysis report for the human-computer interaction system.
[0085] In this step, the evaluation results from each evaluation module can be merged to obtain a systemic security problem analysis report for the human-computer interaction system.
[0086] For example, the results from different modules can be combined to form a structured report. The report content can include the risk level of various security issues, analysis of influencing factors, and improvement suggestions. The report can be output as charts, text, or data files to facilitate understanding and use by decision-makers.
[0087] In this way, transforming the results of multidimensional analysis into visualized and structured information can help managers or designers quickly grasp human factors safety risks, guide optimization measures, and improve the overall security of the system.
[0088] The human factors safety problem analysis method provided in this disclosure can comprehensively acquire the attribute characteristics of human-computer interaction systems from multiple dimensions. It not only covers spatial dimensions such as operators, machines, interaction tasks, and the environment, but also enables systematic anomaly analysis of attribute characteristics across different dimensions, thus avoiding the problem of traditional analysis methods that only consider a single factor and therefore draw incomplete conclusions. Furthermore, this invention inputs the anomaly analysis results from each dimension into a safety problem assessment model containing multiple assessment sub-modules, allowing various safety problems to be independently assessed and results generated in targeted sub-modules, improving the relevance and accuracy of the analysis. Finally, through the comprehensive processing of multiple assessment results, a comprehensive and clearly structured human factors safety problem analysis report can be automatically generated, helping to quickly locate potential risks and improve the safety and reliability of human-computer interaction systems.
[0089] Corresponding to the embodiments of the aforementioned human factors safety problem analysis method, this disclosure also provides embodiments of a human factors safety problem analysis device.
[0090] See Figure 2 The diagram shown is a schematic representation of a human factors safety problem analysis device provided in an embodiment of this disclosure. The device includes: The acquisition module 210 is used to acquire the attribute features of the human-computer interaction system under multiple feature dimensions; the feature dimensions include spatial dimensions; the spatial dimensions include operator features, machine features, interaction task features and environmental features. Analysis module 220 is used to perform anomaly analysis on the attribute features for each feature dimension, and obtain the anomaly analysis results corresponding to each feature dimension. Evaluation module 230 is used to input the anomaly analysis results into the security issue evaluation model to determine the evaluation results for multiple security issues; the security issue evaluation model includes evaluation sub-modules corresponding to multiple security issues respectively; the evaluation sub-modules are used to generate evaluation results for the security issues based on the anomaly analysis results corresponding to one or more feature dimensions; The generation module 240 is used to generate a security issue analysis report for the human-computer interaction system based on the evaluation results of each evaluation module.
[0091] Optionally, the operator characteristics include the operator's physiological characteristics; The analysis module 220 is specifically used for: The health status of the operator is assessed based on historical health data and disease diagnosis information in the aforementioned physiological characteristics. Based on the operator's real-time physiological data during the human-computer interaction process and the operator's health status, the operator's fatigue level is determined.
[0092] Optionally, the operator characteristics include the operator's psychological characteristics, which include eye movement trajectory data, facial expression data, and psychological test results; The analysis module 220 is specifically used for: The eye-tracking data was analyzed to obtain results on psychological stress and attention. The facial expression data is analyzed to obtain the emotion state recognition result; Based on the results of the psychological stress and attention analysis, the results of the emotional state recognition, and the results of the psychological test, the abnormal analysis results of the operator's psychological characteristics are determined.
[0093] Optionally, the operator characteristics include the social attribute characteristics of the operator team; The analysis module 220 is specifically used for: Based on the social attribute characteristics of team members, such as communication frequency, information transmission accuracy, and collaborative task completion, a team collaboration relationship network model is constructed. Based on the communication information in the aforementioned social attribute characteristics, the team's decision-making results are obtained; Based on the team's decision-making results, identify the factors that influence team collaboration; Based on the team culture and management system in the social attribute characteristics, the results of the analysis on the influence of the operator team's behavior and attitude were determined. Based on the team collaboration relationship network model, the team decision-making results, the factors affecting team collaboration, and the analysis results of the influence of behavior and attitude, anomaly analysis results of the social attribute characteristics are generated.
[0094] Optionally, the operator characteristics include the impact of the environment on the operator; The analysis module 220 is specifically used for: Based on the task decomposition information, task time information, operator working memory capacity, and operator task processing ability in the characteristics of the impact of the environment on the operator, the task load status information is determined. Based on the operator's fatigue level, the operator's psychological analysis results, and the anomaly analysis results of the social attribute characteristics, the anomaly analysis results corresponding to the influence characteristics of the environment on the operator are determined.
[0095] Optionally, the feature dimension also includes a time dimension; the time dimension includes the user demand characteristics of the human-computer interaction system in the planning stage, the system design characteristics in the design stage, and the system operation characteristics in the system operation stage.
[0096] Optionally, the device further includes a building module for: Based on the relationship between the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension, a cross-mapping is performed on the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension. Based on the mapping results, an evaluation sub-model is constructed for each security issue.
[0097] Optionally, the analysis module 220 is specifically used for: Based on the user demand characteristics of the human-computer interaction system during the planning stage, the user demand analysis results are determined. The user requirement analysis results are verified to obtain requirement verification results; Based on the user demand analysis results and the demand verification results, the anomaly analysis results corresponding to the user demand characteristics are determined.
[0098] Optionally, the analysis module 220 is specifically used for: Based on the system design characteristics described in the design phase, the design defects of the human-computer interaction system are identified. Based on the aforementioned design flaws, an optimized design scheme for the human-computer interaction system is determined. Based on the aforementioned design flaws and the optimized design scheme, the anomaly analysis results corresponding to the system design features in the design phase are determined.
[0099] Optionally, the analysis module 220 is specifically used for: Based on the real-time system data in the system operation characteristics during the system operation phase, the results of the system operation impact analysis are determined.
[0100] Optionally, the analysis module 220 is specifically used for: The anomaly analysis results of the time dimension are input into the personnel status assessment submodule to obtain the safety assessment results of the personnel status problem; the safety assessment results of the personnel status include the status of the operator, the trend of the operator's status change, and the early warning information matching the operator's status. The anomaly analysis results of the spatial dimension are input into the machine design defect assessment submodule to obtain the security assessment results of the machine design defect problem; the security assessment results of the machine design defect problem include the degree of impact of the defects of the human-computer interaction system on system security; The anomaly analysis results of the spatial dimension are input into the special environment and task impact analysis submodule to obtain the safety assessment results of the special environment and task impact issues; the safety assessment of the special environment and task impact issues includes the safety status prediction information of the human-computer interaction system under different environmental and task conditions; The anomaly analysis results in the time dimension are input into the overall system interaction coupling analysis module to obtain the security assessment results of the overall system interaction coupling problem; the security assessment results of the overall system interaction coupling problem include the impact of the interaction coupling of the human-computer interaction system on system security.
[0101] Optionally, the human-computer interaction system includes at least one of the following: Aircraft cabin external service interaction system, intelligent driving interaction system.
[0102] The human factors safety problem analysis device provided in this disclosure can comprehensively acquire the attribute characteristics of human-computer interaction systems from multiple dimensions. It not only covers spatial dimensions such as operators, machines, interaction tasks, and the environment, but also performs systematic anomaly analysis on attribute characteristics across different dimensions, thus avoiding the problem of traditional analysis methods that only consider a single factor and lead to one-sided conclusions. Furthermore, this invention inputs the anomaly analysis results from each dimension into a safety problem assessment model containing multiple assessment sub-modules, enabling various safety problems to be independently assessed and generate results in targeted sub-modules, improving the relevance and accuracy of the analysis. Finally, through the comprehensive processing of multiple assessment results, a comprehensive and clearly structured human factors safety problem analysis report can be automatically generated, helping to quickly locate potential risks and improve the safety and reliability of human-computer interaction systems.
[0103] This disclosure also provides a computer device, such as... Figure 3 The diagram shown is a schematic representation of a computer device structure provided in an embodiment of this disclosure, including: Processor 31 and memory 32; the memory 32 stores machine-readable instructions executable by the processor 31, and the processor 31 executes the machine-readable instructions stored in the memory 32. When the machine-readable instructions are executed by the processor 31, the processor 31 performs the following steps: Acquire the attribute features of the human-computer interaction system under multiple feature dimensions; the feature dimensions include spatial dimensions; the spatial dimensions include operator features, machine features, interaction task features, and environmental features. For the attribute features of each feature dimension, anomaly analysis is performed on the attribute features to obtain the anomaly analysis results corresponding to each feature dimension; The anomaly analysis results are input into a security issue assessment model to determine the assessment results for multiple security issues. The security issue assessment model includes assessment sub-modules corresponding to each of the multiple security issues. The assessment sub-modules are used to generate assessment results for the security issues based on the anomaly analysis results corresponding to one or more feature dimensions. Based on the evaluation results of each evaluation module, a security issue analysis report for the human-computer interaction system is generated.
[0104] The aforementioned memory 32 includes a main memory 321 and an external memory 322; the main memory 321, also known as internal memory, is used to temporarily store the computational data in the processor 31, as well as the data exchanged with external memory 322 such as a hard disk. The processor 31 exchanges data with the external memory 322 through the main memory 321.
[0105] The specific execution process of the above instructions can be referred to the steps of the human factors safety problem analysis method described in the embodiments of this disclosure, and will not be repeated here.
[0106] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to in the description of the method embodiments. The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this disclosure according to actual needs. Those skilled in the art can understand and implement this without creative effort.
[0107] This disclosure also provides a computer-readable storage medium storing a computer program that, when executed by a processor, performs the steps of the human factors safety problem analysis method described in the above-described method embodiments. The storage medium can be a volatile or non-volatile computer-readable storage medium.
[0108] This disclosure also provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the human factors safety problem analysis method provided in the various embodiments of this disclosure.
[0109] The aforementioned computer program product can be implemented through hardware, software, or a combination thereof. In one optional embodiment, the computer program product is specifically embodied in a computer storage medium; in another optional embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.
[0110] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems and devices described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. In the several embodiments provided in this disclosure, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division; in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces; the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms.
[0111] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0112] In addition, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0113] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0114] Finally, it should be noted that the above-described embodiments are merely specific implementations of this disclosure, used to illustrate the technical solutions of this disclosure, and not to limit it. The protection scope of this disclosure is not limited thereto. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this disclosure; and these modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure, and should all be covered within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the protection scope of the claims.
[0115] The above description is merely a preferred embodiment of this disclosure and is not intended to limit this disclosure. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.
Claims
1. A method for analyzing human factors safety issues, characterized in that, include: Acquire the attribute features of the human-computer interaction system under multiple feature dimensions; the feature dimensions include spatial dimensions; the spatial dimensions include operator features, machine features, interaction task features, and environmental features. For the attribute features of each feature dimension, anomaly analysis is performed on the attribute features to obtain the anomaly analysis results corresponding to each feature dimension; The anomaly analysis results are input into the security issue assessment model to determine the assessment results for multiple security issues; the security issue assessment model includes assessment sub-modules corresponding to each of the multiple security issues. The evaluation submodule is used to generate an evaluation result for the security issue based on the anomaly analysis results corresponding to one or more feature dimensions. Based on the evaluation results of each evaluation module, a security issue analysis report for the human-computer interaction system is generated.
2. The method according to claim 1, characterized in that, The operator characteristics include the operator's physiological characteristics; The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: The health status of the operator is assessed based on historical health data and disease diagnosis information in the aforementioned physiological characteristics. Based on the operator's real-time physiological data during the human-computer interaction process and the operator's health status, the operator's fatigue level is determined.
3. The method according to claim 2, characterized in that, The operator characteristics include the operator's psychological characteristics, which include eye movement trajectory data, facial expression data, and psychological test results; The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: The eye-tracking data was analyzed to obtain results on psychological stress and attention. The facial expression data is analyzed to obtain the emotion state recognition result; Based on the results of the psychological stress and attention analysis, the results of the emotional state recognition, and the results of the psychological test, the abnormal analysis results of the operator's psychological characteristics are determined.
4. The method according to claim 3, characterized in that, The characteristics of the operators include the social attributes of the operator team; The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: Based on the social attribute characteristics of team members, such as communication frequency, information transmission accuracy, and collaborative task completion, a team collaboration relationship network model is constructed. Based on the communication information in the aforementioned social attribute characteristics, the team's decision-making results are obtained; Based on the team's decision-making results, identify the factors that influence team collaboration; Based on the team culture and management system in the social attribute characteristics, the results of the analysis on the influence of the operator team's behavior and attitude were determined. Based on the team collaboration relationship network model, the team decision-making results, the factors affecting team collaboration, and the analysis results of the influence of behavior and attitude, anomaly analysis results of the social attribute characteristics are generated.
5. The method according to claim 4, characterized in that, The operator characteristics include the impact of the environment on the operator; The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: Based on the task decomposition information, task time information, operator working memory capacity, and operator task processing ability in the characteristics of the impact of the environment on the operator, the task load status information is determined. Based on the operator's fatigue level, the operator's psychological analysis results, and the anomaly analysis results of the social attribute characteristics, the anomaly analysis results corresponding to the influence characteristics of the environment on the operator are determined.
6. The method according to claim 1, characterized in that, The feature dimension also includes a time dimension; the time dimension includes the user demand characteristics of the human-computer interaction system in the planning stage, the system design characteristics in the design stage, and the system operation characteristics in the system operation stage.
7. The method according to claim 6, characterized in that, The security assessment model for the human-computer interaction system is constructed through the following steps: Based on the relationship between the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension, a cross-mapping is performed on the feature dimensions in the spatial dimension and the feature dimensions in the temporal dimension. Based on the mapping results, an evaluation sub-model is constructed for each security issue.
8. The method according to claim 6, characterized in that, The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: Based on the user demand characteristics of the human-computer interaction system during the planning stage, the user demand analysis results are determined. The user requirement analysis results are verified to obtain requirement verification results; Based on the user demand analysis results and the demand verification results, the anomaly analysis results corresponding to the user demand characteristics are determined.
9. The method according to claim 6, characterized in that, The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: Based on the system design characteristics described in the design phase, the design defects of the human-computer interaction system are identified. Based on the aforementioned design flaws, an optimized design scheme for the human-computer interaction system is determined. Based on the aforementioned design flaws and the optimized design scheme, the anomaly analysis results corresponding to the system design features in the design phase are determined.
10. The method according to claim 6, characterized in that, The method involves performing anomaly analysis on the attribute features for each feature dimension to obtain the anomaly analysis results corresponding to each feature dimension, including: Based on the real-time system data in the system operation characteristics during the system operation phase, the results of the system operation impact analysis are determined.
11. The method according to claim 6, characterized in that, The step of inputting the anomaly analysis results into the security issue assessment model to determine the assessment results for multiple security issues includes: The anomaly analysis results of the time dimension are input into the personnel status assessment submodule to obtain the safety assessment results of the personnel status problem; the safety assessment results of the personnel status include the status of the operator, the trend of the operator's status change, and the early warning information matching the operator's status. The anomaly analysis results of the spatial dimension are input into the machine design defect assessment submodule to obtain the security assessment results of the machine design defect problem; the security assessment results of the machine design defect problem include the degree of impact of the defects of the human-computer interaction system on system security; The anomaly analysis results of the spatial dimension are input into the special environment and task impact analysis submodule to obtain the safety assessment results of the special environment and task impact issues; the safety assessment of the special environment and task impact issues includes the safety status prediction information of the human-computer interaction system under different environmental and task conditions; The anomaly analysis results in the time dimension are input into the overall system interaction coupling analysis module to obtain the security assessment results of the overall system interaction coupling problem; the security assessment results of the overall system interaction coupling problem include the impact of the interaction coupling of the human-computer interaction system on system security.
12. The method according to any one of claims 1 to 11, characterized in that, The human-computer interaction system includes at least one of the following: Aircraft cabin external service interaction system, intelligent driving interaction system.
13. A human factors safety problem analysis device, characterized in that, include: The acquisition module is used to acquire the attribute features of the human-computer interaction system across multiple feature dimensions. The feature dimension includes a spatial dimension; the spatial dimension includes operator features, machine features, interactive task features, and environmental features. The analysis module is used to perform anomaly analysis on the attribute features of each feature dimension, and obtain the anomaly analysis results corresponding to each feature dimension. The evaluation module is used to input the anomaly analysis results into the security issue evaluation model to determine the evaluation results for multiple security issues; the security issue evaluation model includes evaluation sub-modules corresponding to multiple security issues respectively; The evaluation submodule is used to generate an evaluation result for the security issue based on the anomaly analysis results corresponding to one or more feature dimensions. The generation module is used to generate a security issue analysis report for the human-computer interaction system based on the evaluation results of each evaluation module.
14. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 12.
15. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the method according to any one of claims 1 to 12.
Citation Information
Patent Citations
Driving scene human factor safety monitoring experiment platform and method
CN119279590A
Construction personnel capability assessment method and system based on intelligent model
CN121329214A
System and Methods for Optimizing Human Factors and Usability Engineering in Life Sciences Using Artificial Intelligence
US20240346524A1