Dynamic Human-Machine Interface System Based on Facial Feature Recognition and Its Human-Machine Communication Method

Abstract

The invention belongs to the technical field of man-machine interfaces of instrument control systems and relates to a dynamic man-machine interface system based on facial features recognition and a man-machine communication method thereof. A static man-machine interface system, a camera, an alarm and a control switch are connected with an operator working state detecting module respectively; the camera is used for obtaining a real-time dynamic image in an operation area of the instrument control system and transmitting the obtained image to the operator working state detecting module; the operator working state detecting module is used for detecting and judging the image, sending a signal for reducing operator operation credibility to the static man-machine interface system and sending an alarm signal to the alarm at the same time if judging as undesirable operator working state; and the control switch is controlled by the operator and used for determining whether allowing to send a signal for reducing the operator operation credibility and the alarm signal or not. According to the dynamic man-machine interface system based on facial features recognition, a real-time working state of an operator is detected dynamically by using an image recognizing method; and the dynamic man-machine interface system has the advantages that the dynamic man-machine interface system is not easily realized by a detected individual; and the dynamic man-machine interface system is convenient to implement.

Description

technical field [0001] The invention belongs to the technical field of man-machine interface for instrument control systems in industries such as thermal power, and specifically relates to a dynamic man-machine interface system based on facial feature recognition and a man-machine communication method thereof. Background technique [0002] Instrument and control systems in thermal power and other industries require high reliability, and the man-machine interface is the weakest link. A small fault during the operation of the thermal power unit may have a great impact on the safe operation of the thermal power unit if it is misoperated due to human failure (mainly caused by the poor working condition of the operator). According to statistics, various accidents and safety incidents caused by human failure account for more than 50% of the total number of accidents and safety incidents. [0003] In the instrument and control system of thermal power plants, various built-in tests...

AI Technical Summary

Problems solved by technology

However, the existing human factor reliability analysis is mainly designed based on statistical data of the overall average characteristics of the operator through statistics or the establishment of a mathematical model. Emerging dynamic features

Therefore, the existing human-machine interface system is only a system with a fixed mode, and cannot realize the function similar to the built-in self-test of the instrument control system

It is impossible to detect the operator in real time when his environment or his own state changes

For example, operators are prone to sleepiness when they are on night shift, resulting in decreased thinking ability, unresponsiveness, and more cases of missing and misreading information. At this time, the operation has extremely low reliability.

If it cannot be detected and stopped in time, it may have a great impact on the safe operation of thermal power

However, existing human-machine interface systems do not take this critical aspect into account

[0005] Existing man-machine interface systems can only take into account the static overall characteristics and status of the operator, but cannot take into account the dynamic factors that the operator will have different characteristics and states at different times, so the existing man-machine interface system is a static man-machine interface system interface system

Images