Electric power operation fatigue monitoring device and method

A portable power operation fatigue monitoring device integrated into a safety helmet addresses the limitations of existing systems by providing real-time, comprehensive monitoring and alerting control centers to operator fatigue, enhancing safety and usability.

CN119073697APending Publication Date: 2024-12-06STATE GRID LIAONING ELECTRIC POWER CO LTD +2
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411387674.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-06
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

Existing power operation fatigue monitoring devices are cumbersome, impractical, lack a theoretical basis, and provide delayed alarms, leading to potential safety risks due to reduced vigilance and increased likelihood of incorrect operations.

Method used

A portable power operation fatigue monitoring device integrated into a safety helmet, utilizing a camera and main module connected via a split wired connection, with modules including a human eye feature recognition module, central data processing, and communication, to monitor eye characteristics in real-time and alert control centers when fatigue is detected.

Benefits of technology

Ensures comprehensive, real-time monitoring with no blind spots, improving safety by promptly alerting control centers to operator fatigue, ensuring safety and ease of use, and being adaptable to various power transmission and transformation scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119073697A_ABST
    Figure CN119073697A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of operation fatigue monitoring, and particularly relates to an electric power operation fatigue monitoring device and method. Comprising a safety helmet, a fixing buckle is installed on the lower edge of the safety helmet edge, a camera is installed on the buckle on the lower edge of the safety helmet edge, and the camera and a main module are integrally connected in a split wired mode; the camera is connected and communicated with the main module in a wired connection mode, and meanwhile the main module supplies power to the camera. The system has the advantages of being simple in structure and easy to implement, the field working condition can be effectively tracked and monitored, it is guaranteed that monitoring is free of dead corners, it is guaranteed that field safety control is in place, and the safety of electric power operation is remarkably improved. The device also has the characteristics of being portable and easy to use, has wide market prospects and application values, and can be widely applied to various scenes of power transmission and transformation video online monitoring.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of operation fatigue monitoring, and in particular relates to an electric power operation fatigue monitoring device and method. Background Art

[0002] Based on the actual considerations of the safety risk management and control of operations by the safety risk management platforms of power companies in various places, at the power operation site, fatigue will cause power workers to reduce their vigilance during the construction process and weaken their perception of external risks. In this case, if an incorrect operation is performed, it is very likely to cause serious consequences.

[0003] The essence of power operation fatigue monitoring technology is to capture and analyze the physiological characteristics of operators during the operation process, such as eye movements, facial features, electrocardiogram signals, brain electrical activities and other technologies.

[0004] To collect physiological characteristics, special sensing equipment is needed to compare the physiological characteristic data information collected by the operators during the working stage according to specific standards and algorithms to distinguish the fatigue working status.

[0005] Specific anti-fatigue products include head-down alarm devices that monitor head-down characteristics, watch-type devices that monitor pulse, glasses-type devices that monitor blinking frequency, and image recognition devices that use sensors to capture facial features and identify them.

[0006] However, the above products have various defects in actual application, such as being difficult to carry, poor practicality, insufficient theoretical basis, and delayed alarm. Summary of the invention

[0007] In view of the shortcomings of the above-mentioned prior art, the present invention provides a power operation fatigue monitoring device and method. Its purpose is to achieve tracking and monitoring of on-site working conditions, so that there is no blind spot in monitoring, ensure on-site safety control, improve the safety of power operations, and be portable and easy to use.

[0008] The technical solution adopted by the present invention to achieve the above-mentioned purpose is: A power operation fatigue monitoring device comprises a safety helmet, a fixing buckle is installed at the lower edge of the brim of the safety helmet, a camera is installed on the buckle at the lower edge of the brim of the safety helmet, and the camera and a main module are connected as a whole through a split wired connection; the camera is connected and communicated with the main module through a wired connection, and the main module supplies power to the camera.

[0009] Furthermore, the main module includes: a power module, a communication module, an alarm module, a human eye feature recognition module, a central data processing module and a video image acquisition module; wherein the alarm module, the human eye feature recognition module, the communication module are connected to the central data processing module, and the video image acquisition module is connected to the human eye feature recognition module.

[0010] Furthermore, the main module is equipped with a back clip accessory, and the main module is worn on the operator through the back clip accessory.

[0011] Furthermore, the human eye feature recognition module is used to monitor the state characteristics of the eyes of workers at the power operation site in real time; the fatigue recognition module is used to determine the fatigue state of the workers; The central data processing module is used to calculate the information of the operators in real time and analyze the video data; The communication module is used to upload the real-time video of the fatigue status of the operator identified by the collected eye information of the operator to the control center; The human eye feature recognition module is used to judge the fatigue state of the operator.

[0012] Furthermore, the human eye feature recognition module is used to judge the fatigue state of the operator, including: When judging the state characteristics of the eyes, the PERCLOS-like P80 criterion is used: when the pupil is covered by the eyelid for more than 80% of the area, and the coverage area is significantly higher than the average pupil and eyelid coverage value continuously monitored, the eyes are considered closed; The fatigue state judgment condition is: if the operator is continuously monitored to enter the P80 criterion judgment area, and the eyelid coverage value / pupil eyelid average coverage value at that time is <70%, and the average eye closure time is >0.25s, then the operator is preliminarily judged to be in a fatigue state.

[0013] A method for monitoring fatigue of electric power operation is implemented by using the above-mentioned device for monitoring fatigue of electric power operation, comprising: The power operation fatigue monitoring device is a split-type wired connection mode; Place the power work fatigue monitoring device on the brim of the safety helmet; The human eye feature recognition module collects the eye information of the workers; the fatigue recognition module monitors and recognizes the fatigue state characteristics of the workers' eyes in real time at the power operation site; the fatigue recognition module realizes the matching and recognition of the standard fatigue image library and the images collected by the camera; Upload real-time video to the control center through the 4G communication module.

[0014] Furthermore, the human eye feature recognition module is used to judge the fatigue state of the operator, including: When judging the state characteristics of the eyes, the PERCLOS-like P80 criterion is used: when the pupil is covered by the eyelid for more than 80% of the area, and the coverage area is significantly higher than the average pupil and eyelid coverage value continuously monitored, the eyes are considered to be closed; The fatigue state judgment condition is: if the operator is continuously monitored to enter the P80 criterion judgment area, and the eyelid coverage value / pupil eyelid average coverage value at this time is <70%, and the average eye closure time is >0.25s, then it is preliminarily judged that the operator is in a fatigue state.

[0015] Furthermore, placing the power operation fatigue monitoring device on the brim of the safety helmet means that a fixed buckle is installed on the lower edge of the safety helmet brim, the camera is placed on the buckle on the lower edge of the safety helmet brim, the main module is worn on the operator, the camera is placed on the front edge of the safety helmet, the camera is pointed at one eye of the operator, and the position is on the brim of the safety helmet and does not affect the field of vision.

[0016] A computer device comprises a storage medium, a processor and a computer program stored on the storage medium and executable on the processor, wherein when the processor executes the computer program, the steps of any one of the methods for monitoring fatigue of electric power operations are implemented.

[0017] A computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of any one of the methods for monitoring fatigue of electric power operations.

[0018] The present invention has the following beneficial effects and advantages: The device of the present invention is designed as a portable power operation fatigue monitoring device by combining the current power grid operation safety risk management and control requirements for on-site personnel. The present invention is combined with the implementation of the power system safety risk management and control platform construction project, which can effectively track and monitor the on-site work situation, ensure that there are no blind spots in the monitoring, and ensure that on-site safety management and control are in place, so that the safety of power operations has been significantly improved. The device of the present invention is also portable and easy to use, and has broad market prospects and application value. The device of the present invention also has good scalability and can be widely used in various scenarios of online monitoring of power transmission and transformation video. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which: Figure 1 It is a system module diagram of the present invention; Figure 2 It is a schematic diagram of the main module of the present invention; Figure 3 is a flow chart of the method of the present invention. DETAILED DESCRIPTION

[0020] In order to more clearly understand the above-mentioned objectives, features and advantages of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0021] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0022] Refer to the following Figure 1-Figure 3 The technical solutions of some embodiments of the present invention are described.

[0023] Example 1

[0024] The present invention provides an embodiment, which is a fatigue monitoring device for electric power operation. Figure 1 As shown, Figure 1 The present invention is a schematic diagram of the structure of the present invention. The power operation fatigue monitoring device proposed by the present invention can monitor the fatigue of power operation site workers in real time, automatically and preliminarily determine the possibility of fatigue of the site workers, take photos of the site workers and upload them to the control center, and send out an alarm at the same time, so that the control center personnel can further monitor the situation of the workers.

[0025] The present invention proposes a power operation fatigue monitoring device comprising: a camera and a main module as a whole are connected by a split wired connection. The camera is connected and communicated with the main module by a wired connection, and the main module supplies power to the camera. A fixed buckle is installed at the lower edge of the safety helmet brim, and the camera is placed on the buckle at the lower edge of the safety helmet brim.

[0026] like Figure 2 As shown, Figure 2 Schematic diagram of the main module of the present invention. The main module includes: power module, communication module, alarm module, human eye feature recognition module, voice communication module, central data processing module, video image acquisition module. The main module is equipped with a back clip accessory, and the main module can be worn on the shoulder or waist of the operator through the back clip accessory, so that it is easy to wear.

[0027] The main module includes a camera that can be conveniently installed on the lower edge of the helmet. The main module is placed on the shoulder of the operator in a similar way to a law enforcement recorder. The alarm module, human eye feature recognition module, and voice communication module are connected to the central data processing module, and the video image acquisition module is connected to the human eye feature recognition module.

[0028] The power operation fatigue monitoring device is designed as a split wired connection mode, in which the camera is a separate module, and the device modules with the functions of the video acquisition module and the human eye feature recognition module are together as a main module. The camera is connected and communicated with the main module through a wired connection, and the main module supplies power to the camera.

[0029] Example 2

[0030] The present invention further provides an embodiment, which is a power operation fatigue monitoring device, and also includes a human eye feature recognition module, a fatigue recognition module, a central processing module and a communication module.

[0031] The human eye feature recognition module is used to monitor the state characteristics of the eyes of workers at the power operation site in real time; the fatigue recognition module is used to determine the fatigue state of the workers; The central data processing module is used to calculate the information of the operators in real time and analyze the video data; The communication module is used to upload the real-time video of the fatigue status of the operator identified by the collected eye information of the operator to the control center.

[0032] The human eye feature recognition module is used to judge the fatigue state of the operator, using the following algorithm: When judging the state characteristics of the eyes, the PERCLOS-like P80 criterion is used: when the pupil is covered by the eyelids for more than 80% of its area, and the coverage area is significantly higher than the average pupil and eyelid coverage value continuously monitored, the eyes are considered to be in a closed state.

[0033] The fatigue state judgment condition is: if the operator is continuously monitored to enter the P80 criterion judgment area, and the eyelid coverage value / pupil eyelid average coverage value at this time is <70%, and the average eye closure time is >0.25s, then it is preliminarily judged that the operator is in a fatigue state.

[0034] Example 3

[0035] The present invention further provides an embodiment, which is a method for monitoring fatigue in power operations. Figure 3 As shown, Figure 3 is a flow chart of the method of the present invention, which is implemented by an electric power operation fatigue monitoring device proposed in Example 1 of the present invention.

[0036] The present invention provides a method for monitoring fatigue of electric power operation, which specifically comprises the following steps: Step 1. The power operation fatigue monitoring device is a split wired connection mode.

[0037] In order to reduce the weight of the helmet and avoid affecting the operation due to its large size or even causing unsafe factors, the power operation fatigue monitoring device of the present invention is designed as a split wired connection mode, wherein the camera is a separate module, and the device modules with other video acquisition modules and human eye feature recognition module functions are designed as a main module as a whole. The camera is connected to and communicates with the main module by wired connection, and the main module supplies power to the camera.

[0038] The power operation fatigue monitoring device is used to monitor the fatigue status of operators on the power operation site in real time.

[0039] Step 2. Place the power work fatigue monitoring device on the brim of the safety helmet.

[0040] The camera is arranged on the brim of the safety helmet, a fixed buckle is installed on the lower edge of the brim of the safety helmet, and the camera is arranged on the buckle on the lower edge of the brim of the safety helmet.

[0041] The main module can be worn on the operator's shoulders or waist.

[0042] The camera is placed at the front edge of the helmet, pointing towards the operator's eye. The position should be at the edge of the helmet and not affect the field of vision.

[0043] Step 3. Collect the eye information of the workers through the eye feature collection module; monitor and identify the fatigue status characteristics of the workers' eyes at the power operation site in real time; and use the fatigue recognition module to match and identify the standard fatigue image library with the images collected by the camera.

[0044] The eye feature acquisition module is used to identify the eye area from the video and perform a preliminary screening of the fatigue status of the operator through a specific algorithm; Step 4. Upload real-time video to the control center through the 4G communication module.

[0045] After preliminarily determining that the operator is in a fatigue state through step 3, the power operation fatigue monitoring device will alert the operator's suspected fatigue state to the supervisor in the control center through the power APN 4G private network, and at the same time send the collected video stream to the control center in real time for further identification by the monitoring personnel.

[0046] When it is preliminarily determined that the operator is in a state of fatigue, the alarm module transmits the information to the management and control personnel, and at the same time transmits the real-time monitoring video through the communication module. The management and control personnel make further judgments. If the operator is confirmed to be in a state of fatigue, the management and control personnel immediately take corresponding measures and can speak to the on-site operators through the voice module.

[0047] Example 4

[0048] Based on the same inventive concept, an embodiment of the present invention further provides a computer device, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor. When the processor executes the computer program, the steps of any one of the power operation fatigue monitoring methods described in Embodiment 1, 2, or 3 are implemented.

[0049] Example 5

[0050] Based on the same inventive concept, an embodiment of the present invention further provides a computer storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of any one of the methods for monitoring fatigue of electric power operations described in Embodiment 1, 2 or 3 are implemented.

[0051] In the present invention, the terms "connection" and "fixation" should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0052] In the description of this specification, the description of the terms "one embodiment", "some embodiments", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0053] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0054] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0055] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0056] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0057] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. A power operation fatigue monitoring device, including a safety helmet, characterized in that: A fixed buckle is installed at the lower edge of the brim of the safety helmet, and a camera is installed on the buckle at the lower edge of the brim of the safety helmet. The camera and the main module are connected as a whole through a split wired connection; the camera is connected and communicated with the main module through a wired connection, and the main module supplies power to the camera.

2. The power operation fatigue monitoring device according to claim 1 is characterized in that: The main module includes: a power module, a communication module, an alarm module, a human eye feature recognition module, a central data processing module and a video image acquisition module; wherein the alarm module, the human eye feature recognition module, the communication module are connected to the central data processing module, and the video image acquisition module is connected to the human eye feature recognition module.

3. The power operation fatigue monitoring device according to claim 1 is characterized in that: The main module is equipped with a back clip accessory, and the main module is worn on the operator through the back clip accessory.

4. The power operation fatigue monitoring device according to claim 1 is characterized in that: Said The human eye feature recognition module is used to monitor the state characteristics of the eyes of workers at the power operation site in real time; The fatigue identification module is used to identify the fatigue state of the operator; The central data processing module is used to calculate the information of the operators in real time and analyze the video data; The communication module is used to upload the real-time video of the fatigue status of the operator identified by the collected eye information of the operator to the control center; The human eye feature recognition module is used to judge the fatigue state of the operator.

5. The electric power operation fatigue monitoring device according to claim 4 is characterized in that: The human eye feature recognition module is used to judge the fatigue state of the operator, including: When judging the state characteristics of the eyes, the PERCLOS-like P80 criterion is used: when the pupil is covered by the eyelid for more than 80% of the area, and the coverage area is significantly higher than the average pupil and eyelid coverage value continuously monitored, the eyes are considered closed; The fatigue state judgment condition is: if the operator is continuously monitored to enter the P80 criterion judgment area, and the eyelid coverage value / pupil eyelid average coverage value at that time is <70%, and the average eye closure time is >0.25s, then the operator is preliminarily judged to be in a fatigue state.

6. A method for monitoring fatigue in electric power operations, characterized in that: The method is implemented by using the power operation fatigue monitoring device described in claims 1 to 5, comprising: The power operation fatigue monitoring device is a split-type wired connection mode; Place the power work fatigue monitoring device on the brim of the safety helmet; The human eye feature recognition module collects the eye information of the workers; the fatigue recognition module monitors and recognizes the fatigue state characteristics of the workers' eyes in real time at the power operation site; the fatigue recognition module realizes the matching and recognition of the standard fatigue image library and the images collected by the camera; Upload real-time video to the control center through the 4G communication module.

7. The method for monitoring fatigue of electric power operation according to claim 6 is characterized by: The human eye feature recognition module is used to judge the fatigue state of the operator, including: When judging the state characteristics of the eyes, the PERCLOS-like P80 criterion is used: when the pupil is covered by the eyelid for more than 80% of the area, and the coverage area is significantly higher than the average pupil and eyelid coverage value continuously monitored, the eyes are considered to be closed; The fatigue state judgment condition is: if the operator is continuously monitored to enter the P80 criterion judgment area, and the eyelid coverage value / pupil eyelid average coverage value at this time is <70%, and the average eye closure time is >0.25s, then it is preliminarily judged that the operator is in a fatigue state.

8. The method for monitoring fatigue of electric power operation according to claim 6, characterized in that: Placing the power operation fatigue monitoring device on the brim of the safety helmet means that a fixed buckle is installed on the lower edge of the brim of the safety helmet, and the camera is placed on the buckle on the lower edge of the brim of the safety helmet. The main module is worn on the operator, and the camera is placed on the front edge of the safety helmet. The camera points to the operator's single eye and is located at a position on the brim of the safety helmet that does not affect the field of vision.

9. A computer device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method for monitoring fatigue of electric power operations as described in any one of claims 6 to 8 are implemented.

10. A computer storage medium, characterized in that: The computer storage medium stores a computer program, and when the computer program is executed by a processor, the steps of a method for monitoring fatigue of electric power operations as described in any one of claims 6 to 8 are implemented.