Electric power digital intelligent safety supervision system and operator supervision method

Abstract

The invention relates to the technical field of power management, in particular to a power digital intelligent safety supervision system and an operator supervision method. And by comparing the target moving track distribution information with the field moving track distribution information, the field operation score of the operator is calculated. According to the method, operation reference time distribution information is given according to fixed common operation types and operation places, when the actual operation process of an operator is greatly different from the reference, the condition can be found in time, whether the problem is a human problem or an equipment problem can be judged through professional analysis, and supervision of the operation process is achieved. In addition, the technical scheme can be realized through a software algorithm, the cost is low, and the application range is wide.

Description

Technical Field

[0001] The present invention relates to the field of power management technology, and in particular to a power digital intelligent safety monitoring system and an operator supervision method. Background Art

[0002] With the rapid development of information technology, traditional power operation and maintenance management can no longer meet the current requirements of safe production, and new information-based supervision systems have gradually been applied to the power operation and maintenance management process.

[0003] The current information-based supervision system for power operation and maintenance is generally used for simple process management and authority management. It lacks the necessary management means to determine whether the various operations in the power system are reasonable, resulting in uneven quality of power operation and maintenance operations. Summary of the invention

[0004] The present invention discloses an electric power digital safety monitoring system and an operator supervision method, which can not only realize basic process management, but also supervise the operation quality of operators and improve the quality of electric power operation and maintenance work.

[0005] In order to achieve the above-mentioned object, on the one hand, a power digital intelligent safety monitoring system is provided, the system comprising:

[0006] Personnel information storage module, input basic information of operators, operation scene information and operation information of operators;

[0007] The operation target storage module records the target movement trajectory distribution information corresponding to each operation in each operation site;

[0008] The entry management module obtains facial information of the operator at the work site through the first camera, compares the facial information with the basic information of the operator, and determines whether the operator is allowed to enter the work site;

[0009] The on-site trajectory acquisition module acquires the full-process operation video of the operator at the operation site through the second camera, records the on-site movement trajectory information of the operator based on the full-process operation video, and calculates the on-site movement trajectory distribution information based on the on-site movement trajectory information;

[0010] The operation supervision module compares the on-site movement trajectory distribution information with the corresponding target movement trajectory distribution information and calculates the on-site operation score of the operator.

[0011] Furthermore, the on-site trajectory acquisition module includes an on-site movement trajectory information calculation submodule, which divides the on-site operation space into a plurality of sub-areas, and calculates the residence time of the operator in each sub-area according to the on-site movement trajectory information of the operator;

[0012] The target movement trajectory distribution information and the on-site movement trajectory distribution information both include a time ratio of the stay time in each sub-area.

[0013] The advantage of this embodiment is that it provides a digital safety supervision management system for power operation and maintenance, which, in addition to completing the digital management of traditional process permissions, can also evaluate the actual work situation of the operation and maintenance personnel and improve the overall operation and maintenance work quality.

[0014] In order to achieve the above purpose, on the other hand, a method for supervising operators is provided, and the specific method is as follows:

[0015] Determine the work site of the operators and the specific work type;

[0016] Read the target movement trajectory distribution information corresponding to the work site and work type;

[0017] Record the whole operation video of the operator and obtain the on-site movement trajectory information of the operator based on the whole operation video;

[0018] According to the on-site movement trajectory information, the proportion of the operator's stay time in each sub-area is counted, that is, the on-site movement trajectory distribution information;

[0019] Compare the target movement trajectory distribution information with the on-site movement trajectory distribution information to calculate the on-site operation score of the operator;

[0020] The target movement trajectory distribution information and the on-site movement trajectory distribution information both include a range of residence time ratios between sub-areas of the work space.

[0021] The advantage of this embodiment is that it provides the operation benchmark time distribution information for fixed common operation types and operation locations. When the actual operation process of the operator differs greatly from the benchmark, the situation can be discovered in time. After professional analysis, it can be determined whether it is a human problem or an equipment problem, thus realizing the supervision of the operation process. In addition, this technical solution can be realized through software algorithms, with low cost and wide application range.

[0022] Furthermore, the on-site movement trajectory information of the operator is obtained based on the full operation video. The specific method is as follows:

[0023] The image data of the whole operation video is marked with the shooting time at fixed time intervals;

[0024] Identify the operators in the whole operation video;

[0025] The distance between the operator and the depth camera is measured by the depth camera;

[0026] Combining the coordinates of the depth camera, the shooting angle, the distance from the operator, and the spatial coordinate system, the coordinates of the operator in the spatial coordinate system are calculated;

[0027] The coordinates of the workers in the spatial coordinate system are associated with the image shooting time, arranged in chronological order, and the on-site movement trajectory information of the workers with the shooting time is constructed.

[0028] The advantage of this embodiment is that different work locations and types of work have different work requirements, and currently it is impossible to complete overall supervision. This embodiment innovatively uses the trajectory distribution of workers to achieve supervision. It only needs to obtain the trajectory distribution of workers through video images, and then obtain the trajectory coordinates of workers through ranging algorithms, and finally associate them with the shooting time to provide a basis for subsequent analysis.

[0029] Furthermore, to identify the operators in the entire operation video, a human body recognition convolutional neural network model or a marker recognition convolutional neural network model is used.

[0030] The advantage of this embodiment is that the convolutional neural network model is a mature existing technology in or special object recognition, and the convolutional neural network can ensure target tracking.

[0031] Furthermore, the on-site movement trajectory distribution information is obtained, and the specific method is as follows:

[0032] Divide the work space into several sub-areas;

[0033] Mark the spatial coordinates of each sub-region;

[0034] Divide the on-site movement trajectory information of the operators into several sub-areas;

[0035] Count the image shooting time associated with the on-site movement trajectory information of the workers in each sub-area, and calculate the total stay time in each sub-area;

[0036] According to the total stay time in each sub-area, the stay time ratio between the sub-areas is calculated.

[0037] The advantage of this embodiment is that the on-site movement trajectory information of the operator is only a series of coordinate changes, from which it is difficult to extract the difference data features associated with the operation type. This embodiment uses sub-area division and sub-area residence time to greatly extract the data correlation between the movement trajectory information of the operator and the operation type, providing a basis for evaluating the quality of the operation. That is, when the real-time residence time of the operator in the sub-area is very different from the residence time that the main operation type should have, it is obviously not in line with the law that the operation should have.

[0038] Furthermore, the on-site operation score of the operator is calculated as follows:

[0039] Calculate the residence time of each sub-area in the on-site mobile trajectory distribution information, and the part that exceeds the residence time ratio range between the sub-areas in the target mobile trajectory distribution information in real time, accumulate the proportions of all exceeding parts, and subtract the proportions of all exceeding parts from 1 to calculate the on-site operation score of the operator.

[0040] The advantage of this embodiment is that if the overall time distribution of the operator is similar to the target time distribution, it can be preliminarily judged that there is no problem with the specific operation of the operator; if there is a difference between the overall time distribution of the operator and the target time distribution, the difference can be quantified. The adoption of the ratio takes into account the speed difference of each operator and reduces the possibility of misjudgment.

[0041] Furthermore, the feedback of the operators on the on-site operation scores is counted. If the feedback of the operators on the on-site operation scores is lower than a preset value, the proportion range of the stay time between each sub-area in the target movement trajectory distribution information is updated.

[0042] The advantage of this embodiment is that when the operator reports a problem with the score, it may be that a new technical problem has occurred during the operation, resulting in a change in the time allocation. Therefore, this embodiment provides a channel for updating the target time allocation range.

[0043] Furthermore, the residence time ratio range of each sub-area in the target movement trajectory distribution information is updated, and the specific method is as follows:

[0044] Obtain the over-stay sub-area of ​​the over-stay time ratio range of the feedback operator;

[0045] Obtain feedback on the operator's overstay value in the overstay sub-area;

[0046] The correction coefficient is multiplied by the super-stay value, and the result is added to the original upper limit of the super-stay sub-area, which is used as the upper limit of the stay time ratio range after the super-stay sub-area is updated, and the lower limit of the stay time ratio range remains unchanged;

[0047] The correction factor is the predicted probability of the event causing the operator to exceed the stay time in the future.

[0048] The advantage of this embodiment is that it provides a quantitative method for updating the proportion range of the stay time of each sub-area in the target movement trajectory distribution information, and the method can ensure that the field operation score can be updated at any time.

[0049] Other advantages, objectives and features of the present invention will be described in the following description to some extent, and to some extent, will be obvious to those skilled in the art based on the following examination and study, or can be taught from the practice of the present invention. The objectives and other advantages of the present invention can be achieved and obtained through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The accompanying drawings of the present invention are as follows.

[0051] Figure 1 Schematic diagram of the measurement principle of Example 2.

[0052] Figure 2 This is a schematic diagram of the system architecture of Example 1.

[0053] Figure 3 This is a schematic diagram of the process of Example 2. DETAILED DESCRIPTION

[0054] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0055] Embodiment 1:

[0056] A power digital intelligence safety monitoring system, such as Figure 2 As shown, the system comprises:

[0057] Personnel information storage module, input basic information of operators, operation scene information and operation information of operators;

[0058] The operation target storage module records the target movement trajectory distribution information corresponding to each operation in each operation site;

[0059] The entry management module obtains facial information of the operator at the work site through the first camera, compares the facial information with the basic information of the operator, and determines whether the operator is allowed to enter the work site;

[0060] The on-site trajectory acquisition module acquires the full-process operation video of the operator at the operation site through the second camera, records the on-site movement trajectory information of the operator based on the full-process operation video, and calculates the on-site movement trajectory distribution information based on the on-site movement trajectory information;

[0061] The operation supervision module compares the on-site movement trajectory distribution information with the corresponding target movement trajectory distribution information and calculates the on-site operation score of the operator.

[0062] Embodiment 2:

[0063] A method of monitoring operators, such as Figure 3 As shown, the specific steps are as follows:

[0064] S1. Determine the work site and specific work type of the operators;

[0065] S2. Read the target movement trajectory distribution information corresponding to the work site and work type. in, is the lower limit of the target stay time in the fourth sub-area, This is the upper limit of the target stay time in the fourth sub-area.

[0066] In this embodiment, the work area is divided into four sub-areas.

[0067] S3. Record the whole operation video of the operator and obtain the on-site movement trajectory information of the operator based on the whole operation video in The coordinates corresponding to the k-th picture of the operator.

[0068] To obtain the on-site movement trajectory information of the operator, the specific steps are as follows:

[0069] S31, marking the shooting time for the image data of the whole operation video at fixed time intervals in is the shooting time of the kth picture of the operator.

[0070] S32. Identify the operators in the whole operation video. Identify the operators in the whole operation video using a human body recognition convolutional neural network model.

[0071] S33, measuring the distance between the operator and the depth camera through the depth camera in, is the distance between the operator and the depth camera when the kth picture was taken.

[0072] In step S33, the depth camera distance measurement principle is as follows Figure 1 As shown in the figure, the binocular stereo vision system matches the feature points of the RGB image and calculates the depth information of the image using the triangulation method. In the figure, P is a point where the operator is in the image, I is the imaging plane, A is the imaging distance of the left and right cameras, B is the center length of the camera aperture, C is the distance from the camera, and f represents the focal length of the camera.

[0073] Assume that the imaging points of the operator on the left and right sides are P L , P R , the aperture center of the left and right cameras is O L , O R , the coordinates of the two imaging points in the image are U L , U R , disparity value d = U L -UR , according to similar triangles:

[0074]

[0075] Where A = Bd, and the depth information of the image is calculated by calculating the disparity value d using triangulation.

[0076] S34: Combine the coordinates (x0, y0) of the depth camera, the shooting angle θ, and the distance from the operator And the spatial coordinate system, calculate the coordinates of the operator in the spatial coordinate system

[0077] S35, associate the coordinates of the operator in the spatial coordinate system with the image shooting time, arrange them in chronological order, and construct the on-site movement trajectory information of the operator with the shooting time

[0078] S4. According to the on-site movement trajectory information, the proportion of the operator's stay time in each sub-area is counted, that is, the on-site movement trajectory distribution information.

[0079] To obtain the on-site mobile trajectory distribution information, the specific steps are as follows:

[0080] S41, dividing the working space into four sub-areas;

[0081] S42, marking the spatial coordinates of each sub-region;

[0082] S43, dividing the on-site movement trajectory information of the operator into a plurality of sub-areas;

[0083] S44, counting the image shooting time associated with the on-site movement trajectory information of the workers in each sub-area, and calculating the total stay time of each sub-area;

[0084] S45. Calculate the ratio of the residence time between the sub-areas according to the total residence time of each sub-area.

[0085] S5. Compare the target movement trajectory distribution information with the on-site movement trajectory distribution information, and calculate the on-site operation score of the operator.

[0086] The on-site work score of the operator is calculated as follows:

[0087] Calculate the residence time of each sub-area in the on-site mobile trajectory distribution information, and the part that exceeds the residence time ratio range between the sub-areas in the target mobile trajectory distribution information in real time, accumulate the proportions of all exceeding parts, and subtract the proportions of all exceeding parts from 1 to calculate the on-site operation score of the operator.

[0088] In this embodiment, and The remaining sub-areas are within the range, then:

[0089]

[0090] S6. Count the feedback of the operators on the on-site operation scores. If the feedback of the operators on the on-site operation scores is lower than a preset value, update the proportion range of the stay time between each sub-area in the target movement trajectory distribution information.

[0091] Update the target movement trajectory distribution information, and the dwell time ratio range of each sub-area is as follows:

[0092] S61, obtaining a feedback of the over-staying sub-region of the operator's over-staying time ratio range, which is the fourth sub-region in this embodiment.

[0093] S62, obtaining feedback on the operator's overstay value in the overstay sub-area

[0094] S63, multiply the excess dwell value by the coefficient Plus the original upper limit range of the super stay sub-region As the upper limit of the stay time ratio range after the super stay sub-area is updated, the lower limit of the stay time ratio range remains unchanged, that is,

[0095]

[0096] S64. The correction coefficient is the predicted probability of an event causing the operator to exceed the stay time in the future.

[0097] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. A power digital intelligence safety monitoring system, characterized in that: The system comprises: Personnel information storage module, input basic information of operators, operation scene information and operation information of operators; The operation target storage module records the target movement trajectory distribution information corresponding to each operation in each operation site; The entry management module obtains facial information of the operator at the work site through the first camera, compares the facial information with the basic information of the operator, and determines whether the operator is allowed to enter the work site; The on-site trajectory acquisition module acquires the full-process operation video of the operator at the operation site through the second camera, records the on-site movement trajectory information of the operator based on the full-process operation video, and calculates the on-site movement trajectory distribution information based on the on-site movement trajectory information; The operation supervision module compares the on-site movement trajectory distribution information with the corresponding target movement trajectory distribution information and calculates the on-site operation score of the operator.

2. The force-data intelligent safety monitoring system according to claim 1, characterized in that: The on-site trajectory acquisition module includes an on-site movement trajectory information calculation submodule, which divides the on-site operation space into a plurality of sub-areas, and calculates the stay time of the operator in each sub-area according to the on-site movement trajectory information of the operator; The target movement trajectory distribution information and the on-site movement trajectory distribution information both include a time ratio of the stay time in each sub-area.

3. A method for supervising operators, characterized in that: The specific method is as follows: Determine the work site of the operators and the specific work type; Read the target movement trajectory distribution information corresponding to the work site and work type; Record the whole operation video of the operator and obtain the on-site movement trajectory information of the operator based on the whole operation video; According to the on-site movement trajectory information, the proportion of the operator's stay time in each sub-area is counted, that is, the on-site movement trajectory distribution information; Compare the target movement trajectory distribution information with the on-site movement trajectory distribution information to calculate the on-site operation score of the operator; The target movement trajectory distribution information and the on-site movement trajectory distribution information both include a range of residence time ratios between sub-areas of the work space.

4. The operator supervision method according to claim 3, characterized in that: The on-site movement trajectory information of the operator is obtained based on the full operation video. The specific method is as follows: The image data of the whole operation video is marked with the shooting time at fixed time intervals; Identify the operators in the whole operation video; The distance between the operator and the depth camera is measured by the depth camera; Combining the coordinates of the depth camera, the shooting angle, the distance from the operator, and the spatial coordinate system, the coordinates of the operator in the spatial coordinate system are calculated; The coordinates of the workers in the spatial coordinate system are associated with the image shooting time, arranged in chronological order, and the on-site movement trajectory information of the workers with the shooting time is constructed.

5. The operator supervision method according to claim 4, characterized in that: To identify the workers in the entire operation video, a human body recognition convolutional neural network model or a marker recognition convolutional neural network model is used.

6. The operator supervision method according to claim 3, characterized in that: Get the on-site mobile trajectory distribution information. The specific method is as follows: Divide the work space into several sub-areas; Mark the spatial coordinates of each sub-region; Divide the on-site movement trajectory information of the operators into several sub-areas; Count the image shooting time associated with the on-site movement trajectory information of the workers in each sub-area, and calculate the total stay time in each sub-area; According to the total stay time in each sub-area, the stay time ratio between the sub-areas is calculated.

7. The operator supervision method according to claim 3, characterized in that: The on-site work score of the operator is calculated as follows: Calculate the residence time of each sub-area in the on-site mobile trajectory distribution information, and the part that exceeds the residence time ratio range between the sub-areas in the target mobile trajectory distribution information in real time, accumulate the proportions of all exceeding parts, and subtract the proportions of all exceeding parts from 1 to calculate the on-site operation score of the operator.

8. The operator supervision method according to claim 3, characterized in that: The feedback of the operators on the on-site operation scores is counted. If the feedback of the operators on the on-site operation scores is lower than the preset value, the proportion range of the stay time between each sub-area in the target movement trajectory distribution information is updated.

9. The operator supervision method according to claim 8, characterized in that: Update the target movement trajectory distribution information, and the dwell time ratio range of each sub-area is as follows: Obtain the over-stay sub-area of ​​the over-stay time ratio range of the feedback operator; Obtain feedback on the operator's overstay value in the overstay sub-area; The coefficient is multiplied by the super-stay value, and the result is added to the original upper limit of the super-stay sub-area to obtain the upper limit of the stay time ratio range after the super-stay sub-area is updated. The lower limit of the stay time ratio range remains unchanged. The correction factor is the predicted probability of the event causing the operator to exceed the stay time in the future.

Images