A method and device for digitalizing safety early warning of video data of a hydropower station

Abstract

The present application provides a method and device for digital safety early warning of hydropower station video data, the method comprising: acquiring a video image, identifying the static area and dynamic area of ​​each frame of the video image; extracting the static area of ​​a preset frame of the video image, performing digital processing to generate a digital static area, and marking the static contour line of the digital static area; extracting the dynamic area of ​​each frame of the video image, performing digital processing to generate a digital dynamic area, and marking the dynamic contour line of the digital dynamic area; calculating the vertical offset of the static contour line and the dynamic contour line, generating a dynamic area amplification area, and determining whether the dynamic area amplification area exceeds a preset threshold, and if so, issuing a safety alarm. The present application uses image digitization technology to identify changes in the dynamic area to accurately provide early warning information, and can achieve real-time monitoring and automatic early warning, reducing manpower while improving the accuracy of early warning.

Description

Technical Field

[0001] The present application relates to a hydropower station early warning technology, and more particularly to a hydropower station video data digital security early warning method. The present application also relates to a hydropower station video data digital security early warning device. Background Art

[0002] A hydropower station is a large-scale power system that uses the potential and kinetic energy of water to generate electricity. Generally speaking, a hydropower station needs to intercept a river and use a dam to store a large amount of water, thereby increasing the potential energy of the water. This method of changing the river channel and terrain often brings safety problems, including: damage to the dam or a rapid increase in water flow, which will create safety hazards.

[0003] In the prior art, by monitoring the water flow and then comparing the actual situation of the dam with the water level, a safety risk warning can be issued, which can accurately determine the trend of water level changes and safety expectations. The usual practice is to set up multiple detection points, and arrange a water level measurement device at each detection point, and then collect the measurement data detected at each detection point, and judge the risk situation by analyzing and judging these measurement data. The prior art method of water level detection requires a large number of water level detection devices to be arranged, and records are made by specialized personnel, which is time-consuming and laborious. Summary of the invention

[0004] In order to solve the problem that the water level risk warning of hydropower stations in the prior art is time-consuming and labor-intensive, the present application provides a method for digitalizing video data of hydropower stations for safety warning. The present application also relates to a device for digitalizing video data of hydropower stations for safety warning.

[0005] The present application provides a method for digitalizing video data of a hydropower station for safety early warning, comprising:

[0006] Acquire a video image, and identify a static area and a dynamic area of ​​each frame of the video image;

[0007] Extracting the static area of ​​the preset frame of the video image, performing digital processing to generate a digitized static area, and marking a static contour line of the digitized static area;

[0008] Extracting the dynamic area of ​​each frame of the video image, performing digital processing to generate a digitized dynamic area, and marking the dynamic contour line of the digitized dynamic area;

[0009] The vertical offset between the static contour line and the dynamic contour line is calculated, a dynamic area increase area is generated, and it is determined whether the dynamic area increase area exceeds a preset threshold, and if so, a safety alarm is issued.

[0010] Optionally, the dynamic area is a water surface area, and the static area is an area other than the water surface area; or, the dynamic area is an area other than the water surface area, and the static area is a water surface area.

[0011] Optionally, the static area of ​​the preset frame is digitized and stored, and only the static area of ​​one preset frame is digitized;

[0012] When a new frame of video image is identified, only the dynamic area of ​​the video image is extracted for digitization.

[0013] Optionally, also include:

[0014] The dynamic area is divided into multiple sub-dynamic areas, and the preset threshold is set for each of the sub-dynamic areas.

[0015] Optionally, the security alarm includes: a sound signal, a light signal, a broadcast signal, and a message signal sent via the Internet.

[0016] The present application also provides a hydropower station video data digitization safety early warning device, comprising:

[0017] An image processing module, used for acquiring a video image and identifying a static area and a dynamic area of ​​each frame of the video image;

[0018] A static image module, used for extracting a static area of ​​a preset frame of the video image, performing digital processing to generate a digitized static area, and marking a static contour line of the digitized static area;

[0019] A dynamic image module, used for extracting the dynamic area of ​​each frame of the video image, performing digital processing to generate a digitized dynamic area, and marking a dynamic contour line of the digitized dynamic area;

[0020] The safety warning module is used to calculate the vertical offset between the static contour line and the dynamic contour line, generate a dynamic area increase area and determine whether the dynamic area increase area exceeds a preset threshold, and if so, issue a safety alarm.

[0021] Optionally, the dynamic area is a water surface area, and the static area is an area other than the water surface area; or, the dynamic area is an area other than the water surface area, and the static area is a water surface area.

[0022] Optionally, also include:

[0023] A storage module, used for storing the static area of ​​the preset frame after digitization, and only digitizing the static area of ​​one preset frame;

[0024] When a new frame of video image is identified, only the dynamic area of ​​the video image is extracted for digitization.

[0025] Optionally, the dynamic image module also includes:

[0026] The partitioning unit is used to partition the dynamic area into multiple sub-dynamic areas and set the preset threshold for each sub-dynamic area.

[0027] Optionally, the security alarm includes: a sound signal, a light signal, a broadcast signal, and a message signal sent via the Internet.

[0028] The advantages of this application over the prior art are:

[0029] The present application provides a method for digitalizing video data of a hydropower station for safety early warning, including: acquiring a video image, identifying a static area and a dynamic area of ​​each frame of the video image; extracting a static area of ​​a preset frame of the video image for digital processing to generate a digital static area, and marking the static contour line of the digital static area; extracting a dynamic area of ​​each frame of the video image for digital processing to generate a digital dynamic area, and marking the dynamic contour line of the digital dynamic area; calculating the vertical offset of the static contour line and the dynamic contour line, generating a dynamic area amplification area, and determining whether the dynamic area amplification area exceeds a preset threshold, and if so, issuing a safety alarm. The present application uses image digitization technology to identify changes in the dynamic area to accurately provide early warning information, and can achieve real-time monitoring and automatic early warning, reducing manpower while improving the accuracy of early warning. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is a schematic diagram of the digital safety warning of the hydropower station video data in this application.

[0031] Figure 2 It is a flowchart of the digital processing of the static area described in this application.

[0032] Figure 3 It is a schematic diagram of the digital safety warning device for video data of a hydropower station in this application. DETAILED DESCRIPTION

[0033] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0034] The present application provides a method for digitalizing video data of a hydropower station for safety early warning, including: acquiring a video image, identifying a static area and a dynamic area of ​​each frame of the video image; extracting a static area of ​​a preset frame of the video image for digital processing to generate a digital static area, and marking the static contour line of the digital static area; extracting a dynamic area of ​​each frame of the video image for digital processing to generate a digital dynamic area, and marking the dynamic contour line of the digital dynamic area; calculating the vertical offset of the static contour line and the dynamic contour line, generating a dynamic area amplification area, and determining whether the dynamic area amplification area exceeds a preset threshold, and if so, issuing a safety alarm. The present application uses image digitization technology to identify changes in the dynamic area to accurately provide early warning information, and can achieve real-time monitoring and automatic early warning, reducing manpower while improving the accuracy of early warning.

[0035] Figure 1 It is a schematic diagram of the digital safety warning of the hydropower station video data in this application.

[0036] Please refer to Figure 1 As shown, S101 acquires a video image and identifies a static area and a dynamic area of ​​each frame of the video image.

[0037] The video image is a composite video image for monitoring the entire hydropower station, including a panoramic image synthesized from images captured by multiple cameras, or the video image can also be a high-resolution satellite image. Preferably, the video image is an infrared image.

[0038] After acquiring the video image, it is necessary to determine the static area and dynamic area in the video image. The static area refers to the background image that does not change, while the dynamic area refers to the image content that is undergoing changes. Specifically, the dynamic area is the water surface area, and the static area is the area other than the water surface area. At this time, the monitoring focus is on the monitoring of water flow, such as water rise, etc.; or, the dynamic area is the area other than the water surface area, and the static area is the water surface area. At this time, the monitoring focus is on the changes in the water bank, such as landslides, etc.

[0039] When identifying the static area and the dynamic area, different identification methods need to be set according to the specific video type. One method is that the video image is an ordinary visible light image, which can present the complete image content, and the dynamic area and the static area are identified through the existing image recognition algorithm. The other method is that the video image is an infrared image, and the dynamic area and the static area are identified according to the color change of the infrared image.

[0040] Please refer to Figure 1 As shown, S102 extracts the static area of ​​the preset frame of the video image, performs digital processing to generate a digitized static area, and marks the static contour line of the digitized static area.

[0041] After the dynamic area and the static area are identified, the image of the static area is extracted, and the static image is digitized to generate a digital static area of ​​a digital image.

[0042] Figure 2 It is a flowchart of the digital processing of the static area described in this application.

[0043] Please refer to Figure 2 As shown, S201 extracts the static area.

[0044] After the static area and the dynamic area of ​​the video image are identified, a dividing line is set according to the connection between the dynamic area and the static area, thereby dividing the static area and the dynamic area. A preferred implementation is to generate an image of only the static area and an image of the dynamic area respectively according to a template of a preset size, and then extract the image of only the static area.

[0045] S202 performs digital processing on the static area.

[0046] Specifically, the analog signal of the static area image is input into a video capture card to convert the analog signal into a digital signal to obtain a digital static area.

[0047] S203 stores the digitized static area.

[0048] In the present application, the digitized static area is extracted from a preferred preset frame of the video image, and the digitized static area is used as a reference for judging changes in the dynamic area. Therefore, the digitized static area needs to be stored as a reference for each of the dynamic areas.

[0049] The method for selecting the preset frame includes: collecting multiple frames of video images by a random method, calculating the range of changes of the dynamic area and the static area in the multiple frames, and then obtaining the middle value of the change range. The frame with the dynamic area and static area dividing line closest to the middle value is used as the preset frame.

[0050] The steps of obtaining the preset frame are as follows:

[0051] First, a plurality of frame images of static areas are obtained by random sampling. The expressions of the plurality of frame images of static areas are as follows: .

[0052] Secondly, the static contour line in each frame image in S is obtained by .

[0053] Again, according to the Establish the static contour line change area BH, and its calculation formula is as follows:

[0054]

[0055] Among them, the Each element in represents all the pixel points of a static contour line.

[0056] Next, edge lines on both sides of the BH are extracted, and pixels are filled inside the edge lines on both sides.

[0057] Secondly, according to the edge lines on both sides of the BH, a midline of the change area is established, and each point on the midline is located at the midpoint of the fixed curvature curve perpendicularly connecting the edge lines on both sides of the BH.

[0058] Finally, the static area of ​​the static contour line closest to the median dividing line is used as the preset frame.

[0059] When a new frame of video image is identified, only the dynamic area of ​​the video image is extracted for digitization.

[0060] Finally, the digitized static area is marked with a contour to form a static contour line.

[0061] Please refer to Figure 1 As shown, S103 extracts the dynamic area of ​​each frame of the video image, performs digital processing to generate a digitized dynamic area, and marks the dynamic contour line of the digitized dynamic area.

[0062] An image having only the dynamic area is extracted from each frame, and then the dynamic area is digitized in sequence according to the time sequence of the video image to generate a digitized dynamic area of ​​the digital image, and a dynamic contour line of the dynamic area of ​​each frame is marked.

[0063] Please refer to Figure 1 As shown, S104 calculates the vertical offset of the static contour line and the dynamic contour line, generates a dynamic area increase area and determines whether the dynamic area increase area exceeds a preset threshold, and if so, issues a safety alarm.

[0064] Before calculating the vertical offset of the static contour and the dynamic contour, it is first necessary to extract the digitized static area from the storage, and then set a pixel coordinate system for the digitized static area to establish coordinates for each pixel of the static contour.

[0065] Next, the digitized dynamic area of ​​each frame is extracted, and the same pixel coordinate system is established at the same position of the pixel coordinate system of the static area to establish coordinates for the pixels of each dynamic contour line.

[0066] Finally, the vertical offset between the dynamic contour line and the dynamic contour line is calculated according to the coordinates, and the increase of the dynamic area relative to the static area can be obtained by performing integral calculation according to the vertical offset. The increase can be an increased area.

[0067] A preset threshold is set based on the increase, and a safety alarm is issued when the increase exceeds the preset threshold. Preferably, the dynamic area can be divided into multiple sub-dynamic areas through field measurement, and the preset threshold is set for each sub-dynamic area.

[0068] Preferably, the security alarm includes: a sound signal, a light signal, a broadcast signal, and a message signal sent through the Internet.

[0069] The present application also provides a hydropower station video data digital safety warning device, including: an image processing module 301, a static image module 302, and a dynamic image module 303.

[0070] Figure 3 It is a schematic diagram of the digital safety warning device for video data of a hydropower station in this application.

[0071] Please refer to Figure 3 As shown, the image processing module 301 is used to acquire a video image and identify a static area and a dynamic area of ​​each frame of the video image.

[0072] The video image is a composite video image for monitoring the entire hydropower station, including a panoramic image synthesized from images captured by multiple cameras, or the video image can also be a high-resolution satellite image. Preferably, the video image is an infrared image.

[0073] After acquiring the video image, it is necessary to determine the static area and dynamic area in the video image. The static area refers to the background image that does not change, while the dynamic area refers to the image content that is undergoing changes. Specifically, the dynamic area is the water surface area, and the static area is the area other than the water surface area. At this time, the monitoring focus is on the monitoring of water flow, such as water rise, etc.; or, the dynamic area is the area other than the water surface area, and the static area is the water surface area. At this time, the monitoring focus is on the changes in the water bank, such as landslides, etc.

[0074] When identifying the static area and the dynamic area, different identification methods need to be set according to the specific video type. One method is that the video image is an ordinary visible light image, which can present the complete image content, and the dynamic area and the static area are identified through the existing image recognition algorithm. The other method is that the video image is an infrared image, and the dynamic area and the static area are identified according to the color change of the infrared image.

[0075] Please refer to Figure 3As shown, the static image module 302 is used to extract the static area of ​​the preset frame of the video image, perform digital processing to generate a digitized static area, and mark the static contour line of the digitized static area.

[0076] After the dynamic area and the static area are identified, the image of the static area is extracted, and the static image is digitized to generate a digital static area of ​​a digital image.

[0077] Please refer to Figure 2 As shown, S201 extracts the static area.

[0078] After the static area and the dynamic area of ​​the video image are identified, a dividing line is set according to the connection between the dynamic area and the static area, thereby dividing the static area and the dynamic area. A preferred implementation is to generate an image of only the static area and an image of the dynamic area respectively according to a template of a preset size, and then extract the image of only the static area.

[0079] S202 performs digital processing on the static area.

[0080] Specifically, the analog signal of the static area image is input into a video capture card to convert the analog signal into a digital signal to obtain a digital static area.

[0081] S203 stores the digitized static area.

[0082] In the present application, the device further includes a storage module for digitizing and storing the static area of ​​the preset frame. The digitized static area is extracted from a preferred preset frame of the video image, and the digitized static area is used as a reference for judging the change of the dynamic area, so the digitized static area needs to be stored as a reference for each of the dynamic areas.

[0083] The method for selecting the preset frame includes: collecting multiple frames of video images by a random method, calculating the range of changes of the dynamic area and the static area in the multiple frames, and then obtaining the middle value of the change range. The frame with the dynamic area and static area dividing line closest to the middle value is used as the preset frame.

[0084] The steps of obtaining the preset frame are as follows:

[0085] First, a plurality of frame images of static areas are obtained by random sampling. The expressions of the plurality of frame images of static areas are as follows: .

[0086] Secondly, the static contour line in each frame image in S is obtained by .

[0087] Again, according to the Establish the static contour line change area BH, and its calculation formula is as follows:

[0088]

[0089] Among them, the Each element in represents all the pixel points of a static contour line.

[0090] Next, edge lines on both sides of the BH are extracted, and pixels are filled inside the edge lines on both sides.

[0091] Secondly, according to the edge lines on both sides of the BH, a midline of the change area is established, and each point on the midline is located at the midpoint of the fixed curvature curve perpendicularly connecting the edge lines on both sides of the BH.

[0092] Finally, the static area of ​​the static contour line closest to the median dividing line is used as the preset frame.

[0093] When a new frame of video image is identified, only the dynamic area of ​​the video image is extracted for digitization. Finally, the outline of the digitized static area is marked to form a static contour line.

[0094] Please refer to Figure 3 As shown, the dynamic image module 303 is used to extract the dynamic area of ​​each frame of the video image, perform digital processing to generate a digitized dynamic area, and mark the dynamic contour line of the digitized dynamic area.

[0095] An image having only the dynamic area is extracted from each frame, and then the dynamic area is digitized in sequence according to the time sequence of the video image to generate a digitized dynamic area of ​​the digital image, and a dynamic contour line of the dynamic area of ​​each frame is marked.

[0096] Please refer to Figure 3 As shown, the safety warning module 304 is used to calculate the vertical offset between the static contour line and the dynamic contour line, generate a dynamic area increase area and determine whether the dynamic area increase area exceeds a preset threshold, and if so, issue a safety alarm.

[0097] Before calculating the vertical offset of the static contour and the dynamic contour, it is first necessary to extract the digitized static area from the storage, and then set a pixel coordinate system for the digitized static area to establish coordinates for each pixel of the static contour.

[0098] Next, the digitized dynamic area of ​​each frame is extracted, and the same pixel coordinate system is established at the same position of the pixel coordinate system of the static area to establish coordinates for the pixels of each dynamic contour line.

[0099] Finally, the vertical offset between the dynamic contour line and the dynamic contour line is calculated according to the coordinates, and the increase of the dynamic area relative to the static area can be obtained by performing integral calculation according to the vertical offset. The increase can be an increased area.

[0100] A preset threshold is set based on the increase, and when the increase exceeds the preset threshold, a security alarm is issued. Preferably, the dynamic image is not viewed further including: a partitioning unit, which is used to partition the dynamic area to generate multiple sub-dynamic areas, and set the preset threshold for each sub-dynamic area. Specifically, firstly, through field measurement, the dynamic area can be partitioned to generate multiple sub-dynamic areas, and the preset threshold is set for each sub-dynamic area.

[0101] Preferably, the security alarm includes: a sound signal, a light signal, a broadcast signal, and a message signal sent through the Internet.

Claims

1. A digital safety early warning method for hydropower station video data, It is characterized in that include: Acquire a video image, and identify a static area and a dynamic area of ​​each frame of the video image; Extracting the static area of ​​the preset frame of the video image, performing digital processing to generate a digitized static area, and marking a static contour line of the digitized static area; Extracting the dynamic area of ​​each frame of the video image, performing digital processing to generate a digitized dynamic area, and marking the dynamic contour line of the digitized dynamic area; Calculating the vertical offset between the static contour line and the dynamic contour line, generating a dynamic area increase area and determining whether the dynamic area increase area exceeds a preset threshold, and if so, issuing a safety alarm; The steps of obtaining the preset frame are as follows: First, a plurality of static region frame images are obtained by random sampling. The expression of the plurality of static region frame images is: S = (n 1 、n 2 、n 3 ……n n ); Secondly, the static contour line in each frame image in S is obtained to obtain the pixel line S of the static contour line L =(S 1 , S 2 , S 3 ……S n ); Again, according to the S L Establish the static contour line change area BH, and its calculation formula is as follows: BH=S 1 +S 2 +S 3 +…+S n Among them, the S L Each element in represents all the pixel points of a static contour line; Next, edge lines on both sides of the BH are extracted, and pixels are filled inside the edge lines on both sides; Secondly, according to the edge lines of the two sides of the BH, a midline of the change area is established, and each point on the midline is located at the midpoint of the fixed curvature curve perpendicularly connected to the edge lines of the two sides of the BH; Finally, the static area of ​​the static contour line closest to the median dividing line is used as a preset frame; When a new frame of video image is identified, only the dynamic area of ​​the video image is extracted for digitization; Finally, the digitized static area is marked with a contour to form a static contour line.

2. According to the hydropower station video data digital safety early warning method described in claim 1, It is characterized in that The dynamic area is a water surface area, and the static area is an area other than the water surface area; or, the dynamic area is an area other than the water surface area, and the static area is a water surface area.

3. According to the hydropower station video data digital safety early warning method of claim 1, It is characterized in that The static area of ​​the preset frame is digitized and stored, and only the static area of ​​one preset frame is digitized; When a new frame of video image is identified, only the dynamic area of ​​the video image is extracted for digitization.

4. According to the hydropower station video data digital safety early warning method of claim 1, It is characterized in that Also includes: The dynamic area is divided into multiple sub-dynamic areas, and the preset threshold is set for each of the sub-dynamic areas.

5. According to the hydropower station video data digital safety early warning method of claim 1, It is characterized in that The security alarm includes: a sound signal, a light signal, a broadcast signal, and a message signal sent through the Internet.

6. A digital safety warning device for video data of a hydropower station, It is characterized in that include: An image processing module, used for acquiring a video image and identifying a static area and a dynamic area of ​​each frame of the video image; A static image module, used for extracting a static area of ​​a preset frame of the video image, performing digital processing to generate a digitized static area, and marking a static contour line of the digitized static area; A dynamic image module, used for extracting the dynamic area of ​​each frame of the video image, performing digital processing to generate a digitized dynamic area, and marking a dynamic contour line of the digitized dynamic area; The safety warning module is used to calculate the vertical offset of the static contour line and the dynamic contour line, generate a dynamic area increase area and determine whether the dynamic area increase area exceeds a preset threshold, and if so, issue a safety alarm; the steps for obtaining the preset frame are as follows: First, a plurality of static region frame images are obtained by random sampling. The expression of the plurality of static region frame images is: S = (n 1 、n 2 、n 3 ……n n ); Secondly, the static contour line in each frame image in S is obtained to obtain the pixel line S of the static contour line L =(S 1 , S 2 , S 3 ……S n ); Again, according to the S L Establish the static contour line change area BH, and its calculation formula is as follows: BH=S 1 +S 2 +S 3 +…+S n Among them, the S L Each element in represents all the pixel points of a static contour line; Next, edge lines on both sides of the BH are extracted, and pixels are filled inside the edge lines on both sides; Secondly, according to the edge lines of the two sides of the BH, a midline of the change area is established, and each point on the midline is located at the midpoint of the fixed curvature curve perpendicularly connected to the edge lines of the two sides of the BH; Finally, the static area of ​​the static contour line closest to the median dividing line is used as a preset frame; When a new frame of video image is identified, only the dynamic area of ​​the video image is extracted for digitization; Finally, the digitized static area is marked with a contour to form a static contour line.

7. According to claim 6, the hydropower station video data digital safety warning device, It is characterized in that The dynamic area is a water surface area, and the static area is an area other than the water surface area; or, the dynamic area is an area other than the water surface area, and the static area is a water surface area.

8. According to claim 6, the hydropower station video data digital safety warning device, It is characterized in that Also includes: A storage module, used for storing the static area of ​​the preset frame after digitization, and only digitizing the static area of ​​one preset frame; When a new frame of video image is identified, only the dynamic area of ​​the video image is extracted for digitization.

9. According to claim 6, the hydropower station video data digital safety warning device, It is characterized in that The dynamic image module also includes: The partitioning unit is used to partition the dynamic area into multiple sub-dynamic areas and set the preset threshold for each sub-dynamic area.

10. The hydropower station video data digital safety warning device according to claim 6, It is characterized in that The security alarm includes: a sound signal, a light signal, a broadcast signal, and a message signal sent through the Internet.

Images