A method for generating a three-dimensional model for dam simulation of a hydraulic engineering project

Abstract

The present invention relates to a method for generating a simulated three-dimensional model of a water conservancy project dam, which comprises configuring a water conservancy project dam database, photographing the water conservancy project dam at several angles and several heights, processing the photographed video frames or images, establishing an interface, extracting the content of the water conservancy project dam database based on the processing result, modeling, optimizing the modeled three-dimensional model, and rendering to generate a simulated three-dimensional model. The present invention can greatly reduce the frequency of field visits for the three-dimensional modeling of the water conservancy dam, and adopts the currently mature high-altitude camera technology to collect the field image or video of the dam. The material and outline of the water conservancy dam can be basically determined by processing the image, and based on the material and outline, effective data can be intercepted from the big data, and the water conservancy dam can be assembled using model components, and finally the establishment of the three-dimensional model is realized, with low repair rate, low labor cost, high model generation efficiency, and is conducive to the rapid promotion of the comprehensive management of water conservancy projects.

Description

Technical Field

[0001] The invention relates to the technical field of electric digital data processing, and in particular to a method for generating a three-dimensional model of a hydraulic engineering dam simulation. Background Art

[0002] As an important part of the stability and harmony of the national economy, water conservancy not only has comprehensive application functions such as flood prevention and disaster reduction, agricultural irrigation, urban water supply and diversion, fishery foreign trade, tourism and shipping, ecological environment, but is also one of the most important sustainable energy sources.

[0003] A three-dimensional model is a polygonal representation of an object, usually displayed by a computer or other video device. It can show real-world entities or fictional objects.

[0004] Combining 3D modeling with water conservancy projects, such as dams, can intuitively display the settings and operation conditions of key management objects such as dam bodies, powerhouses, ship locks, ship lifts, generator sets, and spillway structures from multiple angles through 3D modeling, thereby achieving comprehensive operation status management of water conservancy and tracking of dam work conditions.

[0005] In the existing technology, there is also three-dimensional modeling for water conservancy dams, but most of them require a lot of measurement and comparison work to realize the implementation of the three-dimensional model. In addition, due to errors in the measurement work, a certain degree of adjustment is required in the construction of the three-dimensional model. In fact, the efficiency of model generation is not high, and it is not conducive to the rapid promotion of comprehensive management of water conservancy projects. Summary of the invention

[0006] The invention solves the problems existing in the prior art and provides an optimized method for generating a three-dimensional model of a hydraulic engineering dam simulation.

[0007] The technical solution adopted by the present invention is a method for generating a three-dimensional model of a hydraulic engineering dam simulation, the method comprising the following steps:

[0008] Step 1: Configure the water conservancy project dam database;

[0009] Step 2: Shoot the water conservancy project dam at several angles and heights, and process the shot video frames or images;

[0010] Step 3: Establish an interface; based on the processing results, extract the content in the water conservancy project dam database;

[0011] Step 4: Modeling based on the extracted content and image processing results;

[0012] Step 5: Optimize the three-dimensional model after modeling;

[0013] Step 6: Rendering to generate a simulated 3D model.

[0014] Preferably, in step 1, the water conservancy project dam database includes several features corresponding to the dam type and module components corresponding to the dam type; the dam types include gravity dam, arch dam, earth-rock dam, pier dam and rockfill dam.

[0015] Preferably, the features include material features and contour features corresponding to the dam type, the contour features include main dam feature points, auxiliary dam feature points, wave-breaking wall feature points, sluice feature points and spillway feature points, and the module components are the main dam, auxiliary dam, wave-breaking wall, sluice and spillway of the corresponding dam type.

[0016] Preferably, step 2 comprises the following steps:

[0017] Step 2.1: Take photos of the water conservancy project dam from several angles and heights;

[0018] Step 2.2: Acquire a plurality of video frames or images corresponding to the front, back, and side of the dam respectively and a plurality of video frames or images corresponding to the front, back, and side of the dam simultaneously;

[0019] Step 2.3: Based on the video frame or image, obtain the minimum circumscribed cuboid of the dam;

[0020] Step 2.4: Based on the video frames or images in step 2.2, remove visible deviations and record them to obtain the contour features of the dam;

[0021] Step 2.5: Based on any video frame or image obtained in step 2.2, obtain the material characteristics of the dam;

[0022] Step 2.6: The contour features of the dam and the material features of the dam are used as the processing results of the video frame or image.

[0023] Preferably, in step 2.4, the visible deviations include plants and ships that overlap with the outline of the dam.

[0024] Preferably, in step 2.4, if any position in the contour is not closed, the following steps are performed:

[0025] Step 2.4.1: Get the unclosed position and the corresponding contour segments on both sides;

[0026] Step 2.4.2: Collect any three points, A, B, and C, in the two contour segments respectively;

[0027] Step 2.4.3: If the points of the two groups A, B, and C are all on a straight line, then fill in the unclosed position with a straight line and proceed to step 2.4.5, otherwise proceed to the next step;

[0028] Step 2.4.4: For contour segments where points A, B, and C are not on the same straight line, connect the unclosed positions, re-obtain several groups of three points A', B', and C', use the midpoint of A' and B' as the starting point, the midpoint of B' and C' as the end point, and B' as the control point of the quadratic Bezier curve, and sequentially connect the starting point, control point, and end point into a quadratic Bezier curve until the contour segment is smooth;

[0029] Step 2.4.5: Obtain the video frames or images of the dam at all angles in step 2.2 for comparison. If yes, proceed to step 2.5; otherwise, return to step 2.4.1.

[0030] Preferably, in step 2.4, if there is any closed contour whose area is smaller than a preset value and is an isolated point in at least one video frame or image in step 2.2, it is removed and recorded.

[0031] Preferably, the step 2.5 comprises the following steps:

[0032] Step 2.5.1: Obtain CMYK vector values ​​for any video frame or image obtained in step 2.2;

[0033] Step 2.5.2: Cut out a region of interest from any video frame or image obtained in step 2.2, zoom in, and obtain an image of preset pixels;

[0034] Step 2.5.3: Process the image in step 2.5.2 and the images corresponding to several material features with a classifier to obtain the confidence results between the image in step 2.5.3 and different material features, recorded as Q1;

[0035] Step 2.5.4: The CMYK vector value of step 2.5.1 and the CMYK values ​​of the image corresponding to several material features are processed by a classifier to obtain the confidence results between the CMYK vector value of step 2.5.1 and different material features, which are recorded as Q2;

[0036] Step 2.5.5: Use the intersection ratio as a measurement indicator and take the material with the highest overlap between Q1 and Q2 as the material feature of the dam.

[0037] Preferably, in step 3, an interface is established, and based on the material characteristics and contour characteristics of the dam obtained after processing, the dam type corresponding to the current material in the water conservancy project dam database is compared to narrow the search range, and the dam type corresponding to the contour characteristics of the dam is extracted within the narrowed search range;

[0038] In step 4, modeling is performed based on the extracted content and image processing results, with the minimum circumscribed cuboid as the limiting range, and modular modeling is performed within the range using module components corresponding to the dam type, wherein the modular modeling includes scaling, moving and splicing the module components.

[0039] Preferably, in step 5 or 6, environmental elements are reconstructed based on the captured video frames or images, and the environmental elements include ships and plants.

[0040] The invention relates to a method for generating an optimized three-dimensional model of a simulated water conservancy project dam. After configuring a water conservancy project dam database, the water conservancy project dam is photographed at several angles and several heights, and the photographed video frames or images are processed; an interface is established; based on the processing result, the content in the water conservancy project dam database is extracted; modeling is performed based on the extracted content and the image processing result, and the modeled three-dimensional model is optimized; and rendering is performed to generate a simulated three-dimensional model.

[0041] The three-dimensional modeling of the water conservancy dam by the present invention can greatly reduce the frequency of field visits, and adopts the currently mature high-altitude camera technology to collect the field images or videos of the dam. The material and outline of the water conservancy dam can be basically determined by processing the image, and based on the material and outline, the effective data can be intercepted from the big data, and the water conservancy dam can be assembled using the model components, and finally the three-dimensional model can be established, with low repair rate, low labor cost and high model generation efficiency, which is conducive to the rapid promotion of comprehensive management operations of water conservancy projects. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 The figure is a flow chart of the method of the present invention. DETAILED DESCRIPTION

[0043] The present invention is further described in detail below in conjunction with embodiments, but the protection scope of the present invention is not limited thereto.

[0044] The present invention relates to a method for generating a three-dimensional model of a hydraulic engineering dam simulation, the method comprising the following steps:

[0045] Step 1: Configure the water conservancy project dam database;

[0046] In step 1, the water conservancy project dam database includes several features corresponding to the dam type and module components corresponding to the dam type; the dam types include gravity dam, arch dam, earth-rock dam, pier dam and rockfill dam.

[0047] The features include material features and contour features corresponding to the dam type, the contour features include main dam feature points, auxiliary dam feature points, wave-breaking wall feature points, sluice feature points and spillway feature points, and the module components are the main dam, auxiliary dam, wave-breaking wall, sluice and spillway of the corresponding dam type.

[0048] In the present invention, existing big data is used to perform feature segmentation on existing dam types, and the dam is split into a whole of modular components based on the type.

[0049] In the present invention, dams can be divided into gravity dams, arch dams, earth-rock dams, pier dams and rockfill dams based on basic types. The characteristics of these types of dams are very obvious;

[0050] A gravity dam is built with materials such as concrete or stone, and its basic cross-section is triangular. In plane, the axis of the dam is usually a straight line;

[0051] Arch dams are generally built with concrete materials. They are in the shape of an arch convex to the upstream in plane, and their crown sections are vertical or curved convex to the upstream.

[0052] Earth-rock dam, rockfill dam. Earth-rock dam is a water retaining dam built by dumping, rolling and other methods with earth, stone or mixed materials. When the dam body is mainly made of earth and gravel, it is called an earth dam; when it is mainly made of slag, pebbles and blasted stones, it is called a rockfill dam; when both types of local materials account for a considerable proportion, it is called an earth-rock mixed dam;

[0053] A buttress dam is generally constructed of concrete, with a retaining panel sloping upstream and a series of triangular buttresses;

[0054] The above are the more common types of water conservancy dams. It can be seen that they all have certain material properties or structural characteristics. In fact, water conservancy dams generally have their corresponding material characteristics or structural characteristics. Based on this, a water conservancy project dam database is constructed, and feature information is collected based on big data. Through long-term application, the matching accuracy of the database will be further increased.

[0055] In the present invention, the structural features can be described by contour features, and the contour features include but are not limited to the main dam feature points, the auxiliary dam feature points, the wave-breaking wall feature points, the water gate feature points and the spillway feature points, and the corresponding module components are the main dam, the auxiliary dam, the wave-breaking wall, the water gate and the spillway; for example, the main dam feature points include the slope of its water retaining surface, the shape points of the piers or the flood discharge outlet, etc.

[0056] Step 2: Shoot the water conservancy project dam at several angles and heights, and process the shot video frames or images;

[0057] The step 2 comprises the following steps:

[0058] Step 2.1: Take photos of the water conservancy project dam from several angles and heights;

[0059] Step 2.2: Acquire a plurality of video frames or images corresponding to the front, back, and side of the dam respectively and a plurality of video frames or images corresponding to the front, back, and side of the dam simultaneously;

[0060] Step 2.3: Based on the video frame or image, obtain the minimum circumscribed cuboid of the dam;

[0061] Step 2.4: Based on the video frames or images in step 2.2, remove visible deviations and record them to obtain the contour features of the dam;

[0062] In step 2.4, the visible deviations include plants and ships that overlap with the outline of the dam.

[0063] In step 2.4, if any position in the contour is not closed, the following steps are performed:

[0064] Step 2.4.1: Get the unclosed position and the corresponding contour segments on both sides;

[0065] Step 2.4.2: Collect any three points, A, B, and C, in the two contour segments respectively;

[0066] Step 2.4.3: If the points of the two groups A, B, and C are all on a straight line, then fill in the unclosed position with a straight line and proceed to step 2.4.5, otherwise proceed to the next step;

[0067] Step 2.4.4: For contour segments where points A, B, and C are not on the same straight line, connect the unclosed positions, re-obtain several groups of three points A', B', and C', use the midpoint of A' and B' as the starting point, the midpoint of B' and C' as the end point, and B' as the control point of the quadratic Bezier curve, and sequentially connect the starting point, control point, and end point into a quadratic Bezier curve until the contour segment is smooth;

[0068] Step 2.4.5: Obtain the video frames or images of the dam at all angles in step 2.2 for comparison. If yes, proceed to step 2.5; otherwise, return to step 2.4.1.

[0069] In step 2.4, if there is any closed contour whose area is smaller than a preset value and is an isolated point in at least one video frame or image in step 2.2, it is removed and recorded.

[0070] Step 2.5: Based on any video frame or image obtained in step 2.2, obtain the material characteristics of the dam;

[0071] The step 2.5 comprises the following steps:

[0072] Step 2.5.1: Obtain CMYK vector values ​​for any video frame or image obtained in step 2.2;

[0073] Step 2.5.2: Cut out a region of interest from any video frame or image obtained in step 2.2, zoom in, and obtain an image of preset pixels;

[0074] Step 2.5.3: Process the image in step 2.5.2 and the images corresponding to several material features with a classifier to obtain the confidence results between the image in step 2.5.3 and different material features, recorded as Q1;

[0075] Step 2.5.4: The CMYK vector value of step 2.5.1 and the CMYK values ​​of the image corresponding to several material features are processed by a classifier to obtain the confidence results between the CMYK vector value of step 2.5.1 and different material features, which are recorded as Q2;

[0076] Step 2.5.5: Use the intersection ratio as a measurement indicator and take the material with the highest overlap between Q1 and Q2 as the material feature of the dam.

[0077] Step 2.6: The contour features of the dam and the material features of the dam are used as the processing results of the video frame or image.

[0078] In the present invention, video frames or images of the water conservancy project dam are collected at several angles and several heights. Here, a drone can be used to configure a camera device with higher shooting accuracy, and a stabilizer needs to be installed if necessary. After the shooting is completed, the corresponding video frames or images are obtained based on the principles of six-sided views and stereograms. Here, several video frames or images are retained to facilitate the detailed reconstruction of the water conservancy dam.

[0079] In the present invention, based on the video frame or image, the minimum circumscribed cuboid of the dam is obtained, which in fact limits the range of the length, width and height of the dam to avoid direct errors in the actual modeling process; and because the video frames and images will have a certain degree of picture distortion, it is necessary to use images of the front, back and sides of the dam respectively and simultaneously for synchronous determination.

[0080] In the present invention, visible deviations include but are not limited to plants and ships that overlap with the outline of the dam. These visible deviations are removed but not deleted, but recorded to facilitate reconstruction on the later model.

[0081] In the present invention, after removing the visible deviation object, there will obviously be non-closed openings in the contour. The contour supplement between these openings should follow certain criteria and be judged after collecting any three points A, B, and C in the two contour segments respectively;

[0082] Case 1: The points of the two groups A, B, and C are all on a straight line. In general, the unclosed positions can be directly completed with straight lines. The only exception is the existence of high-low structures. Here, they can be supplemented in the comparison and review stage, including but not limited to reconfirming the contour based on pictures from other angles and field surveys.

[0083] Case 2: There is at least one group of points A, B, and C that are not on a straight line. This indicates that there is a curve segment at the unclosed position. First, connect the unclosed position. The connection must be wrong. Re-obtain several groups of three points A', B', and C'. Take the midpoint of A' and B' of each group as the starting point, the midpoint of B' and C' as the end point, and B' as the control point of the quadratic Bezier curve. Connect the starting point, control point, and end point in sequence to form a quadratic Bezier curve. Repeat several times until the contour segment is smooth.

[0084] In the present invention, it is obvious that the distances between any three points A, B, and C are different, and the fitting results are also different. In the actual application process, the selection of any three points A, B, and C can also be adjusted to perform a review.

[0085] In the present invention, the video frames or images of the dam at all angles in step 2.2 are compared until it is established.

[0086] In the present invention, if after the contour is formed, there are still closed contours with smaller areas and existing independently, forming isolated points, such as ships, people, etc., they should be removed, but not deleted, but recorded to facilitate three-dimensional restoration later.

[0087] In the present invention, the material of the dam can be analyzed from the video frame or the image, and the material can be mainly determined from the color and granularity.

[0088] In the present invention, the color of the material can obtain the CMYK vector value for any video frame or image. The reason is that the color composition of the water conservancy dam is often relatively simple. Extracting the CMYK vector value can obtain more color information, and then the CMYK value of the image corresponding to several material features can be processed by a classifier, generally an SMV classifier, to obtain an array of similarities corresponding to different material features, and the array of confidence results is Q2.

[0089] In the present invention, the granularity can be determined by intercepting an area of ​​interest from any video frame or image and then enlarging it to obtain an image of preset pixels; wherein the area of ​​interest is the area focused by the camera and has high clarity; this image and images corresponding to several material features are processed by a classifier, generally an SMV classifier, to obtain an array of similarities corresponding to different granularity features, and the array of confidence results is Q1.

[0090] In the present invention, since Q1 and Q2 correspond to the confidence of each dam type respectively, the intersection and union ratio can be used as a measurement indicator, and the material with the highest overlap in Q1 and Q2 is taken as the material feature of the dam. Often, the material with the highest overlap is the one with the largest value in both Q1 and Q2.

[0091] Step 3: Establish an interface; based on the processing results, extract the content in the water conservancy project dam database;

[0092] In step 3, an interface is established, and based on the material characteristics and contour characteristics of the dam obtained after processing, the dam type corresponding to the current material in the water conservancy project dam database is compared to narrow the search range, and the dam type corresponding to the contour characteristics of the dam is extracted within the narrowed search range.

[0093] In the present invention, the dam type is firstly screened based on the material, such as concrete material, which is generally a gravity dam, arch dam or pier dam. The contour features of the dam are compared based on these three types of dams. Since the contour features of these three types are very obvious, the dam type can be quickly located and information extracted.

[0094] Step 4: Modeling based on the extracted content and image processing results;

[0095] In step 4, modeling is performed based on the extracted content and image processing results, with the minimum circumscribed cuboid as the limiting range, and modular modeling is performed within the range using module components corresponding to the dam type, wherein the modular modeling includes scaling, moving and splicing the module components.

[0096] In the present invention, three-dimensional modeling is performed with the minimum circumscribed cuboid in the previous step as the limited range, and this is used as the spatial range of modeling. Within this spatial range, the membrane hole components corresponding to the confirmed dam type are assembled, assisted by appropriate scaling and movement, and finally the preliminary draft of the dam three-dimensional modeling is established.

[0097] Step 5: Optimize the three-dimensional model after modeling;

[0098] Step 6: Rendering to generate a simulated 3D model.

[0099] In step 5 or 6, environmental elements are reconstructed based on the captured video frames or images, and the environmental elements include ships and plants.

[0100] In the present invention, optimization includes but is not limited to trimming and stretching of the three-dimensional model.

[0101] In the present invention, the environmental elements of the three-dimensional model should be reconstructed when necessary.

Claims

1. A method for generating a three-dimensional model of a hydraulic engineering dam simulation, characterized in that: The method comprises the following steps: Step 1: Configure the water conservancy project dam database; Step 2: Shooting the water conservancy project dam at several angles and several heights, and processing the shot video frames or images, including the following steps: Step 2.1: Take photos of the water conservancy project dam from several angles and heights; Step 2.2: Acquire a plurality of video frames or images corresponding to the front, back, and side of the dam respectively and a plurality of video frames or images corresponding to the front, back, and side of the dam simultaneously; Step 2.3: Based on the video frame or image, obtain the minimum circumscribed cuboid of the dam; Step 2.4: Based on the video frames or images in step 2.2, remove visible deviations and record them to obtain the contour features of the dam; If any position in the contour is not closed, perform the following steps: Step 2.4.1: Get the unclosed position and the corresponding contour segments on both sides; Step 2.4.2: Collect any three points, A, B, and C, in the two contour segments respectively; Step 2.4.3: If the points of the two groups A, B, and C are all on a straight line, then fill in the unclosed position with a straight line and proceed to step 2.4.5, otherwise proceed to the next step; Step 2.4.4: For contour segments where points A, B, and C are not on the same straight line, connect the unclosed positions, re-obtain several groups of three points A', B', and C', use the midpoint of A' and B' as the starting point, the midpoint of B' and C' as the end point, and B' as the control point of the quadratic Bezier curve, and sequentially connect the starting point, control point, and end point into a quadratic Bezier curve until the contour segment is smooth; Step 2.4.5: Obtain the video frames or images of the dam at all angles in step 2.2 for comparison. If yes, proceed to step 2.5; otherwise, return to step 2.4.1; If there is any closed contour whose area is smaller than a preset value and is an isolated point in at least one video frame or image in step 2.2, remove it and record it; Step 2.5: Based on any video frame or image obtained in step 2.2, obtain the material characteristics of the dam; Step 2.6: Using the contour features of the dam and the material features of the dam as the processing result of the video frame or image; Step 3: Establish an interface; based on the processing results, extract the content in the water conservancy project dam database; Step 4: Modeling based on the extracted content and image processing results; Step 5: Optimize the three-dimensional model after modeling; Step 6: Rendering to generate a simulated 3D model.

2. The method for generating a three-dimensional model of a hydraulic engineering dam simulation according to claim 1, characterized in that: In the step 1, the water conservancy project dam database includes several features corresponding to the dam type and module components corresponding to the dam type; the features include material features and contour features corresponding to the dam type, the contour features include main dam feature points, auxiliary dam feature points, wave-breaking wall feature points, water gate feature points and spillway feature points, and the dam types include gravity dam, arch dam, earth-rock dam, pier dam and rockfill dam.

3. The method for generating a three-dimensional model of a hydraulic engineering dam simulation according to claim 2, characterized in that: The module components are the main dam, auxiliary dam, wave-breaking wall, sluice gate and spillway gate corresponding to the dam type.

4. The method for generating a three-dimensional model of a hydraulic engineering dam simulation according to claim 1, characterized in that: In step 2.4, the visible deviations include plants and ships that overlap with the outline of the dam.

5. The method for generating a three-dimensional model of a hydraulic engineering dam simulation according to claim 1, characterized in that: The step 2.5 comprises the following steps: Step 2.5.1: Obtain CMYK vector values ​​for any video frame or image obtained in step 2.2; Step 2.5.2: Cut out a region of interest from any video frame or image obtained in step 2.2, zoom in, and obtain an image of preset pixels; Step 2.5.3: Process the image in step 2.5.2 and the images corresponding to several material features with a classifier to obtain the confidence results between the image in step 2.5.3 and different material features, recorded as Q1; Step 2.5.4: The CMYK vector value of step 2.5.1 and the CMYK values ​​of the image corresponding to several material features are processed by a classifier to obtain the confidence results between the CMYK vector value of step 2.5.1 and different material features, which are recorded as Q2; Step 2.5.5: Use the intersection ratio as a measurement indicator and take the material with the highest overlap between Q1 and Q2 as the material feature of the dam.

6. The method for generating a three-dimensional model of a hydraulic engineering dam simulation according to claim 1, characterized in that: In the step 3, an interface is established, and based on the material characteristics and contour characteristics of the dam obtained after processing, the dam type corresponding to the current material in the water conservancy project dam database is compared to narrow the search range, and the dam type corresponding to the contour characteristics of the dam is extracted within the narrowed search range; In step 4, modeling is performed based on the extracted content and image processing results, with the minimum circumscribed cuboid as the limiting range, and modular modeling is performed within the range using module components corresponding to the dam type, wherein the modular modeling includes scaling, moving and splicing the module components.

7. The method for generating a three-dimensional model of a hydraulic engineering dam simulation according to claim 1, characterized in that: In step 5 or 6, environmental elements are reconstructed based on the captured video frames or images, and the environmental elements include ships and plants.

Images