Water conservancy project construction information collection and processing system based on big data
By dynamically adjusting the threshold value and based on the slope and inflection point characteristics of the construction data points, real-time compression of water conservancy project construction data is achieved, solving the problem of poor compression effect caused by fixed threshold values and improving compression rate and quality.
Patent Information
- Application Number
- CN202510423523.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-07
- Publication Date
- 2025-10-28
- Estimated Expiration
- 2045-04-07
AI Technical Summary
In existing technologies, the use of fixed threshold values in the compression process of water conservancy engineering construction data leads to poor compression results, making it difficult to balance data quality under complex working conditions and stable environments, and making it difficult to achieve efficient and high-quality real-time compression.
By dynamically adjusting the threshold value, the threshold range is adjusted in real time according to the slope changes and inflection point characteristics of the construction data points, forming a data point sequence and inflection points. The threshold value is dynamically adjusted to adapt to changes in construction data, thus achieving real-time compression.
It improves the compression rate and quality of water conservancy project construction data, ensuring that important information can be effectively captured under complex and stable operating conditions, and reducing data loss.
Smart Images

Figure CN120301431B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of construction information processing technology, specifically to a water conservancy project construction information collection and processing system based on big data. Background Technology
[0002] Water conservancy projects are an important component of infrastructure construction, playing a vital role in flood control, irrigation, water supply, and ecological protection. Because water conservancy projects are typically located near rivers, lakes, or other bodies of water, and encompass diverse terrains such as steep slopes, wetlands, and deep gullies, various sensors are used to monitor water levels, flow rates, and pressures at the construction site during construction to ensure efficient resource allocation and construction safety. As construction progresses, the amount of monitored data increases. Currently, to improve management efficiency and save storage space, sensor monitoring data is compressed before transmission and storage for subsequent analysis and retrieval.
[0003] Currently, the SDT rotating door algorithm is used to compress sensor-collected data in real time. However, compression is generally performed with a fixed threshold value. The construction data monitored in water conservancy projects is affected by working conditions and the environment. This construction data includes, but is not limited to, upstream and downstream water level differences, dam foundation seepage pressure, seepage flow, groundwater level, precipitation, temperature, humidity, wind speed, and river flow. Therefore, compression with a fixed threshold value results in poor compression performance. While a lower threshold value can capture more important information under complex working conditions and environments such as pouring, blasting, heavy rain, and strong winds, it also captures small fluctuations in stable working conditions and favorable environments, leading to a decrease in compression rate. Conversely, a higher threshold value, while improving the compression rate under stable working conditions and favorable environments, increases the probability of losing important information under complex working conditions and environments, resulting in poor compression quality. Therefore, dynamically adjusting the threshold value during real-time compression to improve compression performance is a problem that urgently needs to be solved. Summary of the Invention
[0004] To address the aforementioned problems, this invention provides a big data-based system for collecting and processing construction information in water conservancy projects. The specific technical solution adopted is as follows:
[0005] One embodiment of the present invention provides a water conservancy project construction information acquisition and processing system based on big data, including a processor and a memory, wherein the processor executes a computer program stored in the memory to perform the following steps:
[0006] During the construction of water conservancy projects, the construction data points and preset initial threshold values corresponding to the current moment are obtained, and the first threshold range is obtained based on the preset initial threshold values.
[0007] If it is determined that the construction data points corresponding to the 1st future time to the bth future time are within the first threshold, and the upward slope of the construction data points corresponding to the 1st future time to the bth future time is less than the downward slope of the corresponding construction data point, and the construction data point corresponding to the b+1th future time is not within the first threshold, or the upward slope of the construction data point corresponding to the b+1th future time is not less than the downward slope of the construction data point corresponding to the b+1th future time, then the construction data points corresponding to the current time and the bth future time are archived, and the data point sequence formed by the construction data points corresponding to the current time to the bth future time is recorded as the first sequence, and the construction data point corresponding to the b+1th future time is recorded as the first inflection point; based on the first sequence and the first inflection point, the preset initial threshold value is adjusted to obtain the... 1. Adjust the threshold value and obtain the second threshold range based on the first adjusted threshold value. If the construction data points corresponding to the (b+1)th future time to the (c)th future time are within the second threshold range, and the slope of the construction data points corresponding to the (b+1)th future time to the (c)th future time is less than the lower threshold slope of the corresponding construction data point, the construction data point corresponding to the (c+1)th future time is not within the second threshold range, or the upper threshold slope of the construction data point corresponding to the (c+1)th future time is not less than the lower threshold slope of the construction data point corresponding to the (c+1)th future time, then archive the construction data point corresponding to the (c)th future time. Continue to traverse the future times until the end of the water conservancy project construction. All the construction data points archived during the traversal process are used as compressed data. The first future time is the next time after the current time.
[0008] Beneficial Effects: This invention first acquires the construction data points corresponding to the current moment and a preset initial threshold value during the construction of a water conservancy project, and obtains a first threshold range based on the preset initial threshold value. Then, if it is determined that the construction data points corresponding to the 1st future moment to the bth future moment are within the first threshold range, and the upward slope of the construction data points corresponding to the 1st future moment to the bth future moment is less than the downward slope of the corresponding construction data point, and the construction data point corresponding to the b+1th future moment is not within the first threshold range, or the upward slope of the construction data point corresponding to the b+1th future moment is not less than the downward slope of the construction data point corresponding to the b+1th future moment, then the construction data points corresponding to the current moment and the bth future moment are archived, and the data point sequence formed by the construction data points corresponding to the current moment to the bth future moment is recorded as the first sequence, and the construction data point corresponding to the b+1th future moment is recorded as the first threshold. The process involves adjusting a preset initial threshold value based on the first sequence and the first inflection point to obtain a first adjusted threshold value. A second threshold range is then determined based on this first adjusted threshold value. If the construction data points corresponding to the (b+1)th future time to the (c)th future time are within the second threshold range, and the slope of the construction data points corresponding to the (b+1)th future time to the (c)th future time is less than the lower threshold slope of the corresponding construction data point, the construction data point corresponding to the (c+1)th future time is not within the second threshold range, or the upper threshold slope of the construction data point corresponding to the (c+1)th future time is not less than the lower threshold slope of the corresponding construction data point, then the construction data point corresponding to the (c)th future time is archived. The process continues to iterate through future times until the water conservancy project construction ends, and all archived construction data points during the iteration are used as compressed data. The first future time is the next time after the current time. Furthermore, this invention, by adjusting the threshold value, achieves real-time compression of water conservancy construction data. Attached Figure Description
[0009] To more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0010] Figure 1 This is a flowchart of a method for collecting and processing water conservancy project construction information based on big data, according to the present invention. Detailed Implementation
[0011] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention are within the protection scope of the embodiments of the present invention.
[0012] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art.
[0013] This embodiment provides a big data-based water conservancy project construction information collection and processing system, including a processor and a memory. The processor executes a computer program stored in the memory to implement a big data-based water conservancy project construction information collection and processing method, such as... Figure 1 As shown, this method for collecting and processing water conservancy project construction information based on big data includes the following steps:
[0014] Step S001: During the construction of the water conservancy project, obtain the construction data point and the preset initial threshold value corresponding to the current moment, and obtain the first threshold range based on the preset initial threshold value.
[0015] The main purpose of this embodiment is to ensure or improve the compression rate and quality during the compression of water conservancy project construction by dynamically adjusting the threshold value. Since many data types need to be monitored during water conservancy project construction, including but not limited to upstream and downstream water level differences, dam foundation seepage pressure, seepage flow, groundwater level, precipitation, temperature, humidity, wind speed, and river flow, a large number of sensor types and quantities are required. In this embodiment, for ease of analysis and understanding, the following description will focus on the threshold adjustment process for real-time compression of any type of construction data to be monitored during the construction of any water conservancy project. For example, this embodiment mainly focuses on real-time compression of groundwater level. Since multiple groundwater level monitoring locations are typically set up during water conservancy project construction, this... The following embodiments will compress the data monitored in real time at any groundwater level monitoring location and record it as the target monitoring location. That is, the data that appears in this embodiment will all come from the data monitored at the same groundwater level monitoring location, or the data that appears in the following embodiments will not only belong to the same monitoring location but also have the same data type. The reason for setting up multiple groundwater level monitoring points during the construction of water conservancy projects is that groundwater level is a key data that directly affects the success or failure of the project and the sustainability of the surrounding environment. Therefore, the monitoring range needs to cover key areas. For example, monitoring locations are generally arranged near dewatering wells, inside the cutoff wall, near surface water bodies, and outside the cutoff wall. And sensors are generally used for monitoring, such as pressure water level sensors. In addition, water conservancy projects are generally built at the locations of reservoirs, hydropower stations, dams, etc.
[0016] Therefore, in this embodiment, we first need to obtain the construction data corresponding to the target monitoring location at the current moment during the construction of the water conservancy project. Then, we construct a two-dimensional space and map the construction data corresponding to the current moment and the current moment into the two-dimensional space to obtain the construction data point corresponding to the current moment. Since this embodiment takes the groundwater level as an example for analysis, and the target monitoring location is the groundwater level monitoring point, the construction data collected at the current moment and the construction data collected at future moments in this embodiment are all groundwater level data. That is, the horizontal axis of the two-dimensional space is time and the vertical axis is groundwater level data. In addition, this embodiment performs real-time compression starting from the current moment.
[0017] After acquiring the construction data points corresponding to the current moment, the preset initial threshold value is obtained. The preset initial threshold value is the tolerance error ratio coefficient. In practical applications, it is usually set according to historical experience and engineering requirements. For example, it is generally taken as 0.5% to 2% of the data range. For example, for a pressure sensor with a range of 100MPa, the preset initial threshold value can be set to 0.5 to 2MPa.
[0018] After obtaining the preset initial threshold value, the first threshold range is obtained based on the preset initial threshold value. The specific process of obtaining the first threshold range based on the preset initial threshold value is as follows: the sum of the ordinate value of the construction data point corresponding to the current time and the preset initial threshold value is recorded as the upper threshold axis of the first threshold range, and the result of subtracting the preset initial threshold value from the ordinate value of the construction data point corresponding to the current time is recorded as the lower threshold axis of the first threshold range. In this embodiment, the threshold range is one of the conditions for subsequently determining whether a data point should be archived. That is, if the ordinate value of the data point is not within the threshold range, archiving is triggered. In this embodiment, in addition to the threshold range, there is also slope intersection. When the upper threshold slope is greater than or equal to the lower threshold slope of the corresponding data point, archiving is determined. In this embodiment, the archiving conditions do not include time triggering. That is, in this embodiment, the threshold range and slope intersection are the conditions for triggering archiving.
[0019] Step S002: If it is determined that the construction data points corresponding to the 1st future time to the bth future time are within the first threshold, and the upward slope of the construction data points corresponding to the 1st future time to the bth future time is less than the downward slope of the corresponding construction data point, and the construction data point corresponding to the b+1th future time is not within the first threshold, or the upward slope of the construction data point corresponding to the b+1th future time is not less than the downward slope of the construction data point corresponding to the b+1th future time, then archive the construction data points corresponding to the current time and the bth future time, and record the data point sequence formed by the construction data points corresponding to the current time to the bth future time as the first sequence, and record the construction data point corresponding to the b+1th future time as the first inflection point; based on the first sequence and the first inflection point, perform... The initial threshold value is adjusted to obtain the first adjustment threshold value. Based on the first adjustment threshold value, the second threshold range is obtained. If the construction data points corresponding to the (b+1)th future time to the (c)th future time are within the second threshold range, and the slope of the construction data points corresponding to the (b+1)th future time to the (c)th future time is less than the lower threshold slope of the corresponding construction data point, the construction data point corresponding to the (c+1)th future time is not within the second threshold range, or the upper threshold slope of the construction data point corresponding to the (c+1)th future time is not less than the lower threshold slope of the construction data point corresponding to the (c+1)th future time, then the construction data point corresponding to the (c)th future time is archived. The future time is traversed until the end of the water conservancy project construction. All the construction data points archived during the traversal are used as compressed data.
[0020] After obtaining the construction data point corresponding to the current moment, the system continues to obtain the construction data point corresponding to the next moment, which is then recorded as the first future moment of the current moment. Next, the system continues to obtain the construction data point corresponding to the first future moment, and determines whether the construction data point corresponding to the first future moment is within a first threshold and whether the upward slope of the construction data point corresponding to the first future moment is less than the downward slope of the corresponding construction data point. If both are true, the system continues to obtain the construction data point corresponding to the second future moment of the current moment, and determines whether the construction data point corresponding to the second future moment is within a first threshold and whether the upward slope of the construction data point corresponding to the first future moment is less than the downward slope of the corresponding construction data point. If both are true, the system continues to obtain the construction data point corresponding to the current moment. If the construction data points corresponding to the future times of the previous time are all within the first threshold, and the upward slope of the construction data points corresponding to the construction data points corresponding to the first time to the bth time is less than the downward slope of the corresponding construction data point, and the construction data point corresponding to the b+1th time is not within the first threshold, or the upward slope of the construction data point corresponding to the b+1th time is not less than the downward slope of the construction data point corresponding to the b+1th time, then the construction data points corresponding to the current time and the bth future time are archived, and the data point sequence formed by the construction data points corresponding to the current time to the bth future time is recorded as the first sequence, and the construction data point corresponding to the b+1th future time is recorded as the first inflection point;Based on the first sequence and the first inflection point, the preset initial threshold value is adjusted to obtain the first adjustment threshold value. Based on the first adjustment threshold value, the second threshold range is obtained. If it is further determined that the construction data point corresponding to the b-th future time to the c-th future time is within the second threshold range, the slope of the construction data point corresponding to the b-th future time to the c-th future time is less than the downward slope of the corresponding construction data point, the construction data point corresponding to the c+1-th future time is not within the second threshold range, or the upward slope of the construction data point corresponding to the c+1-th future time is less than the downward slope of the construction data point corresponding to the c+1-th future time, then the construction data point corresponding to the c-th future time is archived. The data point sequence formed by the construction data points corresponding to the b-th future time to the c-th future time is recorded as the second sequence, and the construction data point corresponding to the c+1-th future time is recorded as the second inflection point. Based on the second sequence and the second inflection point, the construction data point corresponding to the c-th future time is further determined. The first adjustment threshold is used to obtain the second adjustment threshold, and the third threshold range is obtained based on the second adjustment threshold. If the construction data points corresponding to the (c+1)th future time to the dth future time are within the third threshold range, and the slope of the construction data points corresponding to the (c+1)th future time to the dth future time is less than the lower threshold slope of the corresponding construction data point, or the construction data point corresponding to the (d+1)th future time is not within the third threshold range, or the upper threshold slope of the construction data point corresponding to the (d+1)th future time is not less than the lower threshold slope of the construction data point corresponding to the (d+1)th future time, then the construction data point corresponding to the dth future time is archived. The traversal of future times continues until the end of the water conservancy project construction. All the construction data points archived during the traversal are used as compressed data. The dth future time is located after the cth future time, and the cth future time is located after the bth future time.
[0021] In addition, in this embodiment, the calculation process of the upper and lower slopes of the construction data points is a well-known calculation, so it will not be described in detail in this embodiment.
[0022] In this embodiment, the upper threshold of the first threshold range is the sum of the ordinate value of the construction data point at the current time and the preset initial threshold value; the lower threshold of the first threshold range is the result of subtracting the preset initial threshold value from the ordinate value of the construction data point at the current time; the upper threshold of the second threshold range is the sum of the ordinate value of the construction data point at the b-th future time and the first adjustment threshold value; the lower threshold of the first threshold range is the result of subtracting the first adjustment threshold value from the ordinate value of the construction data point at the b-th future time; the upper threshold of the third threshold range is the sum of the ordinate value of the construction data point at the c-th future time and the second adjustment threshold value; and the lower threshold of the third threshold range is the result of subtracting the second adjustment threshold value from the ordinate value of the construction data point at the c-th future time.
[0023] In this embodiment, the specific process of adjusting the preset initial threshold value to obtain the first adjustment threshold value based on the first sequence and the first inflection point is as follows: Based on the extreme points in the first sequence and the differences between adjacent construction data points in the first sequence, the fluctuation trend characteristic value corresponding to the first sequence is obtained; the first construction data point in the first sequence is recorded as the nearest neighbor inflection point of the first inflection point; based on the difference in the ordinate between the last construction data point in the first sequence and the first inflection point, and the rate of change between the nearest neighbor inflection point and the first inflection point, the trend change characterization value of the first inflection point is obtained; all construction data points collected from the start of construction to the first inflection point are... The mean of the vertical coordinates is recorded as the comprehensive mean corresponding to the first inflection point. The mean of the vertical coordinates of all construction data points in the first sequence is recorded as the local mean corresponding to the first inflection point. Based on the difference between the comprehensive mean corresponding to the first inflection point and the vertical coordinate of the first inflection point, as well as the difference between the local mean corresponding to the first inflection point and the vertical coordinate of the first inflection point, the trend deviation characterization value of the first inflection point is obtained. Based on the fluctuation trend characteristic value corresponding to the first sequence, the trend change characterization value of the first inflection point, and the trend deviation characterization value of the first inflection point, the adjustment degree characterization value of the preset initial threshold value is obtained. The product of the adjustment degree characterization value of the first adjustment threshold value and the preset initial threshold value is recorded as the first adjustment threshold value.
[0024] In this embodiment, the specific process of the fluctuation trend feature value corresponding to the first sequence is as follows: the normalized value of the ratio of the total number of extreme points in the first sequence to the total number of construction data points in the first sequence is recorded as the first index value; the adjacent difference sequence corresponding to the first sequence is obtained; and the normalized value of the mean of the adjacent difference sequence is recorded as the second index value. The z-th adjacent difference in the adjacent difference sequence is the absolute value of the difference between the ordinates of the (z+1)-th and z-th construction data points in the first sequence. The mean of the first index value and the second index value is recorded as the fluctuation trend feature value corresponding to the first sequence.
[0025] The specific process for obtaining the trend change characterization value of the first inflection point is as follows: the result of subtracting the ordinate of the last construction data point in the first sequence from the ordinate value of the first inflection point is recorded as the first difference value; the result of subtracting the abscissa of the last construction data point in the first sequence from the abscissa value of the first inflection point is recorded as the second difference value; the ratio of the first difference value to the second difference value is recorded as the first ratio value; and the mean of the hyperbolic tangent value of the first difference value and the hyperbolic tangent value of the second difference value is recorded as the trend change characterization value of the first inflection point.
[0026] The method for obtaining the adjustment degree characterization value of the preset initial threshold value includes: recording the average of the first inflection point trend change characterization value and the first inflection point trend deviation characterization value as the first feature mean; determining whether the weighted sum of the first feature mean and the fluctuation trend feature value corresponding to the first sequence is greater than a preset adjustment direction determination threshold; if so, using a constant -1 as the adjustment direction parameter of the preset initial threshold value; otherwise, using a constant 1 as the adjustment direction parameter of the preset initial threshold value; using the weighted sum of the normalized value of the first feature mean and the fluctuation trend feature value corresponding to the first sequence as the adjustment degree parameter of the preset initial threshold value; and recording the result of multiplying the adjustment direction parameter of the preset initial threshold value and the adjustment degree parameter of the preset initial threshold value and adding a preset first constant as the adjustment degree characterization value of the preset initial threshold value.
[0027] In this embodiment, the specific process of adjusting the first adjustment threshold value to obtain the second adjustment threshold value based on the second sequence and the second inflection point is as follows: Obtain the fluctuation trend characteristic value corresponding to the second sequence; record the first inflection point as the nearest neighbor inflection point of the second inflection point; based on the difference in the ordinate between the last construction data point in the second sequence and the second inflection point, and the rate of change between the nearest neighbor inflection point of the second inflection point and the second inflection point, obtain the trend change characterization value of the second inflection point; record the average ordinate of all construction data points collected from the start of construction to the second inflection point as the comprehensive average value corresponding to the second inflection point, and then... The mean of the ordinates of all construction data points in the second sequence is denoted as the local mean corresponding to the second inflection point. Based on the differences between the comprehensive mean corresponding to the second inflection point and the ordinate of the second inflection point, as well as the differences between the local mean corresponding to the second inflection point and the ordinate of the second inflection point, the trend deviation characterization value of the second inflection point is obtained. The methods for obtaining the fluctuation trend characteristic value, the trend change characterization value, and the trend deviation characterization value of the second inflection point corresponding to the second sequence are the same as those for obtaining the fluctuation trend characteristic value, the trend change characterization value, and the trend deviation characterization value of the first inflection point corresponding to the first sequence, and therefore will not be described in detail. Based on the fluctuation trend characteristic value, the trend change characterization value, and the trend deviation characterization value of the second inflection point corresponding to the second sequence, the adjustment degree characterization value of the first adjustment threshold is obtained. The product of the first adjustment threshold value and the first adjustment threshold value is denoted as the second adjustment threshold value. Furthermore, the method for obtaining the adjustment degree characterization value of the first adjustment threshold is the same as that for obtaining the adjustment degree characterization value of the preset initial threshold value, and therefore will not be described in detail.
[0028] Thus, this embodiment completes the compression process of construction data collected in real time during water conservancy project construction. Furthermore, the process of real-time compression of construction data collected by any of the configured sensors during water conservancy project construction is consistent with the above process.
[0029] In summary, this embodiment first acquires the construction data point corresponding to the current moment and a preset initial threshold value during the construction of a water conservancy project, and obtains the first threshold range based on the preset initial threshold value. Then, if it is determined that the construction data point corresponding to the 1st future moment to the bth future moment is within the first threshold range, and the upper threshold slope of the construction data point corresponding to the 1st future moment to the bth future moment is less than the lower threshold slope of the corresponding construction data point, and the construction data point corresponding to the b+1th future moment is not within the first threshold range, or the upper threshold slope of the construction data point corresponding to the b+1th future moment is not less than the lower threshold slope of the construction data point corresponding to the b+1th future moment, then the construction data points corresponding to the current moment and the bth future moment are archived, and the data point sequence formed by the construction data points corresponding to the current moment to the bth future moment is recorded as the first sequence, and the construction data point corresponding to the b+1th future moment is recorded as the first... Inflection point; based on the first sequence and the first inflection point, the preset initial threshold value is adjusted to obtain the first adjusted threshold value, and the second threshold range is obtained based on the first adjusted threshold value. If it is determined that the construction data points corresponding to the (b+1)th future time to the (c)th future time are within the second threshold range, and the slope of the construction data points corresponding to the (b+1)th future time to the (c)th future time is less than the lower threshold slope of the corresponding construction data point, the construction data point corresponding to the (c+1)th future time is not within the second threshold range, or the upper threshold slope of the construction data point corresponding to the (c+1)th future time is not less than the lower threshold slope of the construction data point corresponding to the (c+1)th future time, then the construction data point corresponding to the (c)th future time is archived, and the future times are traversed until the end of the water conservancy project construction. All the construction data points archived during the traversal are used as compressed data, where the first future time is the next time after the current time. Furthermore, this embodiment achieves real-time compression of water conservancy construction data by adjusting the threshold value.
[0030] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.
Claims
1. A water conservancy project construction information acquisition and processing system based on big data, comprising a processor and a memory, characterized in that, The processor executes the computer program stored in the memory to perform the following steps: During the construction of water conservancy projects, the construction data points and preset initial threshold values corresponding to the current moment are obtained, and the first threshold range is obtained based on the preset initial threshold values. If it is determined that the construction data points corresponding to the 1st future time to the bth future time are within the first threshold, and the upward slope of the construction data points corresponding to the 1st future time to the bth future time is less than the downward slope of the corresponding construction data point, and the construction data point corresponding to the b+1th future time is not within the first threshold, or the upward slope of the construction data point corresponding to the b+1th future time is not less than the downward slope of the construction data point corresponding to the b+1th future time, then the construction data points corresponding to the current time and the bth future time are archived, and the data point sequence formed by the construction data points corresponding to the current time to the bth future time is recorded as the first sequence, and the construction data point corresponding to the b+1th future time is recorded as the first inflection point; based on the first sequence and the first inflection point, the preset initial threshold value is adjusted to obtain the first... Adjust the threshold value and obtain the second threshold range based on the first adjusted threshold value. If it is determined that the construction data points corresponding to the (b+1)th future time to the (c)th future time are within the second threshold range, and the upper slope of the construction data points corresponding to the (b+1)th future time to the (c)th future time is less than the lower slope of the corresponding construction data point, the construction data point corresponding to the (c+1)th future time is not within the second threshold range, or the upper slope of the construction data point corresponding to the (c+1)th future time is not less than the lower slope of the construction data point corresponding to the (c+1)th future time, then archive the construction data point corresponding to the (c)th future time. Continue to traverse the future times until the end of the water conservancy project construction, and use all the archived construction data points during the traversal as compressed data. The first future time is the next time after the current time. The upper threshold of the first threshold range is the sum of the ordinate value of the construction data point at the current time and the preset initial threshold value; the lower threshold of the first threshold range is the result of subtracting the preset initial threshold value from the ordinate value of the construction data point at the current time; the upper threshold of the second threshold range is the sum of the ordinate value of the construction data point at the b-th future time and the first adjustment threshold value; the lower threshold of the second threshold range is the result of subtracting the first adjustment threshold value from the ordinate value of the construction data point at the b-th future time. A method for adjusting a preset initial threshold value to obtain a first adjusted threshold value based on the first sequence and the first inflection point includes: Based on the extreme points in the first sequence and the differences between adjacent construction data points in the first sequence, the fluctuation trend characteristic value corresponding to the first sequence is obtained; The first construction data point in the first sequence is recorded as the nearest neighbor inflection point of the first inflection point. Based on the difference in the ordinate between the last construction data point in the first sequence and the first inflection point, and the rate of change between the nearest neighbor inflection point and the first inflection point, the trend change characterization value of the first inflection point is obtained. The mean of the ordinates of all construction data points collected from the start of construction to the first inflection point is recorded as the comprehensive mean corresponding to the first inflection point. The mean of the ordinates of all construction data points in the first sequence is recorded as the local mean corresponding to the first inflection point. Based on the difference between the comprehensive mean corresponding to the first inflection point and the ordinate of the first inflection point, as well as the difference between the local mean corresponding to the first inflection point and the ordinate of the first inflection point, the trend deviation characterization value of the first inflection point is obtained. Based on the fluctuation trend characteristic value, the first inflection point trend change characterization value, and the first inflection point trend deviation characterization value corresponding to the first sequence, the adjustment degree characterization value of the preset initial threshold value is obtained, and the product of the adjustment degree characterization value of the preset initial threshold value and the preset initial threshold value is recorded as the first adjustment threshold value.
2. The water conservancy project construction information collection and processing system based on big data as described in claim 1, characterized in that, The construction data point at any given moment consists of the construction data collected at that time and the construction data collected at that time.
3. The water conservancy project construction information collection and processing system based on big data as described in claim 1, characterized in that, The method for obtaining the fluctuation trend feature value corresponding to the first sequence includes: The normalized value of the ratio of the total number of extreme points in the first sequence to the total number of construction data points in the first sequence is recorded as the first index value. The adjacent difference sequence corresponding to the first sequence is obtained, and the normalized value of the mean of the adjacent difference sequence is recorded as the second index value. The z-th adjacent difference in the adjacent difference sequence is the absolute value of the difference between the ordinates of the (z+1)-th and z-th construction data points in the first sequence. The mean of the first index value and the second index value is recorded as the fluctuation trend characteristic value corresponding to the first sequence.
4. The water conservancy project construction information collection and processing system based on big data as described in claim 1, characterized in that, The method for obtaining the characteristic value of the first inflection point trend change includes: The result of subtracting the ordinate of the last construction data point in the first sequence from the ordinate of the first inflection point is recorded as the first difference. The result of subtracting the abscissa of the last construction data point in the first sequence from the abscissa of the first inflection point is recorded as the second difference. The ratio of the first difference to the second difference is recorded as the first ratio. The mean of the hyperbolic tangent of the first difference and the hyperbolic tangent of the second difference is recorded as the trend change characterization value of the first inflection point.
5. The water conservancy project construction information collection and processing system based on big data as described in claim 1, characterized in that, The method for obtaining the first inflection point trend deviation from the representation value includes: The result of subtracting the local mean corresponding to the first inflection point from the ordinate value of the first inflection point is recorded as the third difference value. The result of subtracting the comprehensive mean corresponding to the first inflection point from the ordinate value of the first inflection point is recorded as the fourth difference value. The hyperbolic tangent value of the result obtained by adding the third difference value and the fourth difference value is recorded as the trend deviation characterization value of the first inflection point.
6. The water conservancy project construction information collection and processing system based on big data as described in claim 5, characterized in that, The method for obtaining the adjustment degree characterization value of the preset initial threshold value includes: The average of the first inflection point trend change characterization value and the first inflection point trend deviation characterization value is recorded as the first feature mean. The weighted sum of the first feature mean and the fluctuation trend characteristic value corresponding to the first sequence is checked against a preset adjustment direction determination threshold. If the sum is greater than the preset adjustment direction determination threshold, a constant -1 is used as the adjustment direction parameter of the preset initial threshold value; otherwise, a constant 1 is used as the adjustment direction parameter of the preset initial threshold value. The weighted sum of the normalized value of the first feature mean and the fluctuation trend characteristic value corresponding to the first sequence is used as the adjustment degree parameter of the preset initial threshold value. The result of multiplying the adjustment direction parameter of the preset initial threshold value and the adjustment degree parameter of the preset initial threshold value and adding the preset first constant is recorded as the adjustment degree characterization value of the preset initial threshold value.
7. The water conservancy project construction information collection and processing system based on big data as described in claim 6, characterized in that, After archiving the construction data point corresponding to the c-th future time, the following steps are also included: The data point sequence formed by the construction data points corresponding to the b-th future time to the c-th future time is denoted as the second sequence. The construction data point corresponding to the (c+1)-th future time is denoted as the second inflection point. Based on the second sequence and the second inflection point, the first adjustment threshold is adjusted to obtain the second adjustment threshold. Based on the second adjustment threshold, the third threshold range is obtained. If the construction data points corresponding to the (c+1)-th future time to the d-th future time are within the third threshold range, and the upward slope of the construction data points corresponding to the (c+1)-th future time to the d-th future time is less than the downward slope of the corresponding construction data point, the construction data points corresponding to the (d+1)-th future time... If the construction data point is not within the third threshold range, or if the upward slope of the construction data point corresponding to the (d+1)th future time is not less than the downward slope of the construction data point corresponding to the (d+1)th future time, then the construction data point corresponding to the dth future time is archived. The method of adjusting the first adjustment threshold value to obtain the second adjustment threshold value and obtaining the third threshold range based on the second adjustment threshold value is the same as the method of adjusting the preset initial threshold value to obtain the first adjustment threshold value and obtaining the second threshold range based on the first adjustment threshold value. The dth future time is located after the cth future time, and the cth future time is located after the bth future time.
8. The water conservancy project construction information collection and processing system based on big data as described in claim 7, characterized in that, The method for adjusting the first adjustment threshold value to obtain the second adjustment threshold value based on the second sequence and the second inflection point includes: The fluctuation trend characteristic value corresponding to the second sequence is obtained; the first inflection point is recorded as the nearest inflection point of the second inflection point; based on the difference in the ordinate between the last construction data point in the second sequence and the second inflection point, and the rate of change between the nearest inflection point of the second inflection point and the second inflection point, the trend change characterization value of the second inflection point is obtained; the mean of the ordinates of all construction data points collected from the start of construction to the second inflection point is recorded as the comprehensive mean corresponding to the second inflection point; the mean of the ordinates of all construction data points in the second sequence is recorded as the local mean corresponding to the second inflection point; based on the difference between the comprehensive mean corresponding to the second inflection point and the ordinate of the second inflection point, and the difference between the local mean corresponding to the second inflection point and the ordinate of the second inflection point, the trend deviation characterization value of the second inflection point is obtained; the methods for obtaining the fluctuation trend characteristic value, the trend change characterization value of the second inflection point, and the trend deviation characterization value of the second inflection point corresponding to the second sequence are the same as the methods for obtaining the fluctuation trend characteristic value, the trend change characterization value of the first inflection point, and the trend deviation characterization value of the first inflection point corresponding to the first sequence. Based on the fluctuation trend characteristic value, the trend change characterization value of the second inflection point, and the trend deviation characterization value of the second inflection point corresponding to the second sequence, the adjustment degree characterization value of the first adjustment threshold is obtained, and the product of the adjustment degree characterization value of the first adjustment threshold and the first adjustment threshold is recorded as the second adjustment threshold. The method for obtaining the adjustment degree characterization value of the first adjustment threshold is the same as the method for obtaining the adjustment degree characterization value of the preset initial threshold.
Citation Information
Patent Citations
Ship lock remote management system based on Internet data
CN116155298A
Data storage method and system
CN116823492A