Water flow state analysis method for ship lock channel based on big data analysis

Abstract

The invention relates to the technical field of water flow data analysis, in particular to a ship lock channel water flow state analysis method based on big data analysis, which comprises the following steps: constructing a water flow state model, then dividing historical hydrological data into a plurality of data groups according to acquisition time, merging and analyzing the data groups, determining key influence parameters, and calculating the water flow state of a ship lock channel; the method comprises the following steps: determining a single number set based on key influence parameters, obtaining data scenes through feature analysis of an external environment in the single number set, establishing a weight change function of the key influence parameters in each data scene, and finally, acquiring hydrological data and environmental data of a ship lock channel in real time, and carrying out information matching with the data scenes to obtain a weight change function of the key influence parameters in each data scene. And the real-time weight coefficient of the key influence parameter is calculated in the corresponding weight change function, so that the system can dynamically adjust the water flow state model according to the real-time environment change, and the adaptability and flexibility of the system to the complex and changeable ship lock channel water flow environment are enhanced.

Description

Technical Field

[0001] The present invention relates to the technical field of water flow data analysis, and in particular to a water flow state analysis method for a ship lock channel based on big data analysis. Background Art

[0002] A ship lock refers to the space enclosed by the upper and lower lock heads and the lock walls on both sides. The lock walls are equipped with mooring posts, floating mooring rings, etc. for ships to moor when they are moored in the lock chamber. Ships passing through the lock rise and fall in the lock chamber as the water level in the lock chamber rises and falls, allowing ships to overcome the concentrated water level difference in the waterway. It is a box-shaped navigation building.

[0003] Prior art CN118607400A discloses a method for analyzing water flow in a pilot channel and a waterway during the filling and discharging operation of a ship lock, comprising: using a one-dimensional, two-dimensional, and three-dimensional joint mathematical model to analyze the water flow in the pilot channel and the waterway during the filling and discharging operation of the ship lock, and through the mutual correlation between the one-dimensional mathematical model, the two-dimensional mathematical model, and the three-dimensional mathematical model, it can not only save a lot of calculation time, but also accurately analyze the water flow conditions in key areas of concern, thereby greatly improving the accuracy of water flow analysis; setting virtual monitoring points corresponding one to one to actual monitoring points, combining the water flow calculation results obtained by numerical simulation with the water flow data measured at the actual monitoring points, and replacing the water flow data measured at the virtual monitoring points with the water flow data measured at the actual monitoring points, so that the established neural network model is more in line with the actual situation.

[0004] However, the existing lock and channel flow state analysis technology has failed to fully utilize the advantages of big data and has obvious deficiencies in data integration, feature extraction, and model construction. In the data processing process, the weight coefficients corresponding to different influencing parameters under different environments will change dynamically. If the dynamic changes of parameter weights are not considered, the accuracy of water flow state analysis will be reduced. Summary of the invention

[0005] The purpose of the present invention is to solve the problems in the background technology and to propose a water flow state analysis method for a ship lock channel based on big data analysis.

[0006] In order to achieve the above object, the present invention adopts the following technical solutions: A method for analyzing water flow conditions in a ship lock channel based on big data analysis, the method specifically comprising the following steps: Step 1: Collect historical hydrological data of the selected lock channel and obtain the water flow state model based on the recurrent neural network model; Step 2: Based on the collection time, the historical hydrological data are divided into multiple data groups, and the key influencing parameters of each data group are determined using the differential calculation method; Based on the key influencing parameters, the data groups are merged to obtain a single data set, and then the external environment in the single data set is obtained and the characteristics of the external environment are analyzed to obtain the data scenario of the single data set; Step 3: Calculate the node weights of the key influencing parameters in the single item data set, establish a multivariate linear regression model based on the node weights and the data in the single item data set, and obtain the weight change function of the key influencing parameters in each data scenario; Step 4: Collect hydrological data and environmental data of the ship lock channel in real time, match the environmental data with the data scenario, and calculate in the corresponding weight change function to determine the real-time weight coefficient of the corresponding key influencing parameters; Step 5: Input the real-time weight coefficients of key parameters and the real-time collected hydrological data into the water flow state model at the same time, and perform data analysis to obtain the water flow state of the lock channel.

[0007] As a further solution of the present invention, after obtaining the historical hydrological data, it is necessary to first perform data preprocessing on the historical hydrological data, wherein the data preprocessing includes removing outliers and filling missing values, and then the preprocessed historical hydrological data is subjected to a recurrent neural network model and differential calculation.

[0008] As a further solution of the present invention, the difference calculation method includes: S11: Acquire historical hydrological data under various environments, wherein the historical hydrological data includes flow velocity, flow direction, flow rate, and water level; According to the collection time, the historical hydrological data collected at the same time are marked as a data group, wherein a data group contains the flow velocity, flow direction, flow rate and water level data collected at the same time; Then, the data groups in the historical hydrological data are arranged in chronological order from far to near to obtain a data sequence; S12: Set the first data group in the data sequence as the starting data point. Starting from the starting data point, subtract data group (i-1) from data group i to obtain the differential data of data group i, where i∈[1,n], n represents the total number of remaining data groups in the data sequence except the starting data point. Further, set the data group of the starting data point to data group 0. When i takes the value of 1, data group 1 is subtracted from data group 0 to obtain the differential data of data group 1.

[0009] As a further solution of the present invention, a method for determining key influencing parameters includes: Obtain the ship operation status of the selected lock channel, and correspond the ship operation status to the data group according to the time relationship, wherein the ship operation status refers to the speed of the ship passing through the lock; In chronological order, the ship operation status is processed according to the calculation method of differential data to obtain the differential status; The differential data and differential state are obtained at the same time, and the differential data and differential state of the same data group are matched one by one according to the data group. Each data in the differential data is correlated with the differential state in turn to obtain the data correlation value, and then in the same data group, the maximum value of the data correlation value is taken as the key influencing parameter of this data group.

[0010] As a further solution of the present invention, in a data group collected at the same time, based on the difference in unit collection time, there are multiple data collected by different unit collection times. At the same time, when calculating the differential data, it is necessary to first perform mean processing on the data in the data group according to the parameter type, and then perform difference calculation on the data after mean processing to obtain differential data.

[0011] As a further solution of the present invention, a method for calculating the node weights of key influencing parameters includes: SS1: Select a data scenario at random and mark it as the target analysis environment. Obtain the single item data set corresponding to the target analysis environment. First use the formula The data in the single-item data set are normalized, where b represents different types of parameters in the single-item data set. Furthermore, b represents flow velocity, flow direction, flow rate, and water level, and j represents the specific value of parameter b. represents the minimum value in parameter b, Indicates the maximum value in parameter b; SS2: After the normalization process is completed, the mean and standard deviation of the parameter b in each data group are calculated according to the data group to obtain the parameter mean Pb and parameter standard deviation Bb; SS3: Utilizing formulas Calculate the coefficient of variation CVb of parameter b in each data group, and obtain the coefficient of variation CVg of the key influencing parameters, where g∈b, and again use the formula The node weight Qm of the key influencing parameter is calculated, where r represents the total label value of parameter b, and m in the node weight Qm represents different data groups.

[0012] As a further solution of the present invention, a method for obtaining a weight change function of a key influencing parameter includes: The parameter b in the target analysis environment is set as the independent variable, and the node weight Qm is set as the dependent variable. Then, the linear regression model is used to transfer the independent variable and the dependent variable to the linear regression model respectively, and data training is performed to establish a multivariate linear regression model. ,in, represents the intercept, represents the error term, , , as well as is the regression coefficient, D1, D2, D3 and D4 are the data after normalization by parameter b.

[0013] As a further solution of the present invention, a method for obtaining a real-time weight coefficient includes: The hydrological data and environmental data in the ship lock channel are collected in real time. First, based on the real-time collected environmental data, the real-time collected environmental data is searched in the scenario data of the single item data set, and the matched scenario data is set as the real-time target data; The weight change function corresponding to the real-time target data is obtained, and the real-time collected environmental data is input into the weight change function to obtain the real-time weight coefficient of the key influencing parameters.

[0014] Compared with the prior art, the advantages of the present invention are: The present invention collects historical hydrological data of a selected ship lock and waterway, and constructs a water flow state model based on a recurrent neural network model. The historical hydrological data is then divided into multiple data groups according to the collection time, and the data groups are merged and analyzed to determine key influencing parameters. A single number set is determined based on the key influencing parameters, and a data scenario is obtained by analyzing the characteristics of the external environment in the single number set. A weight change function of the key influencing parameters in each data scenario is established. Finally, the hydrological data and environmental data of the ship lock and waterway are collected in real time, and information is matched with the data scenario. The real-time weight coefficients of the key influencing parameters are calculated in the corresponding weight change function, so that the system can dynamically adjust the water flow state model according to real-time environmental changes, thereby enhancing the adaptability and flexibility of the system to the complex and changeable ship lock and waterway water flow environment, and further improving the accuracy of the analysis results. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a schematic diagram of the method flow structure of the present invention. DETAILED DESCRIPTION

[0016] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0017] Reference Figure 1 , a water flow state analysis method for a ship lock channel based on big data analysis, the method specifically comprises the following steps: Step 1: Select a ship lock channel, and according to the selected ship lock channel, obtain historical hydrological data of the ship lock channel in various environments, then perform data preprocessing on the historical hydrological data, and use an artificial intelligence model to perform data training on the preprocessed historical hydrological data to obtain a water flow state model, wherein the artificial intelligence model in this embodiment is set to a recurrent neural network model, and the recurrent neural network belongs to the prior art, which will not be described here. Furthermore, data preprocessing includes removing outliers, filling missing values, etc. to ensure the quality of the data; Step 2: Obtain the historical hydrological data after data preprocessing again, and perform data analysis on the historical hydrological data to determine the data scenario. The specific method for determining the data scenario includes: S1: Obtain historical hydrological data under various environments, where the historical hydrological data includes flow velocity, flow direction, flow rate, and water level, and identify key influencing parameters in each set of historical hydrological data. The specific methods for identifying key influencing parameters include: S11: marking the historical hydrological data collected at the same time as a data group according to the collection time, wherein a data group contains data such as flow velocity, flow direction, flow rate and water level collected at the same time; Then, the data groups in the historical hydrological data are arranged in chronological order from far to near to obtain a data sequence; S12: Set the first data group in the data sequence as the starting data point, and starting from the starting data point, subtract data group (i-1) from data group i to obtain differential data of data group i, where i∈[1,n], n represents the total number of remaining data groups in the data sequence except the starting data point. Further, set the data group of the starting data point to data group 0. When i takes the value of 1, data group 1 is subtracted from data group 0 to obtain differential data of data group 1. It should be further explained that, based on the unit collection time, in the data group collected at the same time, there are multiple data collected by different unit collection times. For example, if a time is set to 30 minutes and the unit collection time is set to 5 minutes, there are 6 hydrological data collected based on the unit time in a data group. At the same time, when calculating the differential data, it is necessary to first perform mean processing on the data of the data group according to the parameter type, and then perform difference calculation on the data after mean processing to obtain the differential data; S13: obtaining the ship operation status of the selected lock channel, and matching the ship operation status with the data group according to the time relationship, wherein the ship operation status in this embodiment refers to the ship's speed of passing the lock; Then, in chronological order, the ship operation status is processed according to the method in the above step S12 to obtain a differential state; Acquire differential data and differential states simultaneously, make one-to-one correspondence between differential data and differential states of the same data group according to the data group, then sequentially perform correlation analysis on each data in the differential data and the differential state to obtain data correlation values. For example, first perform correlation analysis on the flow velocity in the data group and the differential state to obtain the data correlation value of the flow velocity, then perform correlation analysis on the water level in the data group and the differential state to obtain the data correlation value of the water level, and so on to obtain the data correlation value of each data in the data group; Then, in the same data group, the maximum value of the data correlation value is taken as the key influencing parameter of this data group; Furthermore, the correlation analysis method in this embodiment adopts a polynomial regression analysis method for processing, and the specific processing process belongs to the prior art and will not be described in detail here; S2: classify the historical hydrological data according to the key influencing parameters, so that the data groups with the same key influencing parameters are merged to obtain multiple single item data sets, wherein the key influencing parameters of the data groups in a single item data set are the same; S3: randomly select a single number set, take this single number set as an example, identify the external environment corresponding to each data group in this single number set, then use the external environment of the data group in this single number set as input data, use the feature extraction algorithm to calculate the environmental features of this single number set, and set this environmental feature as the data scenario of this single number set; Furthermore, the feature extraction algorithm in this embodiment selects an automatic encoder based on neural network feature extraction, and the use of an automatic encoder for feature extraction belongs to the prior art and will not be described in detail here; Step 3: Select any data scenario from multiple data scenarios and mark it as the target analysis environment. Taking the target analysis environment as an example, determine the weight change function in the target analysis environment. The specific method for determining the weight change function of the target analysis environment includes: SS1: Get the single item number set corresponding to the target analysis environment, first use the formula The data in the single-item data set are normalized, where b represents different types of parameters in the single-item data set. Furthermore, b represents flow velocity, flow direction, flow rate, and water level, and j represents the specific value of parameter b. represents the minimum value in parameter b, Indicates the maximum value in parameter b; SS2: After the normalization process is completed, the mean and standard deviation of the parameter b in each data group are calculated according to the data group to obtain the parameter mean Pb and the parameter standard deviation Bb. Furthermore, when calculating the parameter mean Pb and the parameter standard deviation Bb, the data after the normalization process are used for calculation, which can eliminate the dimension effect between different variables and make multiple parameters comparable on the same scale; SS3: Utilizing formulas Calculate the coefficient of variation CVb of parameter b in each data group, and obtain the coefficient of variation CVg of the key influencing parameters, where g∈b, and again use the formula The node weight Qm of the key influencing parameter is calculated, where r represents the total label value of parameter b, and m in the node weight Qm represents different data groups; SS4: Set the parameter b in the target analysis environment as the independent variable and the node weight Qm as the dependent variable. Then use the linear regression model to transfer the independent variable and the dependent variable to the linear regression model respectively, perform data training, and then establish a multivariate linear regression model. ,in, represents the intercept, represents the error term, , , as well as is the regression coefficient, D1, D2, D3 and D4 are the data after normalization of parameter b; Furthermore, the multivariate linear regression model of the target analysis environment is set as the weight change function of the key influencing parameters, and the remaining data scenarios are taken as the target analysis environment in turn, and processed according to the above method, so as to obtain the weight change function of the key influencing parameters in each data scenario; Step 4: Collect the hydrological data and environmental data in the lock channel in real time. First, based on the real-time collected environmental data, search the real-time collected environmental data in the scenario data of the single item data set, and set the matched scenario data as the real-time target data; Obtain the weight change function corresponding to the real-time target data, and input the real-time collected environmental data into the weight change function to obtain the real-time weight coefficient of the key influencing parameters; Step 5: Obtain the water flow state model of the ship lock channel, input the real-time weight coefficients of key parameters and the real-time collected hydrological data into the water flow state model at the same time, and perform data analysis to obtain the water flow state of the ship lock channel.

[0018] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A method for analyzing water flow conditions in a ship lock channel based on big data analysis, characterized in that: The method specifically comprises the following steps: Step 1: Collect historical hydrological data of the selected lock channel and obtain the water flow state model based on the recurrent neural network model; Step 2: Based on the acquisition time, divide the historical hydrological data into multiple data groups, and use the differential calculation method to determine the key influence parameters of each data group; Based on the key influencing parameters, the data groups are merged to obtain a single data set, and then the external environment in the single data set is obtained and the characteristics of the external environment are analyzed to obtain the data scenario of the single data set; Step 3: Calculate the node weights of the key influencing parameters in the single item data set, establish a multivariate linear regression model based on the node weights and the data in the single item data set, and obtain the weight change function of the key influencing parameters in each data scenario; Step 4: Collect hydrological data and environmental data of the ship lock channel in real time, match the environmental data with the data scenario, and calculate in the corresponding weight change function to determine the real-time weight coefficient of the corresponding key influencing parameters; Step 5: Enter the real-time weight coefficient of the key parameters and the hydrological data collected in real time into the water flow state model, and perform data analysis to obtain the water flow state of the lock channel.

2. The method for analyzing water flow status of a ship lock channel based on big data analysis according to claim 1 is characterized in that: After obtaining the historical hydrological data, it is necessary to preprocess the data first. The data preprocessing includes removing outliers and filling missing values. After that, the preprocessed historical hydrological data is subjected to a recurrent neural network model and differential calculation.

3. The method for analyzing water flow status of a ship lock channel based on big data analysis according to claim 1 is characterized in that: Difference calculation methods include: S11: Obtain historical hydrological data in various environments, including flow rate, flow direction, flow rate and water level; According to the acquisition time, the historical hydrological data collected at the same time are marked as a data group, where there are flow velocity, flow direction, flow rate and water level data collected at the same time in one data group; Then, in chronological order, the data groups in historical hydrological data are arranged in a position in order from far to near to obtain a data sequence; S12: Set the first data group in the data sequence as the starting data point. Starting from the starting data point, subtract data group (i-1) from data group i to obtain the differential data of data group i, where i∈[1,n], n represents the total number of remaining data groups in the data sequence except the starting data point. Further, set the data group of the starting data point to data group 0. When i takes the value of 1, data group 1 is subtracted from data group 0 to obtain the differential data of data group 1.

4. The method for analyzing water flow state of a ship lock channel based on big data analysis according to claim 3 is characterized in that: The methods for determining key influencing parameters include: Obtain the ship's operating status of the selected lock channel, and correspond to the ship's operating status with the data set according to time relationship, where the ship's operating status refers to the ship's passing speed; In chronological order, the operating status of the ship is processed according to the calculation method of differential data to obtain the differential status; The differential data and differential state are obtained at the same time, and the differential data and differential state of the same data group are matched one by one according to the data group. Each data in the differential data is correlated with the differential state in turn to obtain the data correlation value, and then in the same data group, the maximum value of the data correlation value is taken as the key influencing parameter of this data group.

5. The method for analyzing water flow state of a ship lock channel based on big data analysis according to claim 3 is characterized in that: In the data group collected at the same time, based on the different unit collection times, there are multiple data collected by different unit collection times. At the same time, when calculating the differential data, it is necessary to first perform mean processing on the data in the data group according to the parameter type, and then perform difference calculation on the data after mean processing to obtain differential data.

6. The method for analyzing water flow status of a ship lock channel based on big data analysis according to claim 1 is characterized in that: The calculation method of the node weights of key influencing parameters includes: SS1: Select a data scenario at random and mark it as the target analysis environment. Obtain the single item data set corresponding to the target analysis environment. First use the formula The data in the single-item data set are normalized, where b represents different types of parameters in the single-item data set. Furthermore, b represents flow velocity, flow direction, flow rate, and water level, and j represents the specific value of parameter b. represents the minimum value in parameter b, Indicates the maximum value in parameter b; SS2: After the normalization process is completed, the mean and standard deviation of the parameter b in each data group are calculated according to the data group to obtain the parameter mean Pb and parameter standard deviation Bb; SS3: Utilizing formulas Calculate the coefficient of variation CVb of parameter b in each data group, and obtain the coefficient of variation CVg of the key influencing parameters, where g∈b, and again use the formula The node weight Qm of the key influencing parameter is calculated, where r represents the total label value of parameter b, and m in the node weight Qm represents different data groups.

7. The method for analyzing water flow status of a ship lock channel based on big data analysis according to claim 6 is characterized in that: The method for obtaining the weight change function of the key influencing parameters includes: The parameter b in the target analysis environment is set as the independent variable, and the node weight Qm is set as the dependent variable. Then, the linear regression model is used to transfer the independent variable and the dependent variable to the linear regression model respectively, and data training is performed to establish a multivariate linear regression model. ,in, represents the intercept, represents the error term, , , as well as is the regression coefficient, D1, D2, D3 and D4 are the data after normalization by parameter b.

8. The water flow state analysis method of a ship lock channel based on big data analysis according to claim 1, characterized in that, The method for obtaining the real-time weight coefficient includes: The hydrological data and environmental data in the ship lock channel are collected in real time. First, based on the real-time collected environmental data, the real-time collected environmental data is searched in the scenario data of the single item data set, and the matched scenario data is set as the real-time target data; The weight change function corresponding to the real-time target data is obtained, and the real-time collected environmental data is input into the weight change function to obtain the real-time weight coefficient of the key influencing parameters.

Images