Oil field water quality on-line detection system database design method

Abstract

The invention discloses an oil field water quality on-line detection system database design method, which comprises the following steps: 1) database selection and configuration: configuring a corresponding database according to system stability and data security, and carrying out regular data backup on water quality data; 2) data verification, wherein cyclic redundancy verification and MD5 verification are adopted to verify the correctness of data transmission; 3) data packaging and caching: for the received water quality data information in the sensor module, packaging different types of sensor data information into corresponding fixed frame formats; 4) designing a data model, establishing water quality classification meeting standards for the received water quality data transmitted by the remote monitoring equipment, and classifying the water quality data; 5) data encryption and decryption; and (6) data transmission: performing data transmission and access by adopting high-concurrency optimization processing. According to the invention, database management is carried out on the water quality indexes of the water injection detection points, so that data sharing and data independence are realized, and the redundancy of water quality data is reduced.

Description

Technical Field

[0001] The present invention relates to oilfield water quality detection technology, in particular to a database design method for an oilfield water quality online detection system. Background Art

[0002] Oilfield water quality management usually adopts manual testing and report writing mode after data aggregation. Data management is very chaotic and query is difficult. There are problems such as untimely water quality analysis, insufficient analysis capabilities, and delayed analysis results, which is far from meeting the requirements of fine water injection. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a database design method for an oilfield water quality online detection system in view of the defects in the prior art.

[0004] The technical solution adopted by the present invention to solve the technical problem is: a method for designing a database for an oilfield water quality online detection system, comprising the following steps:

[0005] 1) Database selection and configuration: configure the corresponding database according to system stability and data security, and perform regular data backup of water quality data;

[0006] When configuring the database, formulate quality control rules for new data entering the database, including:

[0007] Establish constraint rules for fields and set an appropriate critical condition for each field. If the data is not within the threshold range, it will not be allowed to enter the database;

[0008] Establish field association rules. If there is a conflict between the attribute values ​​of the related fields, the data will not be allowed to be stored.

[0009] Establish association rules between tables, clarify the relationships between data tables with complete correspondence, and ensure mutual standardization between tables;

[0010] Establish correlation rules between various processes, clarify the correlation relationship between data of different processes, and ensure that the data of each process are independent of each other but coordinated with each other;

[0011] 2) Data verification: cyclic redundancy check and MD5 check are used to verify the correctness of data transmission;

[0012] The CRC (Cyclic Redundancy Check) technology is used to detect errors using the principle of division and remainder. The received code group is divided. If the division is complete, it means that the transmission is correct. If it is not complete, it means that there is an error in the transmission. The CRC checker also has the ability to automatically correct errors.

[0013] The CRC cyclic redundancy check (CRC) technology is characterized by: converting a generating polynomial G(x) with the highest power of x being R into a corresponding R+1-bit binary number, shifting the information code left by R bits, which is equivalent to the corresponding information polynomial C(x)*2R, performing a modulo-2 division on the information code using the generating polynomial (binary number) to obtain an R-bit remainder, and concatenating the remainder into the position vacated by the left-shifted information code to obtain a complete CRC code;

[0014] 3) Data packaging and caching: for receiving water quality data information from the sensor module, different types of sensor data information are packaged into corresponding fixed frame formats;

[0015] 4) Design a data model to establish a water quality classification that meets the standards for the water quality data transmitted by the remote monitoring equipment, and store the water quality data after classification;

[0016] Water quality data is classified based on the BP neural network water quality classification model. The input layer of the neural network is set to 3 nodes, corresponding to the online detection index, conventional detection water quality index and portable water quality detection index; the output layer is set to 6 nodes; the intermediate hidden layer is set to 10-50 layers;

[0017] 5) Data encryption and decryption;

[0018] Using an asymmetric encryption algorithm, the public key value is used to encrypt messages, and the private key value is used to decrypt messages. Messages encrypted with a public key can only be decrypted with the corresponding private key. The public key is sent through an insecure channel or published in a directory.

[0019] 6) Data transmission, using multiple methods for high concurrency optimization processing;

[0020] When using cache, data that is not in the cache is extracted from the database when data is sent, and then saved as the latest data in the cache;

[0021] Use stored procedures to integrate operations that require multiple database accesses to process a request into stored procedures to reduce the number of database accesses.

[0022] Batch reading: In high concurrency situations, multiple requests are merged into one query to reduce the number of database accesses.

[0023] Delayed modification: In high concurrency situations, multiple modification requests are first saved in the cache, and then the data in the cache is saved to the database at regular intervals.

[0024] Use indexes as special caches;

[0025] Separate active data and save data that needs to be queried frequently into an active table. When querying, query the active table first. If no results are found, check the general table to improve query efficiency.

[0026] The beneficial effects produced by the present invention are:

[0027] The present invention collects and systematically analyzes the detection data of water quality indicators (online detection indicators, conventional detection water quality indicators and portable water quality detection indicators) at water injection detection points, performs database management, realizes data sharing and data independence, and reduces the redundancy of water quality data, so that the water quality data that was previously managed in a decentralized manner is centrally controlled and managed, and realizes the organization of various data and the connection between data through data models, thereby realizing stable and precise water injection water quality management. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The present invention will be further described below with reference to the accompanying drawings and embodiments, in which:

[0029] Figure 1 is a flow chart of a method according to an embodiment of the present invention;

[0030] Figure 2 This is a data warehousing quality control rule diagram according to an embodiment of the present invention;

[0031] Figure 3 2 is a structural diagram of a neural network model according to an embodiment of the present invention. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0033] like Figure 1 As shown, a method for designing a database for an oilfield water quality online detection system includes the following steps:

[0034] 1) Database selection and configuration: configure the corresponding database according to system stability and data security, and perform regular data backup of water quality data;

[0035] like Figure 2 When configuring the database, formulate quality control rules for new data entering the database, including:

[0036] Establish constraint rules for fields and set an appropriate critical condition for each field. If the data is not within the threshold range, it will not be allowed to enter the database;

[0037] Establish field association rules. If there is a conflict between the attribute values ​​of the related fields, the data will not be allowed to be stored.

[0038] Establish association rules between tables, clarify the relationships between data tables with complete correspondence, and ensure mutual standardization between tables;

[0039] Establish correlation rules between various processes, clarify the correlation relationship between data of different processes, and ensure that the data of each process are independent of each other but coordinated with each other;

[0040] 2) Data verification: cyclic redundancy check and MD5 check are used to verify the correctness of data transmission;

[0041] The CRC (Cyclic Redundancy Check) technology is used to detect errors using the principle of division and remainder. The received code group is divided. If the division is complete, it means that the transmission is correct. If it is not complete, it means that there is an error in the transmission. The CRC checker also has the ability to automatically correct errors.

[0042] The CRC cyclic redundancy check (CRC) technology is characterized by: converting a generating polynomial G(x) with the highest power of x being R into a corresponding R+1-bit binary number, shifting the information code left by R bits, which is equivalent to the corresponding information polynomial C(x)*2R, performing a modulo-2 division on the information code using the generating polynomial (binary number) to obtain an R-bit remainder, and concatenating the remainder into the position vacated by the left-shifted information code to obtain a complete CRC code;

[0043] 3) Data packaging and caching: for receiving water quality data information from the sensor module, different types of sensor data information are packaged into corresponding fixed frame formats;

[0044] 4) Design a data model to establish a water quality classification that meets the standards for the water quality data transmitted by the remote monitoring equipment and classify the water quality data;

[0045] like Figure 3 , based on the BP neural network water quality classification model, the water quality data is classified. The input layer of the neural network is set to 3 nodes, corresponding to the online detection index, conventional detection water quality index and portable water quality detection index; the output layer is set to 6 nodes; the middle hidden layer is set to 10-50 layers;

[0046] 5) Data encryption and decryption;

[0047] Using an asymmetric encryption algorithm, the public key value is used to encrypt messages, and the private key value is used to decrypt messages. Messages encrypted with a public key can only be decrypted with the corresponding private key. The public key is sent through an insecure channel or published in a directory.

[0048] 6) Data transmission, using multiple methods for high concurrency optimization processing;

[0049] When using cache, data that is not in the cache is extracted from the database when data is sent, and then saved as the latest data in the cache;

[0050] Use stored procedures to integrate operations that require multiple database accesses to process a request into stored procedures to reduce the number of database accesses.

[0051] Batch reading: In high concurrency situations, multiple requests are merged into one query to reduce the number of database accesses.

[0052] Delayed modification: In high concurrency situations, multiple modification requests are first saved in the cache, and then the data in the cache is saved to the database at regular intervals.

[0053] Use indexes as special caches;

[0054] Separate active data and save data that needs to be queried frequently into an active table. When querying, query the active table first. If no results are found, check the general table to improve query efficiency.

[0055] It should be understood that those skilled in the art can make improvements or changes based on the above description, and all such improvements and changes should fall within the scope of protection of the appended claims of the present invention.

Claims

1. A method for designing a database for an oilfield water quality online detection system, characterized in that: The following steps are involved: 1) Database selection and configuration: configure the corresponding database according to system stability and data security, and perform regular data backup of water quality data; When configuring the database, formulate quality control rules for new data entering the database, including: Establish constraint rules for fields and set an appropriate critical condition for each field. If the data is not within the threshold range, it will not be allowed to enter the database; Establish field association rules. If there is a conflict between the attribute values ​​of the related fields, the data will not be allowed to be stored. Establish association rules between tables, clarify the relationships between data tables with complete correspondence, and ensure mutual standardization between tables; Establish correlation rules between various processes, clarify the correlation relationship between data of different processes, and ensure that the data of each process are independent of each other but coordinated with each other; 2) Data verification: cyclic redundancy check and MD5 check are used to verify the correctness of data transmission; 3) Data packaging and caching: for receiving water quality data information from the sensor module, different types of sensor data information are packaged into corresponding fixed frame formats; 4) Design a data model to establish a water quality classification that meets the standards for the water quality data transmitted by the remote monitoring equipment and classify the water quality data; 5) Data encryption and decryption; 6) Data transmission: high concurrency optimization processing is used for data transmission and access.

2. The method for designing a database for an oilfield water quality online detection system according to claim 1, characterized in that: The CRC cyclic redundancy check uses the principle of division and remainder to perform error detection. The received code group is divided. If the division is complete, it means that the transmission is correct. If the division is not complete, it means that an error has occurred in the transmission and automatic error correction is performed.

3. The method for designing a database for an oilfield water quality online detection system according to claim 1, wherein: In the step 4), the water quality data is classified based on the BP neural network water quality classification model, and the input layer of the neural network is set to 3 nodes, corresponding to the online detection index, the conventional detection water quality index and the portable water quality detection index; the output layer is set to 6 nodes, corresponding to the water quality level; the intermediate hidden layer is set to 10-50 layers.

4. The method for designing a database for an oilfield water quality online detection system according to claim 1, wherein: In step 5), an asymmetric encryption algorithm is used, where the public key value is used to encrypt the message and the private key value is used to decrypt the message. The message encrypted with the public key can only be decrypted with the corresponding private key; the public key is sent through an insecure channel or published in a directory.

5. The method for designing a database for an oilfield water quality online detection system according to claim 1, wherein: In step 6), the following high-concurrency optimization process is used to send data: When using cache, data that is not in the cache is extracted from the database when data is sent, and then saved as the latest data in the cache.

6. The method for designing a database for an oilfield water quality online detection system according to claim 1, wherein: In step 6), the following high-concurrency optimization process is used for data access: Use stored procedures to integrate operations that require multiple database accesses to process a request into stored procedures to reduce the number of database accesses. Batch reading: In high concurrency situations, multiple requests are merged into one query to reduce the number of database accesses. Delayed modification: In high concurrency situations, multiple modification requests are first saved in the cache, and then the data in the cache is saved to the database at regular intervals. Use indexes as special caches; Separate active data and save data with a query frequency greater than a set value into an active table. When querying, query the active table first. If no data is found, query the general table to improve query efficiency.

Images