Self-adaptive data acquisition, analysis and storage system and method

Abstract

The invention provides a self-adaptive data acquisition, analysis and storage system and method, relates to the technical field of data acquisition, and is applied to a detector in a pipeline, the system comprises a data acquisition module arranged in the data acquisition system, the data acquisition module is in communication connection with a sensor, and the sensor is in communication connection with the data acquisition module; the data acquisition module is configured to acquire detection data acquired by the sensor; the self-adaptive module is in communication connection with the sensors, the self-adaptive module is electrically connected with the data acquisition module, and the self-adaptive module is configured to obtain the number and the types of the sensors; and controlling the data acquisition module to acquire the detection data acquired by the sensors according to the quantity and the types of the sensors according to the quantity and the types of the sensors, so as to solve the problem that the acquisition and storage methods of the current acquisition and storage system are used for performing acquisition and storage according to the maximum quantity of the sensors; and a large amount of junk data can be stored.

Description

Technical Field

[0001] The present application relates to the field of data acquisition technology, and in particular to an adaptive data acquisition, analysis and storage system and method. Background Art

[0002] The electronic part of the pipeline detector mainly includes data acquisition and storage system and sensors.

[0003] The pipeline detector transmits the image, data or signal inside the pipeline in real time through the sensor, and stores it through the data acquisition system to help operators understand the conditions inside the pipeline, including but not limited to corrosion, cracks, blockage, leakage and other problems.

[0004] Each data acquisition and storage system has a certain maximum number of sensors that can be collected. Different caliber detectors carry different numbers of sensors. If the detectors store data according to the maximum number of sensors they are configured with, although it simplifies the electronic program design, the acquisition and storage system stores a large amount of junk data, increasing the time and cost of data storage and analysis. Summary of the invention

[0005] The present application provides an adaptive data acquisition, analysis and storage system and method to solve the technical problem that the acquisition and storage methods of existing acquisition and storage systems all perform acquisition and storage according to the maximum number of sensors, resulting in the storage of a large amount of garbage data.

[0006] In a first aspect, the present application provides an adaptive data acquisition, analysis and storage system, which is applied to an in-pipe detector, wherein the in-pipe detector comprises: at least one sensor; a data acquisition system, wherein the data acquisition system is communicatively connected to the sensor; the number of each type of the sensors is less than or equal to the set number of sensors that the data acquisition system can communicate with; the data acquisition system is configured to: obtain detection data collected by the sensor according to the set number; and comprises:

[0007] Provided in the data acquisition system:

[0008] A data acquisition module, the data acquisition module is in communication with the sensor and is configured to:

[0009] Acquiring detection data collected by the sensor;

[0010] An adaptive module, wherein the adaptive module is communicatively connected to the sensor, and the adaptive module is electrically connected to the data acquisition module, and is configured as follows:

[0011] Obtaining the quantity and type of the sensors;

[0012] According to the number and type of the sensors, the data acquisition module is controlled to acquire the detection data collected by the sensors according to the number and type of the sensors.

[0013] In some embodiments, the adaptation module is further configured to:

[0014] Sending a query command to the sensor and receiving response data returned by the sensor;

[0015] The quantity and type of the sensors are acquired according to the response data.

[0016] In some embodiments, the adaptation module is further configured to:

[0017] According to the number and type of the sensors, the target number of bytes of detection data to be collected by the sensors within a preset time is obtained;

[0018] The data acquisition system is controlled to obtain the detection data collected by the sensor according to the target number of bytes.

[0019] In some embodiments, the system further comprises:

[0020] Provided in the data acquisition system:

[0021] A data storage module is electrically connected to the data acquisition module and is configured as follows:

[0022] The detection data sent by the data acquisition module is stored.

[0023] In some embodiments, the system further comprises:

[0024] Provided in the data acquisition system:

[0025] A data pre-analysis module, the data pre-analysis module is electrically connected to the adaptive module and the data storage module, and is configured as follows:

[0026] Acquire the detection data stored in the data storage module;

[0027] According to the detection data, defect information of the pipeline to be tested is obtained; the defect information includes: the specific location of the defect, and the length, width and depth of the defect in the pipeline to be tested;

[0028] The adaptive module is further configured to:

[0029] According to the type of the sensor, setting the operating parameters of the data pre-analysis module;

[0030] The data pre-analysis module is controlled to run with the operating parameters, and after the analysis of the detection data corresponding to the operating parameters is completed, the operating parameters of the data pre-analysis module are set in sequence according to the types of the remaining sensors, until the data pre-analysis module completes the analysis of all the detection data stored in the data storage module to obtain the defect information of the pipeline to be tested.

[0031] In some embodiments, the data pre-analysis module is further configured to:

[0032] The detection data is preprocessed; the preprocessing operation includes: filling missing values ​​in the detection data, and processing abnormal values ​​and noise in the detection data.

[0033] In some embodiments, the adaptation module is further configured to:

[0034] The sensor type information is obtained and stored in a database; the sensor type information includes: the type of the sensor, and the detection data collected by the sensor corresponding to the operating parameters of the data pre-analysis module.

[0035] A second aspect of the present application provides an adaptive data collection, analysis and storage method, which is applied to an adaptive data collection, analysis and storage system as described in any one of the first aspects above, including:

[0036] Sending a query command to a sensor and receiving response data returned by the sensor;

[0037] According to the response data, obtaining the quantity and type of the sensors;

[0038] According to the number and type of the sensors, the target number of bytes of detection data to be collected by the sensors within a preset time is obtained;

[0039] The data acquisition system is controlled to obtain the detection data collected by the sensor according to the target number of bytes.

[0040] In some embodiments, the method for adaptive data collection, analysis and storage further includes:

[0041] The data pre-analysis module is controlled to operate with the operating parameters. After the analysis of the detection data corresponding to the operating parameters is completed, the operating parameters of the data pre-analysis module are set in sequence according to the types of the remaining sensors, until the data pre-analysis module completes the analysis of all the detection data stored in the data storage module, and obtains the defect information of the pipeline to be tested; the defect information includes: the specific location where the defect occurs, and the length, width and depth of the defect in the pipeline to be tested.

[0042] The present application provides an adaptive data acquisition, analysis and storage system and method, which are applied to an in-pipe detector, wherein the in-pipe detector comprises: at least one sensor; a data acquisition system, the data acquisition system is communicatively connected to the sensor; the number of each sensor is less than or equal to the set number of corresponding sensors that the data acquisition system can communicate with; the data acquisition system is configured to: obtain detection data collected by the sensor according to the set number; the system comprises: a data acquisition module arranged in the data acquisition system, the data acquisition module is communicatively connected to the sensor, and is configured to: obtain detection data collected by the sensor; an adaptive module, the adaptive module is communicatively connected to the sensor, the adaptive module is electrically connected to the data acquisition module, and is configured to: obtain the number and type of sensors; according to the number and type of sensors, the data acquisition module is controlled to obtain the detection data collected by the sensor according to the number and type of sensors, so as to realize that the acquisition and storage system can perform data acquisition and storage according to the actual number of sensors, and ensure that all stored data are valid data. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0044] Figure 1 This is a schematic diagram of the structure of the adaptive data acquisition, analysis and storage system in this application;

[0045] Figure 2 This is a schematic diagram of defect information of the pipeline to be tested in this application.

[0046] Description of reference numerals:

[0047] 1-Sensor; 2-Data acquisition system; 3-Data acquisition module; 4-Adaptive module; 5-Data storage module; 6-Data pre-analysis module. DETAILED DESCRIPTION

[0048] In order to enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0049] Since in some technologies, the collection and storage methods of the collection and storage system are all based on the maximum number of sensors for collection and storage, a large amount of garbage data will be stored. In order to solve this technical problem, the present application provides an adaptive data collection, analysis and storage system and method. The adaptive data collection, analysis and storage system and method are described below:

[0050] For example, the electronic part of the current pipeline detector mainly includes a data acquisition storage system and sensors. Each data acquisition storage system can collect a certain number of sensors at most, and the number of sensors carried by different caliber detectors is also different. If data is stored according to the maximum number of sensors, although the electronic program design is simplified, a large amount of garbage data is stored, which increases the time and cost of data storage and analysis.

[0051] Exemplarily, a certain type of data acquisition system can collect data from up to 160 magnetic flux leakage sensors, 120 diameter measuring sensors, 20 stress sensors, and 3 mileage sensors. A certain type of equipment is only equipped with 80 magnetic flux leakage sensors, 80 diameter measuring sensors, 8 stress sensors, and 3 mileage sensors. If the data acquisition system stores data according to the maximum number of sensors that can be collected, it is obvious that a lot of invalid data is stored, and invalid data corresponding to 80 magnetic flux leakage sensors, 40 diameter measuring sensors, and 12 stress sensors are stored. Among them, the invalid data corresponds to the position in the data acquisition system where there is no communication connection with the sensor. Although no sensor is connected, the data will be stored normally. It can be understood that the invalid data is blank data with no actual content but will occupy the storage space of the data acquisition system. On the one hand, it increases the storage time of the data acquisition system. On the other hand, the amount of data is increased due to the inclusion of invalid data in the data, which increases the subsequent analysis time and cost.

[0052] Depend on Figure 1 It can be seen that the first aspect of the present application provides an adaptive data acquisition, analysis and storage system, which is applied to an in-pipeline detector, and the in-pipeline detector includes: at least one sensor 1; a data acquisition system 2, and the data acquisition system 2 is communicatively connected to the sensor 1; the number of each type of sensor 1 is less than or equal to the set number of sensors 1 that the data acquisition system 2 can communicate with; the data acquisition system 2 is configured to: obtain the detection data collected by the sensor 1 according to the set number; the sensor 1 includes: leakage magnetic sensor, diameter measurement sensor, stress sensor, IDOD, mileage sensor, etc.

[0053] For example, each data acquisition system has a certain collection and storage capacity. In daily use, the data acquisition system will not acquire sensor data exceeding the maximum number of sensors it can receive. For example, if the data acquisition system can collect data collected by 160 magnetic flux leakage sensors, it will not be used in an environment with more than 160 magnetic flux leakage sensors. It can only be backward compatible, not upward compatible. If the number of collected sensors exceeds the number of data acquisition systems equipped, it is necessary to replace the data acquisition system with a stronger collection capability.

[0054] The system includes: a data acquisition module 3 arranged in the data acquisition system 2, the data acquisition module 3 is communicatively connected to the sensor 1, and is configured to: obtain the detection data collected by the sensor 1; an adaptive module 4, the adaptive module 4 is communicatively connected to the sensor 1, the adaptive module 4 is electrically connected to the data acquisition module 3, and is configured to: obtain the number and type of the sensors 1; according to the number and type of the sensors 1, control the data acquisition module 3 to obtain the detection data collected by the sensors 1 according to the number and type of the sensors 1. The present application obtains the number and type of sensors 1 through the adaptive module 4. For example, the data acquisition module 3 can collect data from up to 160 magnetic flux leakage sensors, 120 diameter measuring sensors, 20 stress sensors, and 3 mileage sensors. A certain type of equipment is equipped with 80 magnetic flux leakage sensors, 80 diameter measuring sensors, 8 stress sensors, and 3 mileage sensors. The adaptive module 4 controls the data acquisition module 3 to only collect data obtained by 80 magnetic flux leakage sensors, 80 diameter measuring sensors, 8 stress sensors, and 3 mileage sensors. In addition, the data acquisition module 3 will not store invalid data corresponding to the 80 magnetic flux leakage sensors, 40 diameter measuring sensors, and 12 stress sensors of the data acquisition module 3. The system provided by the present application can collect data according to the actual number of sensors to ensure that the collected data is valid. There is no need to perform special configuration for different detectors. The collection system can be adapted to a variety of detectors, greatly reducing the workload of designers.

[0055] In this embodiment, the adaptive module 4 is further configured to: send a query instruction to the sensor 1 and receive the response data returned by the sensor 1; according to the response data, obtain the number and type of the sensor 1. By sending the query instruction and receiving the returned response data, it can be understood that the response data returned by each sensor 1 is different, wherein the response data can be configuration information, etc., for example: the leakage magnetic sensor collects leakage magnetic data, the stress sensor collects stress data, etc.; the type information of the sensor is obtained by different configurations and functions of different types of sensors; the type information can usually be obtained by querying a specific register or sending a specific command. Some sensors may directly contain type information in their response data, or the type information may be determined by certain parameters or configurations preset by the manufacturer. The quantity information is determined according to the number of response data. Each sensor 1 only returns one response data after receiving the query instruction, so the number of sensors 1 can be determined according to the number of response data.

[0056] In this embodiment, the adaptive module 4 is further configured to: obtain the target number of bytes of detection data to be collected by the sensor 1 within a preset time according to the number and type of the sensor 1; control the data acquisition system 2 to obtain the detection data collected by the sensor 1 according to the target number of bytes.

[0057] Exemplarily, the following embodiment 1 is a data format of 100ms in a data acquisition system in the prior art, wherein 100ms is regarded as 1 frame in the following embodiment;

[0058]

[0059]

[0060] Example 2 below is the data format of 100ms of the data acquisition system in this application:

[0061] Example 2 Number of bytes Number Sampling frequency Frame Header 136 1 1 Magnetic flux leakage sensor 48 80 500 Diameter sensor 2 80 500 Strain Sensors 4 9 500 IDOD 4 0 500 Mileage sensor 8 3 800 2037336

[0062] The data acquisition system 2 stores a maximum of sensor data by default, such as 4037336 bytes for one frame in Example 1; after starting the adaptive module 4, the data format will be reorganized according to the actual number of sensors 1, and stored according to the actual number of bytes of one frame, that is, 2037336 bytes for one frame in Example 2. If the data is stored according to 4037336 bytes, 2000000 bytes of data will be stored more, which will cause a large amount of invalid data in the collected data, and increase the subsequent analysis time and cost; if the detection data of sensor 1 is obtained according to the target number of bytes, that is, 2037336 bytes, no redundant invalid data will be stored, and the detection data of the sensor 1 will be obtained according to the actual number of data bytes collected by sensor 1, that is, the target number of bytes; ensuring that the collected data are valid will greatly reduce the amount of data storage; storing according to this standard is also convenient for subsequent data processing and analysis.

[0063] Depend on Figure 1 It can be seen that the system also includes: a data storage module 5 arranged in the data acquisition system 2, the data storage module 5 is electrically connected to the data acquisition module 3, and is configured to store the detection data sent by the data acquisition module 3. Since the amount of detection data acquired is large, it cannot be received and analyzed by the data pre-analysis module 6 at the same time, and the acquired data comes from different types of sensors 1, so the data formats will be different to a certain extent. The data pre-analysis module 6 cannot analyze data of different formats at the same time, so it is necessary to first store the acquired detection data in the data storage module 5, and wait until the operating parameters of the data pre-analysis module 6 meet the corresponding detection data, before gradually analyzing the detection data of the corresponding type.

[0064] Depend on Figure 1 It can be seen that the system also includes: a data pre-analysis module 6 arranged in the data acquisition system 2, the data pre-analysis module 6 is electrically connected to the adaptive module 4 and the data storage module 5, and is configured to: obtain the detection data stored in the data storage module 5; obtain the defect information of the pipeline to be tested according to the detection data; the defect information includes: the specific location where the defect occurs, and the length, width and depth of the defect corresponding to the pipeline to be tested. After the current data acquisition system collects and stores data, it generally needs to be downloaded to the data analysis software for processing to obtain the basic information and status of the pipeline to provide a basis for the next step of detection. According to regulations, a rough report is generally issued within 7 days. Sometimes, in order to meet the construction schedule and the detection window, 7 days is longer. Therefore, in response to the above problems, the present application is provided with a data pre-analysis module 6 that can pre-analyze the detection data stored in the data storage module 5 to obtain the defect information of the pipeline to be tested, such as Figure 2As shown, the operator can export the defect information at any time without downloading it to the data analysis software, so that the preliminary test results can be obtained at the end of the test, providing timely reference for the next test; avoiding the phenomenon that the test results are obtained in a long time and the construction period is affected.

[0065] Exemplarily, the purpose of the in-pipe detector is to obtain defect information of the pipeline to be tested based on the detection data. The in-pipe detector is usually equipped with a variety of sensors, such as leakage magnetic sensors, mechanical sensors (for deformation detection), inertial measurement units (IMU, for pipeline direction mapping), etc. The above sensors can collect various types of information such as leakage magnetic detection data, deformation detection data, pipeline direction mapping data, etc. Specifically, by analyzing the leakage magnetic field signal obtained by the leakage magnetic sensor, the defect information such as corrosion, mechanical damage, manufacturing defects, and weld abnormalities on the pipeline can be identified; the usage of other types of sensors is not detailed here.

[0066] For example, the defect information of the pipeline to be tested is as follows: Figure 2 As shown, the time sampling represents the specific location where the defect occurs, that is, the specific location of the detector in the pipeline, the axial mileage represents the axial mileage of the detector in the pipeline, the upstream weld number represents the weld position in the pipeline to be tested, and the distance relative to the upstream weld is the distance relative to the upstream weld with the corresponding number. The specific location of the defect can be confirmed by the above data. The actual value of the defect represents the length, width and depth of the defect in the pipeline to be tested; the above data can be obtained by image sensors, etc., and will not be described in detail here. The specific location of the defect and the length, width and depth of the defect in the pipeline to be tested can be confirmed by the defect information of the pipeline to be tested.

[0067] In this embodiment, the adaptive module 4 is further configured to: set the operating parameters of the data pre-analysis module 6 according to the type of the sensor 1; control the data pre-analysis module 6 to operate with the operating parameters, and after the analysis of the detection data corresponding to the operating parameters is completed, set the operating parameters of the data pre-analysis module 6 according to the types of the remaining sensors 1 in turn, until the data pre-analysis module 6 has completed the analysis of all the detection data stored in the data storage module 5 to obtain the defect information of the pipeline to be tested. It can be understood that the detection data format acquired by each sensor 1 is different. For example, the leakage magnetic sensor collects leakage magnetic data, and the stress sensor collects stress data. Therefore, the present application gradually sets the operating parameters of the data pre-analysis module 6 according to the type of sensor 1 through the adaptive module 4. For example, the data acquisition system 2 collects the detection data of the leakage magnetic sensor, the diameter measuring sensor, the stress sensor, and the mileage sensor. The operating parameters of the data pre-analysis module 6 are set to the operating parameters corresponding to the leakage magnetic sensor through the adaptive module 4, and the leakage magnetic data is analyzed. After the leakage magnetic data analysis is completed, the operating parameters of the data pre-analysis module 6 are set to the operating parameters corresponding to the diameter measuring sensor. After the diameter measuring data analysis is completed, the operating parameters of the data pre-analysis module 6 are gradually converted until the detection data collected by all types of sensors 1 are analyzed.

[0068] In this embodiment, the data pre-analysis module 6 is further configured to: perform preprocessing operations on the detection data; the preprocessing operations include: filling missing values ​​in the detection data, and processing abnormal values ​​and noise in the detection data. The missing values ​​in the detection data are filled by a filling method, using statistics (such as mean, median, mode) or model prediction values ​​to fill missing values; the noise in the detection data is processed by identifying and processing the noise in the data through binning, regression, clustering and other methods; the abnormal values ​​in the detection data are processed by identifying and processing extreme values ​​or unreasonable values ​​in the data, usually by setting thresholds or judging based on statistical methods, so as to replace or delete them.

[0069] In this embodiment, the adaptive module 4 is further configured to: obtain sensor type information and store it in a database; the sensor type information includes: the type of the sensor 1, and the detection data collected by the sensor 1 corresponds to the operating parameters of the data pre-analysis module 6. It can be understood that the types and models of sensors 1 are updated or upgraded every year. In this application, the sensor type information can be updated or added through the adaptive module 4 and stored in its database, so that it can be adapted to sensors 1 of any type.

[0070] The second aspect of the present application provides an adaptive data acquisition, analysis and storage method, which is applied to an adaptive data acquisition, analysis and storage system described in any of the above embodiments, including: sending a query instruction to a sensor and receiving the response data returned by the sensor; obtaining the number and type of the sensor according to the response data; obtaining the target number of bytes of the detection data to be collected by the sensor within a preset time according to the number and type of the sensor; and controlling the data acquisition system to obtain the detection data collected by the sensor according to the target number of bytes. The effects of the above method embodiments can refer to the effects of the above system embodiments.

[0071] In this embodiment, the adaptive data acquisition, analysis and storage method further includes: controlling the data pre-analysis module to operate with the operating parameters, and after the analysis of the detection data corresponding to the operating parameters is completed, setting the operating parameters of the data pre-analysis module in turn according to the types of the remaining sensors, until the data pre-analysis module analyzes all the detection data stored in the data storage module, and obtains the defect information of the pipeline to be tested; the defect information includes: the specific location of the defect, and the length, width and depth of the defect in the pipeline to be tested. The effects of the above method embodiment can refer to the effects of the above system embodiment.

Claims

1. An adaptive data acquisition, analysis and storage system, applied to an in-pipeline detector, the in-pipeline detector comprising: at least one sensor (1); A data acquisition system (2), wherein the data acquisition system (2) is communicatively connected to the sensors (1); the number of each type of sensors (1) is less than or equal to a set number of corresponding sensors (1) that the data acquisition system (2) can communicatively connect; the data acquisition system (2) is configured to: obtain detection data collected by the sensors (1) according to the set number; and is characterized by comprising: Arranged in the data acquisition system (2): A data acquisition module (3), the data acquisition module (3) is in communication with the sensor (1) and is configured to: Acquiring detection data collected by the sensor (1); An adaptive module (4), the adaptive module (4) is communicatively connected to the sensor (1), the adaptive module (4) is electrically connected to the data acquisition module (3), and is configured as follows: Obtaining the number and type of the sensors (1); According to the number and type of the sensors (1), the data acquisition module (3) is controlled to acquire the detection data collected by the sensors (1) according to the number and type of the sensors (1).

2. The adaptive data acquisition, analysis and storage system according to claim 1, characterized in that: The adaptive module (4) is further configured to: Sending a query command to the sensor (1) and receiving response data returned by the sensor (1); The number and type of the sensors (1) are obtained based on the response data.

3. The adaptive data acquisition, analysis and storage system according to claim 1, characterized in that: The adaptive module (4) is further configured to: According to the number and type of the sensors (1), a target number of bytes of detection data to be collected by the sensors (1) within a preset time is obtained; The data acquisition system (2) is controlled to obtain the detection data collected by the sensor (1) according to the target number of bytes.

4. The adaptive data acquisition, analysis and storage system according to claim 1, characterized in that: The system further comprises: Arranged in the data acquisition system (2): A data storage module (5), the data storage module (5) is electrically connected to the data acquisition module (3), and is configured as follows: The detection data sent by the data acquisition module (3) is stored.

5. The adaptive data acquisition, analysis and storage system according to claim 4, characterized in that: The system further comprises: Arranged in the data acquisition system (2): A data pre-analysis module (6), the data pre-analysis module (6) is electrically connected to the adaptive module (4) and the data storage module (5), and is configured as follows: Acquire the detection data stored in the data storage module (5); According to the detection data, defect information of the pipeline to be tested is obtained; the defect information includes: the specific location of the defect, and the length, width and depth of the defect in the pipeline to be tested; The adaptive module (4) is further configured to: Setting the operating parameters of the data pre-analysis module (6) according to the type of the sensor (1); The data pre-analysis module (6) is controlled to operate with the operating parameters, and after the analysis of the detection data corresponding to the operating parameters is completed, the operating parameters of the data pre-analysis module (6) are set in sequence according to the types of the remaining sensors (1), until the data pre-analysis module (6) has completed the analysis of all the detection data stored in the data storage module (5), thereby obtaining defect information of the pipeline to be tested.

6. The adaptive data acquisition, analysis and storage system according to claim 5, characterized in that: The data pre-analysis module (6) is further configured to: The detection data is preprocessed; the preprocessing operation includes: filling missing values ​​in the detection data, and processing abnormal values ​​and noise in the detection data.

7. The adaptive data acquisition, analysis and storage system according to claim 5, characterized in that: The adaptive module (4) is further configured to: Sensor type information is obtained and stored in a database; the sensor type information includes: the type of the sensor (1), and the operating parameters of the data pre-analysis module (6) corresponding to the detection data collected by the sensor (1).

8. An adaptive data collection, analysis and storage method, applied to an adaptive data collection, analysis and storage system as claimed in any one of claims 1 to 7, characterized in that: include: Sending a query command to a sensor and receiving response data returned by the sensor; According to the response data, obtaining the quantity and type of the sensors; According to the number and type of the sensors, the target number of bytes of detection data to be collected by the sensors within a preset time is obtained; The data acquisition system is controlled to obtain the detection data collected by the sensor according to the target number of bytes.

9. The method for adaptive data collection, analysis and storage according to claim 8, characterized in that: Also includes: Controlling the data pre-analysis module to operate with the operating parameters, and after the analysis of the detection data corresponding to the operating parameters is completed, setting the operating parameters of the data pre-analysis module in turn according to the types of the remaining sensors, until the data pre-analysis module completes the analysis of all the detection data stored in the data storage module, and obtains the defect information of the pipeline to be tested; The defect information includes: the specific location where the defect occurs, and the length, width and depth of the defect in the pipeline to be tested.

Images