Full-intelligent pipeline detection report automatic generation system and method

Abstract

The invention discloses a full-intelligent pipeline detection report automatic generation system and method, and belongs to the technical field of pipeline detection. The full-intelligent pipeline detection report automatic generation system comprises a user side and a processor side, the user side comprises a data collection unit and a data processing unit, and the processor side comprises a report generation unit. The problem that a pipeline detection report cannot be automatically generated in the prior art is solved, the user side regularly collects the pipeline detection data obtained by the detection device and stores the pipeline detection data in the database, and a user sends a pipeline detection report generation request to the processor side according to the collected pipeline detection data; the collected pipeline detection data is processed and transmitted to the processor end, the processor end carries out report form construction on the processed pipeline detection data through the report template based on the generation request sent by the user, a final report document is generated and fed back to the user end, manual report generation is not needed, and therefore the accuracy of the report is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of pipeline detection, and in particular to a fully intelligent pipeline detection report automatic generation system and method. Background Art

[0002] Pipeline inspection is the inspection of buried pipelines during use. The main purpose of pipeline inspection reports is to evaluate the structural integrity of the pipe body. Pipeline inspection reports are generated by pipeline inspection data. The generated pipeline inspection reports are the basis for evaluating the structure of the pipe body. Therefore, the accuracy of pipeline inspection data is very important. However, the existing generation of pipeline inspection reports has the following problems. The traditional method relies on manually recording pipeline inspection data, and then manually filling in the key data to organize them into pipeline inspection reports. However, the manual method not only increases the workload of staff, but also manual recording and filling in can easily cause errors, making it impossible to generate accurate pipeline inspection reports, and thus unable to provide an accurate basis for the evaluation of the pipe body. Therefore, it does not meet the existing needs. For this reason, we propose a fully intelligent pipeline inspection report automatic generation system and method. Summary of the invention

[0003] The object of the present invention is to provide a fully intelligent pipeline inspection report automatic generation system and method. The user end collects the pipeline inspection data obtained by the detection device at a regular time and stores it in a database. The user sends a request for generating a pipeline inspection report to the processor end according to the collected pipeline inspection data. The collected pipeline inspection data is processed and transmitted to the processor end. The processor end constructs a report for the processed pipeline inspection data through a report template based on the generation request sent by the user, thereby generating a final report document and feeding it back to the user end, thereby solving the problems raised in the above-mentioned background technology.

[0004] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a fully intelligent pipeline inspection report automatic generation system, comprising a user end and a processor end, wherein the user end and the processor end are connected to each other, and the user sends a request for generating a pipeline inspection report to the processor end through the user end according to the collected pipeline inspection data, and the processor end generates a final report document using the collected pipeline inspection data through a report template according to the received generation request, and feeds back the generated final report document to the user end, wherein:

[0005] The user side includes:

[0006] A data collection unit is used to regularly collect pipeline detection data acquired by the detection device, and the collected pipeline detection data is stored in a database. The user selects the pipeline detection data stored in the database to send a request for generating a pipeline detection report to the processor end;

[0007] A data processing unit is used to retrieve the pipeline detection data selected by the user from the database, and perform processing operations on the retrieved pipeline detection data, wherein the processing operations include data cleaning and feature extraction of the pipeline detection data, so as to obtain processed and screened pipeline detection data, and transmit the processed pipeline detection data to the processor end;

[0008] The processor side includes:

[0009] The report generation unit is used to generate the pipeline detection data transmitted by the data processing unit based on the generation request sent by the user. The report generation unit pre-stores a report template, and generates a final report document from the pipeline detection data through the report template and feeds it back to the user end.

[0010] Furthermore, the data collection unit comprises:

[0011] A timing module, which is connected to the acquisition module and is used to preset the acquisition time. The acquisition module acquires pipeline detection data according to the set acquisition time;

[0012] An acquisition module is used to regularly acquire pipeline detection data acquired by the detection device and store the acquired pipeline detection data in a database;

[0013] The database is used to store the pipeline detection data collected by the collection module, so that the user can select the pipeline detection data as needed to send a request for generating a pipeline detection report to the processor end.

[0014] Furthermore, the acquisition module is connected to a detection device, which is distributed in the pipeline detection area. The detection device is used to detect various items of the pipeline to obtain pipeline detection data, so that the acquisition module can perform regular acquisition of the acquired pipeline detection data.

[0015] Furthermore, the pipeline inspection data stored in the database is divided into newly added inspection data and historical data. The newly added inspection data is the new data stored by this acquisition module, and the historical data is the data of the pipeline inspection report generated last time. When the next pipeline inspection report is generated, the newly added inspection data will overwrite the historical data.

[0016] Furthermore, the data processing unit comprises:

[0017] A calling module, used for calling the pipeline detection data selected by the user and corresponding to the generation request from the database according to the generation request sent by the user;

[0018] The cleaning module is used to clean the retrieved pipeline inspection data, including operations such as screening, deduplication, missing value processing, and outlier processing of the pipeline inspection data;

[0019] An extraction module is used to perform feature extraction operations on the pipeline inspection data processed by the cleaning module to extract representative pipeline data features from the pipeline inspection data;

[0020] The transmission module is used to transmit the pipeline detection data after the feature extraction operation to the processor end, so that the report generation unit can generate a report based on the processed pipeline detection data.

[0021] Furthermore, the missing value processing in the cleaning module adopts deletion method and interpolation method. The deletion method is to directly delete the data containing missing values, and re-detect, collect and process the deleted data. The interpolation method includes one or more of multiple interpolation method, K nearest neighbor filling method and random forest filling method.

[0022] Furthermore, the outlier processing in the cleaning module adopts deletion method and replacement method. The deletion method is to directly delete the outliers in the data, and the replacement method is to replace the outliers in the data center. The replacement method adopts one or more of the mean, median and mode.

[0023] Furthermore, the report generating unit includes:

[0024] The template library is used to store report templates. Users download report templates from the Internet in advance and store them in the template library so that the generation module can select report templates from the template library for use;

[0025] The generation module is used to receive generation requests sent by users and generate processed pipeline detection data. Users select report templates in the template library to build reports as needed, so as to generate final report documents from pipeline detection data. The generated final report documents will be fed back to the user end for users to view.

[0026] Furthermore, the report templates in the template library are of various types, and the user stores the report templates according to actual needs, and the user regularly updates or deletes the report templates in the template library.

[0027] The method for generating a fully intelligent pipeline inspection report automatic generation system comprises the following steps:

[0028] S1: The user end collects the pipeline detection data obtained by the detection device at regular intervals through the data collection unit and stores it in the database. The user sends a request for generating a pipeline detection report to the processor end according to the collected pipeline detection data;

[0029] S2: The collected pipeline inspection data is cleaned, deduplicated, missing and outlier processed, and feature extracted by the data processing unit, and the processed pipeline inspection data is transmitted to the processor end;

[0030] S3: The processor side uses the report generation unit and based on the generation request sent by the user, constructs a report for the processed pipeline inspection data through the report template, so as to generate the final report document and feed it back to the user side.

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] The user end of the present invention collects the pipeline detection data acquired by the detection device at a fixed time through the data collection unit. The user sends a request for generating a pipeline detection report to the processor end according to the collected pipeline detection data, and the collected pipeline detection data is stored in a database, which is retrieved by the data processing unit. The data processing unit can perform cleaning processing, deduplication processing, missing value processing and abnormal value processing operations on the pipeline detection data, and then perform feature extraction data on the pipeline detection data. The pipeline detection data after a series of processing operations is transmitted to the processor end through the transmission module. The processor end receives the generation request sent by the user and the processed pipeline detection data through the generation module, and processes the transmitted pipeline detection data based on the generation request sent by the user. The template library stores the report template. The user first selects the report template according to the actual needs of the pipeline detection data, and constructs a report for the pipeline detection data through the report template. The report template constructs a report for the processed pipeline detection data, thereby generating a final report document, and the generated final report document is fed back to the user end so that the user can view the final report document. In this process, there is no need to manually generate the report, which increases the accuracy of the report. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a schematic diagram of the overall structure of the present invention;

[0034] Figure 2 is a schematic diagram of a data collection unit of the present invention;

[0035] Figure 3 is a schematic diagram of a data processing unit of the present invention;

[0036] Figure 4 It is a schematic diagram of the report generating unit of the present invention. DETAILED DESCRIPTION

[0037] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] In order to solve the technical problem that the existing method relies on manually recording pipeline inspection data and then manually filling in the key data to organize the pipeline inspection report, the manual method not only increases the workload of the staff, but also easily causes errors, thus failing to generate an accurate pipeline inspection report. Figure 1-Figure 4 , this embodiment provides the following technical solutions:

[0039] The fully intelligent pipeline inspection report automatic generation system includes a user end and a processor end, which are connected to each other. The user sends a request for generating a pipeline inspection report to the processor end through the user end according to the collected pipeline inspection data. The processor end generates a final report document using a report template based on the collected pipeline inspection data according to the received generation request, and feeds back the generated final report document to the user end, wherein:

[0040] The user side includes:

[0041] A data collection unit is used to regularly collect pipeline detection data acquired by the detection device, and the collected pipeline detection data is stored in a database. The user selects the pipeline detection data stored in the database to send a request for generating a pipeline detection report to the processor end;

[0042] A data processing unit is used to retrieve the pipeline detection data selected by the user from the database, and perform processing operations on the retrieved pipeline detection data, wherein the processing operations include data cleaning and feature extraction of the pipeline detection data, so as to obtain processed and screened pipeline detection data, and transmit the processed pipeline detection data to the processor end;

[0043] Processor side, including:

[0044] The report generation unit is used to generate the pipeline detection data transmitted by the data processing unit based on the generation request sent by the user. The report generation unit pre-stores a report template, and generates a final report document from the pipeline detection data through the report template and feeds it back to the user end.

[0045] Data collection unit, including:

[0046] A timing module, which is connected to the acquisition module and is used to preset the acquisition time. The acquisition module acquires pipeline detection data according to the set acquisition time;

[0047] The acquisition module is used to regularly acquire the pipeline detection data acquired by the detection device and store the acquired pipeline detection data in the database; the acquisition module is connected to the detection device, which is distributed in the pipeline detection area, and the detection device is used to detect various items of the pipeline to acquire the pipeline detection data, so that the acquisition module can regularly acquire the acquired pipeline detection data;

[0048] The database is used to store the pipeline detection data collected by the collection module, so that the user can select the pipeline detection data as needed to send a request for generating a pipeline detection report to the processor end.

[0049] The technical effects of the above contents are as follows: first, the timing module can set the collection time of the collection module. The collection time is set for the collection module through the timing module, such as setting the collection once an hour, so that the collection module can perform timed collection according to the set time. For example, the collection module collects the pipeline detection data acquired by the detection device once an hour according to the time set by the timing module, and the collection module stores the collected pipeline detection data in the database so that the data processing unit can retrieve it. At the same time, the user can select the pipeline detection data in the database, so as to send a request for generating a pipeline detection report to the processor end.

[0050] The pipeline inspection data stored in the database is divided into newly added inspection data and historical data. The newly added inspection data is the new data stored by this acquisition module, and the historical data is the data of the last generated pipeline inspection report. When the next pipeline inspection report is generated, the newly added inspection data will overwrite the historical data.

[0051] The technical effect of the above content is: by dividing the pipeline inspection data stored in the database into two types: new inspection data and historical data, it is convenient to manage the data in the database, and it is also beneficial to select new inspection data, and the new inspection data can be used to overwrite the historical data. In this way, there is no need for users to clean up the database regularly, which can prevent excessive data from being stored in the database.

[0052] Data processing unit, including:

[0053] A calling module, used for calling the pipeline detection data selected by the user and corresponding to the generation request from the database according to the generation request sent by the user;

[0054] The cleaning module is used to clean the retrieved pipeline inspection data, including operations such as screening, deduplication, missing value processing, and outlier processing of the pipeline inspection data;

[0055] An extraction module is used to perform feature extraction operations on the pipeline inspection data processed by the cleaning module to extract representative pipeline data features from the pipeline inspection data;

[0056] The transmission module is used to transmit the pipeline detection data after the feature extraction operation to the processor end, so that the report generation unit can generate a report based on the processed pipeline detection data.

[0057] The technical effect of the above content is as follows: based on the generation request sent by the user, the pipeline detection data selected by the user and corresponding to the generation request can be retrieved from the database through the retrieval module, and the retrieved pipeline detection data is first processed by the cleaning module, the cleaning module can filter out the key data about the pipeline in the pipeline detection data, and remove the duplicate data in the pipeline detection data, and then process the missing values ​​and abnormal values ​​in the pipeline detection data. The processing of the cleaning module can improve the accuracy of the data, and then the processed pipeline detection data is subjected to feature extraction operation through the extraction module. The extraction module can extract representative pipeline data features in the pipeline detection data, thereby facilitating the subsequent report generation.

[0058] The missing value processing in the cleaning module adopts deletion method and interpolation method. The deletion method is to directly delete the data containing missing values, and re-detect, collect and process the deleted data. The interpolation method includes one or more of the multiple interpolation method, K nearest neighbor interpolation method and random forest interpolation method.

[0059] The technical effects of the above contents are as follows: the missing values ​​in the pipeline detection data can be directly deleted by the deletion method, and then the deleted part of the data can be obtained by re-detection, collection and processing; the multiple interpolation method usually estimates the values ​​to be interpolated in specific practice to form multiple groups of optional interpolation values, and selects the most appropriate interpolation value according to the actual selection basis; the K nearest neighbor filling method determines the K cases closest to the case with missing data based on Euclidean distance or correlation analysis, and estimates the data to be filled by weighted average of these K values; the random forest filling method performs preset processing on the missing values, and then evaluates the similarity with the original missing path under different preset conditions based on its performance in the random forest, and obtains a stable estimated value through multiple iterations; when the above methods are actually performing missing value processing, one or more methods are selected to fill in the missing values ​​in the pipeline detection data, so that the pipeline detection data is more complete.

[0060] The outlier processing in the cleaning module adopts the deletion method and the replacement method. The deletion method is to directly delete the outliers in the data, and the replacement method is to replace the outliers in the data center. The replacement method adopts one or more of the mean, median and mode.

[0061] Technical effects of the above contents: outliers in pipeline detection data can be directly deleted by deletion method, which is suitable for the situation where the number of outliers in pipeline detection data is small and does not affect the overall data; the selection replacement method can adopt the mean, median and mode methods, and the choice of which replacement method to use depends on the distribution of pipeline detection data and the characteristics of outliers. For example, if the pipeline detection data presents a normal distribution, the mean can be used for replacement. If the data has more discrete values, the median or mode can be used for replacement.

[0062] Report generation unit, including:

[0063] The template library is used to store report templates. Users download report templates from the Internet in advance and store them in the template library so that the generation module can select report templates from the template library for use. There are many types of report templates in the template library. Users store report templates according to actual needs, and users regularly update or delete report templates in the template library.

[0064] The generation module is used to receive generation requests sent by users and generate processed pipeline detection data. Users select report templates in the template library to build reports as needed, so as to generate final report documents from pipeline detection data. The generated final report documents will be fed back to the user end for users to view.

[0065] The technical effect of the above content is as follows: the generation module receives a generation request sent by a user and pipeline detection data processed by a data processing unit. Based on the generation request sent by the user, the user can first select a report template from a template library. The report template is selected according to the pipeline detection data and actual needs. The selected report template can construct a report for the pipeline detection data. The report template is used to construct a report for the processed pipeline detection data, thereby generating a final report document. The generated final report document is fed back to the user end, and the user can view the final report document through the user end, thereby evaluating the structural integrity of the pipe body according to the final report document.

[0066] The method for generating a fully intelligent pipeline inspection report automatic generation system comprises the following steps:

[0067] S1: The user end collects the pipeline detection data obtained by the detection device at regular intervals through the data collection unit and stores it in the database. The user sends a request for generating a pipeline detection report to the processor end according to the collected pipeline detection data;

[0068] S2: The collected pipeline inspection data is cleaned, deduplicated, missing and outlier processed, and feature extracted by the data processing unit, and the processed pipeline inspection data is transmitted to the processor end;

[0069] S3: The processor side uses the report generation unit and based on the generation request sent by the user, constructs a report for the processed pipeline inspection data through the report template, so as to generate the final report document and feed it back to the user side.

[0070] Working principle: The user end can collect the pipeline detection data obtained by the detection device at a fixed time through the data collection unit, and store the collected pipeline detection data in the database. The user sends a request for generating a pipeline detection report to the processor end based on the collected pipeline detection data. Based on the generation request sent by the user, the corresponding pipeline detection data in the database is retrieved through the data processing unit, and the pipeline detection data is cleaned, deduplicated, missing valued and outlier processed, and then feature extraction data is performed on the pipeline detection data. The pipeline detection data after a series of processing operations is then transmitted to the processor end through the transmission module. The processor end receives the generation request sent by the user and the processed pipeline detection data through the generation module, and processes the transmitted pipeline detection data based on the generation request sent by the user. The user selects a report template in the template library to construct a report for the pipeline detection data, and constructs a report for the processed pipeline detection data through the report template, thereby generating a final report document, and the generated final report document is fed back to the user end so that the user can view the final report document, which provides a basis for the user to evaluate the integrity of the pipe body structure. In this process, there is no need to manually generate a report, which avoids the errors that may be caused by manual recording and filling, and increases the accuracy of the final report.

[0071] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0072] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. Fully intelligent pipeline inspection report automatic generation system, including user side and processor side, It is characterized in that The user end and the processor end are connected to each other. The user sends a request for generating a pipeline detection report to the processor end through the user end according to the collected pipeline detection data. The processor end generates a final report document using the collected pipeline detection data through a report template according to the received generation request, and feeds back the generated final report document to the user end. in, The user side includes: A data collection unit is used to regularly collect pipeline detection data acquired by the detection device, and the collected pipeline detection data is stored in a database. The user selects the pipeline detection data stored in the database to send a request for generating a pipeline detection report to the processor end; A data processing unit is used to retrieve the pipeline detection data selected by the user from the database, and perform processing operations on the retrieved pipeline detection data, wherein the processing operations include data cleaning and feature extraction of the pipeline detection data, so as to obtain processed and screened pipeline detection data, and transmit the processed pipeline detection data to the processor end; Processor side, including: The report generation unit is used to generate the pipeline detection data transmitted by the data processing unit based on the generation request sent by the user. The report generation unit pre-stores a report template, and generates a final report document from the pipeline detection data through the report template and feeds it back to the user end.

2. According to claim 1, the fully intelligent pipeline inspection report automatic generation system, Features: The data collection unit comprises: A timing module, which is connected to the acquisition module and is used to preset the acquisition time. The acquisition module acquires pipeline detection data according to the set acquisition time; An acquisition module is used to regularly acquire pipeline detection data acquired by the detection device and store the acquired pipeline detection data in a database; The database is used to store the pipeline detection data collected by the collection module, so that the user can select the pipeline detection data as needed to send a request for generating a pipeline detection report to the processor end.

3. According to claim 2, the fully intelligent pipeline inspection report automatic generation system, Features: The acquisition module is connected to the detection device, which is distributed in the pipeline detection area. The detection device is used to detect various items of the pipeline to obtain pipeline detection data, so that the acquisition module can regularly collect the acquired pipeline detection data.

4. According to claim 2, the fully intelligent pipeline inspection report automatic generation system, Features: The pipeline inspection data stored in the database is divided into newly added inspection data and historical data. The newly added inspection data is the new data stored by the current acquisition module, and the historical data is the data of the last generated pipeline inspection report. When the next pipeline inspection report is generated, the newly added inspection data will overwrite the last historical data.

5. According to claim 1, the fully intelligent pipeline inspection report automatic generation system, Features: The data processing unit comprises: A calling module, used for calling the pipeline detection data selected by the user and corresponding to the generation request from the database according to the generation request sent by the user; The cleaning module is used to clean the retrieved pipeline inspection data, including operations such as screening, deduplication, missing value processing, and outlier processing of the pipeline inspection data; An extraction module is used to perform feature extraction operations on the pipeline inspection data processed by the cleaning module to extract representative pipeline data features from the pipeline inspection data; The transmission module is used to transmit the pipeline detection data after the feature extraction operation to the processor end, so that the report generation unit can generate a report based on the processed pipeline detection data.

6. According to claim 5, the fully intelligent pipeline inspection report automatic generation system, Features: The missing value processing in the cleaning module adopts deletion method and interpolation method. The deletion method is to directly delete the data containing missing values, and re-detect, collect and process the deleted data. The interpolation method includes one or more of multiple interpolation method, K nearest neighbor filling method and random forest filling method.

7. According to claim 5, the fully intelligent pipeline inspection report automatic generation system, Features: The outlier processing in the cleaning module adopts the deletion method and the replacement method. The deletion method is to directly delete the outliers in the data, and the replacement method is to replace the outliers in the data center. The replacement method adopts one or more of the mean, median and mode.

8. According to claim 1, the fully intelligent pipeline inspection report automatic generation system, Features: The report generating unit comprises: The template library is used to store report templates. Users download report templates from the Internet in advance and store them in the template library so that the generation module can select report templates from the template library for use; The generation module is used to receive generation requests sent by users and generate processed pipeline detection data. Users select report templates in the template library to build reports as needed, so as to generate final report documents from pipeline detection data. The generated final report documents will be fed back to the user end for users to view.

9. The fully intelligent pipeline inspection report automatic generation system according to claim 8, Features: The report templates in the template library are of various types. The user stores the report templates according to actual needs, and the user regularly updates or deletes the report templates in the template library.

10. A method for generating a fully intelligent pipeline inspection report automatic generation system according to any one of claims 1 to 9, Features: The following steps are involved: S1: The user end collects the pipeline detection data obtained by the detection device at regular intervals through the data collection unit and stores it in the database. The user sends a request for generating a pipeline detection report to the processor end according to the collected pipeline detection data; S2: The collected pipeline inspection data is cleaned, deduplicated, missing and outlier processed, and feature extracted by the data processing unit, and the processed pipeline inspection data is transmitted to the processor end; S3: The processor side uses the report generation unit and based on the generation request sent by the user, constructs a report for the processed pipeline inspection data through the report template, so as to generate the final report document and feed it back to the user side.

Images