Construction scheme database management and updating system and method thereof

Abstract

The invention relates to a construction scheme database management and updating system and method. The system comprises a data preprocessing system, a data conversion system, a data management and query system and a data expansion and updating system. The data preprocessing system performs data cleaning on the collected construction scheme; the data conversion system analyzes the preprocessed construction scheme data, splits all the data according to keywords, takes a data format as a label of each keyword data, and stores the split construction scheme data in a database; the data management and query system manages the database and optimizes the data index; the data expansion and update system generates new data samples by extracting, combining and modifying existing data to increase the scale of a training set or continuously update database content from a new scheme. According to the system, data collection, cleaning, analysis and storage are automatically completed, manual intervention is reduced, working efficiency is improved, and timeliness and integrity of a database are guaranteed.

Description

Technical Field

[0001] The invention belongs to the technical field of building construction, and in particular relates to a construction scheme database management and updating system and method thereof. Background Art

[0002] The amount of construction plan data is huge, and the data formats involved are various, including data in text, tables, pictures, formulas and other formats. These data are often interrelated, and it is necessary to ensure the accuracy and real-time update of the data. Therefore, the storage, retrieval and analysis of these data require the database to have a high degree of flexibility and powerful data processing capabilities. At this stage, although multi-mode databases can manage structured, semi-structured and unstructured data in the same database platform, reducing the problem of data islands, the management of multi-mode databases usually requires a large amount of computing resources. When processing large-scale unstructured data, the data storage and query efficiency is low, and the model managed by the multi-mode database is prone to overfitting, and the performance is poor in the application of construction plan database management. Therefore, how to provide a construction plan database management and update system and method is a technical problem that technicians in this field urgently need to solve. Summary of the invention

[0003] In view of the problem of low efficiency in traditional construction plan database management, the present invention proposes a construction plan database management and update system and method, which adopts artificial intelligence technology to analyze and manage the stored database, stores various types of structured, semi-structured and unstructured data in a keyword-tag format, improves data retrieval efficiency, ensures data accuracy and consistency, and dynamically expands the database to adapt to the growing amount of data, ultimately achieving effective management and real-time updating of construction plan data.

[0004] In order to solve the above technical problems, the present invention includes the following technical solutions:

[0005] A construction scheme database management and updating system, comprising:

[0006] A data preprocessing system, the data preprocessing system includes a data acquisition module and a data cleaning module, the data acquisition module is used to collect various construction plan documents containing multiple data formats; the data cleaning module uses regular expressions to clean the collected data;

[0007] The data conversion system includes a data analysis module and a data storage module. The data analysis module is responsible for analyzing the cleaned data, extracting keywords, identifying data formats, and generating labels; the data storage module formats and stores the analyzed keywords and labels in a database;

[0008] Data management and query system, which includes a data management module and a data query module. The data management module is responsible for the daily management of the database, including backup, recovery, authority control and data consistency maintenance; the data query module provides advanced query functions based on the indexing mechanism of keywords and tags;

[0009] The data expansion and update system includes a data expansion module and a data update module. The data expansion module generates new data samples through data enhancement technology to expand the training set; the data update module is responsible for extracting data from the newly added construction plan and updating the database content.

[0010] Furthermore, the data cleaning module cleans the collected data, including: removing noise, correcting errors, filling missing values, and standardizing formats.

[0011] Furthermore, the data analysis module uses NLP technology to perform text analysis and keyword extraction, uses a machine learning model to identify data formats, and automatically assigns corresponding data format labels to each keyword. NLP technologies include TF-IDF, LDA, etc.

[0012] Furthermore, the model recognizes data formats including text, tables, formulas and pictures.

[0013] Furthermore, the data query module provides fuzzy query, multi-keyword query and Boolean logic query.

[0014] The present invention also provides a method for managing and updating a construction scheme database, the method comprising:

[0015] Step S1, using the construction plan database management and update system;

[0016] Step S2: Cleaning the collected construction plan through a data preprocessing system;

[0017] Step S3: Conduct in-depth analysis on the cleaned data, extract keywords and identify data formats, and store the data in a database in the format of keywords-tags;

[0018] Step S4: Manage the database according to user needs, optimize data indexes, and improve data retrieval efficiency;

[0019] Step S5: continuously extract, combine and modify existing data to generate new data samples, or continuously update database content from new plans to adapt to the ever-changing construction needs and environment, thereby completing the management and update of the construction plan database.

[0020] Compared with the prior art, the present invention has the following advantages and beneficial effects:

[0021] The present invention provides a construction scheme database management and update system and method thereof, the system comprises a data preprocessing system, a data conversion system, a data management and query system, and a data expansion and update system; the data preprocessing system comprises a data acquisition module and a data cleaning module; the data conversion system comprises a data analysis module and a data storage module; the data management and query system comprises a data management module and a data query module; the data expansion and update system comprises a data expansion module and a data update module. The data preprocessing system is mainly responsible for data cleaning of the collected construction scheme; the data conversion system is mainly responsible for analyzing the preprocessed construction scheme data, splitting all data according to keywords and using the data format as a label for each keyword data, and storing the split construction scheme data in a database according to the keyword-label format; the data management and query system is mainly responsible for managing the database and optimizing the data index using the keyword-label system to improve the retrieval efficiency; the data expansion and update system is mainly responsible for generating new data samples by extracting, combining and modifying the existing data to increase the scale of the training set, or continuously updating the database content from the newly added scheme.

[0022] Compared with the traditional management method, the beneficial effects of the present invention are mainly as follows:

[0023] (1) High degree of automation: Artificial intelligence technology is used to automatically complete data collection, cleaning, analysis and storage, reducing manual intervention and improving work efficiency.

[0024] (2) Strong data processing capabilities: Able to process structured, semi-structured and unstructured data, and adapt to a variety of data formats.

[0025] (3) Improved retrieval efficiency: Optimizing data indexing through a keyword-tag system makes data retrieval faster and more accurate.

[0026] (4) Data consistency and accuracy: A data cleaning and verification mechanism is implemented to ensure data consistency and accuracy, reducing construction risks caused by data errors.

[0027] (5) Real-time update and dynamic expansion: Respond to data update and expansion needs in real time, quickly integrate new construction plans, and maintain the timeliness and integrity of the database. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is an architecture diagram of a construction plan database management and update system in one embodiment of the present invention. DETAILED DESCRIPTION

[0029] The following is a further detailed description of a construction plan database management and updating system and method provided by the present invention in conjunction with the accompanying drawings and specific embodiments. The advantages and features of the present invention will become more apparent from the following description.

[0030] Embodiment 1

[0031] Combine the following Figure 1 , a detailed description of the construction plan database management and update system of the present invention is given.

[0032] A construction plan database management and update system includes a data preprocessing system, a data conversion system, a data management and query system, and a data expansion and update system. The data preprocessing system includes a data acquisition module and a data cleaning module, wherein the data acquisition module is used to collect various construction plan documents containing multiple data formats; the data cleaning module uses regular expressions to clean the collected data; the data conversion system includes a data analysis module and a data storage module, wherein the data analysis module is responsible for analyzing the cleaned data, extracting keywords, identifying data formats, and generating labels; the data storage module formats and stores the analyzed keywords and labels in a database; the data management and query system includes a data management module and a data query module, wherein the data management module is responsible for the daily management of the database, including backup, recovery, authority control, and data consistency maintenance; the data query module provides advanced query functions based on the indexing mechanism of keywords and labels; the data expansion and update system includes a data expansion module and a data update module, wherein the data expansion module generates new data samples through data enhancement technology to expand the training set; the data update module is responsible for extracting data from the newly added construction plan and updating the database content.

[0033] In this embodiment, more preferably, the data cleaning module cleans the collected data, including: removing noise, correcting errors, filling missing values, and standardizing formats.

[0034] In this embodiment, more preferably, the data analysis module uses NLP technology to perform text analysis and keyword extraction, uses a machine learning model to identify data formats, and automatically assigns corresponding data format labels to each keyword. NLP technology includes TF-IDF, LDA, etc.

[0035] In this embodiment, more preferably, the model recognition data format includes text, table, formula and picture.

[0036] In this embodiment, more preferably, the data query module provides fuzzy query, multi-keyword query and Boolean logic query.

[0037] Please continue to refer to Figure 1The present invention also provides a method for managing and updating a construction scheme database, the method comprising:

[0038] Step S1, using the construction plan database management and update system;

[0039] Step S2: Cleaning the collected construction plan through a data preprocessing system;

[0040] Step S3: Conduct in-depth analysis on the cleaned data, extract keywords and identify data formats, and store the data in a database in the format of keywords-tags;

[0041] Step S4: Manage the database according to user needs, optimize data indexes, and improve data retrieval efficiency;

[0042] Step S5: continuously extract, combine and modify existing data to generate new data samples, or continuously update database content from new plans to adapt to the ever-changing construction needs and environment, thereby completing the management and update of the construction plan database.

[0043] In particular, the data update module is responsible for extracting data from newly added construction plans and updating the database content, realizing data merging and deduplication, and ensuring the accuracy and currency of the data in the database.

[0044] The above examples are preferred embodiments of the present invention, but the embodiments of the present invention are not limited to the above embodiments. The above embodiments only express several embodiments of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for those of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A construction plan database management and update system, characterized in that: include: A data preprocessing system, the data preprocessing system includes a data acquisition module and a data cleaning module, the data acquisition module is used to collect various construction plan documents containing multiple data formats; The data cleaning module uses regular expressions to clean the collected data; The data conversion system includes a data analysis module and a data storage module. The data analysis module is responsible for analyzing the cleaned data, extracting keywords, identifying data formats, and generating labels; the data storage module formats and stores the analyzed keywords and labels in a database; Data management and query system, which includes a data management module and a data query module. The data management module is responsible for the daily management of the database, including backup, recovery, authority control and data consistency maintenance; the data query module provides advanced query functions based on the indexing mechanism of keywords and tags; The data expansion and update system includes a data expansion module and a data update module. The data expansion module generates new data samples through data enhancement technology to expand the training set; the data update module is responsible for extracting data from the newly added construction plan and updating the database content.

2. The construction plan database management and updating system according to claim 1 is characterized in that: The data cleaning module cleans the collected data, including: removing noise, correcting errors, filling missing values, and standardizing formats.

3. The construction plan database management and updating system according to claim 1 is characterized in that: The data analysis module uses NLP technology to perform text analysis and keyword extraction, uses a machine learning model to identify data formats, and automatically assigns corresponding data format labels to each keyword.

4. The construction plan database management and updating system according to claim 3 is characterized in that: The model recognizes data formats including text, tables, formulas and pictures.

5. The construction plan database management and updating system according to claim 1 is characterized in that: The data query module provides fuzzy query, multi-keyword query and Boolean logic query.

6. A method for managing and updating a construction plan database, characterized in that: include: Step S1, using the construction plan database management and update system as described in any one of claims 1 to 5; Step S2: Cleaning the collected construction plan through a data preprocessing system; Step S3: Conduct in-depth analysis on the cleaned data, extract keywords and identify data formats, and store the data in a database in the format of keywords-tags; Step S4: Manage the database according to user needs, optimize data indexes, and improve data retrieval efficiency; Step S5: continuously extract, combine and modify existing data to generate new data samples, or continuously update database content from new plans to adapt to the ever-changing construction needs and environment, thereby completing the management and update of the construction plan database.

Images