Method and system for automatically sequencing multi-specialty list items of hydropower engineering
Through an automated data synchronization and sorting system, the problems of inconsistent data and repeated operations in hydropower engineering projects are solved, efficient data processing and historical data traceability are achieved, and the efficiency and reliability of engineering project management are improved.
Patent Information
- Application Number
- CN202411904851.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-23
- Publication Date
- 2025-03-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In traditional engineering cost management, data exchange between design, construction and cost departments is complex and inefficient, resulting in inconsistent data, repeated operations and sorting disorder, especially when data is updated frequently, information traceability is difficult.
Provides a method and system for automatic sorting of multi-professional list items in hydropower engineering. Through the RESTful API, data is pulled from the design and construction department, sorted according to industry standard templates, automatic synchronization and logical deletion of data, and data item snapshots are generated for historical data traceability.
It solves the problems of data inconsistency, repeated operations and disordered sorting, improves the efficiency and accuracy of data processing, reduces user repetitive operations, supports flexible data addition and deletion and backtracement, and ensures data integrity and traceability.
Smart Images

Figure CN119719228A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of computer technology for project cost management in the hydropower and water conservancy industry, and specifically relates to a method and system for automatically sorting multi-professional list items of a hydropower project. Background Art
[0002] In the traditional engineering cost management process, the data exchange process between the three departments of design, construction and cost is complicated and inefficient. Since each department uses different platforms and formats, the cost department needs to manually adjust the data, which increases the workload and the risk of errors. With the frequent modification of project design plans and adjustments to costs, how to efficiently synchronize the data of the design and construction departments to the cost department and ensure its consistency and accuracy has become an important challenge in project management.
[0003] The existing working mode relies on manual operation, the data synchronization efficiency is low, and the order of each data item in the cost department is unstable. Especially when the data of the design and construction departments are updated, it is difficult to synchronize the data items to the cost department accurately and timely; when the order of data items in the design and construction departments changes, the cost department needs to repeat the order of data items, resulting in repeated operations, which further reduces work efficiency. In addition, due to the frequent update of data items, it is difficult to trace information. Summary of the invention
[0004] In view of the defects of the prior art, the present invention provides a method and system for automatically sorting multi-professional list items of hydropower engineering, which can effectively solve the problems of inconsistent data, repeated operations, chaotic sorting and difficult information tracing in the collaboration among the three departments of design, construction and cost estimation in the traditional working mode.
[0005] The technical solution adopted by the present invention is as follows:
[0006] The present invention provides a method for automatically sorting multi-professional list items of a hydropower project, comprising the following steps:
[0007] Step S1, the first data extraction and sorting process:
[0008] Pull all data items of the project plan from the plan management interface of the design and construction department for the first time, and sort all data items according to the industry standard template and sorting rules to obtain a sorted project plan, and configure a project plan version number for the sorted project plan and save it;
[0009] Step S2, incremental synchronization and logical deletion process:
[0010] Based on the latest version of the saved project plan, the plan management interface of the design and construction department is monitored in real time, and when it is detected that the plan management interface of the design and construction department is updated, the changed data items are identified, including newly added, modified and deleted data items;
[0011] According to the industry standard template, the newly added and modified data items are synchronized to the latest version of the project plan by using the sorting rules, and the deleted data items are logically deleted in the latest version of the project plan, so as to obtain a new version of the project plan, configure the version number of the new version of the project plan, save the new version of the project plan, and record the detailed change records of this update;
[0012] Step S3, historical data tracing process:
[0013] During each incremental synchronization and logical deletion, a snapshot of each changed data item is generated and stored in the database;
[0014] Historical data tracing is performed based on snapshots of data items stored in the database and detailed change records of each record.
[0015] Preferably, step S1 specifically comprises:
[0016] Step S1.1, the processing system for automatically sorting multi-professional list items of hydropower engineering uses a RESTful API to first pull all data items of the project plan from the solution management interface of the design and construction department, and in the process of pulling data items, the data items are transmitted in JSON format to ensure the logical relationship and consistency between the data items, so as to synchronize the project plan of the solution management interface of the design and construction department to the processing system;
[0017] Step S1.2, the processing system has multiple industry standard templates built in; based on the industry standard templates, all the data items of the project plan pulled are categorized and sorted, and the specific method is: identifying the category of the data item, the category of the data item includes standard items and non-standard items; for all standard items, sorting all the identified standard items according to the sorting order of each standard item in the industry standard template; for the identified non-standard items, sorting them to the end of the data items of the same level by default, and marking the non-standard items;
[0018] Step S1.3, for the non-standard items sorted in step S1.2, the processing system has a manual adjustment function. Specifically, the front end of the processing system uses Vue.js to realize dynamic interaction with the displayed project plan, and the user manually sorts the non-standard items by dragging and moving; after the user manually adjusts the position of the non-standard item, the processing system records the relative position relationship of the non-standard item in the project plan, and uses localStorage to temporarily store the relative position relationship of the non-standard item;
[0019] Based on the relative position relationship temporarily stored in the localStorage, the relative position relationship of the non-standard items remains unchanged during the subsequent incremental synchronization and logical deletion process;
[0020] Thus, the sorted project plan is obtained.
[0021] Preferably, in step S1.1, when all data items of the project plan are first pulled from the plan management interface of the design and construction department and the data items are sorted, the processing system continuously performs data consistency verification to ensure the accuracy of the status, sequence and content of all data items, and uses a full-path string comparison method to ensure the integrity of data items during data item transmission and storage.
[0022] Preferably, when all data items of the project solution are first pulled from the solution management interface of the design and construction department and the data items are sorted, the processing system uses a local Map to cache frequent data items to improve the response speed of data item pulling and sorting.
[0023] Preferably, when all data items of the project plan are pulled from the plan management interface of the design and construction department for the first time for data synchronization, the processing system adopts a state and optimistic locking mechanism to ensure the consistency of the synchronized project plan: using the transaction management function, the entire synchronization process is encapsulated into a transaction to ensure the atomicity of the project plan and the integrity of the project plan.
[0024] Preferably, step S2 specifically comprises:
[0025] Step S2.1, the processing system monitors the solution management interface of the design and construction department in real time through the RESTful API, determines whether the project solution of the solution management interface of the design and construction department is updated relative to the latest version of the saved project solution, and when it is monitored that the solution management interface of the design and construction department is updated, based on the latest version of the saved project solution, identifies the changed data items, and uses the Axios library to send a request to obtain the changed data items to the solution management interface of the design and construction department;
[0026] Step S2.2, the processing system pulls the changed data items from the solution management interface of the design and construction department, and the changed data items are transmitted in JSON format;
[0027] The processing system verifies the status of the changed data items that have been pulled, and uses a full-path string comparison verification method to verify the correctness and integrity of the changed data items to ensure the accuracy of the changed data items;
[0028] Step S2.3, the processing system performs the following operations on the pulled changed data items:
[0029] For deleted data items: the processing system identifies the deleted data items in the latest version of the project plan read, sets the status of the deleted data items to logical deletion, and sets the logically deleted data items to be hidden and invisible in the user interface in the new version of the project plan obtained this time; therefore, the logically deleted data items are completely retained in the new version of the project plan obtained this time for subsequent tracing;
[0030] For newly added data items: according to the category of the newly added data items, if it is a standard item, it will be added to the corresponding position of the latest version of the project plan according to the sorting order in the industry standard template; if it is a non-standard item, it will be sorted to the end of the data items of the same level by default, and the user can manually adjust the function;
[0031] For modified data items, in the latest version of the project plan, directly logically delete the corresponding original data items, and add the modified data items to the corresponding positions of the latest version of the project plan according to the sorting rules;
[0032] Record the detailed change records of this update and associate them with the corresponding data items;
[0033] This completes incremental synchronization and logical deletion, and generates a new version of the project plan based on the latest version of the project plan;
[0034] In step S2.4, the new version of the project plan is checked for data consistency, and a version number comparison and status verification mechanism is used to ensure that the status and content of all data items are correctly updated.
[0035] Preferably, the updated detailed change record includes: changed data items, change operation time, change operation type and executing user.
[0036] Preferably, step S3 specifically comprises:
[0037] Step S3.1, each time incremental synchronization and logical deletion are performed, for each changed data item, a snapshot of the changed data item is generated, the snapshot of the changed data item records the unique identifier of the data item, the current state of the data item, the modification time of the data item, the executing user and the change type, and is stored in the MySQL database;
[0038] Step S3.2, based on the snapshot of the data items stored in the database and the detailed change records of each record, historical data tracing is performed, including:
[0039] Through the interface provided by the processing system, the historical version of the project plan is compared with the current version of the project plan. The Diff algorithm is used to highlight the modified data items in the current version of the project plan, intuitively display the changes of data items, and provide the function of viewing data items one by one to enhance user understanding;
[0040] For data items that have been logically deleted, the user selects the data items that need to be restored from the detailed change record, resets their status to a valid state, and establishes an association with the current version of the project plan. The data items are then reinserted into the corresponding position of the current version of the project plan according to the sorting rules. The recovery operation will generate a new detailed change record to ensure the integrity of the data item traceability.
[0041] The present invention also provides a system for the method of automatically sorting items in a multi-professional list of hydropower projects, comprising:
[0042] The first data extraction and sorting process module is used to extract all data items of the project plan from the plan management interface of the design and construction department for the first time, and sort all data items according to the industry standard template using sorting rules to obtain the sorted project plan, and configure the project plan version number for the sorted project plan and save it;
[0043] The incremental synchronization and logical deletion module is used to monitor the solution management interface of the design and construction department in real time based on the latest version of the saved project solution, and when it is detected that the solution management interface of the design and construction department is updated, the changed data items are identified, including newly added, modified and deleted data items;
[0044] According to the industry standard template, the newly added and modified data items are synchronized to the latest version of the project plan by using the sorting rules, and the deleted data items are logically deleted in the latest version of the project plan, so as to obtain a new version of the project plan, configure the version number of the new version of the project plan, save the new version of the project plan, and record the detailed change records of this update;
[0045] The historical data tracing module is used to generate a snapshot of each changed data item and store it in the database during each incremental synchronization and logical deletion.
[0046] Historical data tracing is performed based on snapshots of data items stored in the database and detailed change records of each record.
[0047] The method and system for automatically sorting multi-professional list items of hydropower engineering provided by the present invention have the following advantages:
[0048] The present invention provides an efficient method for automatically sorting multi-professional list items of hydropower engineering, which can solve the problems of data inconsistency, repeated operations and chaotic sorting in the collaboration of the three departments of design, construction and cost in the hydropower and water conservancy industry. By introducing intelligent algorithms, it is possible to efficiently synchronize large-scale data, maintain data consistency and reliability, reduce user repeated operations, and support flexible data addition, deletion and backtracking. At the same time, optimistic locking and state control are used to ensure data integrity, and the microservice architecture and caching strategy are combined to optimize the user experience to meet the diverse needs of complex engineering project management. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] Figure 1 A flow chart of a method for automatically sorting multi-professional checklist items for a hydropower project provided by the present invention;
[0050] Figure 2 A flowchart of a method for automatically sorting multi-professional checklist items for a hydropower project provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0051] In order to make the technical problems, technical solutions and beneficial effects solved by the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0052] The present invention proposes a method and system for automatically sorting multi-professional list items of hydropower projects. It is a method and system for automatically sorting multi-professional list items of hydropower projects based on intelligent algorithms, aiming to solve the problem of cross-platform data processing and achieve seamless data connection between design, construction and cost departments. Through automated synchronization and sorting, manual intervention is reduced and the efficiency and accuracy of data processing are improved. The method can automatically save and apply the user's customized sorting when the data is updated, avoiding repeated adjustments caused by invalid sorting, and significantly improving work efficiency and user experience.
[0053] The present invention proposes a method for automatically sorting multi-professional list items of a hydropower project, comprising the following steps:
[0054] Step S1, the first data extraction and sorting process:
[0055] Pull all data items of the project plan from the plan management interface of the design and construction department for the first time, and sort all data items according to the industry standard template and sorting rules to obtain a sorted project plan, and configure a project plan version number for the sorted project plan and save it;
[0056] Step S1 is specifically as follows:
[0057] Step S1.1, the processing system for automatically sorting multi-professional list items of hydropower engineering uses a RESTful API to first pull all data items of the project plan from the solution management interface of the design and construction department, and in the process of pulling data items, the data items are transmitted in JSON format to ensure the logical relationship and consistency between the data items, so as to synchronize the project plan of the solution management interface of the design and construction department to the processing system;
[0058] Step S1.2, the processing system has multiple industry standard templates built in; based on the industry standard templates, all the data items of the project plan pulled are categorized and sorted, and the specific method is: identifying the category of the data item, the category of the data item includes standard items and non-standard items; for all standard items, sorting all the identified standard items according to the sorting order of each standard item in the industry standard template; for the identified non-standard items, sorting them to the end of the data items of the same level by default, and marking the non-standard items;
[0059] Step S1.3, for the non-standard items sorted in step S1.2, the processing system has a manual adjustment function. Specifically, the front end of the processing system uses Vue.js to realize dynamic interaction with the displayed project plan, and the user manually sorts the non-standard items by dragging and moving; after the user manually adjusts the position of the non-standard item, the processing system records the relative position relationship of the non-standard item in the project plan, and uses localStorage to temporarily store the relative position relationship of the non-standard item;
[0060] Based on the relative position relationship temporarily stored in the localStorage, the relative position relationship of the non-standard items remains unchanged during the subsequent incremental synchronization and logical deletion process;
[0061] Thus, the sorted project plan is obtained.
[0062] In this step S1, when all data items of the project plan are first pulled from the plan management interface of the design and construction department and the data items are sorted, the processing system continuously performs data consistency verification to ensure the accuracy of the status, sequence and content of all data items, and uses the full-path string comparison method to ensure the integrity of data items during data item transmission and storage.
[0063] When all data items of the project plan are first pulled from the plan management interface of the design and construction department and the data items are sorted, the processing system uses the local Map to cache frequent data items to improve the response speed of data item pulling and sorting.
[0064] When all data items of the project plan are pulled from the plan management interface of the design and construction department for the first time for data synchronization, the processing system adopts a state and optimistic locking mechanism to ensure the consistency of the synchronized project plan: using the transaction management function, the entire synchronization process is encapsulated into a transaction to ensure the atomicity of the project plan and the integrity of the project plan.
[0065] Step S2, incremental synchronization and logical deletion process:
[0066] Based on the latest version of the saved project plan, the plan management interface of the design and construction department is monitored in real time, and when it is detected that the plan management interface of the design and construction department is updated, the changed data items are identified, including newly added, modified and deleted data items;
[0067] According to the industry standard template, the newly added and modified data items are synchronized to the latest version of the project plan by using the sorting rules, and the deleted data items are logically deleted in the latest version of the project plan, so as to obtain a new version of the project plan, configure the version number of the new version of the project plan, save the new version of the project plan, and record the detailed change records of this update;
[0068] Step S2 is specifically as follows:
[0069] Step S2.1, the processing system monitors the solution management interface of the design and construction department in real time through the RESTful API, determines whether the project solution of the solution management interface of the design and construction department is updated relative to the latest version of the saved project solution, and when it is monitored that the solution management interface of the design and construction department is updated, based on the latest version of the saved project solution, identifies the changed data items, and uses the Axios library to send a request to obtain the changed data items to the solution management interface of the design and construction department;
[0070] Step S2.2, the processing system pulls the changed data items from the solution management interface of the design and construction department, and the changed data items are transmitted in JSON format;
[0071] The processing system verifies the status of the changed data items that have been pulled, and uses a full-path string comparison verification method to verify the correctness and integrity of the changed data items to ensure the accuracy of the changed data items;
[0072] Step S2.3, the processing system performs the following operations on the pulled changed data items:
[0073] For deleted data items: the processing system identifies the deleted data items in the latest version of the project plan read, sets the status of the deleted data items to logical deletion, and sets the logically deleted data items to be hidden and invisible in the user interface in the new version of the project plan obtained this time; therefore, the logically deleted data items are completely retained in the new version of the project plan obtained this time for subsequent tracing;
[0074] For newly added data items: according to the category of the newly added data items, if it is a standard item, it will be added to the corresponding position of the latest version of the project plan according to the sorting order in the industry standard template; if it is a non-standard item, it will be sorted to the end of the data items of the same level by default, and the user can manually adjust the function;
[0075] For modified data items, in the latest version of the project plan, directly logically delete the corresponding original data items, and add the modified data items to the corresponding positions of the latest version of the project plan according to the sorting rules;
[0076] Record the detailed change record of this update and establish an association with the corresponding data item; wherein the detailed change record of the update includes: the changed data item, the change operation time, the change operation type and the executing user.
[0077] This completes incremental synchronization and logical deletion, and generates a new version of the project plan based on the latest version of the project plan;
[0078] In step S2.4, the new version of the project plan is checked for data consistency, and a version number comparison and status verification mechanism is used to ensure that the status and content of all data items are correctly updated.
[0079] Step S3, historical data tracing process:
[0080] During each incremental synchronization and logical deletion, a snapshot of each changed data item is generated and stored in the database;
[0081] Historical data tracing is performed based on snapshots of data items stored in the database and detailed change records of each record.
[0082] Step S3 is specifically as follows:
[0083] Step S3.1, each time incremental synchronization and logical deletion are performed, for each changed data item, a snapshot of the changed data item is generated, the snapshot of the changed data item records the unique identifier of the data item, the current state of the data item, the modification time of the data item, the executing user and the change type, and is stored in the MySQL database;
[0084] Step S3.2, based on the snapshot of the data items stored in the database and the detailed change records of each record, historical data tracing is performed, including:
[0085] Through the interface provided by the processing system, the historical version of the project plan is compared with the current version of the project plan. The Diff algorithm is used to highlight the modified data items in the current version of the project plan, intuitively display the changes of data items, and provide the function of viewing data items one by one to enhance user understanding;
[0086] For data items that have been logically deleted, the user selects the data items that need to be restored from the detailed change record, resets their status to a valid state, and establishes an association with the current version of the project plan. The data items are then reinserted into the corresponding position of the current version of the project plan according to the sorting rules. The recovery operation will generate a new detailed change record to ensure the integrity of the data item traceability.
[0087] The present invention also provides a system for automatically sorting multi-professional list items of hydropower engineering, comprising:
[0088] The first data extraction and sorting process module is used to extract all data items of the project plan from the plan management interface of the design and construction department for the first time, and sort all data items according to the industry standard template using sorting rules to obtain the sorted project plan, and configure the project plan version number for the sorted project plan and save it;
[0089] The incremental synchronization and logical deletion module is used to monitor the solution management interface of the design and construction department in real time based on the latest version of the saved project solution, and when it is detected that the solution management interface of the design and construction department is updated, the changed data items are identified, including newly added, modified and deleted data items;
[0090] According to the industry standard template, the newly added and modified data items are synchronized to the latest version of the project plan by using the sorting rules, and the deleted data items are logically deleted in the latest version of the project plan, so as to obtain a new version of the project plan, configure the version number of the new version of the project plan, save the new version of the project plan, and record the detailed change records of this update;
[0091] The historical data tracing module is used to generate a snapshot of each changed data item and store it in the database during each incremental synchronization and logical deletion.
[0092] Historical data tracing is performed based on snapshots of data items stored in the database and detailed change records of each record.
[0093] The present invention provides an efficient method for automatically sorting multi-professional list items of hydropower engineering, which can solve the problems of data inconsistency, repeated operations and chaotic sorting in the collaboration of the three departments of design, construction and cost in the hydropower and water conservancy industry. By introducing intelligent algorithms, it is possible to efficiently synchronize large-scale data, maintain data consistency and reliability, reduce user repeated operations, and support flexible data addition, deletion and backtracking. At the same time, optimistic locking and state control are used to ensure data integrity, and the microservice architecture and caching strategy are combined to optimize the user experience to meet the diverse needs of complex engineering project management.
[0094] Two embodiments are described below:
[0095] Embodiment 1:
[0096] The embodiment of the present invention provides an efficient automatic sorting method for multi-professional list items of hydropower engineering. Based on an intelligent algorithm, it is an efficient data synchronization and sorting method. It adopts optimistic locking, microservice architecture, cache strategy and historical data backup and other technologies to achieve the functions of first synchronization, user adjustment and preservation, incremental processing, consistency maintenance, etc., including data pulling and sorting module, incremental synchronization and logical deletion module, and historical data tracing module:
[0097] The data extraction and sorting module extracts all data items of the project plan from the plan management interface of the design and construction department for the first time through intelligent algorithms, and sorts them according to the industry standard template sequence. When it is not the first incremental synchronization, the processing system processes the data according to the sorting order of the data items saved last time, and the newly added items are automatically inserted into the corresponding positions of the latest version of the project plan, and the missing items are marked as logical deletions to ensure the consistency and integrity of the data.
[0098] The implementation method of the data pulling and sorting module specifically includes the following steps:
[0099] S1. The processing system uses RESTful API to pull all data items of the latest reported design plan, construction method, specification, engineering quantity information, etc. from the design and construction departments, and automatically sorts the pulled data items through quick sorting according to the preset industry standard template during the first pull process to ensure that all data items are arranged in a standard order, and uses JSON format to transmit data items to ensure the logical relationship and consistency between data items;
[0100] S2. After all data items of the project plan are synchronized to the processing system, the front end of the processing system uses Vue.js to implement dynamic interaction. Users can manually sort non-standard items by dragging and moving. The processing system can save the user's adjustment order in real time and use localStorage for temporary data storage for reference in subsequent synchronization;
[0101] S3. When the data items reported by the design or construction department are updated, the processing system will synchronize the content again and repeat the work done in S1. At the same time, the processing system will process the data according to the sorting order of the data items saved last time to ensure that the order adjusted by the user is not changed. For the newly added data items, the processing system will automatically insert them into the user-defined position. The logically deleted data items will be removed during display, but the historical records will be kept in the background for easy traceability.
[0102] S4. During the entire process of pulling and sorting data items, the processing system continuously performs data consistency verification to ensure the accuracy of the status, order and content of all data items, and uses the full-path string comparison method to ensure data integrity during data transmission and storage;
[0103] S5. The processing system adopts efficient query algorithms and cache strategies, uses local Map to cache frequent data, improves the response speed of data item pulling and sorting, and updates the data item status in time after completing the data item sorting to ensure the smoothness of user operations;
[0104] S6. The processing system uses state and optimistic locking mechanisms during data item synchronization to ensure the consistency of data items. It uses the transaction management function of the database to encapsulate the entire synchronization process into a transaction to ensure atomicity. After the main business processing is completed, the consistency of the data items is determined by comparing the version numbers. If they are consistent, the update is committed. If they are inconsistent, the transaction is rolled back to ensure data integrity.
[0105] The incremental synchronization and logical deletion module achieves real-time incremental data pulling through RESTful API, marking deleted data items instead of physically deleting them to preserve historical records. After data status verification and logical deletion processing, the processing system ensures data item consistency. Combined with MySQL for flexible storage, the module records detailed change information and provides user-friendly recovery functions, thereby improving the flexibility and reliability of the system in high-concurrency business scenarios.
[0106] The implementation method of the incremental synchronization and logical deletion module specifically includes the following steps:
[0107] S1. The processing system interacts with the design and construction department's solution management interface in real time through the RESTful API, uses the project solution version number to identify the data items that have been added or modified since the last synchronization, uses the Axios library to send requests, and uses the JSON format to transmit data items to ensure fast response and consistency of data structure;
[0108] S2. During the process of pulling data items, the processing system verifies the status of the acquired data items and uses the full path string comparison verification method to verify the correctness and integrity of the data items to ensure the accuracy of the newly added data items and logically deleted data items;
[0109] S3. The processing system identifies the deleted data items marked by the user and sets their status to "logically deleted" instead of physically deleted. Only valid data items are displayed in the user interface, and logically deleted data items are fully retained in the background for subsequent tracing;
[0110] S4. The processing system records the addition and logical deletion operations that occur in each incremental synchronization in detail, including the changed items, modification time, and executing user, and uses the MySQL database to store the change records, supporting flexible query and retrieval;
[0111] S5. After the incremental synchronization is completed, the processing system performs a data item consistency check and uses a version number comparison and status verification mechanism to ensure that the status and content of all data items are correctly updated;
[0112] S6. The processing system provides a history interface, where users can select logically deleted data items and reset their status to "valid" before inserting them into the current project plan.
[0113] The historical data tracing module automatically generates data item snapshots and change records, combined with MySQL flexible storage and RESTful API query interface, so that users can quickly retrieve historical records according to time range and change type. The module supports project plan version comparison and logical deletion recovery, ensuring data transparency and traceability, and improving the management efficiency and reliability of the system in complex engineering projects.
[0114] The implementation method of the historical data tracing module specifically includes the following steps:
[0115] S1. After each data item synchronization is completed, the processing system automatically generates a snapshot of the current data item. Each snapshot records the unique identifier, current status, modification time, executing user, and change type (addition, modification, or logical deletion) of the data item and stores it in the MySQL database;
[0116] S2. The processing system generates a detailed change record for each data item change, recording the status before and after the change, modification time, and execution user information, and establishes an association with the corresponding data item for subsequent retrieval;
[0117] S3. Users can compare the historical version of the project plan with the current version through the interface provided by the processing system, use the Diff algorithm to highlight the modified data items, intuitively display the changes in data items, and provide the function of viewing data items one by one to enhance user understanding.
[0118] S4. For data items that have been logically deleted, users can select the data items that need to be restored from the historical records. The processing system will reset their status to "valid" and reinsert them into the current project plan. The recovery operation will generate a new change record to ensure the integrity of data item traceability.
[0119] The present invention provides a method for automatically sorting multi-professional list items of hydropower projects, which can solve the problems of low efficiency, inconsistent data and delayed information update in traditional manual sorting. The existing technology usually relies on manual sorting, which takes a long time to process and is prone to errors, resulting in inaccurate data. The manual method not only increases the workload, but also affects the timeliness and reliability of data processing.
[0120] The present invention introduces intelligent algorithms, industry standards and data verification mechanisms to ensure that list items are automatically sorted according to predetermined logic, improve the accuracy and consistency of data processing, thereby optimizing hydropower project management and significantly improving work efficiency and user experience.
[0121] In terms of data item extraction and sorting, intelligent sorting algorithms and industry standard templates are used to achieve automatic sorting of list items. Traditional products often require manual adjustments when processing 1,000 pieces of data, resulting in frequent errors. This module reduces human errors through automation and significantly improves system reliability and user satisfaction.
[0122] In terms of incremental synchronization and logical deletion, the incremental pull mechanism ensures that only the order of newly added or modified data items is synchronized, which significantly improves efficiency. The existing method usually physically deletes data, resulting in the loss of historical data, while the present invention ensures the integrity and traceability of historical data through the logical deletion function, enhances the flexibility and security of data management, and meets the high requirements of modern project management for data processing.
[0123] In terms of historical data tracing, the transparency and traceability of data items are ensured by automatically generating data item snapshots and change records. Existing technologies often require manual retrieval when querying historical data, which is inefficient. This module allows users to quickly retrieve historical data on demand, improving the efficiency of data management.
[0124] Embodiment 2:
[0125] This embodiment introduces an automatic sorting system for multi-professional checklist items in hydropower projects based on intelligent algorithms, aiming to solve the problems of inconsistent data, repeated operations and chaotic sorting of checklist items in traditional hydropower engineering projects. The system combines industry standard templates and manual adjustment functions to help projects collaborate efficiently in multiple links such as design, construction and cost.
[0126] S1. The administrator logs in to the platform to create a new project. First, add project team members to the project, including the design department, construction department, and cost department, and then grant permissions to relevant personnel. Project members can then log in to the platform and perform operations according to the granted permissions.
[0127] S2. After each professional department (such as construction, dam work, waterway, factory, electromechanical, etc.) enters the project, during the project implementation, they submit the edited or imported list item data through the platform. The system will automatically sort the standard items submitted by each department according to the built-in industry standard template.
[0128] Among them: standard items refer to the content specified in the industry standards, such as earth excavation, stone excavation, stone tunnel excavation and other data. In the construction professional project, the data reported by the construction department is automatically sorted according to the built-in industry standards. For example, the construction profession is divided into construction traffic engineering, construction power supply engineering, diversion engineering, and other construction auxiliary engineering. The correct order in the diversion engineering is diversion open channel, diversion tunnel, cofferdam engineering, and the correct order of the diversion open channel is earth excavation, stone excavation, earth and stone backfill, concrete structure, steel bar installation, shotcrete, etc. The order of the construction profession when submitting is earth and stone backfill, stone excavation, earth excavation, concrete structure, shotcrete and steel bar installation. When the report is completed and submitted, the system can automatically sort the standard items reported by the construction profession according to the built-in correct order, and the order of the construction profession display interface remains unchanged, which is convenient for subsequent updates of the construction profession.
[0129] Non-standard items refer to project items that are not within the scope of industry standard templates, such as specific temporary projects or design changes. Users can manually adjust the sorting position of these non-standard items through the platform. The system will save the user's manual adjustments and ensure that these non-standard items remain in the adjusted order during subsequent synchronization. For example, the construction department added a temporary access road data item in a certain design change. Since the access road does not belong to the standard list items, the system defaults to placing it at the end of the same level item. Users can manually adjust it to the appropriate project position by dragging or moving it up and down, and the system will save the sorting result. Even if there are other new items or modifications later, the position of the access road remains unchanged, and the relevant departments do not have to make repeated adjustments.
[0130] S3. When each professional department submits new design or construction data, the system will automatically synchronize the data. The system will reorder the standard items, and for non-standard items that have been manually adjusted before, the system will retain the order adjusted by the user. Users only need to sort the newly added or modified non-standard items, which reduces repetitive operations and improves work efficiency. For example, in the middle of the project, the design department added a protective facility. The system will automatically insert the new facility into the bill of quantities. If it is a standard item, it will be automatically sorted. If it is a non-standard item, it will be placed at the end of the same level item by default for manual adjustment, and the previous sorting of other non-standard items will be retained. Users only need to sort the newly added items, and other manually adjusted non-standard items will not be affected.
[0131] S4. The system has powerful historical data tracing and version management functions.
[0132] After each synchronization, the system automatically generates a snapshot of the current data item. Users can use the system to compare data versions from different periods and view the specific changes of each update. For data items that have been marked as logically deleted, users can choose to restore them to the current list to ensure data integrity and traceability. During the review, the project manager found that a protective facility that was deleted earlier still needs to be re-implemented. Through the system's historical data tracing function, the manager can quickly find the historical record of the facility, click "valid" and restore it to the current project. The system will automatically insert it into the correct location and ensure consistency with other engineering data.
[0133] The present invention has the following characteristics:
[0134] The data pulling and sorting module pulls data for the first time and sorts it according to the standard template. During subsequent synchronization, the data is processed according to the sorting order saved last time, and new items are automatically inserted and missing items are logically deleted. Specifically, data is pulled from the design and construction department's solution management interface and sorted according to the standard template. Users manually adjust the sorting of non-standard items, and the system saves the order in real time. When synchronizing again, the data is automatically processed according to the last order; and data consistency verification is continuously performed.
[0135] The incremental synchronization and logical deletion module implements real-time incremental data synchronization and logical deletion through the RESTful API, retains historical records and ensures data consistency; specifically, the incremental synchronization and logical deletion module features: real-time data interaction, identification of new and modified items; logical deletion of missing items and display of valid data; recording of change information in incremental synchronization.
[0136] The historical data tracing module generates a data snapshot after each synchronization; generates detailed change records, and supports time-range-based retrieval and logically deleted data recovery by generating data snapshots and change records, and supports version comparison and data recovery.
[0137] This embodiment uses intelligent algorithms combined with industry standards to achieve automatic sorting and manual adjustment of multi-professional list items for hydropower projects. The system can efficiently manage data synchronization and incremental processing, and has a powerful historical data traceability function, helping various departments to maintain data consistency during project implementation, reduce duplication of operations, and ensure that the project proceeds smoothly as planned.
[0138] The present invention provides an efficient method for automatically sorting multi-professional list items of hydropower engineering, which solves the problems of data inconsistency, repeated operations and chaotic sorting in the collaboration of the three departments of design, construction and cost in the hydropower and water conservancy industry. By introducing intelligent algorithms, it is possible to efficiently synchronize large-scale data, maintain data consistency and reliability, reduce user repeated operations, and support flexible data addition, deletion and backtracking. At the same time, optimistic locking and state control are used to ensure data integrity, and the microservice architecture and caching strategy are combined to optimize the user experience to meet the diverse needs of complex engineering project management.
[0139] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be considered as the scope of protection of the present invention.
Claims
1. A method for automatically sorting multi-professional list items of hydropower engineering, characterized in that: The following steps are involved: Step S1, the first data extraction and sorting process: Pull all data items of the project plan from the plan management interface of the design and construction department for the first time, and sort all data items according to the industry standard template and sorting rules to obtain a sorted project plan, and configure a project plan version number for the sorted project plan and save it; Step S2, incremental synchronization and logical deletion process: Based on the latest version of the saved project plan, the plan management interface of the design and construction department is monitored in real time, and when it is detected that the plan management interface of the design and construction department is updated, the changed data items are identified, including newly added, modified and deleted data items; According to the industry standard template, the newly added and modified data items are synchronized to the latest version of the project plan by using the sorting rules, and the deleted data items are logically deleted in the latest version of the project plan, so as to obtain a new version of the project plan, configure the version number of the new version of the project plan, save the new version of the project plan, and record the detailed change records of this update; Step S3, historical data tracing process: During each incremental synchronization and logical deletion, a snapshot of each changed data item is generated and stored in the database; Historical data tracing is performed based on snapshots of data items stored in the database and detailed change records of each record.
2. The method for automatically sorting multi-professional checklist items of a hydropower project according to claim 1 is characterized in that: Step S1 is specifically as follows: Step S1.1, the processing system for automatically sorting multi-professional list items of hydropower engineering uses a RESTful API to first pull all data items of the project plan from the solution management interface of the design and construction department, and in the process of pulling data items, the data items are transmitted in JSON format to ensure the logical relationship and consistency between the data items, so as to synchronize the project plan of the solution management interface of the design and construction department to the processing system; Step S1.2, the processing system has multiple industry standard templates built in; based on the industry standard templates, all the data items of the project plan pulled are categorized and sorted, and the specific method is: identifying the category of the data item, the category of the data item includes standard items and non-standard items; for all standard items, sorting all the identified standard items according to the sorting order of each standard item in the industry standard template; for the identified non-standard items, sorting them to the end of the data items of the same level by default, and marking the non-standard items; Step S1.3, for the non-standard items sorted in step S1.2, the processing system has a manual adjustment function. Specifically, the front end of the processing system uses Vue.js to realize dynamic interaction with the displayed project plan, and the user manually sorts the non-standard items by dragging and moving; after the user manually adjusts the position of the non-standard item, the processing system records the relative position relationship of the non-standard item in the project plan, and uses localStorage to temporarily store the relative position relationship of the non-standard item; Based on the relative position relationship temporarily stored in the localStorage, the relative position relationship of the non-standard items remains unchanged during the subsequent incremental synchronization and logical deletion process; Thus, the sorted project plan is obtained.
3. The method for automatically sorting multi-professional checklist items of a hydropower project according to claim 2 is characterized in that: In step S1.1, when all data items of the project plan are first pulled from the plan management interface of the design and construction department and the data items are sorted, the processing system continuously performs data consistency verification to ensure the accuracy of the status, sequence and content of all data items, and uses the full-path string comparison method to ensure the integrity of data items during data item transmission and storage.
4. The method for automatically sorting multi-professional checklist items of a hydropower project according to claim 2 is characterized in that: When all data items of the project plan are first pulled from the plan management interface of the design and construction department and the data items are sorted, the processing system uses the local Map to cache frequent data items to improve the response speed of data item pulling and sorting.
5. The method for automatically sorting multi-professional checklist items of a hydropower project according to claim 2 is characterized in that: When all data items of the project plan are pulled from the plan management interface of the design and construction department for the first time for data synchronization, the processing system adopts a state and optimistic locking mechanism to ensure the consistency of the synchronized project plan: using the transaction management function, the entire synchronization process is encapsulated into a transaction to ensure the atomicity of the project plan and the integrity of the project plan.
6. The method for automatically sorting multi-professional checklist items of a hydropower project according to claim 1 is characterized in that: Step S2 is specifically as follows: Step S2.1, the processing system monitors the solution management interface of the design and construction department in real time through the RESTful API, determines whether the project solution of the solution management interface of the design and construction department is updated relative to the latest version of the saved project solution, and when it is monitored that the solution management interface of the design and construction department is updated, based on the latest version of the saved project solution, identifies the changed data items, and uses the Axios library to send a request to obtain the changed data items to the solution management interface of the design and construction department; Step S2.2, the processing system pulls the changed data items from the solution management interface of the design and construction department, and the changed data items are transmitted in JSON format; The processing system verifies the status of the changed data items that have been pulled, and uses a full-path string comparison verification method to verify the correctness and integrity of the changed data items to ensure the accuracy of the changed data items; Step S2.3, the processing system performs the following operations on the pulled changed data items: For deleted data items: the processing system identifies the deleted data items in the latest version of the project plan read, sets the status of the deleted data items to logical deletion, and sets the logically deleted data items to be hidden and invisible in the user interface in the new version of the project plan obtained this time; Therefore, the logically deleted data items are completely retained in the new version of the project plan obtained this time for subsequent tracing; For newly added data items: according to the category of the newly added data items, if it is a standard item, it will be added to the corresponding position of the latest version of the project plan according to the sorting order in the industry standard template; if it is a non-standard item, it will be sorted to the end of the data items of the same level by default, and the user can manually adjust the function; For modified data items, in the latest version of the project plan, directly logically delete the corresponding original data items, and add the modified data items to the corresponding positions of the latest version of the project plan according to the sorting rules; Record the detailed change records of this update and associate them with the corresponding data items; This completes incremental synchronization and logical deletion, and generates a new version of the project plan based on the latest version of the project plan; In step S2.4, the new version of the project plan is checked for data consistency, and a version number comparison and status verification mechanism is used to ensure that the status and content of all data items are correctly updated.
7. A method for automatically sorting multi-professional checklist items for hydropower engineering according to claim 6, characterized in that: The updated detailed change record includes: the changed data item, the change operation time, the change operation type and the executing user.
8. The method for automatically sorting multi-professional checklist items of a hydropower project according to claim 1 is characterized in that: Step S3 is specifically as follows: Step S3.1, each time incremental synchronization and logical deletion are performed, for each changed data item, a snapshot of the changed data item is generated, the snapshot of the changed data item records the unique identifier of the data item, the current state of the data item, the modification time of the data item, the executing user and the change type, and is stored in the MySQL database; Step S3.2, based on the snapshot of the data items stored in the database and the detailed change records of each record, historical data tracing is performed, including: Through the interface provided by the processing system, the historical version of the project plan is compared with the current version of the project plan. The Diff algorithm is used to highlight the modified data items in the current version of the project plan, intuitively display the changes of data items, and provide the function of viewing data items one by one to enhance user understanding; For data items that have been logically deleted, the user selects the data items that need to be restored from the detailed change record, resets their status to a valid state, and establishes an association with the current version of the project plan. The data items are then reinserted into the corresponding position of the current version of the project plan according to the sorting rules. The recovery operation will generate a new detailed change record to ensure the integrity of the data item traceability.
9. A system for automatically sorting multi-professional list items of a hydropower project according to any one of claims 1 to 8, characterized in that: include: The first data extraction and sorting process module is used to extract all data items of the project plan from the plan management interface of the design and construction department for the first time, and sort all data items according to the industry standard template using sorting rules to obtain the sorted project plan, and configure the project plan version number for the sorted project plan and save it; The incremental synchronization and logical deletion module is used to monitor the solution management interface of the design and construction department in real time based on the latest version of the saved project solution, and when it is detected that the solution management interface of the design and construction department is updated, the changed data items are identified, including newly added, modified and deleted data items; According to the industry standard template, the newly added and modified data items are synchronized to the latest version of the project plan by using the sorting rules, and the deleted data items are logically deleted in the latest version of the project plan, so as to obtain a new version of the project plan, configure the version number of the new version of the project plan, save the new version of the project plan, and record the detailed change records of this update; The historical data tracing module is used to generate a snapshot of each changed data item and store it in the database during each incremental synchronization and logical deletion. Historical data tracing is performed based on snapshots of data items stored in the database and detailed change records of each record.
Citation Information
Cited By
Method and system for RAG type data item extraction and consistency checking oriented to engineering technology document
CN121501758A
Incremental change method and system based on version number
CN121996280A