A method and system for managing operational daily report data
By parsing and processing daily operation reports in Excel format, the problem of low efficiency in managing daily operation data of wastewater treatment plants was solved, achieving efficient data storage and management, generating scientific statistical reports, improving work efficiency and saving labor costs.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- RIZHAO CHENGTOU ENVIRONMENTAL TECH GRP CO LTD
- Filing Date
- 2022-12-06
- Publication Date
- 2026-05-08
AI Technical Summary
In existing technologies, daily operation data of wastewater treatment plants mainly rely on Excel documents for storage, which makes filling, saving and statistics time-consuming and laborious, easy to lose and prone to errors, and inefficient.
It uses a unique algorithm to parse daily reports in Excel format, imports and stores the data, preprocesses and scans the data in a loop to generate statistical reports, and achieves classified storage and modular management of the data.
It improves data storage and management efficiency, saves labor costs, reduces the risk of data loss, and enables systematic and modular management and extraction of relevant data to generate scientific production reports, saving office costs and improving work efficiency.
Smart Images

Figure CN116150098B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data processing technology, and in particular to a method and system for managing daily operation data. Background Technology
[0002] The daily operation reports of the wastewater treatment industry cover data such as wastewater treatment volume, load rate, electricity consumption, sludge disposal volume, reclaimed water reuse volume, influent and effluent indicators, auxiliary agent dosage, and dosing cost. Most wastewater treatment plants generally use Excel documents to store various data during operation.
[0003] However, saving wastewater treatment operation data through Excel documents is a very outdated method. Filling in, saving, and compiling data is time-consuming and laborious, and it is also prone to loss and errors. Summary of the Invention
[0004] To save labor costs and improve efficiency, this application provides a method and system for managing daily operational data.
[0005] Firstly, this application provides a method for managing daily operation data, which adopts the following technical solution:
[0006] A method for managing daily operational data, comprising:
[0007] Import and save daily operation reports in Excel format;
[0008] The daily operation report is preprocessed to determine the corresponding start and end rows of valid data;
[0009] Based on the start and end rows of the valid data, the daily operation report is scanned cyclically to obtain the operation data of the daily operation report;
[0010] Based on the operational data, corresponding statistical reports are generated.
[0011] By adopting the above technical solution, and based on a unique algorithm to parse the daily operation reports in Excel format, the data of each plant is classified and stored. According to different business needs, relevant data can be queried and extracted. Compared with simply saving the operation data of sewage treatment in Excel documents, it is more efficient, saves labor costs, and the data is not easily lost. It can also manage and extract a lot of data in a systematic and modular way.
[0012] Optionally, the step of importing and storing the daily report in Excel format includes:
[0013] The running time can be obtained from the filename of the daily running report;
[0014] Convert the runtime into the required date format;
[0015] Determine whether the daily running report corresponding to the running time has been imported; if not, import it.
[0016] Optionally, the step of preprocessing the daily report to determine the corresponding start and end rows of valid data includes:
[0017] Using the data in the first column of the daily operation report as the feature data, scan row by row until different feature data appears, and update the information of the last row of valid data in real time.
[0018] Optionally, the step of cyclically scanning the daily operation report based on the start and end rows of the valid data to obtain the operation data of the daily operation report includes:
[0019] Start a loop and scan line by line from the first line of valid data to the last line of valid data; wherein, a new object is created in each loop, and the object is used to record the valid data;
[0020] Add the object to the list;
[0021] Start a loop to iterate through the valid data in the list until all valid data for the daily report has been saved to the database.
[0022] Optionally, the step of starting a loop to iterate through the data in the list until all valid data for the daily report has been saved to the database includes:
[0023] Based on the different columns in the daily operation report, obtain the corresponding valid data and save the valid data as a record to the database.
[0024] Optional, also includes:
[0025] Import and save an ecological environment monitoring table in Excel format; wherein the ecological environment monitoring table includes the discharge concentration and discharge amount of effluent indicators;
[0026] The ecological environment monitoring form is preprocessed to determine the start and end rows of valid data.
[0027] Scan line by line from the beginning of the valid data row to the end of the valid data row to obtain the detection data of the ecological environment monitoring table;
[0028] Based on the detection data, the average values of the discharge concentration and discharge amount of the effluent indicators are calculated;
[0029] Determine whether the average value of the discharge concentration and discharge volume of the effluent indicators is abnormal. If not, count the discharge concentration and include the discharge volume in the total discharge volume.
[0030] Optionally, the step of determining whether the average value of the discharge concentration and discharge amount of the effluent indicators is abnormal data includes:
[0031] If the emission concentration or emission amount is empty or equal to 0, it is considered abnormal data.
[0032] Optional, also includes:
[0033] Based on the emissions, it is determined whether the hourly flow rate exceeds a preset threshold; wherein, the hourly flow rate is the emissions within 1 hour;
[0034] If so, it will be included in the abnormal hourly flow statistics, and the maximum emission concentration and the maximum emission amount will be recorded.
[0035] Secondly, the daily report data management system provided in this application adopts the following technical solution:
[0036] A daily report data management system includes:
[0037] The import module is configured to import and store daily reports in Excel format.
[0038] The preprocessing module is configured to preprocess the daily report and determine the corresponding start row and end row of valid data.
[0039] The acquisition module is configured to perform a cyclic scan of the daily operation report based on the start row and end row of the valid data to acquire the operation data of the daily operation report;
[0040] The generation module is configured to generate corresponding statistical reports based on the running data.
[0041] In summary, this application includes at least one of the following beneficial technical effects:
[0042] 1. Based on a unique algorithm, the system parses daily operational reports in Excel format, categorizes and stores data from each plant, and allows for querying and retrieving relevant data according to different business needs. Compared to simply storing wastewater treatment operational data in Excel documents, this method is more efficient, saves labor costs, and reduces the risk of data loss. Furthermore, it enables systematic and modular management and effective extraction of a wide range of data.
[0043] 2. The system provides detailed statistics on various operational data and scientifically generates various production reports, which not only saves office costs but also improves work efficiency. Attached Figure Description
[0044] Figure 1 This is a flowchart illustrating a daily operation data management method according to one embodiment of this application. Detailed Implementation
[0045] The following combination Figure 1 This application will be described in further detail.
[0046] This application discloses a method for managing daily operation data.
[0047] Log in to the daily data management system with your username and password, and set your login account and password, as well as basic information such as the sewage treatment plant and the reclaimed water reuse enterprise through the super administrator. Then, use the daily data management system to perform the following daily data management methods to facilitate the systematic and modular management and effective extraction of a large amount of data.
[0048] It should be noted that the super administrator is a user group built in when the system is installed. All administrator users are in this group. It can set permissions for other users and can also be used to manage registered users or other administrators with certain permissions.
[0049] As one implementation method for daily operation data management, the specific steps include:
[0050] 100. Import and save the daily running report in Excel format.
[0051] Specifically, the system collects operational data reported by each wastewater treatment plant, summarizes it into an Excel document, and imports the daily operational report in Excel format into the system.
[0052] Step 100 includes:
[0053] 101. Obtain the running time through the file name of the running daily report.
[0054] Specifically, based on the filename with a fixed format, such as: 2022-11-13 Wastewater Treatment Plant Operation Daily Report.xlsx, the operation time (2022-11-13) can be obtained.
[0055] 102. Convert the runtime into the required Java date format.
[0056] 103. Determine whether the daily running report corresponding to the running time has been imported. If not, import it.
[0057] Specifically, check if the daily report corresponding to the running time has been imported. If it has been imported, exit the program to prevent duplicate imports.
[0058] 200. Preprocess the daily operation report to determine the corresponding start row and end row of valid data.
[0059] Specifically, the data in the first column of the daily operation report is used as the feature data, and the data is scanned row by row until different feature data appears, and the information of the last row of valid data is updated in real time.
[0060] It should be noted that two flags, "Start Row" and "End Row," are pre-set, with initial values of 0 for both. Using the data in column 1 (the name of the wastewater treatment plant) as the feature data, the data is scanned row by row until a different wastewater treatment plant name appears. The valid data end row information in that object is then updated, thereby determining the valid data record range for a particular wastewater treatment plant, i.e., from row n to row m.
[0061] 300. Based on the start and end rows of the valid data, the daily operation report is scanned cyclically to obtain the operation data of the daily operation report.
[0062] Step 300 includes:
[0063] 301. Begin a loop, scanning line by line from the beginning of the valid data row to the end of the valid data row; wherein, a new object is created in each loop, the object being used to record the valid data;
[0064] 302, Add the object to the list;
[0065] 303. Start a loop to iterate through the valid data in the list until all valid data for the daily report has been saved to the database.
[0066] Specifically, a loop is started, scanning line by line from the beginning row of valid data to the end row of valid data. In each iteration of this loop, a new RowScale object is created, recording the name of a wastewater treatment plant and valid data belonging to that plant, such as the beginning row of valid data, the end row of valid data, and the treatment capacity, and then added to the RowScale list.
[0067] Then a loop begins, iterating through the data in the RowScale list, that is, retrieving the corresponding valid data based on different columns in the daily operation report in Excel format, and saving the valid data as a record to the database.
[0068] Specifically, based on different columns in Excel, the following data are obtained: wastewater treatment volume, load rate, wastewater power consumption, wastewater unit consumption, sludge removal volume of wastewater treatment plant, sludge removal chemical dosage, and reclaimed water reuse volume. These data are then saved to a single record in the database.
[0069] Then, using this loop, based on different columns in Excel, information such as the amount of reclaimed water supplied by the wastewater treatment plant, the electricity consumption for reclaimed water, the unit consumption of reclaimed water, and the units using reclaimed water can be obtained and saved to the database. This process may involve one or more data entries for a single wastewater treatment plant.
[0070] At the same time, this loop can be used to obtain and save information on wastewater treatment plant effluent indicators such as COD, ammonia nitrogen, total phosphorus, and total nitrogen, based on different columns in Excel.
[0071] In addition, using this loop, the usage of auxiliary chemicals in the wastewater treatment plant is obtained based on different columns in Excel, and the unit price of the chemicals in the signed chemical contracts is queried. The current chemical costs of the wastewater treatment plant are calculated, and the usage and cost of each chemical are saved to the database.
[0072] After the loop completes its iteration through the RowScale list, all valid data in the Excel file has been saved to the database.
[0073] 400. Based on the aforementioned operational data, generate corresponding statistical reports.
[0074] Specifically, the system records daily operational information for each wastewater treatment plant, third-party influent monitoring data, daily discharge and reclaimed water supply information for each wastewater treatment plant, monthly reclaimed water sales information, information on chemicals received by wastewater treatment plants according to contracts, and daily chemical usage information for each wastewater treatment plant. The daily operational information for each wastewater treatment plant includes: wastewater treatment volume, load rate, wastewater power consumption, wastewater unit consumption, sludge removal volume, reclaimed water supply volume, and reclaimed water unit consumption. The daily discharge and reclaimed water supply information for each wastewater treatment plant includes: water supplier, water user, date of use, and water consumption. The information on chemicals received by wastewater treatment plants according to contracts includes: wastewater treatment plant, chemical manufacturer, chemical name, unit price, date of receipt, quantity received, and amount received. The daily chemical usage information includes: wastewater treatment plant, operating date, chemical name, chemical price, dosage, and cost.
[0075] Each row of data is categorized and stored in the corresponding data table according to business needs. Business data includes: sewage treatment volume, load rate, sludge removal volume, electricity consumption per ton of water, reclaimed water supply, effluent indicators, and auxiliary agent usage.
[0076] At the same time, relevant data can be queried and extracted according to different business needs; daily, monthly or annual statistical reports can also be generated according to query requirements.
[0077] As another implementation of the daily report data management method, the following steps are also included:
[0078] 500. Import and save the ecological environment monitoring table in Excel format; wherein, the ecological environment monitoring table includes the discharge concentration and discharge amount of the effluent indicators.
[0079] It should be noted that the ecological and environmental monitoring information of a wastewater treatment plant for a certain quarter is retrieved and downloaded from the website of the Ecological and Environmental Protection Bureau, including the discharge concentration and discharge volume of effluent indicators such as COD, ammonia nitrogen, total phosphorus, and total nitrogen; and the ecological and environmental monitoring table is imported into the system in step 100.
[0080] 600, preprocess the ecological environment monitoring form to determine the start row and end row of valid data.
[0081] It should be noted that this step uses the same method as step 200.
[0082] 700, scan line by line from the beginning of the valid data row to the end of the valid data row to obtain the detection data of the ecological environment monitoring table.
[0083] Specifically, the time for detecting water quality indicators is determined based on the first column of each row of data, accurate to the year, month, day, and hour; then the detection data is filtered based on the other columns.
[0084] It should be noted that this step uses the same method as step 300.
[0085] 800, based on the detection data, calculate the average value of the discharge concentration and discharge amount of the effluent index.
[0086] 900, determine whether the average value of the discharge concentration and discharge amount of the effluent indicators is abnormal data. If not, count the discharge concentration and include the discharge amount in the total discharge amount.
[0087] Specifically, if the emission concentration or emission amount is empty or equal to 0, it is considered abnormal data, and the emission concentration and emission amount are not counted, nor is the emission amount included in the total emission amount. If the emission concentration is greater than 0, the emission concentration and emission amount are counted and included in the total emission amount.
[0088] In addition, the daily operation data management methods also include:
[0089] Based on the emissions, it is determined whether the hourly flow rate exceeds a preset threshold; wherein, the hourly flow rate is the emissions within 1 hour;
[0090] If so, it will be included in the abnormal hourly flow statistics, and the maximum emission concentration and the maximum emission amount will be recorded.
[0091] If not, calculate the total hourly flow rate and record the maximum emission concentration and the maximum emission amount.
[0092] After each row of data is scanned and statistically analyzed, data such as hourly flow rate, discharge concentration of various effluent indicators, and discharge volume are displayed on the page. When filling in environmental protection tax data, relevant analysis data can be selected and filled in according to the filling requirements; and operation reports can be generated and exported.
[0093] Based on the above-described method for managing daily operation data, this application also discloses a daily operation data management system, specifically including:
[0094] The import module is configured to import and store daily reports in Excel format.
[0095] The preprocessing module is configured to preprocess the daily report and determine the corresponding start row and end row of valid data.
[0096] The acquisition module is configured to perform a cyclic scan of the daily operation report based on the start row and end row of the valid data to acquire the operation data of the daily operation report;
[0097] The generation module is configured to generate corresponding statistical reports based on the running data.
[0098] The above are all preferred embodiments of this application, and are not intended to limit the scope of protection of this application. Therefore, all equivalent changes made in accordance with the structure, shape and principle of this application should be covered within the scope of protection of this application.
Claims
1. A method for managing daily operational data, characterized in that, include: Importing and storing daily operation reports in Excel format includes: obtaining the operation time through the file name of the daily operation report, converting the operation time into the required date format, determining whether the daily operation report corresponding to the operation time should be imported, and if not, importing it; The daily operation report is preprocessed to determine the corresponding start row and end row of valid data, including: using the data in the first column of the daily operation report as feature data, scanning row by row until different feature data appears, and updating the end row information of valid data in real time; Based on the start and end rows of valid data, the daily operation report is scanned cyclically to obtain the operation data of the daily operation report. This includes: starting a loop and scanning line by line from the start row to the end row of valid data; wherein, a new object is created in each loop to record valid data; the object is added to a list; starting a loop and traversing the valid data in the list until all valid data of the daily operation report has been saved to the database, including: creating a RowScale object in each loop to record the name of a wastewater treatment plant and valid data such as the start row, end row, and treatment capacity of the valid data belonging to that wastewater treatment plant, and adding it to the RowScale list; Then a loop is started to traverse the data in the RowScale list, obtain the corresponding valid data according to different columns in the daily operation report, and save the valid data as a record to the database; Based on the operational data, corresponding statistical reports are generated.
2. The method for managing daily operation data according to claim 1, characterized in that, Also includes: Import and save an ecological environment monitoring table in Excel format; wherein the ecological environment monitoring table includes the discharge concentration and discharge amount of effluent indicators; The ecological environment monitoring form is preprocessed to determine the start and end rows of valid data. Scan line by line from the beginning of the valid data row to the end of the valid data row to obtain the detection data of the ecological environment monitoring table; Based on the detection data, the average values of the discharge concentration and discharge amount of the effluent indicators are calculated; Determine whether the average value of the discharge concentration and discharge volume of the effluent indicators is abnormal. If not, count the discharge concentration and include the discharge volume in the total discharge volume.
3. The daily operation data management method according to claim 2, characterized in that, The step of determining whether the average value of the discharge concentration and discharge volume of the effluent indicators is abnormal data includes: If the emission concentration or emission amount is empty or equal to 0, it is considered abnormal data.
4. The daily operation data management method according to claim 3, characterized in that, Also includes: Based on the emissions, it is determined whether the hourly flow rate exceeds a preset threshold; wherein, the hourly flow rate is the emissions within 1 hour; If so, it will be included in the abnormal hourly flow statistics, and the maximum emission concentration and the maximum emission amount will be recorded.
5. A daily report data management system, characterized in that, The daily operation data management method according to any one of claims 1-4 includes: The import module is configured to import and store daily reports in Excel format. The preprocessing module is configured to preprocess the daily report and determine the corresponding start row and end row of valid data. The acquisition module is configured to perform a cyclic scan of the daily operation report based on the start row and end row of the valid data to acquire the operation data of the daily operation report; The generation module is configured to generate corresponding statistical reports based on the running data.
Citation Information
Patent Citations
EXCEL data export method and export device in multi-concurrence large data volume environment
CN103500196A
Data export method, server and computer readable storage medium
CN107562705A
Sewage treatment online supervision platform
CN112598368A
Report generation method and device, equipment and medium
CN115033623A