Method, System and Computing Device for Updating and Processing Environmental Monitoring Data
By verifying content and relevance update of environmental monitoring data, the data timeliness and accuracy problems caused by improper update methods in the prior art are solved, real-time relevance update of environmental monitoring data is realized, and real-time and accuracy of data updates are improved.
Patent Information
- Application Number
- CN202210450123.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-26
- Publication Date
- 2025-08-01
- Estimated Expiration
- 2042-04-26
AI Technical Summary
In the prior art, the update method of environmental monitoring data is difficult to ensure that each type of time monitoring data reaches the optimal update time interval, resulting in excessive signal update frequency or reducing the timeliness of environmental monitoring data.
By receiving environmental monitoring data, performing content verification processing, determining the initial data to be updated in the environment and its associated data, and using corresponding data update methods to perform association update processing to ensure the real-time and accuracy of the data.
Realize instant correlation updates of environmental monitoring data, improve the timeliness and accuracy of data updates, and ensure the real-time and reliability of environmental analysis results.
Smart Images

Figure CN114840541B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of geographic information processing. Specifically, it relates to a method, a system, and an arithmetic device for updating and processing environmental monitoring data. Background Art
[0002] Environmental monitoring is that environmental monitoring agencies monitor and measure the environmental quality status to obtain environmental monitoring data such as physical indicators, chemical indicators, and ecosystem indicators that can reflect the environmental quality. Environmental monitoring data includes various types of data with different update intervals. To timely grasp the environmental change trend based on the updated environmental monitoring data, the management of updated data of environmental monitoring data is a very important task.
[0003] In the prior art, generally, multiple levels of update time intervals are set, such as minute level, hour level, day level, week level, etc., so that the update times of various types of environmental monitoring data respectively correspond to a certain level of update time interval, and data updates are performed according to the update time interval of the update level.
[0004] However, this data update method in the prior art is difficult to ensure that the update time intervals of each type of time monitoring data reach the optimal update time interval. If the update time interval is set too small, it will lead to too high a signal update frequency, reducing the performance of arithmetic processing. If the update time interval is set too large, it will reduce the timeliness of environmental monitoring data. Summary of the Invention
[0005] The objectives of this application include, for example, providing a method, a system, and an arithmetic device for updating and processing environmental monitoring data, which can perform associated update processing immediately according to the update of the initial environmental data to be updated in the environmental monitoring data and the update of the environmental associated data related to the initial environmental data to be updated, and obtain the corresponding environmental monitoring updated data and environmental monitoring associated data, improving the timeliness of data updates.
[0006] The embodiments of this application can be implemented as follows:
[0007] In a first aspect, this application provides a method for updating and processing environmental monitoring data, and the method includes:
[0008] Receiving environmental monitoring data sent by a data acquisition device, where the data types of the environmental monitoring data include: environmental monitoring real-time data type, environmental monitoring archived data type;
[0009] Perform content verification processing on the environmental monitoring data to obtain initial environmental data to be updated and initial environmental associated data. The initial environmental associated data includes: data that has an association with the initial environmental data to be updated and affects the update of the initial environmental data to be updated.
[0010] Determine the corresponding data update method according to the data type of the initial environmental data to be updated.
[0011] Perform associated update processing on the initial environmental data to be updated and the initial environmental associated data according to the data update method to obtain updated environmental monitoring data and environmental monitoring associated data.
[0012] In an optional implementation manner, the determining the corresponding data update method according to the initial environmental data to be updated includes:
[0013] If the data type of the initial environmental data to be updated is an environmental monitoring real-time data type, determine the corresponding data update method as a data real-time update method.
[0014] If the data type of the initial environmental data to be updated is an environmental monitoring archived data type, determine the corresponding data update method as a data archived update method.
[0015] In an optional implementation manner, the performing associated update processing on the initial environmental data to be updated and the initial environmental associated data according to the data update method to obtain updated environmental monitoring data and environmental monitoring associated data includes:
[0016] If the data update method is a data real-time update method, identify the first data category of the initial environmental data to be updated, and perform analysis processing on the initial environmental data to be updated according to the first data category to obtain the updated environmental monitoring data, and identify the second data category of the initial environmental associated data, and perform analysis processing on the initial environmental associated data according to the second data category to obtain the environmental monitoring associated data.
[0017] In an optional implementation manner, the performing content verification processing on the environmental monitoring data to obtain initial environmental data to be updated and initial environmental associated data includes:
[0018] Perform data association processing and normalization processing on the environmental monitoring data to obtain monitored normalized data and associated normalized data.
[0019] Perform data verification on the monitored normalized data and the associated normalized data to obtain the initial environmental data to be updated and the initial environmental associated data.
[0020] In an optional embodiment, the performing data verification on the monitoring normalized data and the associated normalized data to obtain the initial environment data to be updated and the initial environment associated data includes:
[0021] Determine whether the data format of the monitoring normalized data is correct; if the data format is correct, determine whether the data content of the monitoring normalized data is correct; if the data content is correct, verify that the monitoring normalized data passes, and use the monitoring normalized data as the initial data to be updated for the environment;
[0022] Determine whether the data format of the associated normalized data is correct. If the data format is correct, determine whether the data content of the associated normalized data is correct. If the data content is correct, the verification passes and the associated normalized data is used as the initial associated data of the environment.
[0023] In an optional embodiment, the method further includes:
[0024] Determining a data update level of the environmental monitoring update data according to a data type of the environmental monitoring update data;
[0025] Determining a data update level of the environmental monitoring associated data according to a data type of the environmental monitoring associated data;
[0026] The environment monitoring update data and the environment monitoring associated data are written into a database according to the data update level of the environment monitoring update data and the data update level of the environment monitoring associated data.
[0027] In an optional embodiment, the method further includes:
[0028] If the data format or data content of the monitoring normalized data is incorrect, deleting the monitoring normalized data;
[0029] If the data format or data content of the associated normalized data is incorrect, the associated normalized data is deleted.
[0030] In a second aspect, the present application provides an environmental monitoring data update processing system, the environmental monitoring data update processing system comprising: a plurality of data acquisition devices and a computing device, the plurality of data acquisition devices being respectively communicatively connected to the computing device;
[0031] The multiple data acquisition devices are used to collect environmental monitoring data and send it to the computing device in real time;
[0032] The computing device is used in the method for updating and processing environmental monitoring data as described in any one of the aforementioned embodiments.
[0033] In a third aspect, the present application provides an update processing device for environmental monitoring data, and the device includes:
[0034] a receiving module, configured to receive environmental monitoring data sent by a data acquisition device, and the data types of the environmental monitoring data include: environmental monitoring real-time data type and environmental monitoring archived data type.
[0035] a verification module, configured to perform content verification processing on the environmental monitoring data to obtain initial environmental data to be updated and initial environmental associated data, and the initial environmental associated data includes: data that has an associated relationship with the initial environmental data to be updated and affects the update of the initial environmental data to be updated.
[0036] a determination module, configured to determine a corresponding data update method according to the data type of the initial environmental data to be updated.
[0037] an update module, configured to perform associated update processing on the initial environmental data to be updated and the initial environmental associated data according to the data update method to obtain updated environmental monitoring data and environmental monitoring associated data.
[0038] Specifically, the determination module is further configured to, if the data type of the initial environmental data to be updated is the environmental monitoring real-time data type, determine that the corresponding data update method is the data real-time update method; if the data type of the initial environmental data to be updated is the environmental monitoring archived data type, determine that the corresponding data update method is the data archived update method.
[0039] Specifically, the update module is further configured to, if the data update method is the data real-time update method, identify a first data category of the initial environmental data to be updated, and perform analysis processing on the initial environmental data to be updated according to the first data category to obtain the updated environmental monitoring data, and identify a second data category of the initial environmental associated data, and perform analysis processing on the initial environmental associated data according to the second data category to obtain the environmental monitoring associated data.
[0040] Specifically, the verification module is further configured to perform data association processing and normalization processing on the environmental monitoring data to obtain monitored normalized data and associated normalized data; perform data verification on the monitored normalized data and the associated normalized data to obtain the initial environmental data to be updated and the initial environmental associated data.
[0041] Specifically, the verification module is further configured to determine whether the data format of the monitored normalized data is correct. If the data format is correct, it determines whether the data content of the monitored normalized data is correct. If the data content is correct, the verification passes, and the monitored normalized data is used as the initial environment data to be updated. It determines whether the data format of the associated normalized data is correct. If the data format is correct, it determines whether the data content of the associated normalized data is correct. If the data content is correct, the verification passes, and the associated normalized data is used as the initial environment associated data.
[0042] The determination module is further configured to determine the data update level of the environmental monitoring update data according to the data type of the environmental monitoring update data; determine the data update level of the environmental monitoring associated data according to the data type of the environmental monitoring associated data; and write the environmental monitoring update data and the environmental monitoring associated data into the database according to the data update level of the environmental monitoring update data and the data update level of the environmental monitoring associated data.
[0043] The verification module is further configured to delete the monitored normalized data if the data format or data content of the monitored normalized data is incorrect; and delete the associated normalized data if the data format or data content of the associated normalized data is incorrect.
[0044] In a fourth aspect, the present application provides an operation device, which includes: a processor, a storage medium, and a bus. The storage medium stores machine-readable instructions executable by the processor. When the operation device runs, the processor communicates with the storage medium through the bus, and the processor executes the machine-readable instructions to perform the steps of the environmental monitoring data update processing method according to any one of the foregoing embodiments.
[0045] In a fifth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the environmental monitoring data update processing method according to any one of the foregoing embodiments are implemented.
[0046] The beneficial effects of the embodiments of the present application include:
[0047] By using the method, system and computing device for updating environmental monitoring data provided in this application, first, initial environmental data to be updated and initial environmental associated data that has an associated relationship with the initial environmental data to be updated and can affect the initial environmental data to be updated are obtained. In this way, after obtaining the initial environmental data to be updated and the initial environmental associated data, the associated update process for the above data can be triggered immediately to obtain updated environmental monitoring data and associated environmental monitoring data, ensuring the real-time nature of data update. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.
[0049] Figure 1 It is a schematic structural diagram of the system for updating environmental monitoring data provided by an embodiment of this application;
[0050] Figure 2 It is a schematic flowchart of the steps of the method for updating environmental monitoring data provided by an embodiment of this application;
[0051] Figure 3 It is another schematic flowchart of the steps of the method for updating environmental monitoring data provided by an embodiment of this application;
[0052] Figure 4 It is another schematic flowchart of the steps of the method for updating environmental monitoring data provided by an embodiment of this application;
[0053] Figure 5 It is another schematic flowchart of the steps of the method for updating environmental monitoring data provided by an embodiment of this application;
[0054] Figure 6 It is another schematic flowchart of the steps of the method for updating environmental monitoring data provided by an embodiment of this application;
[0055] Figure 7 It is another schematic flowchart of the steps of the method for updating environmental monitoring data provided by an embodiment of this application;
[0056] Figure 8 It is a schematic structural diagram of the device for updating environmental monitoring data provided by an embodiment of this application;
[0057] Figure 9 It is a schematic structural diagram of the computing device provided by an embodiment of this application.
[0058] Icons: 101 - computing device; 1021 - first data acquisition device; 1022 - second data acquisition device; 1023 - Nth data acquisition device; 10 - update processing device for environmental monitoring data; 1001 - receiving module; 1002 - verification module; 1003 - determination module; 1004 - update module; 2001 - processor; 2002 - memory. Detailed implementation manners
[0059] To make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Apparently, the described embodiments are some, but not all, of the embodiments of the present application. Usually, the components of the embodiments of the present application described and illustrated in the accompanying drawings here can be arranged and designed in various different configurations.
[0060] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application claimed, but merely represents selected embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts fall within the scope of protection of the present application.
[0061] It should be noted that similar reference numerals and letters denote similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.
[0062] In addition, terms such as "first" and "second" are used for descriptive purposes only and cannot be construed as indicating or implying relative importance.
[0063] It should be noted that the features in the embodiments of the present application can be combined with each other without conflict.
[0064] Monitoring the temperature, humidity, air pollutant concentration, ultraviolet intensity, etc. of the environment to obtain environmental monitoring data can play an important role in aspects such as weather forecasting and resource scheduling. In order to obtain environmental monitoring data, after environmental monitoring data is measured at various monitoring sites of different types and positions, it is transmitted to the analysis server, so as to further analyze and display the environmental change trend. Due to the large number and wide distribution of the designed monitoring sites, it is not easy to synchronize the collection and upload of various types of environmental monitoring data. Currently, generally, multiple levels of update time intervals are set, such as minute-level, hour-level, day-level, week-level, etc. Then, according to the update cycle of the environmental monitoring data, a similar update time interval is assigned to it, and finally, it is written into the analysis server according to the update time interval.
[0065] However, this data update method in the prior art may cause a certain time difference between the actual reception time of environmental monitoring data and the data update time, directly affecting the accuracy and timeliness of the transmission results of the analysis server.
[0066] Based on this, through research, the applicant has proposed an update processing method, system and computing device for environmental monitoring data, which can perform associated update processing immediately after determining that the mutually associated initial environmental data to be updated and environmental associated data are both updated, obtaining updated environmental monitoring update data and environmental monitoring associated data, improving the update rate and real-time performance of environmental monitoring data, and also improving the accuracy of the environmental situation analysis results.
[0067] The following combines multiple specific application examples to explain an update processing method, system and computing device for environmental monitoring data provided by an embodiment of the present application.
[0068] Figure 1 The following shows a schematic structural diagram of an update processing system for environmental monitoring data provided by an embodiment of the present application. As Figure 1 shown, the update processing system for environmental monitoring data includes: a plurality of data collection devices and a computing device 101, and the plurality of data collection devices are respectively communicatively connected to the computing device 101.
[0069] The plurality of data collection devices are used to collect environmental monitoring data and send it to the computing device 101 in real time.
[0070] The computing device 101 is used to execute the update processing method for environmental monitoring data in the following embodiments.
[0071] The space involved in environmental monitoring is relatively vast. To ensure the reliability of data, a sufficient number and density of data collection devices need to be set up for collecting environmental monitoring data. Among them, the data collection device can be a monitoring device capable of collecting various types of environmental monitoring data, such as the devices for detecting air humidity and temperature set up in a meteorological monitoring station, or the devices for detecting river runoff velocity set up in a hydrological monitoring station, etc. Of course, it is not limited thereto. In this embodiment, a plurality of data collection devices are set up. Exemplarily, it may include: a first data collection device 1021, a second data collection device 1022 to an Nth data collection device 1023.
[0072] The computing device 101 may be a computer device, a server, etc. with computing and processing capabilities. The above-mentioned multiple data acquisition devices send the collected different types of environmental monitoring data to the computing device 101 in real time, and the computing device 101 performs content verification processing on it to obtain the initial environmental data to be updated and the initial environmental associated data. Among them, the process of content verification processing may be: First, define the data output format and the associated relationship for various data in the environmental monitoring data, and then perform normalization processing on the environmental monitoring data to obtain the monitored normalized data and the associated normalized data. It can be understood that the monitored normalized data is any data in the environmental monitoring data, and the associated normalized data is the data having an associated relationship with it. Then, the computing device 101 can perform data verification on the above-mentioned monitored normalized data and the associated normalized data respectively to verify whether their data formats and data contents are correct. If the verification passes, the above-mentioned monitored normalized data and the associated normalized data are used as the initial environmental data to be updated and the initial environmental associated data. If the verification fails, the data that fails the verification is re-obtained, and the above-mentioned monitored normalized data and the associated normalized data are deleted.
[0073] If both the initial environmental data to be updated and the initial environmental associated data obtained simultaneously are of the environmental monitoring archived data type, determine that the data update method is the data archiving update method, and update according to the preset update period or regularly by the staff.
[0074] If the above-mentioned initial environmental data to be updated and the initial environmental associated data are of the environmental monitoring real-time data type, determine that the data update method is the data real-time update method, and update the data stored in the database of the computing device 101. Optionally, the update process may be: First, analyze and process the initial environmental data to be updated according to the first data category of the initial environmental data to be updated to obtain the valid data that can describe the environmental situation in the initial environmental data to be updated as the environmental monitoring update data. In the same way, the initial environmental associated data can be analyzed and processed according to the second data category of the initial environmental associated data to obtain the environmental monitoring associated data. Next, the computing device 101 can determine the corresponding data update levels according to the data types of the environmental monitoring update data and the environmental monitoring associated data respectively. Further, according to the data update levels, the environmental monitoring update data and the environmental monitoring associated data obtained in the above process are written into the database to complete the data update process.
[0075] Optionally, the environmental monitoring update data and the environmental monitoring associated data that have been updated in the database can be further analyzed to generate the latest environmental evaluation results.
[0076] Next, the update processing method of the environmental monitoring data will be described in detail.
[0077] Figure 2 The following is a flowchart of the steps of the method for updating environmental monitoring data provided by an embodiment of the present application. As Figure 2 shown, the execution subject of this method can be the computing device of the above-mentioned environmental monitoring data update processing system. As Figure 2 shown, this method can be implemented by the following steps.
[0078] S201, Receive environmental monitoring data sent by the data acquisition device.
[0079] Among them, the data types of the environmental monitoring data include: environmental monitoring real-time data type, environmental monitoring archived data type.
[0080] The environmental monitoring data may include remote sensing image data, image sensor data, numerical sensor data, etc. The data types of these data are environmental monitoring real-time data types and are environmental monitoring archived data types. The environmental monitoring data may include both types of data at the same time, or may include only one type of data.
[0081] The environmental monitoring data collected and sent in real time by the data acquisition device may be of the environmental monitoring real-time data type. The environmental monitoring archived data type may be the type of environmental monitoring data that is sent after a delay due to network reasons or a preset data sending cycle reason after being collected in real time by the data acquisition device, or may also be the type of historical environmental monitoring data uploaded by the staff.
[0082] The computing device can determine whether the type of the received environmental monitoring data is the environmental monitoring real-time data type according to the comparison difference between the time tag of the received environmental monitoring data and the current time. Exemplarily, if the comparison difference is less than or equal to the transmission delay between the computing device and the data acquisition device, it is confirmed that it is the environmental monitoring real-time data type.
[0083] S202, Perform content verification processing on the environmental monitoring data to obtain initial environmental data to be updated and initial environmental associated data.
[0084] Among them, the initial environmental associated data includes: data that has an associated relationship with the initial environmental data to be updated and affects the update of the initial environmental data to be updated.
[0085] It can be understood that the environmental monitoring data includes various types of data, and there is an associated relationship between some of the environmental monitoring data. For example, wind speed, temperature, and light are interrelated. When all three are updated simultaneously, the latest results regarding changes in the environmental situation may be analyzed. For example, if the wind speed increases, the temperature decreases, and the light decreases, it may rain. The associated relationships between the above parameters can be defined based on the parameters that jointly affect the environmental analysis results in historical data, and can also be supplemented by manual definition by staff according to experience. This application does not make any limitations here.
[0086] According to the above description, if any data after content verification processing of the environmental monitoring data is used as the target data, that is, the initial environmental data to be updated, then the environmental monitoring data associated with the initial environmental data to be updated in the environmental monitoring data is updated simultaneously with the initial environmental data to be updated, and after content verification processing, the initial environmental associated data is obtained. Then, based on the above initial environmental data to be updated and the initial environmental associated data, the latest environmental analysis results can be obtained, and the initial environmental data to be updated can update the database of the computing device. Otherwise, if the initial environmental associated data associated with the initial environmental data to be updated is not obtained, the latest environmental analysis results cannot be obtained, and there is no need to write the updated initial environmental data to be updated into the database. That is, the initial environmental associated data is the data that has an associated relationship with the initial environmental data to be updated after content verification processing of the environmental monitoring data and affects whether the initial environmental data to be updated needs to be updated into the database.
[0087] Among them, the above content verification processing can be the determination of the associated relationship between the data in the environmental monitoring data, the determination of the correctness of the data content, etc. This application does not make any limitations here.
[0088] S203. Determine the corresponding data update method according to the data type of the initial environmental data to be updated.
[0089] Furthermore, the data type can be determined according to the time tag of the initial environmental data to be updated, and further, the data update methods of the above initial environmental data to be updated and the initial environmental associated data can be determined. Exemplarily, it can be whether it is necessary to write to the database in real time for data update, etc.
[0090] S204. Perform an associated update process on the initial environmental data to be updated and the initial environmental associated data according to the data update method to obtain the updated environmental monitoring data and the associated environmental monitoring data.
[0091] Among them, the associated update process can further analyze and process the initially to-be-updated environmental data and the initially associated environmental data that are mutually associated, so as to obtain the data value of the environmental situation described by the above data. For example, by analyzing whether the river runoff of the initially to-be-updated environmental data exceeds a preset threshold, it is determined whether a flood has occurred.
[0092] Optionally, the initially to-be-updated environmental data after the above analysis and processing can be used as environmental monitoring update data, and the initially associated environmental data after the analysis and processing can be used as environmental monitoring associated data.
[0093] In this embodiment, after obtaining the initially to-be-updated environmental data and the initially associated environmental data having an associated relationship therewith, the associated update process of the above data can be immediately triggered to obtain environmental monitoring update data and environmental monitoring associated data, ensuring the real-time nature of data update.
[0094] Optionally, as Figure 3 shown, in the above step S203, according to the initially to-be-updated environmental data, the corresponding data update method can be implemented by the following steps S301 to S302.
[0095] S301, if the data type of the initially to-be-updated environmental data is an environmental monitoring real-time data type, then determine that the corresponding data update method is a data real-time update method.
[0096] Optionally, the corresponding data update method can be further determined according to the data type of the initially to-be-updated environmental data. It can be understood that since the initially to-be-updated environmental data is obtained by content verification processing of environmental monitoring data, its data type also includes: environmental monitoring real-time data type, environmental monitoring archived data type.
[0097] The data real-time update method includes: immediate update, delayed update, and scheduled update. For data with high real-time requirements, or data that can obtain the latest environmental analysis results, immediate update is adopted to write the update data into the database for data analysis without delay. For data with low real-time requirements or weak influence on the environmental analysis results, delayed update or scheduled update is adopted. Among them, delayed update is to write the data into the database after a fixed time delay. According to the real-time requirement level, the delay time level can be in seconds, minutes, hours, days, etc. Scheduled update is to write the data into the database at fixed time intervals. According to the real-time requirement level, the fixed time interval can be in seconds, minutes, hours, days, etc.
[0098] If the data type of the initial environmental data to be updated is the real-time environmental monitoring data type, and the data type of the initial environmental associated data is also the real-time environmental monitoring data type, then based on the real-time initial environmental data to be updated and the initial environmental associated data, the computing device can obtain the real-time result of the environmental status, and then perform immediate update.
[0099] If the data type of the initial environmental data to be updated is the real-time environmental monitoring data type, and the data type of the initial environmental associated data is the archived environmental monitoring data type, then it can be determined whether to perform delayed update or scheduled update according to whether the time difference between the time tag of the initial environmental data to be updated and the time tag of the initial environmental associated data is greater than the preset time threshold, so that the real-time result of the environmental status cannot be obtained.
[0100] S302, if the data type of the initial environmental data to be updated is the archived environmental monitoring data type, then determine that the corresponding data update method is the data archiving update method.
[0101] The data archiving update method includes manual update and scheduled update. For data that affects the environmental analysis result, to improve its real-time performance, manual update can be used to write the initial environmental data to be updated and the initial environmental associated data into the database. For data with low real-time requirements, to avoid data accumulation, scheduled update can be performed at fixed time intervals. The time intervals for scheduled update can be in seconds, minutes, hours, days, etc.
[0102] Similar to the above steps, if the data type of the initial environmental data to be updated is the archived environmental monitoring data type, then determine whether to use manual update or scheduled update specifically according to whether the initial environmental associated data and the initial environmental data to be updated can generate real-time environmental analysis results.
[0103] In this embodiment, by determining the data update method, the processing time limit of the initial environmental data to be updated is limited, the load balance of the computing device is achieved, and the computing efficiency of the computing device is improved.
[0104] Optionally, in the above step S204, according to the data update method, the initial environmental data to be updated and the initial environmental associated data are associated and updated to obtain the environmental monitoring updated data and the environmental monitoring associated data, which may include:
[0105] If the data update method is the data real-time update method, then identify the first data category of the initial environmental data to be updated, and analyze and process the initial environmental data to be updated according to the first data category to obtain the environmental monitoring updated data, and identify the second data category of the initial environmental associated data, and analyze and process the initial environmental associated data according to the second data category to obtain the environmental monitoring associated data.
[0106] Among them, the ways to analyze and process the initial environmental data to be updated and the initial environmental associated data can be: one or more of threshold judgment, empirical constant, numerical regression, artificial intelligence, physical model simulation, or other custom calculation methods, which are not specifically limited in this application.
[0107] The first data category of the initial environmental data to be updated and the second data category of the initial environmental associated data can be used to indicate the specific category of the data. For example, the flow data type of hydrological data, the temperature data in meteorological data, etc. It can be understood that for different types of data, different analysis and processing methods are required to obtain. Exemplarily, for multiple historical sensor data, the trend of its change can be analyzed by means of artificial intelligence to determine and output whether the change amount of the data is within the normal range.
[0108] In this way, according to the first data category, the initial environmental data to be updated is analyzed and processed to obtain the environmental monitoring updated data. According to the second data category, the initial environmental associated data is analyzed and processed to obtain the environmental monitoring associated data. The obtained environmental monitoring updated data and environmental monitoring associated data can be used for database update or further obtain environmental analysis results.
[0109] In this embodiment, according to the first data category of the initial environmental data to be updated and the second data category of the initial environmental associated data, the above data are respectively analyzed and processed to obtain the environmental monitoring updated data and the environmental monitoring associated data, and more effective information is obtained from the environmental monitoring data, so that the environmental analysis report is more accurate.
[0110] Optionally, as Figure 4 shown, in the above step S202, the content verification process of the environmental monitoring data to obtain the initial environmental data to be updated and the initial environmental associated data can be implemented by the following steps S401 to S402.
[0111] S401, perform data association processing and normalization processing on the environmental monitoring data to obtain the monitored normalized data and the associated normalized data.
[0112] As described in the foregoing embodiments, the environmental monitoring data may include remote sensing image data, image sensor data, numerical sensor data, etc. Taking one of the data in the environmental monitoring data as the target data, then, the data in the environmental monitoring data that has an association relationship with the target data is added with a marker label to obtain the marked data. It can be understood that the marked data corresponding to different target data in the environmental monitoring data is different. A certain data in the environmental monitoring can be used as both the target data and the associated data, and the same data can have an association relationship with multiple target data.
[0113] Further, the above environmental monitoring data is normalized, that is, the dimensional data in the environmental monitoring data is transformed into dimensionless data through transformation to become a scalar and is restricted within a certain range, obtaining the monitored normalized data and the associated normalized data. In this embodiment, this range can be (0, 1).
[0114] Among them, the monitored normalized data can be obtained by normalizing the above target data, and the managed normalized data can be obtained by normalizing the above marked data.
[0115] S402. Perform data verification on the monitored normalized data and the associated normalized data to obtain the initial environmental data to be updated and the initial environmental associated data.
[0116] Optionally, it is also possible to verify whether the data acquisition sources of the above monitored normalized data and associated normalized data are correct, and whether the data content is correct, etc. If the data verification passes, the monitored normalized data can be used as the initial environmental data to be updated, and the associated normalized data can be used as the initial environmental associated data.
[0117] In this embodiment, through data association processing, normalization processing, and data verification of the environmental monitoring data, the accuracy of the obtained initial environmental data to be updated and the initial environmental associated data is ensured, thereby improving the accuracy of the environmental analysis results.
[0118] Optionally, as Figure 5 shown, in the above step S402, performing data verification on the monitored normalized data and the associated normalized data to obtain the initial environmental data to be updated and the initial environmental associated data can be implemented by the following steps S501 to S502.
[0119] S501. Determine whether the data format of the monitored normalized data is correct. If the data format is correct, then determine whether the data content of the monitored normalized data is correct. If the data content is correct, the verification passes, and the monitored normalized data is used as the initial environmental data to be updated.
[0120] It can be understood that each monitored normalized data is obtained by performing data association processing and normalization processing on the environmental monitoring data. To avoid errors in the processing process, it is possible to verify the data format and data content of the monitored normalized data.
[0121] Among them, since the types of each monitored normalized data are not the same, the data format verification can be to verify whether the output format of the monitored normalized data matches its type and whether the correct environmental monitoring data is obtained. If the data format of the monitored normalized data is incorrect, the verification fails. If it is confirmed that the data format of the obtained monitored normalized data is correct, the verification passes, and the next step of content verification is further carried out.
[0122] The data content verification can be to verify whether the value of the monitored normalized data is within the restricted range after normalization. If it is not within the preset range, the content verification fails. If it is within the preset range, the verification passes, and the monitored normalized data is used as the initial environmental data to be updated.
[0123] S502, determine whether the data format of the associated normalized data is correct. If the data format is correct, determine whether the data content of the associated normalized data is correct. If the data content is correct, the verification passes, and the associated normalized data is used as the initial environmental associated data.
[0124] It can be understood that the content verification process of the associated normalized data is the same as that of the monitored normalized data, and this application will not elaborate here.
[0125] In the embodiments of the present application, by verifying the data format and data content of the monitored normalized data and the associated normalized data, the accuracy of the obtained initial environmental data to be updated and the initial environmental associated data is ensured, and the accuracy of the environmental analysis result is improved.
[0126] Optionally, as Figure 6 shown, the method for updating environmental monitoring data provided by the embodiments of the present application may further include the following steps.
[0127] S601, if the data format or data content of the monitored normalized data is incorrect, delete the monitored normalized data.
[0128] In the process of verifying the content of the monitored normalized data above, if the data content or data format of the monitored normalized data is incorrect, the monitored normalized data is deleted and the monitored normalized data is obtained again.
[0129] S602, if the data format or data content of the associated normalized data is incorrect, delete the associated normalized data.
[0130] Similarly, the data format and data content of the associated normalized data can be verified. If one or both of them are incorrect, the associated normalized data is deleted and the associated normalized data is obtained again.
[0131] In this embodiment, the associated normalized data or the monitored normalized data that fails the content verification is deleted, which reduces the computing pressure on the computing device and improves the computing efficiency.
[0132] It can be understood that the key to determining whether to update the database according to the obtained data is: whether the obtained data can obtain the latest environmental analysis result. Therefore, if the associated normalized data and the monitored normalized data cannot pass the content verification simultaneously, the following steps do not need to be executed.
[0133] Optionally, as Figure 7 shown, the method for updating environmental monitoring data provided in the embodiment of the present application may further include the following steps.
[0134] S701, determine the data update level of the environmental monitoring update data according to the data type of the environmental monitoring update data.
[0135] S702, determine the data update level of the environmental monitoring associated data according to the data type of the environmental monitoring associated data.
[0136] The data update level may be the data calculation priority determined according to the environmental monitoring update data or the environmental monitoring associated data. Since the real-time requirements of various types of data are different, in order to reduce the processing pressure on the computing device, after the associated update processing of the initial environmental data to be updated and the initial environmental associated data, in the case where the data update methods are the same and the selected update times are also the same, the following steps may be performed on the environmental monitoring update data or the environmental monitoring associated data according to the order determined by the data update level of the data.
[0137] S703, write the environmental monitoring update data and the environmental monitoring associated data into the database according to the data update level of the environmental monitoring update data and the data update level of the environmental monitoring associated data.
[0138] As can be seen from the above description, after obtaining the environmental monitoring update data and the environmental monitoring associated data, if the data update level of the environmental monitoring update data is different from the data update level of the environmental monitoring associated data, the environmental monitoring update data and the environmental monitoring associated data are written into the database according to the data update level corresponding to the data with the higher data update level.
[0139] Optionally, the environmental monitoring update data and the environmental monitoring associated data written into the database may be further analyzed to obtain the latest environmental analysis result.
[0140] In this embodiment, writing it into the database according to the data update level of the data ensures the orderly execution of parallel data, improves the real-time performance of the environmental analysis result, and can also maximize the computing power utilization of the computing device.
[0141] This application also provides an updating processing device 10 for environmental monitoring data. As Figure 8 shown, this device includes:
[0142] A receiving module 1001, configured to receive environmental monitoring data sent by a data acquisition device. The data types of the environmental monitoring data include: environmental monitoring real-time data type and environmental monitoring archived data type.
[0143] A verification module 1002, configured to perform content verification processing on the environmental monitoring data to obtain initial environmental data to be updated and initial environmental associated data. The initial environmental associated data includes: data that has an associated relationship with the initial environmental data to be updated and affects the update of the initial environmental data to be updated.
[0144] A determination module 1003, configured to determine a corresponding data update method according to the data type of the initial environmental data to be updated. [[ID=]14]
[0145] An update module 1004, configured to perform associated update processing on the initial environmental data to be updated and the initial environmental associated data according to the data update method to obtain updated environmental monitoring data and environmental monitoring associated data.
[0146] Specifically, the determination module 1003 is further configured to, if the data type of the initial environmental data to be updated is the environmental monitoring real-time data type, determine that the corresponding data update method is the data real-time update method; if the data type of the initial environmental data to be updated is the environmental monitoring archived data type, determine that the corresponding data update method is the data archiving update method.
[0147] Specifically, the update module 1004 is further configured to, if the data update method is the data real-time update method, identify a first data category of the initial environmental data to be updated, and perform analysis processing on the initial environmental data to be updated according to the first data category to obtain updated environmental monitoring data, and identify a second data category of the initial environmental associated data, and perform analysis processing on the initial environmental associated data according to the second data category to obtain environmental monitoring associated data.
[0148] Specifically, the verification module 1002 is further configured to perform data association processing and normalization processing on the environmental monitoring data to obtain monitored normalized data and associated normalized data; perform data verification on the monitored normalized data and the associated normalized data to obtain initial environmental data to be updated and initial environmental associated data.
[0149] The verification module 1002 is also specifically used to determine whether the data format of the monitoring normalized data is correct. If the data format is correct, then determine whether the data content of the monitoring normalized data is correct. If the data content is correct, then the verification is passed, and the monitoring normalized data is used as the initial data to be updated for the environment; determine whether the data format of the associated normalized data is correct. If the data format is correct, then determine whether the data content of the associated normalized data is correct. If the data content is correct, then the verification is passed, and the associated normalized data is used as the initial associated data for the environment.
[0150] The determination module 1003 is also used to determine the data update level of the environmental monitoring update data according to the data type of the environmental monitoring update data; determine the data update level of the environmental monitoring associated data according to the data type of the environmental monitoring associated data; and write the environmental monitoring update data and the environmental monitoring associated data into the database according to the data update level of the environmental monitoring update data and the data update level of the environmental monitoring associated data.
[0151] The verification module 1002 is further configured to delete the monitoring normalized data if the data format or data content of the monitoring normalized data is incorrect; and delete the associated normalized data if the data format or data content of the associated normalized data is incorrect.
[0152] See also Figure 9 This embodiment also provides a computing device, which includes: a processor 2001, a memory 2002 and a bus. The memory 2002 stores machine-readable instructions executable by the processor 2001. When the computing device is running, the above-mentioned machine-readable instructions are executed. The processor 2001 and the memory 2002 communicate through the bus. The processor 2001 is used to execute the steps of the environmental monitoring data update processing method in the above-mentioned embodiment.
[0153] The memory 2002, the processor 2001 and the bus components are electrically connected to each other directly or indirectly to realize the transmission or interaction of data. For example, these components can be electrically connected to each other through one or more communication buses or signal lines. The data processing device of the update processing system of environmental monitoring data includes at least one software function module that can be stored in the memory 2002 in the form of software or firmware or solidified in the operating system (OS) of the computing device. The processor 2001 is used to execute the executable modules stored in the memory 2002, such as the software function modules and computer programs included in the update processing device of environmental monitoring data.
[0154] Among them, the memory 2002 can be, but is not limited to, Random Access Memory (RAM), Read Only Memory (ROM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Electric Erasable Programmable Read-Only Memory (EEPROM), etc.
[0155] Optionally, the present application further provides a storage medium, on which a computer program is stored. When the computer program is run by a processor, it executes the steps of the method embodiment described above. The specific implementation manners and technical effects are similar, and will not be elaborated here.
[0156] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems and devices described above can refer to the corresponding processes in the method embodiments, which will not be elaborated in the present application. In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the modules is only a logical function division, and there can be other division manners in actual implementation. For another example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some communication interfaces. The indirect coupling or communication connection of the devices or modules can be in an electrical, mechanical or other form.
[0157] In addition, in each embodiment of the present application, the functional units can be integrated in one processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, ROM, RAM, magnetic disks, or optical discs that can store program codes.
[0158] As described above, it is only the specific implementation manner of the present application. However, the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed by the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claimed rights.
Claims
1. A method for updating and processing environmental monitoring data, characterized in that The method includes: Receiving environmental monitoring data sent by a data acquisition device, where the data types of the environmental monitoring data include: environmental monitoring real-time data type, environmental monitoring archived data type; the environmental monitoring archived data type is the type of environmental monitoring data that is delayed in sending after being collected in real time by the data acquisition device due to network reasons or preset data sending cycle reasons; or the type of historical environmental monitoring data uploaded by staff; Performing content verification processing on the environmental monitoring data to obtain initial environmental data to be updated and initial environmental associated data, where the initial environmental associated data includes: data that has an associated relationship with the initial environmental data to be updated and affects the update of the initial environmental data to be updated; Determining a corresponding data update method according to the data type of the initial environmental data to be updated; Performing associated update processing on the initial environmental data to be updated and the initial environmental associated data according to the data update method to obtain updated environmental monitoring data and associated environmental monitoring data; Among them, determining a corresponding data update method according to the initial environmental data to be updated includes: If the data type of the initial environmental data to be updated is the environmental monitoring real-time data type, determining the corresponding data update method as the data real-time update method; If the data type of the initial environmental data to be updated is the environmental monitoring archived data type, determining the corresponding data update method as the data archived update method; Among them, performing associated update processing on the initial environmental data to be updated and the initial environmental associated data according to the data update method to obtain updated environmental monitoring data and associated environmental monitoring data includes: If the data update method is the data real-time update method, identifying a first data category of the initial environmental data to be updated, and analyzing and processing the initial environmental data to be updated according to the first data category to obtain the updated environmental monitoring data, and identifying a second data category of the initial environmental associated data, and analyzing and processing the initial environmental associated data according to the second data category to obtain the associated environmental monitoring data; The method further includes: Determining a data update level of the updated environmental monitoring data according to the data type of the updated environmental monitoring data; Determining a data update level of the associated environmental monitoring data according to the data type of the associated environmental monitoring data; Writing the updated environmental monitoring data and the associated environmental monitoring data into a database according to the data update level of the updated environmental monitoring data and the data update level of the associated environmental monitoring data.
2. The method for updating and processing environmental monitoring data according to claim 1, wherein, Performing content verification processing on the environmental monitoring data to obtain initial environmental data to be updated and initial environmental associated data includes: Performing data association processing and normalization processing on the environmental monitoring data to obtain normalized monitoring data and normalized associated data; Performing data verification on the normalized monitoring data and the normalized associated data to obtain the initial environmental data to be updated and the initial environmental associated data.
3. The method for updating and processing environmental monitoring data according to claim 2, wherein Performing data verification on the monitored normalized data and the associated normalized data to obtain the initial environmental data to be updated and the initial environmental associated data includes: Determining whether the data format of the monitored normalized data is correct. If the data format is correct, determining whether the data content of the monitored normalized data is correct. If the data content is correct, the verification passes, and the monitored normalized data is used as the initial environmental data to be updated; Determining whether the data format of the associated normalized data is correct. If the data format is correct, determining whether the data content of the associated normalized data is correct. If the data content is correct, the verification passes, and the associated normalized data is used as the initial environmental associated data.
4. The method for updating and processing environmental monitoring data according to claim 3, characterized in that The method further includes: If the data format or data content of the monitored normalized data is incorrect, deleting the monitored normalized data; If the data format or data content of the associated normalized data is incorrect, deleting the associated normalized data.
5. An updated processing system for environmental monitoring data, characterized in that, The environmental monitoring data update processing system includes: a plurality of data collection devices and an arithmetic device, and the plurality of data collection devices are respectively communicatively connected to the arithmetic device; The plurality of data collection devices are used to collect environmental monitoring data and send it to the arithmetic device in real time; The arithmetic device is used to execute the environmental monitoring data update processing method according to any one of claims 1-4.
6. An operation device, characterized in that, The arithmetic device includes: a processor, a storage medium, and a bus. The storage medium stores machine-readable instructions executable by the processor. When the arithmetic device runs, the processor communicates with the storage medium through the bus, and the processor executes the machine-readable instructions to execute the steps of the environmental monitoring data update processing method according to any one of claims 1-4.
7. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the environmental monitoring data update processing method according to any one of claims 1-4 are implemented.
Citation Information
Patent Citations
Fire monitoring method and device and edge computing device
CN109686036A
Data updating method, device and equipment and storage medium
CN111800487A
SCADA-based production process digital management method, storage medium and mobile terminal
CN112180880A