Data processing system

Abstract

The embodiment of the invention discloses a data processing system. The system comprises a data acquisition module, a data transmission module, an Internet of Things platform module and an Internet of Things terminal, wherein the data acquisition module is used for acquiring original data associated with a target platform; the data transmission module is used for transmitting the original data to the Internet of Things middle station module; the Internet of Things platform module is used for receiving the original data and processing the original data to obtain target data; and the Internet of Things terminal is used for performing an access operation associated with the target data to obtain access data, and performing visualization processing on the access data. According to the technical scheme, the data processing difficulty of the target platform can be reduced.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of data processing, and in particular to a data processing system. Background Art

[0002] Offshore oilfield platforms are platforms used for offshore and offshore oil extraction, and are mainly used for oil extraction and related daily activities.

[0003] However, when performing operation and maintenance work on offshore oilfield platforms, due to the differences in construction time of each offshore oilfield platform and the lack of unified hardware infrastructure, the sources of the collected original data are scattered, and the data standards and data quality vary greatly, resulting in greater difficulty in data processing, which needs to be solved urgently. Summary of the invention

[0004] The embodiment of the present invention provides a data processing system to reduce the difficulty of data processing on a target platform.

[0005] According to one aspect of the present invention, a data processing system is provided, which may include: a data acquisition module, a data transmission module, an IoT middle platform module and an IoT terminal; wherein:

[0006] A data acquisition module, used to collect raw data associated with the target platform;

[0007] Data transmission module, used to transmit original data to the IoT middle station module;

[0008] The IoT middle platform module is used to receive and process the original data to obtain the target data;

[0009] The IoT terminal is used to perform access operations associated with target data, obtain access data, and visualize the access data.

[0010] Optionally, the IoT middle station module includes a data receiving submodule, a data preprocessing submodule and a data analysis submodule; wherein,

[0011] The data receiving submodule is used to receive the original data transmitted by the data transmission module;

[0012] The data preprocessing submodule is used to preprocess the original data to obtain processed data;

[0013] The data analysis submodule is used to perform data analysis on the processed data to obtain analysis results, and obtain target data based on the analysis results and the processed data.

[0014] Optionally, the data preprocessing submodule includes a data cleaning unit, a data standardization unit and a data audit unit; wherein,

[0015] A data cleaning unit, used for cleaning the original data to obtain cleaned data;

[0016] A data standardization unit is used to standardize the cleaned data based on a preset data standard system to obtain standard data;

[0017] The data audit unit is used to determine the problematic data with structural missing and / or logical errors in the standard data, and mark the problematic data so as to process the standard data based on the marking results to obtain processed data.

[0018] Optionally, the original data includes original operation data of the target platform and original environment data associated with the target platform, and the processed data includes processed operation data obtained by preprocessing the original operation data and processed environment data obtained by preprocessing the original environment data;

[0019] The data analysis submodule includes an environmental data analysis unit, an operation data classification unit, an association relationship determination unit, an environmental clustering unit and a target data generation unit; wherein,

[0020] An environmental data analysis unit, used to analyze the processing environmental data, determine environmental abnormality data in the processing environmental data and the environmental abnormality time point corresponding to the environmental abnormality data;

[0021] An operation data classification unit, used to classify the processed operation data based on the application scenario of the operation device corresponding to the processed operation data and preset classification requirements, and obtain a classification result;

[0022] An association relationship determination unit, used to determine an association relationship between the environmental abnormality data and the processing operation data at the environmental abnormality time point, wherein the association relationship represents the influence of the environmental abnormality data on the processing operation data at the environmental abnormality time point;

[0023] An environmental clustering unit, used to perform clustering processing on the environmental data based on the time series and spatial location of the environmental data to determine the change trend of the environmental data;

[0024] The target data generating unit is used to generate target data based on at least one of the processing operation data, the processing environment data, the classification result, the association relationship and the change trend.

[0025] Optionally, the IoT terminal includes an access instruction sending submodule, an access data receiving submodule and a visualization submodule; wherein,

[0026] The access instruction sending submodule is used to obtain the access instruction for the target data and send the access instruction to the IoT middle station module;

[0027] The access data receiving submodule is used to receive the access data fed back by the IoT middle platform module based on the access instruction;

[0028] The visualization submodule is used to visualize the access data.

[0029] Optionally, the IoT platform module is also used to:

[0030] In response to the received access instruction, the access right of the access object to the target data is determined, and based on the access right, access data is determined from the target data, and the access data is fed back to the IoT terminal.

[0031] Optional, IoT middle platform module is also used for:

[0032] In response to the received access instruction, determining the access rights of the access object to the target data according to the organization to which the access object belongs;

[0033] The access rights are matched with the target data to determine the access data from the target data according to the matching result, and the access data is fed back to the IoT terminal.

[0034] Optionally, the data acquisition module is also used to:

[0035] Processing the raw data to achieve edge processing of the raw data;

[0036] The original data is updated based on the processing results.

[0037] Optionally, the original data includes the operation data of the target platform and the environmental data associated with the target platform, and the data acquisition module includes an operation data acquisition submodule and an environmental data acquisition submodule; wherein,

[0038] The operation data collection submodule is used to collect operation data for the operation equipment installed on the target platform based on the equipment sensors installed on the operation equipment;

[0039] The environmental data collection submodule is used to collect environmental data within a preset range of the target platform based on the environmental sensors installed on the target platform.

[0040] Optionally, the target platform is an offshore oil field platform.

[0041] The technical solution of the embodiment of the present invention includes a data acquisition module, a data transmission module, an IoT middle platform module and an IoT terminal; wherein the data acquisition module is used to collect the original data associated with the target platform to realize the complete collection of various data from scattered sources; the data transmission module is used to transmit the original data to the IoT middle platform module, which can reduce the transmission delay caused by the long distance between the original data and the IoT middle platform module; the IoT middle platform module is used to receive the original data and process the original data to obtain the target data. Through the unified IoT middle platform module, the data standard of the original data can be unified, the data quality can be improved, and the data information can be mined; the IoT terminal is used to perform access operations associated with the target data, obtain access data, and visualize the access data to facilitate intuitive understanding of the access data. The above technical solution can reduce the difficulty of data processing on the target platform by processing the collected original data through the IoT middle platform module.

[0042] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0044] Figure 1 is a structural block diagram of a data processing system provided according to an embodiment of the present invention;

[0045] Figure 2 is a structural block diagram of another data processing system provided according to an embodiment of the present invention;

[0046] Figure 3 It is a structural block diagram of another data processing system provided according to an embodiment of the present invention.

[0047] Figure 4 is a schematic diagram of device distribution query in another specific example of a data processing system provided according to an embodiment of the present invention;

[0048] Figure 5 is a schematic diagram of product classification in another specific example of a data processing system provided in an embodiment of the present invention;

[0049] Figure 6is a schematic diagram of a device operation status of a specific example in another data processing system provided by an embodiment of the present invention;

[0050] Figure 7 It is a schematic diagram of a device alarm situation of another specific example in a data processing system provided according to an embodiment of the present invention. DETAILED DESCRIPTION

[0051] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0052] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. The situations of "target", "original", etc. are similar and will not be repeated here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0053] Figure 1 This is a structural block diagram of a data processing system provided by an embodiment of the present invention. This embodiment is applicable to the case of processing the original data of the target platform, and is particularly applicable to the case of processing the original data of the offshore oil field platform.

[0054] See also Figure 1 The data processing system of the embodiment of the present invention includes: a data acquisition module 11, a data transmission module 12, an IoT middle platform module 13 and an IoT terminal 14; wherein,

[0055] A data collection module 11 is used to collect raw data associated with the target platform;

[0056] The data transmission module 12 is used to transmit the original data to the IoT middle station module 13;

[0057] The IoT middle platform module 13 is used to receive the original data and process the original data to obtain the target data;

[0058] The IoT terminal 14 is used to perform access operations associated with target data, obtain access data, and visualize the access data.

[0059] The data acquisition module 11 can be understood as a module for collecting original data associated with the target platform. Since the target platform is relatively dispersed and has many data sources, the data acquisition module 11 is required to comprehensively collect original data associated with the target platform.

[0060] The target platform can be understood as the platform to be monitored. The operating status and operating environment of the target platform can be determined by obtaining the raw data associated with the target platform. Optionally, the target platform is an offshore oilfield platform. Since the offshore oilfield platforms are distributed in different sea areas, the distance between each offshore oilfield platform is far, and the operation and maintenance difficulty is relatively large, the difficulty of operation and maintenance can be reduced by monitoring the offshore oilfield platform.

[0061] The raw data can be understood as unprocessed data that can reflect the operating status of the target platform. Optionally, the raw data can be obtained through sensors on the target platform, and the operating status of the target platform can be determined by further processing and analyzing the raw data.

[0062] The data transmission module 12 can be understood as a module for transmitting original data, and can transmit the original data to the IoT middle platform module 13. Optionally, the data transmission module 12 can realize the transmission of original data through an efficient and stable data transmission method to reduce transmission delay.

[0063] The IoT middle platform module 13 can be understood as a module that further processes the received raw data to obtain the target data. Optionally, the IoT middle platform module 13 can support multiple communication protocols and interface standards to ensure that the raw data can be received smoothly. At the same time, the IoT middle platform module 13 can also have functions such as data processing, data analysis and mining, and data security protection to make full use of the raw data and obtain target data containing various aspects of the target platform information (such as operation information, environmental information, fault alarm information, and predicted operation information, etc.).

[0064] The IoT terminal 14 can be understood as a terminal for accessing the target data and visually displaying the access data obtained by the access. Optionally, the object can retrieve the access data from the target data through the IoT terminal 14 based on its own access rights, and visualize it through the IoT terminal 14 to facilitate viewing of the access data.

[0065] The data collection module 11 collects the original data associated with the target platform based on various data collection methods and data sources, and transmits the original data to the IoT middle platform module 13 through the data transmission module 12. The IoT middle platform module 13 processes the received original data in various ways to obtain the target data. The IoT terminal 14 obtains the access data from the target data based on the access operation associated with the target data, and visualizes the access data for easy viewing.

[0066] The technical solution of the embodiment of the present invention includes a data acquisition module, a data transmission module, an IoT middle platform module and an IoT terminal; wherein the data acquisition module is used to collect the original data associated with the target platform to realize the complete collection of various data from scattered sources; the data transmission module is used to transmit the original data to the IoT middle platform module, which can reduce the transmission delay caused by the long distance between the original data and the IoT middle platform module; the IoT middle platform module is used to receive the original data and process the original data to obtain the target data. Through the unified IoT middle platform module, the data standard of the original data can be unified, the data quality can be improved, and the data information can be mined; the IoT terminal is used to perform access operations associated with the target data, obtain access data, and visualize the access data to facilitate intuitive understanding of the access data. The above technical solution can reduce the difficulty of data processing on the target platform by processing the collected original data through the IoT middle platform module.

[0067] An optional technical solution, the data acquisition module is also used to: process the original data to achieve edge processing of the original data; and update the original data based on the processing results.

[0068] The above technical solution uses edge computing power to process raw data at the edge when it is acquired, and updates the raw data based on the processing results. It can realize real-time processing and analysis of raw data, reduce the computing pressure of the IoT middle platform module after the raw data is transmitted to the IoT middle platform module, and speed up the processing efficiency of raw data.

[0069] Another optional technical solution is that the original data includes the operating data of the target platform and the environmental data associated with the target platform, and the data acquisition module includes an operating data acquisition submodule and an environmental data acquisition submodule; wherein the operating data acquisition submodule is used to collect operating data for the operating equipment installed on the target platform based on the equipment sensors installed on the operating equipment; and the environmental data acquisition submodule is used to collect environmental data within a preset range of the target platform based on the environmental sensors installed on the target platform.

[0070] Among them, the raw data may include different types of data to reflect various situations of the target platform, such as the operating data of the target platform and the environmental data associated with the target platform, etc. The data acquisition module may collect different types of raw data through different types of acquisition submodules, such as an operating data acquisition submodule and an environmental data acquisition submodule. Optionally, the operating data acquisition submodule may collect operating data of the operating device installed on the target platform based on the device sensor installed on the operating device; the environmental data acquisition submodule may collect environmental data within a preset range of the target platform based on the environmental sensor installed on the target platform.

[0071] The above technical solution can comprehensively reflect the operation status of the target platform by collecting different types of raw data through the data collection module.

[0072] Figure 2 It is a structural block diagram of another data processing system provided by an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, the IoT middle platform module includes a data receiving submodule, a data preprocessing submodule and a data analysis submodule; wherein the data receiving submodule is used to receive the original data transmitted by the data transmission module; the data preprocessing submodule is used to preprocess the original data to obtain processed data; the data analysis submodule is used to perform data analysis on the processed data to obtain analysis results, and obtain target data based on the analysis results and the processed data. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0073] For details, see Figure 2 The data processing system of this embodiment includes: a data acquisition module 21, a data transmission module 22, an IoT middle station module 23 and an IoT terminal 24, wherein the IoT middle station module 23 includes a data receiving submodule 231, a data preprocessing submodule 232 and a data analysis submodule 233; wherein,

[0074] A data collection module 21, used to collect raw data associated with the target platform;

[0075] The data transmission module 22 is used to transmit the original data to the IoT middle station module 23;

[0076] The data receiving submodule 231 is used to receive the original data transmitted by the data transmission module 22;

[0077] The data preprocessing submodule 232 is used to preprocess the original data to obtain processed data;

[0078] The data analysis submodule 233 is used to perform data analysis on the processed data to obtain analysis results, and obtain target data based on the analysis results and the processed data;

[0079] The IoT terminal 24 is used to perform access operations associated with target data, obtain access data, and visualize the access data.

[0080] Among them, the data receiving submodule 231 can be understood as a module for receiving raw data in the IoT middle platform module 23. The optional data receiving submodule 231 can support multiple communication protocols, such as (Message Queuing Telemetry Transport, MQTT) and Hypertext Transfer Protocol (HyperText Transfer Protocol, HTTP), etc., and is compatible with various interface standards, such as Simple Object Access Protocol (Simple Object Access Protocol, SOAP) and Representational State Transfer Application Programming Interface (Representational State Transfer Application Programming Interface, RESTful API), etc., to fully receive raw data.

[0081] The data preprocessing submodule 232 can be understood as a module that preprocesses the raw data to obtain processed data. Optionally, the preprocessing module can perform preprocessing operations such as cleaning, screening and standardization on the raw data to obtain processed data for subsequent data analysis.

[0082] The data analysis submodule 233 can be understood as a module for further data analysis of the processed data. The data analysis submodule 233 can be used to perform in-depth data analysis on the processed data, such as classifying the processed data and analyzing the connections and influences between different types of processed data, so as to obtain analysis results, and summarize the analysis results and the processed data to obtain target data.

[0083] The technical solution of the embodiment of the present invention can comprehensively receive and deeply process the original data through the various sub-modules in the IoT middle platform module to obtain accurate and comprehensive target data.

[0084] An optional technical solution, the data preprocessing submodule includes a data cleaning unit, a data standardization unit and a data audit unit; wherein the data cleaning unit is used to clean the original data to obtain cleaned data; the data standardization unit is used to standardize the cleaned data based on a preset data standard system to obtain standard data; the data audit unit is used to determine the problem data with structural missing and / or logical errors in the standard data, and mark the problem data, so as to process the standard data based on the marking results to obtain processed data.

[0085] Among them, the data cleaning unit can perform preliminary cleaning on the received raw data, remove duplicate, invalid and abnormal data in the raw data, and obtain cleaned data to reduce the burden of subsequent data processing and improve the accuracy of data analysis. The data standardization unit can standardize the cleaned data based on the preset data standard system to obtain standard data to form a unified data standard for subsequent data processing; the data audit unit can determine the problem data with structural missing and / or logical errors in the standard data through data audit, and mark the problem data to process the standard data based on the marking results, for example, the marked data can be downgraded based on the marking results to ensure the quality and consistency of the data and obtain processed data.

[0086] The above technical solution, through the mutual cooperation of various units in the data preprocessing submodule, can perform preliminary processing on the original data to obtain processed data, thereby improving the accuracy of subsequent data analysis and reducing the calculation amount of data analysis.

[0087] In another optional technical solution, the original data includes the original operation data of the target platform and the original environment data associated with the target platform, and the processed data includes the processed operation data obtained by preprocessing the original operation data and the processed environment data obtained by preprocessing the original environment data; the data analysis submodule includes an environment data analysis unit, an operation data classification unit, an association relationship determination unit, an environment clustering unit and a target data generation unit; wherein the environment data analysis unit is used to analyze the processed environment data, determine the environmental abnormality data in the processed environment data and the environmental abnormality time point corresponding to the environmental abnormality data; the operation data classification unit is used to classify the environment based on the processed operation data. According to the application scenario of the corresponding operating device and the preset classification requirements, the processing operation data is classified to obtain the classification result; the association determination unit is used to determine the association between the environmental abnormality data and the processing operation data at the environmental abnormality time point, wherein the association relationship represents the impact of the environmental abnormality data on the processing operation data at the environmental abnormality time point; the environmental clustering unit is used to cluster the environmental data based on the time series and spatial position of the processing environmental data to determine the change trend of the environmental data; the target data generation unit is used to generate target data based on at least one of the processing operation data, the processing environmental data, the classification result, the association relationship and the change trend.

[0088] The original data may include original operation data generated when each device in the target platform is in operation, such as the operation voltage and power of each device in the target platform, and original environmental data associated with the target platform, such as the wind force, ambient temperature, and wave intensity in the area where the target platform is located. Correspondingly, the processed data obtained by preprocessing the original data also includes processed operation data obtained by preprocessing the original operation data and processed environmental data obtained by preprocessing the original environmental data.

[0089] Further, the processing environment data can be analyzed by the environmental data analysis unit in the data analysis submodule. Optionally, the processing environment data can be analyzed in time series to determine the environmental abnormality data in the processing environment data that characterizes abnormal environmental conditions (such as abnormal weather conditions such as typhoons and tsunamis) and the environmental abnormality time point corresponding to the environmental abnormality data. Then, the impact of the environmental abnormality data on the processing operation data at the environmental abnormality time point is determined by the association determination unit, and represented by the association relationship, so that when similar environmental abnormality data appears, the operation of the equipment on the target platform can be predicted through the association relationship. The operation data classification unit can classify the processing operation data based on the application scenario and preset classification requirements of the operation equipment corresponding to the processing operation data to obtain the classification results. For example, the equipment can be divided into power plant equipment and video monitoring according to different functions. The environmental clustering unit is used to cluster the environmental data based on the time series and spatial position of the processing environment data, and obtain the change of the processing environment data at the location of each target platform over time to determine the change trend of the environmental data. Finally, the target data generation unit generates the target data based on at least one of the processing operation data, the processing environment data, the classification results, the association relationship and the change trend.

[0090] The above technical solution, through different units in the data analysis submodule, analyzes the processed data in different aspects respectively, and can comprehensively mine all aspects of the processed data to obtain more comprehensive and accurate target data.

[0091] Figure 3 It is a structural block diagram of another data processing system provided by an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, the Internet of Things terminal includes an access instruction sending submodule, an access data receiving submodule and a visualization submodule; wherein the access instruction sending submodule is used to obtain the access instruction for the target data, and send the access instruction to the Internet of Things middle station module; the access data receiving submodule is used to receive the access data fed back by the Internet of Things middle station module based on the access instruction; the visualization submodule is used to visualize the access data. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0092] For details, see Figure 3 The data processing system of this embodiment includes: a data acquisition module 31, a data transmission module 32, an IoT middle platform module 33 and an IoT terminal 34, wherein the IoT terminal 34 includes an access instruction issuing submodule 341, an access data receiving submodule 342 and a visualization submodule 343; wherein,

[0093] A data collection module 31, used to collect raw data associated with the target platform;

[0094] The data transmission module 32 is used to transmit the original data to the IoT middle station module 33;

[0095] The IoT middle station module 33 is used to receive the original data and process the original data to obtain the target data;

[0096] The access instruction sending submodule 341 is used to obtain the access instruction for the target data and send the access instruction to the IoT middle station module 33;

[0097] The access data receiving submodule 342 is used to receive the access data fed back by the IoT middle platform module 33 based on the access instruction;

[0098] The visualization submodule 343 is used to perform visualization processing on the access data.

[0099] Among them, the access instruction sending submodule 341 can be understood as a submodule that obtains the access instruction in the IoT terminal 34 and sends the access instruction to the IoT middle station module 33. The access instruction sending submodule 341 can pass the access instruction to the IoT middle station module 33. After receiving the access instruction, the IoT middle station module 33 retrieves the access data based on the access instruction, and the IoT terminal 34 receives the access data fed back by the IoT middle station module 33 through the access data receiving submodule 342. Finally, the access data is visualized through the visualization submodule 343.

[0100] The technical solution of the embodiment of the present invention can realize the rapid retrieval and visual display of access data through various sub-modules in the Internet of Things terminal.

[0101] An optional technical solution, the IoT middle platform module is also used to: respond to a received access instruction, determine the access rights of the access object to the target data, and based on the access rights, determine the access data from the target data, and feed back the access data to the IoT terminal.

[0102] Among them, the IoT middle platform module can also determine the access rights of the access object to the target data based on the received access instructions. Optionally, a zero-trust model can be adopted to continuously verify the access object or the access object and verify the principle of least privilege. Finally, based on the access rights, the access data corresponding to the access rights is determined from the target data, and the access data is fed back to the IoT terminal.

[0103] The above technical solution further determines the access rights of the access object through the IoT middle platform module, and accesses the data based on the access rights feedback, which can effectively avoid risks such as data tampering and unauthorized access to data, and reduce internal and external attack surfaces.

[0104] On this basis, optionally, the IoT middle platform module is also specifically used to: respond to the received access instruction, determine the access right of the access object to the target data according to the organization to which the access object belongs; match the access right with the target data to determine the access data from the target data according to the matching result, and feed back the access data to the IoT terminal.

[0105] Among them, when the IoT middle platform module responds to the received access instruction and determines the access right of the access object to the target data, it can determine the access right of the access object to the target data based on the organizational structure of the access object, such as the technical department and the management department, and then match the access right with the target data, determine the access data from the target data based on the matching result, and feed back the access data to the IoT terminal to avoid the loss and tampering of the target data.

[0106] The above technical solution, by determining access rights according to organizational structures, can enable different organizations to access different access data, thereby preventing target data from being tampered with and called by unrelated organizations, thereby improving the security of target data.

[0107] In order to better understand the above-mentioned technical solutions as a whole, the following is an exemplary description of the above-mentioned technical solutions in combination with a specific example. In this specific example, the target platform is an offshore oil field platform, and the specific steps are as follows:

[0108] 1. Data acquisition module collects raw data

[0109] The data acquisition module collects the operating data of each operating equipment through the equipment sensors installed on the operating equipment of the offshore oilfield platform, and collects the environmental data within a preset range of the offshore oilfield platform through the environmental sensors on the offshore oilfield platform. It uses edge computing power to perform preliminary processing on the operating data and environmental data to obtain the original data, and transmits it to the IoT middle platform module through the data transmission module.

[0110] 2. The IoT middle platform module processes the original data to obtain the target data

[0111] 2.1. The IoT middle platform module receives the original data through the data receiving sub-module, and cleans, standardizes and audits the original data through the data preprocessing sub-module, unifies the data format of the original data and removes erroneous data in the original data to obtain processed data.

[0112] 2.2. The IoT middle platform module performs environmental data analysis on the processing data through the data analysis submodule to determine the environmental abnormality data in the processing environment data and the environmental abnormality time point corresponding to the environmental abnormality data; classifies the operation data based on the application scenarios and preset classification requirements of the operation equipment corresponding to the processing operation data to obtain the classification results; determines the association relationship to determine the impact of the environmental abnormality data on the processing operation data at the environmental abnormality time point, and represents it with the association relationship; clusters the environment data based on the time series and spatial position of the processing environment data to obtain the location of each target platform and the changes in the processing environment data at that location over time; finally, generates the target data based on at least one of the processing operation data, processing environment data, classification results, association relationships and change trends.

[0113] 3. The IoT terminal calls and displays the target data

[0114] 3.1. The IoT terminal receives the access instruction for querying device distribution input by the access object, and sends the access instruction to the IoT middle platform module. The IoT middle platform module determines the access rights of the access object according to the access instruction and retrieves the access data of device distribution from the target data based on the access rights, and feeds the access data back to the IoT terminal. The IoT terminal displays the access data, such as Figure 4 As shown, the location of each target platform and the number of target platforms may be displayed based on the processing environment data in the target data.

[0115] 3.2. The IoT terminal receives the access instruction for querying product classification input by the access object, and sends the access instruction to the IoT middle platform module. The IoT middle platform module determines the access permission of the access object according to the access instruction and retrieves the access data of product classification from the target data based on the access permission, and feeds the access data back to the IoT terminal. The IoT terminal displays the access data, such as Figure 5 As shown, the product classification can be displayed based on the classification results in the target data, and further viewing can be performed.

[0116] 3.3. The IoT terminal receives the access instruction for querying the device operation status input by the access object, and sends the access instruction to the IoT middle platform module. The IoT middle platform module determines the access rights of the access object according to the access instruction and retrieves the access data of the device operation status from the target data based on the access rights, and feeds the access data back to the IoT terminal. The IoT terminal displays the access data, such as Figure 6 As shown, the operating status of each device can be displayed based on the processed operating data.

[0117] 3.4. The IoT terminal receives the access instruction input by the access object to query the device alarm information, and sends the access instruction to the IoT middle platform module. The IoT middle platform module determines the access right of the access object according to the access instruction and retrieves the access data related to the device alarm information from the target data based on the access right, and feeds the access data back to the IoT terminal. The IoT terminal displays the access data, such as Figure 7 As shown, the name and specific information of the alarm device can be displayed based on the processing operation data.

[0118] In the above specific example, the collected raw data is processed by the IoT middle platform module, which can reduce the difficulty of data processing on the target platform.

[0119] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A data processing system, characterized in that: include: Data collection module, data transmission module, IoT middle platform module and IoT terminal; among them, The data acquisition module is used to acquire raw data associated with the target platform; The data transmission module is used to transmit the original data to the IoT middle station module; The IoT platform module is used to receive the original data and process the original data to obtain target data; The IoT terminal is used to perform an access operation associated with the target data, obtain access data, and perform visualization processing on the access data.

2. The system according to claim 1, characterized in that The IoT middle station module includes a data receiving submodule, a data preprocessing submodule and a data analysis submodule; wherein, The data receiving submodule is used to receive the original data transmitted by the data transmission module; The data preprocessing submodule is used to preprocess the original data to obtain processed data; The data analysis submodule is used to perform data analysis on the processed data to obtain analysis results, and obtain target data based on the analysis results and the processed data.

3. The system according to claim 2, characterized in that The data preprocessing submodule includes a data cleaning unit, a data standardization unit and a data audit unit; wherein, The data cleaning unit is used to clean the original data to obtain cleaned data; The data standardization unit is used to perform standardization processing on the cleaned data based on a preset data standard system to obtain standard data; The data audit unit is used to determine problematic data with missing structures and / or logical errors in the standard data, and mark the problematic data, so as to process the standard data based on the marking results to obtain processed data.

4. The system according to claim 2, characterized in that The original data includes original operation data of the target platform and original environment data associated with the target platform, and the processed data includes processed operation data obtained by preprocessing the original operation data and processed environment data obtained by preprocessing the original environment data; The data analysis submodule includes an environment data analysis unit, an operation data classification unit, an association relationship determination unit, an environment clustering unit and a target data generation unit; wherein, The environmental data analysis unit is used to analyze the processing environment data to determine the environmental abnormality data in the processing environment data and the environmental abnormality time point corresponding to the environmental abnormality data; The operation data classification unit is used to classify the processed operation data based on the application scenario of the operation device corresponding to the processed operation data and the preset classification requirements to obtain a classification result; The association relationship determination unit is used to determine the association relationship between the environmental abnormality data and the processing operation data at the environmental abnormality time point, wherein the association relationship represents the influence of the environmental abnormality data on the processing operation data at the environmental abnormality time point; The environmental clustering unit is used to perform clustering processing on the environmental data based on the time series and spatial position of the processed environmental data to determine the change trend of the environmental data; The target data generating unit is used to generate target data based on at least one of the processing operation data, the processing environment data, the classification result, the association relationship and the change trend.

5. The system according to claim 1, characterized in that The IoT terminal includes an access instruction sending submodule, an access data receiving submodule and a visualization submodule; wherein, The access instruction sending submodule is used to obtain the access instruction for the target data and send the access instruction to the IoT middle station module; The access data receiving submodule is used to receive the access data fed back by the IoT middle platform module based on the access instruction; The visualization submodule is used to perform visualization processing on the access data.

6. The system according to claim 5, characterized in that The IoT middle platform module is also used for: In response to the received access instruction, the access right of the access object to the target data is determined, and based on the access right, the access data is determined from the target data, and the access data is fed back to the IoT terminal.

7. The system according to claim 6, characterized in that The IoT middle platform module is also specifically used for: In response to the received access instruction, determining the access rights of the access object to the target data according to the organization to which the access object belongs; The access permission is matched with the target data to determine the access data from the target data according to the matching result, and the access data is fed back to the IoT terminal.

8. The system according to claim 1, characterized in that The data acquisition module is also used for: Processing the raw data to achieve edge processing of the raw data; The original data is updated based on the processing result.

9. The system according to claim 1, characterized in that The original data includes the operation data of the target platform and the environmental data associated with the target platform, and the data acquisition module includes an operation data acquisition submodule and an environmental data acquisition submodule; wherein, The operation data collection submodule is used to collect the operation data for the operation device installed on the target platform based on the device sensor installed on the operation device; The environmental data collection submodule is used to collect the environmental data within a preset range of the target platform based on the environmental sensor installed on the target platform.

10. The system according to any one of claims 1 to 9, characterized in that: The target platform is an offshore oil field platform.

Images