Data middle platform system, data processing method and device

Abstract

The present application provides a data middle platform system, data processing method and device, wherein the system includes: a central data middle platform and multiple edge data middle platforms; multiple edge data middle platforms are set up in different areas, for performing data governance on their corresponding areas, and sending the corresponding data governance results to the central data middle platform; the central data middle platform is used to process the data governance results sent by each edge data middle platform to obtain data that meets user needs. By setting up edge data middle platforms in each area, data governance can be achieved for each area, which has the characteristics of low startup cost and short implementation cycle; each edge data middle platform sends the data governance results to the central data middle platform. Since each edge data middle platform uploads data governance results, the amount of data is less than the original data, thus reducing data transmission, storage and processing costs.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data middle-end system, a data processing method and a device. Background Art

[0002] Currently, the data center platform has become an essential step for traditional manufacturing to digitally transform and embrace big data technology. While it offers numerous benefits to the manufacturing industry, its complexity and construction costs have limited many manufacturing companies from experimenting with it. This is especially true for process manufacturers with numerous factories, such as cement, solid waste, and steel. These companies have factories scattered across the country, with dispersed data and poor levels of informatization, yet they have a strong need for centralized group data management. When building a data center platform, the traditional approach is to establish it centrally within the group and collect data from each factory for statistical analysis. However, the sheer volume of data from each factory results in extremely high bandwidth, storage, and computing costs. Furthermore, differences in informatization implementation across factories make data standardization very difficult. Summary of the Invention

[0003] The embodiments of the present application provide a data middle-office system, a data processing method, and a device to reduce the construction cost of the manufacturing data middle-office system.

[0004] In order to solve the above problems, the embodiment of the present application discloses a data middle platform system, which includes: a central data middle platform and multiple edge data middle platforms;

[0005] Multiple edge data middle platforms are set up in different areas, and each edge data middle platform is used to perform data governance in its corresponding area and send the corresponding data governance results to the central data middle platform;

[0006] The central data center is used to process the data governance results sent by each edge data center to obtain data that meets user needs.

[0007] Optionally, each of the edge data middle platforms is used to perform data governance on its corresponding area and send the corresponding data governance results to the central data middle platform, including:

[0008] Each of the edge data middle stations is used to perform data governance on its corresponding area, and sends the corresponding data governance results to the central data middle station in accordance with the data interface specification corresponding to the central data middle station.

[0009] Optionally, a management network for transmitting management signals and a data network for transmitting data signals are set between the central data middle station and each of the edge data middle stations.

[0010] Optionally, the plurality of edge data middle stations are divided into a first edge data middle station and a second edge data middle station, the first edge data middle station is set in an area with organizational management responsibilities, and the second edge data middle station is set in an area without organizational management responsibilities; an organization consists of one area with organizational management responsibilities and at least one area without organizational management responsibilities;

[0011] The management network and the data network are set between the first edge data middle platform and the second edge data middle platform belonging to the same organization.

[0012] Optionally, the data network is a unidirectional communication network;

[0013] A data network is provided between the first edge data middle station and the second edge data middle station, for transmitting the data governance result of the second edge data middle station to its corresponding first edge data middle station;

[0014] A data network is set up between the central data middle station and the first edge data middle station, and between the central data middle station and the second edge data middle station, for transmitting the data governance results of the first edge data middle station and / or the second edge data middle station to the central data middle station.

[0015] Optionally, the second edge data middle station is used to send the data governance results of its corresponding area to its corresponding first edge data middle station in accordance with the data interface specification corresponding to its corresponding first edge data middle station.

[0016] Optionally, the management network is a Gigabit network, and the data network is a 10 Gigabit network.

[0017] The present application also discloses a data processing method, which includes:

[0018] By setting up multiple edge data middle platforms in different regions, data governance is carried out in the corresponding regions, and the corresponding data governance results are sent to the central data middle platform;

[0019] The data governance results sent by each edge data middle station are processed through the central data platform to obtain data that meets user needs.

[0020] Optionally, the plurality of edge data middle stations are divided into a first edge data middle station and a second edge data middle station, the first edge data middle station is set in an area with organizational management responsibilities, and the second edge data middle station is set in an area without organizational management responsibilities; an organization consists of an area with organizational management responsibilities and at least one area without organizational management responsibilities; the plurality of edge data middle stations set in different areas perform data governance on the corresponding areas, and send the corresponding data governance results to the central data middle station, including:

[0021] Through the second edge data center, data governance is performed on the corresponding area, and the corresponding data governance results are sent to the first edge data center of the same organization to which it belongs;

[0022] Through the first edge data middle station, data governance is performed on the corresponding area, and the corresponding data governance results and the data governance results received from the second edge data middle station are sent to the central data middle station.

[0023] Optionally, the method of setting up multiple edge data middle platforms in different regions to perform data governance on the corresponding regions and sending the corresponding data governance results to the central data middle platform includes:

[0024] Data governance is performed on the corresponding areas through each edge data middle station, and the corresponding data governance results are sent to the central data middle station in accordance with the data interface specifications corresponding to the central data middle station.

[0025] Optionally, performing data governance on the corresponding area through the first edge data middle station, and sending the corresponding data governance result and the received data governance result sent by the second edge data middle station to the central data middle station, includes:

[0026] Through the first edge data center, data governance is performed on the corresponding area, and the corresponding data governance results and the data governance results received from the second edge data center are sent to the central data center in accordance with the data interface specification corresponding to the central data center.

[0027] The present application also discloses a data processing device, comprising:

[0028] The data processing module is used to perform data governance in the corresponding areas by setting up multiple edge data middle platforms in different areas, and send the corresponding data governance results to the central data middle platform;

[0029] The data application module is used to process the data governance results sent by each edge data middle station through the central data platform to obtain data that meets user needs.

[0030] Optionally, the data processing module is specifically used to perform data governance on the corresponding areas through each edge data middle station, and send the corresponding data governance results to the central data middle station according to the data interface specification corresponding to the central data middle station.

[0031] Optionally, the data processing module includes:

[0032] The organizational data processing module is used to perform data governance on the corresponding area through the second edge data center station set up in the area without organizational management responsibilities, and send the corresponding data governance results to the first edge data center station set up in the area with organizational management responsibilities in the same organization to which it belongs; an organization consists of one area with organizational management responsibilities and at least one area without organizational management responsibilities;

[0033] The group data processing module is used to perform data governance on the corresponding area through the first edge data middle platform set up in the area with organizational management responsibilities, and send the corresponding data governance results and the data governance results received from the second edge data middle platform to the central data middle platform.

[0034] Optionally, the organizational data processing module is specifically used to perform data governance on the corresponding area through a second edge data middle station set up in an area that does not have organizational management responsibilities, and send the corresponding data governance results to the first edge data middle station in accordance with the data interface specification corresponding to the first edge data middle station that belongs to the same organization and is set up in an area with organizational management responsibilities.

[0035] Optionally, the group data processing module is specifically used to perform data governance on the corresponding area through a first edge data middle station set up in the area with organizational management responsibilities, and send the corresponding data governance results and the data governance results received from the second edge data middle station to the central data middle station in accordance with the data interface specification corresponding to the central data middle station.

[0036] An embodiment of the present application further discloses an electronic device, comprising: a processor; and a memory on which executable code is stored. When the executable code is executed, the processor executes the data processing method as described in one or more embodiments of the present application.

[0037] The present application also discloses one or more machine-readable media having executable codes stored thereon. When the executable codes are executed, the processor executes the data processing method described in one or more of the embodiments of the present application.

[0038] Compared with the prior art, the embodiments of the present application have the following advantages:

[0039] In an embodiment of the present application, the data middle platform system includes: a central data middle platform and multiple edge data middle platforms; multiple edge data middle platforms are set up in different areas, and each edge data middle platform is used to perform data governance for its corresponding area and send the corresponding data governance results to the central data middle platform; the central data middle platform is used to process the data governance results sent by each edge data middle platform to obtain data that meets user needs. When the data middle platform system is used to manage data assets for manufacturing enterprises, one area corresponds to one factory area, and the central data middle platform is set up in the center of the manufacturing group. By setting up edge data middle platforms in each factory area, the data aggregation and data processing capabilities of the edge data middle platform are utilized to aggregate the business system and equipment data of a single factory, build factory-level data applications, and perform data governance for each factory area, which has the characteristics of low startup cost and short implementation cycle; each edge data middle platform sends the data governance results to the central data middle platform according to the requirements of the central data middle platform set up in the center of the group, providing basic summary data for the group's data summary statistics; since the data governance results uploaded by each edge data middle platform are lightly aggregated data, the data volume is less than the original data, so the data transmission, storage and processing costs can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 This is a structural block diagram of a data middle platform system according to an embodiment of the present application;

[0041] Figure 2 This is a functional architecture diagram of the edge data middle platform according to one embodiment of the present application;

[0042] Figure 3 This is a schematic diagram of the hardware architecture of the edge data center according to one embodiment of the present application;

[0043] Figure 4 This is a schematic diagram of the data architecture of the edge data middle platform in one embodiment of the present application;

[0044] Figure 5 This is a functional architecture diagram of the central data platform according to one embodiment of the present application;

[0045] Figure 6 This is a schematic diagram of the hardware architecture of the central data center according to one embodiment of the present application;

[0046] Figure 7 This is a schematic diagram of the data architecture of the central data platform according to one embodiment of the present application;

[0047] Figure 8 This is a network diagram of the data center system of this application example;

[0048] Figure 9This is a schematic diagram of the data exchange architecture of the data middle platform system according to an embodiment of the present application;

[0049] Figure 10 A flowchart of the steps of a data processing method according to an embodiment of the present application;

[0050] Figure 11 This is a structural block diagram of a data processing device according to an embodiment of the present application. DETAILED DESCRIPTION

[0051] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.

[0052] The data middle platform is to accumulate the business and data of each business unit during the digital transformation of government and enterprises, and build a system for data construction, management, and use including data technology, data governance, and data operations to achieve data empowerment.

[0053] Current manufacturing data centers typically build large-scale clusters at the center of the group, pull raw data from individual factories via dedicated lines for processing, and then centrally store it at the group's center. This approach presents the following problems:

[0054] (1) When factories are distributed across the country and there are many of them, the movement of data puts great pressure on the enterprise bandwidth. Sometimes the bandwidth cannot meet the demand, resulting in the inability to include data in the data center management and use, which in turn reduces business effectiveness.

[0055] (2) The raw data of each factory is aggregated to the group's central storage and calculation. The storage and calculation costs are extremely high. In addition, due to the differences in data structures among factories, the cost of promoting unified standards is high, and the cost of maintaining data is also high.

[0056] (3) The construction cost is very high and requires a one-time investment.

[0057] Therefore, the existing data middle platform is not suitable for the manufacturing industry, that is, the existing data middle platform is not suitable for enterprises with large amounts of data and scattered distribution.

[0058] In view of this, an embodiment of the present application proposes a data middle-end system suitable for data management of manufacturing enterprises.

[0059] One of the core concepts of the embodiments of this application is to set up an edge data center in each region of the enterprise, and use the data aggregation and data processing capabilities of the edge data center to aggregate the business system and equipment data of a single region, build primary data applications, and perform data governance for each region; set up a central data center at the center of the enterprise group, and each edge data center sends the data governance results to the central data center to provide basic summary data for the group's data aggregation and statistics. This reduces data transmission, storage, and processing costs.

[0060] Reference Figure 1 , shows a structural block diagram of a data middle platform system provided in one embodiment of the present application. The data middle platform system provided in the embodiment of the present application is used to manage data assets for an enterprise. The data middle platform system in the embodiment of the present application includes a central data middle platform and multiple edge data middle platforms; wherein:

[0061] Multiple edge data middle platforms are set up in different regions. Each edge data middle platform is used to manage data in its corresponding region and send the corresponding data management results to the central data middle platform.

[0062] The central data middle platform is used to process the data governance results sent by each edge data middle platform to obtain data that meets user needs.

[0063] In an embodiment of the present application, for enterprises involving multiple regions, edge data middle platforms are set up in different regions, and a central data middle platform is set up in the central group of the enterprise. Data governance is performed on the corresponding regions through each edge data middle platform, and the corresponding data governance results are sent to the central data middle platform. The central data middle platform processes the data governance results sent by each edge data middle platform to obtain data that meets user needs.

[0064] When applied to a manufacturing enterprise with multiple plants, one region corresponds to one plant, and each edge data is used to support plant-level data needs to build data scenarios that meet the needs of each plant; the central data middle platform is used to support the group's data needs. Through data interaction between the edge data middle platform and the central data middle platform, the group can achieve control over each plant. For ease of understanding, the following embodiment will be illustrated by taking the application of the data middle platform system to a manufacturing enterprise as an example.

[0065] Each edge data middle station is used to perform data governance for its corresponding factory area. Data governance is a set of management behaviors involving data use in an organization. Initiated and promoted by the enterprise data governance department, it is about how to formulate and implement a series of policies and processes for commercial applications and technical management of internal data of the entire enterprise. In the embodiment of the present application, the edge data middle station can implement data governance for its corresponding factory area. Specifically, the functional architecture, hardware architecture and data architecture of the edge data middle station can be determined in combination with actual needs. The functional architecture, hardware architecture and data architecture of the edge data middle station in the embodiment of the present application will be exemplarily described below.

[0066] like Figure 2 As shown, Figure 2 The functional architecture diagram of the edge data center in one embodiment of the present application is shown. The functional architecture of the edge data center includes, from bottom to top, an IaaS (Infrastructure as a Service) layer, a storage & computing layer, a scheduling layer, a PaaS (Platform as a Service) layer, and a SaaS (Software as a Service) layer. It can be understood that the lower layer in the functional architecture is the infrastructure of the upper layer, and the services implemented by the upper layer need to rely on the lower layer to be implemented. Specifically:

[0067] (1) The IaaS layer and the storage & computing layer together support the normal operation of the edge data platform.

[0068] The IaaS layer includes service interfaces such as host management, cloud host management, network management, operation and maintenance, monitoring and alarm, and load balancing to implement corresponding services.

[0069] The storage and computing layer includes a cloud-native data warehouse (such as AnalyticDB for PostgreSQL). This cloud-native data warehouse can include modules such as row / column hybrid storage, compression levels 1 to 9, partitioned tables, HTAP (Hybrid Transaction and Analytical Process) databases, multiple replicas, and distribution strategies to provide corresponding services. Optionally, the storage and computing layer can also include an open-source distributed time series, event, and metrics database (such as InfluxDB) to provide services such as high-frequency read and write of time series data and efficient querying.

[0070] (2) The scheduling layer and PaaS layer support daily development and operation and maintenance work.

[0071] The scheduling layer includes the DataStack (a product for data R&D task scheduling and operation and maintenance) scheduling resource pool and the model deployment cluster (such as Flink Standalone) resource pool; specifically, it can include modules such as offline data synchronization, real-time data synchronization, ADBSQL JOB (database table synchronization), scheduling monitoring, scheduling task retry mechanism, scheduling task monitoring and alarm mechanism to provide corresponding services.

[0072] The PaaS layer includes a lightweight version of mobile IoT terminals (such as IData) and a lightweight version of Data Stack. The lightweight version of mobile IoT terminals can specifically include data service modules and model import modules, while the lightweight version of Data Stack can specifically include modules such as data R&D workbench, data map, task operation and maintenance, and permission management. Optionally, the PssS layer can further include other products.

[0073] (3) The SaaS layer provides a user-oriented functional interface.

[0074] The SaaS layer includes AI (Artificial Intelligence) applications, BI (Business Intelligence) applications, and CI (Customer Intelligence) applications.

[0075] Taking the cement manufacturing industry as an example, AI applications can include modules such as control optimization, carbon emission management, and equipment management to provide corresponding control optimization services, carbon emission management services, and equipment management services. BI applications can include modules such as generating daily / monthly reports, daily / monthly power consumption reports, and factory-level large screens to provide corresponding daily / monthly report generation services, daily / monthly power consumption reports, and factory-level large screen interactive services. CI applications can include modules such as production dashboards, marketing dashboards, and equipment dashboards to provide corresponding services for visually displaying production, marketing, and equipment information.

[0076] like Figure 3 As shown, Figure 3 The hardware architecture diagram of the edge data center of an embodiment of the present application is shown. The hardware architecture of the edge data center includes a physical machine cluster layer, a virtualization layer, a database layer, a data stack platform and operating environment layer, and an application layer. Specifically:

[0077] The physical machine cluster layer is the lowest level of hardware and consists of multiple physical machines. Specifically, it can be composed of 4, 5, or any other number of physical machines, which is not limited by this application.

[0078] The virtualization layer is used to virtualize a physical machine into several virtual machines. For example, the virtualization layer can be a ZStack virtualization layer.

[0079] The database layer serves as the storage and computing engine of the edge data platform, used to store and process business data. For example, the database layer can include Adb PostgreSQL (a database) and DbStack (a database platform).

[0080] The DataStack platform and runtime environment layer provides the database layer with an operating environment for data processing and data tasks. For example, the DataStack platform and runtime environment layer may include Flink Standalone, DataStack, and Kubernetes (a portable container orchestration and management tool).

[0081] The application layer is used to interact with the client and retrieve data from the database layer based on the client's business needs and feed the data back to the client. For example, the application layer can include IData.Edge (an application in the edge data center) and other SaaS applications.

[0082] like Figure 4 As shown, Figure 4 The data architecture diagram of the edge data center in one embodiment of the present application is shown. The data architecture of the edge data center includes the ODS (raw data) layer, DWD (middle detail) layer, DWS (middle summary) layer, and TDM (tag data) layer in order from bottom to top. Among them:

[0083] The ODS layer is used to receive raw data, and may include modules such as product table, equipment table, personnel table, warehousing details, production details, sales details, DSC (monitoring) raw data, etc., for receiving the corresponding raw data.

[0084] The DWD layer analyzes the raw data received from the ODS layer and generates corresponding analysis results. For example, analyzing data in the product table yields the corresponding product dimension table; analyzing data in the equipment table yields the corresponding equipment dimension table; analyzing data in the personnel table yields the corresponding personnel dimension table; and analyzing material-related inventory details, production details, sales details, and DSC raw data yields the corresponding material dimension table.

[0085] The DWS layer is used to divide data into different topics based on business types to reduce data redundancy. These topics may include: factory-level marketing data topics, factory-level production data topics, factory-level equipment data topics, etc.

[0086] The TDM layer is used to tag data, connecting various business segments to create global tags for objects. These tags can include production / energy consumption / marketing reports, interactive H5 applications, equipment / employee management dashboards, third-party CI, and service tables.

[0087] In the embodiment of the present application, the data architecture of the edge data middle platform utilizes the row and column fusion characteristics of ADB (a database product used for storage and calculation of the edge data middle platform) in terms of data storage and calculation. For tables that serve as dimension tables and tables that need to provide data services, row storage (Heap table) is used; for tables that serve as real-time tables and need to do OLAP (On-Line Analytical Processing, online analytical processing) analysis, column storage (Appendonly table) is used. During the data processing process, since ADB does not have a similar syntax for inserting or overwriting data, and there is no dynamic partitioning setting, a non-partitioned table + insert conflict overwrite write method is used to process the incremental data of each scheduling cycle, and a partitioned table is used to process static partitioned data.

[0088] Traditional data middle platforms use Hadoop (a distributed system infrastructure) for data storage and computing, which often requires the collaboration of multiple big data components. This results in high data development complexity and high hardware and deployment and maintenance costs. In the embodiments of the present application, the data architecture of the edge data middle platform can reduce hardware and deployment and maintenance costs, and reduce the complexity of data development.

[0089] In the embodiment of the present application, the central data center is used to manage and apply the data governance results sent by each edge data center; the functional architecture, hardware architecture, and data architecture of the central data center can be determined based on actual needs. The functional architecture, hardware architecture, and data architecture of the central data center in the embodiment of the present application are exemplarily described below.

[0090] like Figure 5 As shown, Figure 5 The following is a diagram showing the functional architecture of the central data platform in one embodiment of the present application. The functional architecture of the central data platform includes, from bottom to top, the R&D workbench layer, the industry model layer, the data asset layer, the data service layer, and the data application layer. It can be understood that the lower layer in the functional architecture is the infrastructure of the upper layer, and the services implemented by the upper layer need to rely on the lower layer to be implemented. Specifically:

[0091] (1) The R&D workbench layer is responsible for data aggregation and processing, and realizes data cloud governance, that is, data is transmitted to the cloud for data governance.

[0092] The R&D workbench layer includes a data aggregation module and a data processing module. The data aggregation module is used to receive data, while the data processing module processes the data gathered by the data aggregation module. The data aggregation module includes modules such as data template management, metadata assets, task management, and monitoring and maintenance to implement corresponding services. The data processing module includes modules such as standard management, model management, intelligent ETL (Extract-Transform-Load), and data quality assessment to implement corresponding services.

[0093] (2) The industry model layer is used to define and manage industry segmentation data models, as well as the relationship between management models.

[0094] The industry model layer includes a data model management module, a data view module, and a model service module. The data model management module includes a model storage module and a model category management module; the data view module includes a model structure module, a model quality module, and a kinship model; and the model service module includes a service encapsulation module and an input window module. Each model implements its corresponding service.

[0095] (3) The data asset layer is used to define and manage data assets, including data labeling and data scenario construction, as well as data asset management and authorization.

[0096] The data asset layer includes asset market module, asset management module, asset processing module, data application module, data rights management module, and business scenario module. Among them:

[0097] The asset market module includes the asset view module, the tag usage module, and the tag activity module.

[0098] The asset management module includes the tag management module, the data online module, and the data indicator module.

[0099] The asset processing module includes a strategy labeling module, an algorithm labeling module, and a statistical classification module.

[0100] The data application module includes data visualization module, intelligent reporting module, and data cluster module.

[0101] The data rights management module includes a label application module, a label authorization module, and a business scenario association module.

[0102] The business scenario module includes the service permission module, the tag permission module, and the project attribute module.

[0103] (4) The data service layer is used to define and manage data services, including providing API services and authorization.

[0104] The data service layer includes the service market module, service management module, and service application module. Among them:

[0105] The service market module includes an interface view module, a service usage module, and a service testing module.

[0106] The service management module includes a service application module, a service authorization module, and a service generation module.

[0107] The service application module includes the service application module, the interface testing module, and the service calling module.

[0108] (5) The data application layer is the top-level application and interface closest to the customer.

[0109] The data application layer includes a group-level digital operation analysis module, a factory-level intelligent manufacturing application module, a data visualization large-screen module, and a system integration module to realize the corresponding data asset application functions.

[0110] like Figure 6 As shown, Figure 6 The following figure shows the hardware architecture of the central data center platform in one embodiment of the present application. In this embodiment, the central data center platform is deployed using a public cloud VPC (Virtual Private Cloud), that is, purchasing an ECS (Elastic Compute Service) cluster in the public cloud. This can improve the stability and scalability of the data platform system and also facilitate operation and maintenance support.

[0111] After the ECS cluster is determined, deploy the agile standard base in the ECS cluster and deploy upper-layer applications. The upper-layer applications include:

[0112] The Data Resource Platform (DataQ) or Data Factory (DataWorks) application is responsible for data scheduling and development.

[0113] Indirect addressing (IData) applications are responsible for industrial data assets and data services.

[0114] Other SaaS applications are used for users in various industries.

[0115] like Figure 7 As shown, Figure 7 The following is a schematic diagram of the data architecture of the central data center in one embodiment of the present application. The data architecture of the central data center includes, from bottom to top, the ODS layer, the DWD layer, the DWS layer, and the TDM layer. In order to distinguish it from the data architecture of the edge data center, the ODS layer, DWD layer, DWS layer, and TDM layer of the data architecture of the central data center are respectively recorded as the central ODS layer, the central DWD layer, the central DWS layer, and the central TDM layer.

[0116] (1) The central ODS layer is used for data access, that is, data access at the source of the data.

[0117] In an embodiment of the present application, the data source accessed by the ODS layer of the central data middle station is the data governance result sent by the edge data middle station; specifically, the data governance result can be obtained after data governance based on the management instructions sent by the central data middle station.

[0118] The central ODS layer can include business data modules and production data modules; among them, the business data module can include ERP (Enterprise Resource Planning), SIS (Supervisory Information System in Plant Level), PLM (Product Lifecycle Management), SCM (Supply Chain Management), MES (Manufacturing Execution System), MIS (Management Information System), CRM (Customer Relationship Management), WMS (Warehouse Management System) and other modules to obtain corresponding business data. The production data module includes equipment, tools, production lines, cameras, mechanical equipment, robots, cars, trains and other modules to obtain corresponding production data.

[0119] (2) The central DWD layer is used to perform data fusion.

[0120] The central DWD layer includes modules such as data aggregation, data cleaning, data services, data modeling, data standards, master data management, data quality, and metadata management, and the corresponding data fusion services are implemented through the above modules.

[0121] (3) The central DWS layer is used to provide data asset services.

[0122] The central DWS layer divides the group's global data assets into eight domains: orders, raw materials, suppliers, equipment, production, products, customers, and public centers, and provides corresponding data asset services based on each domain.

[0123] (4) The central TDM layer is responsible for data asset management operations.

[0124] The central TDM layer tags data and includes modules such as the data asset portal, data asset assessment, data asset management, data asset sharing, data service management, and data interface services. Each module determines data tags to meet the needs of various industry applications. For example, in the cement manufacturing industry, industry applications include steel, water, chemicals, cement, and discrete manufacturing. Based on the data requirements of each application, data is retrieved from the corresponding tags and fed back to the application. The table structure and data content of the central TDM layer can be customized according to the needs of upper-layer applications.

[0125] In one embodiment of the present application, each of the edge data middle platforms is used to perform data governance on its corresponding factory area and send the corresponding data governance results to the central data middle platform, including:

[0126] Each of the edge data middle stations is used to perform data governance on the corresponding factory area, and sends the corresponding data governance results to the central data middle station in accordance with the data interface specification corresponding to the central data middle station.

[0127] In this embodiment, each edge data middle station transmits data to the central data middle station in accordance with the requirements of the central data middle station. Therefore, the problems caused by the inconsistent original data structures of each factory can be reduced, and the efficiency of data processing of the central data middle station can be improved.

[0128] In one embodiment of the present application, a management network and a data network are provided between the central data center and each of the edge data centers;

[0129] The management network is used to transmit management signals;

[0130] The data network is used to transmit data signals.

[0131] In this embodiment, a management network for transmitting management signals and a data network for transmitting data signals are set up between the central data middle station and each edge data middle station, that is, management signals and data signals are transmitted using different networks respectively, which can facilitate management and subsequent maintenance.

[0132] Furthermore, in one embodiment of the present application, the plurality of edge data middle stations are divided into a first edge data middle station and a second edge data middle station, the first edge data middle station is set in an area with organizational management responsibilities, and the second edge data middle station is set in an area without organizational management responsibilities; an organization is composed of an area with organizational management responsibilities and at least one area without organizational management responsibilities; the first edge data middle station set in an area with organizational management responsibilities can aggregate and manage the data assets corresponding to other areas of the organization to which it belongs that do not have organizational management responsibilities. It can be understood that in a manufacturing enterprise, the above-mentioned area corresponds to a factory area, and the organization corresponds to an area consisting of a factory area with organizational management responsibilities and at least one factory area without organizational management responsibilities.

[0133] The management network and the data network are set between the first edge data middle platform and the second edge data middle platform belonging to the same organization.

[0134] like Figure 8 As shown, Figure 8 The network diagram of the data center system of this application is shown. The cloud-edge collaborative architecture of the central data center and the edge data center in the figure includes the group management and operation center (i.e., the group center), the first area with organizational management responsibilities in each organization (such as Figure 8 Plant A in the East China region and Plant D in the Southwest region), and a second region within each organization without organizational management responsibilities (e.g. Figure 8 Factory B in East China, Factory C in East China, and Factory E in Southwest China). The group has a central data center (such as Figure 8 Each region is equipped with an edge data center (such as Figure 8 Idata.Edge in ).

[0135] For example, in the East China organization (i.e. the East China region in the figure), the one with organizational management responsibilities is Factory A in the East China region, and the ones without organizational management responsibilities are Factory B and Factory C in the East China region; therefore, the edge data middle station set up in Factory A in the East China region is the first edge data middle station, and the edge data middle stations set up in Factory B and Factory C in the East China region are both the second edge data middle stations.

[0136] In view of the considerations of the size of management and operation signal volume and data signal volume, as well as construction cost considerations, in the embodiment of the present application, the management network uses a gigabit switch, that is, the management network is a gigabit network; the data network uses a 10 gigabit switch, that is, the data network is a 10 gigabit network; this achieves the reduction of construction costs while meeting the needs.

[0137] The management network is mainly responsible for the uploading and sending of management signals. In this embodiment, the management network's isolation strategy for the network is as follows:

[0138] (1) The networks between the second edge data centers within the same organization cannot communicate with each other; that is, no management network is set up between the second edge data centers within the same organization; the second edge data centers within the same organization cannot expose IP and communication to each other.

[0139] (2) The first edge data middle station and each second edge data middle station in the same organization are interconnected; that is, a management network is set up between the first edge data middle station and each second edge data middle station in the same organization; the first edge data middle station and each second edge data middle station in the same organization expose IP addresses to each other and communicate with each other.

[0140] (3) The central data center is interconnected with the edge data centers of each organization (including the first edge data center and the second edge data center); that is, a management network is set up between the central data center and each edge data center; the central data center and each edge data center expose their IP addresses to each other and communicate with each other.

[0141] By managing the network's isolation strategy, the central data center can manage, control, and operate the hardware and virtual machines of each organization's factory. At the same time, each organization can also manage, control, and operate the hardware and virtual machines of each factory within the organization through the first edge data center. However, the edge data centers between different organizations cannot communicate with each other, and different second edge data centers within the same organization cannot communicate with each other. This enables independent autonomy for each organization and factory, allowing the construction of data scenarios that meet the needs of each organization and factory.

[0142] The data network is primarily responsible for data flow and exchange within the cluster. In this embodiment, the data network's isolation strategy for the network is as follows:

[0143] (1) The networks between the second edge data middle stations within the same organization cannot be interconnected; that is, no data network is set up between the second edge data middle stations within the same organization; the data of the second edge data middle stations within the same organization are not interoperable.

[0144] (2) The data of each second edge data middle station within the same organization can be transmitted unidirectionally to the first edge data middle station; that is, the data network set up between the first edge data middle station and each second edge data middle station within the same organization to which it belongs is a unidirectional communication network, and the data transmission direction is from the second edge data middle station to the first edge data middle station; it can be understood that for the data network, the first edge data middle station within the same organization exposes the IP to each second edge data middle station, so that each second edge data middle station can obtain the table structure of the data to be reported according to the IP of the first edge data middle station, and report the data to the first edge data middle station according to the table structure.

[0145] (3) The data of each edge data middle station of each organization (including the first edge data middle station and the second edge data middle station) can be transmitted unidirectionally to the central data middle station; that is, the data network set up between the central data middle station and each edge data middle station is a unidirectional communication network, and the data transmission method is from the edge data middle station to the central data middle station; it can be understood that for the data network, the central data middle station exposes the IP to each edge data middle station of each organization, so that each edge data middle station can obtain the table structure of the data to be reported according to the IP of the central data middle station, and report the data to the central data middle station according to the table structure.

[0146] Through the isolation strategy of the data network, each second edge data middle station can report the data governance results to the first edge data middle station or the central data middle station of the organization to which it belongs; each first edge data middle station can report the data governance results of its corresponding area and the data governance results received from the second edge data middle station to the central data middle station; through the one-way data network, the accuracy and efficiency of data transmission can be improved, facilitating data management and optimization.

[0147] It should be noted that the data reported to the first edge data middle station needs to be standardized according to the data interface specifications corresponding to the first edge data middle station before it can be reported to the first edge data middle station; the data reported to the central data middle station needs to be standardized according to the data interface specifications corresponding to the central data middle station before it can be reported to the central data middle station.

[0148] like Figure 9 As shown, a schematic diagram of the data exchange architecture of the data middle platform system of an embodiment of the present application is shown. Figure 9 The Idata Group data center is set up in the cement group), and the edge data center is set up in each plant (such as Figure 9 The Idata.Edge edge data middle platform set up in East China A Factory and East China B Factory) and the factory end (such as Figure 9 The edge data center has a one-to-one correspondence with the factory end.

[0149] The edge data center mainly focuses on three aspects: factory sales, production, and equipment maintenance. It uses the data aggregation and data processing capabilities of the edge data center to aggregate the business system and equipment data of a single factory and build factory-level data applications. Specifically, the edge data center is used to collect data such as equipment data and business system data at the corresponding factory end. Through data aggregation, factory-level generation details, inventory details, sales details, and other data can be obtained; and further data processing can be used to determine factory-level theme data, such as factory-level production management data themes, factory-level marketing management data themes, factory-level inventory management data themes, factory-level equipment management data themes, and other data.

[0150] The first edge data center can also receive factory-level subject data reported by the second edge data centers of its affiliated organizations according to the specifications of the first edge data center, and process it in combination with the factory-level subject data of the first edge data center itself to obtain data on the organizational management data theme. In manufacturing enterprises, the organizational management data theme is the regional management data theme.

[0151] Based on the data of its factory-level themes, each edge data middle platform can provide corresponding user-oriented factory-level applications to achieve factory-level data governance.

[0152] For the first edge data center, it can also provide corresponding user-oriented organization-level applications based on the data of its organizational management data topics to achieve organization-level data governance. In manufacturing enterprises, organization-level applications are regional-level applications.

[0153] The central data middle station can receive data from various edge data middle stations (including the first edge middle station and the second edge middle station), report factory-level subject data in accordance with the standard caliber of the central data middle station, and receive data from various first edge data middle stations, report regional-level subject data in accordance with the standard caliber of the central data middle station, and process it to provide corresponding user-oriented group-level applications and realize group-level data governance.

[0154] When the data middle platform system provided in the embodiment of the present application is applied to a manufacturing enterprise, it includes: a central data middle platform set up in the center of the manufacturing group and multiple edge data middle platforms set up in each manufacturing factory; each edge data middle platform is used to perform data governance for its corresponding factory, and send the corresponding data governance results to the central data middle platform in accordance with the data interface specification corresponding to the central data middle platform; the central data middle platform is used to manage and apply the data governance results sent by each edge data middle platform. By setting up an edge data middle platform in each factory area and utilizing the data aggregation and data processing capabilities of the edge data middle platform, the business system and equipment data of a single factory are aggregated, factory-level data applications are built, and data governance is carried out for each factory area, which has the characteristics of low startup cost and short implementation cycle; each edge data middle platform sends the data governance results to the central data middle platform in accordance with the requirements of the central data middle platform set up in the center of the group, providing basic summary data for the group's data summary statistics; since the data governance results uploaded by each edge data middle platform are lightly aggregated data, the data volume is less than the original data, so the data transmission, storage and processing costs can be reduced; in addition, since each edge data middle platform transmits data to the central data middle platform in accordance with the requirements of the central data middle platform, it can also reduce the problems caused by inconsistent original data structures of each factory.

[0155] Reference Figure 10 , shows a flowchart of the steps of a data processing method of the present application, which can be executed by the above-mentioned data middle platform system; specifically, it may include the following steps:

[0156] Step 1001: By setting up multiple edge data middle platforms in different regions, data governance is performed on the corresponding regions, and the corresponding data governance results are sent to the central data middle platform;

[0157] Step 1002: Process the data governance results sent by each edge data middle station through the central data platform to obtain data that meets user needs.

[0158] In one embodiment of the present application, the method of setting up multiple edge data middle platforms in different regions to perform data governance on the corresponding regions and sending the corresponding data governance results to the central data middle platform includes:

[0159] Data governance is performed on the corresponding areas through each edge data middle station, and the corresponding data governance results are sent to the central data middle station in accordance with the data interface specifications corresponding to the central data middle station.

[0160] In one embodiment of the present application, the plurality of edge data middle stations are divided into a first edge data middle station and a second edge data middle station, the first edge data middle station is set in an area with organizational management responsibilities, and the second edge data middle station is set in an area without organizational management responsibilities; an organization consists of one area with organizational management responsibilities and at least one area without organizational management responsibilities; the plurality of edge data middle stations set in different areas perform data governance on the corresponding areas, and send the corresponding data governance results to the central data middle station, including:

[0161] Through the second edge data center, data governance is performed on the corresponding area, and the corresponding data governance results are sent to the first edge data center of the same organization to which it belongs;

[0162] Through the first edge data middle station, data governance is performed on the corresponding area, and the corresponding data governance results and the data governance results received from the second edge data middle station are sent to the central data middle station.

[0163] In one embodiment of the present application, the first edge data middle station performs data governance on the corresponding area, and sends the corresponding data governance results and the received data governance results sent by the second edge data middle station to the central data middle station, including:

[0164] Through the first edge data middle station, data governance is performed on the corresponding area, and the corresponding data governance results and the data governance results received from the second edge data middle station are sent to the central data middle station in accordance with the data interface specifications corresponding to the central data middle station.

[0165] In one embodiment of the present application, the above method further includes:

[0166] Through the first edge data middle platform, data governance is performed on the corresponding area, and the corresponding data governance results and the data governance results received from the second edge data middle platform are summarized and processed to obtain organizational data that meets customer needs.

[0167] In one embodiment of the present application, the second edge data middle platform performs data governance on the corresponding area and sends the corresponding data governance results to the first edge data middle platform of the same organization, including:

[0168] Through the second edge data middle station, data governance is performed on the corresponding area, and the corresponding data governance results are sent to the first edge data middle station according to the data interface specifications corresponding to the first edge data middle station belonging to the same organization.

[0169] In one embodiment of the present application, management signal transmission is performed through a management network set between the central data middle station and each edge data middle station; data signal transmission is performed through a data network set between the central data middle station and each edge data middle station.

[0170] The management network is a Gigabit network, the data network is a 10 Gigabit network, the management network is a two-way communication network, and the data network is a one-way communication network.

[0171] It can be understood that the central data middle station can carry out two-way management signal transmission with each edge data middle station, and the central data middle station can carry out one-way data signal transmission with each edge data middle station, that is, data signals can only be transmitted from the edge data middle station to the central data middle station.

[0172] In one embodiment of the present application, no management network and data network are set up between the edge data middle stations of different organizations, and management signals and data signals cannot be transmitted. No management network and data network are set up between the second edge data middle stations of the same organization, and management signals and data signals cannot be transmitted. A management network and a data network are set up between the first edge data middle station and each second edge data middle station of the same organization. For the convenience of description, the management network between the first edge data middle station and each second edge data middle station of the same organization is recorded as the edge management network, and the data network between the first edge data middle station and each second edge data middle station of the same organization is recorded as the edge data network. The first edge data middle station of the same organization transmits management signals with each second edge data middle station through the edge management network; the first edge data middle station of the same organization transmits data signals with each second edge data middle station through the edge data network.

[0173] It can be understood that the first edge data middle station of the same organization can perform bidirectional management signal transmission with each second edge data middle station, while the data signal can only be transmitted from the second edge data middle station to the first edge data middle station.

[0174] In the embodiment of the present application, when applied to a manufacturing enterprise, by setting up an edge data middle station in each factory area, utilizing the data aggregation and data processing capabilities of the edge data middle station, the business system and equipment data of a single factory are aggregated, a factory-level data application is constructed, and data governance is performed on each factory area, which has the characteristics of low startup cost and short implementation cycle; each edge data middle station sends the data governance results to the central data middle station in accordance with the requirements of the central data middle station set up in the center of the group, providing basic summary data for the group's data summary statistics; since the data governance results uploaded by each edge data middle station are lightly aggregated data, the data volume is less than the original data, and therefore, the data transmission, storage and processing costs can be reduced; in addition, since each edge data middle station transmits data to the central data middle station in accordance with the requirements of the central data middle station, it can also reduce the problems caused by the inconsistent original data structure of each factory.

[0175] It should be noted that for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the order of the actions described, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

[0176] Reference Figure 11 , shows a structural block diagram of an embodiment of a data processing device of the present application. The device corresponds to the above-mentioned embodiment of the data processing method and may specifically include the following modules:

[0177] The data processing module 1101 is used to perform data governance in the corresponding areas by setting up multiple edge data middle platforms in different areas, and send the corresponding data governance results to the central data middle platform;

[0178] The data application module 1102 is used to process the data governance results sent by each edge data middle station through the central data platform to obtain data that meets user needs.

[0179] In one embodiment of the present application, the data processing module 1101 is specifically used to perform data governance on the corresponding areas through each edge data middle station, and send the corresponding data governance results to the central data middle station according to the data interface specification corresponding to the central data middle station.

[0180] In one embodiment of the present application, the data processing module 1101 includes:

[0181] The organizational data processing module is used to perform data governance on the corresponding area through the second edge data center station set up in the area without organizational management responsibilities, and send the corresponding data governance results to the first edge data center station set up in the area with organizational management responsibilities in the same organization to which it belongs; an organization consists of one area with organizational management responsibilities and at least one area without organizational management responsibilities;

[0182] The group data processing module is used to perform data governance on the corresponding area through the first edge data middle platform set up in the area with organizational management responsibilities, and send the corresponding data governance results and the data governance results received from the second edge data middle platform to the central data middle platform.

[0183] In one embodiment of the present application, the organizational data processing module is specifically used to perform data governance on the corresponding area through a second edge data middle station set up in an area that does not have organizational management responsibilities, and send the corresponding data governance results to the first edge data middle station in accordance with the data interface specification corresponding to the first edge data middle station of the same organization to which it belongs and set up in an area with organizational management responsibilities.

[0184] In one embodiment of the present application, the group data processing module is specifically used to perform data governance on the corresponding area through a first edge data middle station set up in the area with organizational management responsibilities, and send the corresponding data governance results and the data governance results received from the second edge data middle station to the central data middle station in accordance with the data interface specification corresponding to the central data middle station.

[0185] In one embodiment of the present application, the organizational data processing module is further configured to perform data governance on the corresponding region through the first edge data middle platform, and to aggregate and process the corresponding data governance results and the data governance results received from the second edge data middle platform to obtain organizational data that meets customer needs. In one embodiment of the present application, the device further includes a management network module and a data network module. The management network module is configured to transmit management signals between the central data middle platform and each edge data middle platform; and the data network module is configured to transmit data signals between the central data middle platform and each edge data middle platform.

[0186] The management network module is used to provide a Gigabit network, and the data network module is used to provide a 10 Gigabit network.

[0187] The management network module is used to provide a two-way communication network, and the data network module is used to provide a unidirectional communication network. Specifically, the data network module is used to transmit the data signals of each edge data middle station to the central data middle station; and to transmit the data signals of each second edge data middle station to the first edge data middle station of the same organization.

[0188] In the embodiment of the present application, when applied to a manufacturing enterprise, the business system and equipment data of a single factory are aggregated through the data processing module to build a factory-level data application, and data governance is performed on each factory area, which has the characteristics of low startup cost and short implementation cycle; through the data application module, the data governance results of each edge data middle station are summarized in accordance with the requirements of the central data middle station set up in the center of the group, providing basic summary data for the group's data summary statistics; since the data governance results uploaded by each edge data middle station are lightly aggregated data, the data volume is less than the original data, and therefore, the data transmission, storage and processing costs can be reduced; in addition, since each edge data middle station transmits data to the central data middle station in accordance with the requirements of the central data middle station, it can also reduce the problems caused by the inconsistent original data structure of each factory.

[0189] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0190] An embodiment of the present application also discloses an electronic device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the steps of the data processing method described above when executed by the processor.

[0191] The embodiment of the present application further discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the data processing method described above are implemented.

[0192] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0193] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0194] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0195] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0196] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0197] Although preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they become aware of the basic inventive concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0198] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or terminal device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that includes the element.

[0199] The above is a detailed introduction to the data middle-office system, data processing method and device, equipment and storage medium provided by this application. Specific examples are used in this article to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method of this application and its core idea; at the same time, for general technical personnel in this field, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on this application.

Claims

1. A data middle platform system, characterized in that: Applied to data asset management of multi-factory manufacturing enterprises, one region corresponds to one factory, and the data center system includes: a central data center and multiple edge data centers; Multiple edge data middle platforms are set up in different areas, and each edge data middle platform is used to perform data governance in its corresponding area and send the corresponding data governance results to the central data middle platform; The central data center is used to process the data governance results sent by each edge data center to obtain data that meets user needs; Among them, the multiple edge data middle stations are divided into a first edge data middle station and a second edge data middle station, the first edge data middle station is set in an area with organizational management responsibilities, and the second edge data middle station is set in an area without organizational management responsibilities; an organization consists of an area with organizational management responsibilities and at least one area without organizational management responsibilities; edge data middle stations between different organizations cannot communicate with each other over the network, and different second edge data middle stations in the same organization cannot communicate with each other over the network; The second edge data center is used to perform data governance for its corresponding area and send the corresponding data governance results to the first edge data center of the same organization to which it belongs; The first edge data middle station is used to perform data governance on its corresponding area, and sends the corresponding data governance results and the data governance results received from the second edge data middle station to the central data middle station.

2. The data middle platform system according to claim 1, characterized in that: Each of the edge data middle platforms is used to perform data governance on its corresponding area and send the corresponding data governance results to the central data middle platform, including: Each of the edge data middle stations is used to perform data governance on its corresponding area, and sends the corresponding data governance results to the central data middle station in accordance with the data interface specification corresponding to the central data middle station.

3. The data middle platform system according to claim 2, characterized in that: A management network for transmitting management signals and a data network for transmitting data signals are set between the central data middle station and each of the edge data middle stations.

4. The data middle platform system according to claim 3, characterized in that: The management network and the data network are set between the first edge data middle station and the second edge data middle station belonging to the same organization.

5. The data middle platform system according to claim 4 is characterized in that: The data network is a one-way communication network; A data network is provided between the first edge data middle station and the second edge data middle station, for transmitting the data governance result of the second edge data middle station to its corresponding first edge data middle station; A data network is set up between the central data middle station and the first edge data middle station, and between the central data middle station and the second edge data middle station, for transmitting the data governance results of the first edge data middle station and / or the second edge data middle station to the central data middle station.

6. The data middle platform system according to claim 4, characterized in that: The second edge data center is used to perform data governance for its corresponding area and send the corresponding data governance results to the first edge data center of the same organization to which it belongs, including The second edge data middle station is used to send the data governance results of its corresponding area to its corresponding first edge data middle station in accordance with the data interface specification corresponding to its corresponding first edge data middle station.

7. According to the data middle-office system according to any one of claims 3-6, the management network is a Gigabit network and the data network is a 10 Gigabit network.

8. A data processing method, characterized in that: Applied to data asset management for a multi-factory manufacturing enterprise, where one region corresponds to one factory, the method includes: By setting up multiple edge data middle platforms in different regions, data governance is carried out in the corresponding regions, and the corresponding data governance results are sent to the central data middle platform; The data governance results sent by each edge data center are processed by the central data center to obtain data that meets user needs; Among them, the multiple edge data middle stations are divided into a first edge data middle station and a second edge data middle station, the first edge data middle station is set in an area with organizational management responsibilities, and the second edge data middle station is set in an area without organizational management responsibilities; an organization consists of an area with organizational management responsibilities and at least one area without organizational management responsibilities; the edge data middle stations between different organizations cannot communicate with each other over the network, and different second edge data middle stations in the same organization cannot communicate with each other over the network; the multiple edge data middle stations set up in different areas perform data governance for their corresponding areas, and send the corresponding data governance results to the central data middle station, including: Through the second edge data center, data governance is performed on the corresponding area, and the corresponding data governance results are sent to the first edge data center of the same organization to which it belongs; Through the first edge data middle station, data governance is performed on the corresponding area, and the corresponding data governance results and the data governance results received from the second edge data middle station are sent to the central data middle station.

9. A data processing device, characterized in that: Applicable to data asset management of multi-factory manufacturing enterprises, where one area corresponds to one factory. The device includes: The data processing module is used to perform data governance in the corresponding areas by setting up multiple edge data middle platforms in different areas, and send the corresponding data governance results to the central data middle platform; A data application module is used to process the data governance results sent by each edge data center through the central data center to obtain data that meets user needs; Among them, the plurality of edge data middle stations are divided into a first edge data middle station and a second edge data middle station, and the data processing module includes: An organizational data processing module is configured to perform data governance on the corresponding region through a second edge data middle station located in a region without organizational management responsibilities, and to send the corresponding data governance results to a first edge data middle station located in a region with organizational management responsibilities, belonging to the same organization to which it belongs; an organization is composed of a region with organizational management responsibilities and at least one region without organizational management responsibilities; wherein, no management network for transmitting management signals and no data network for transmitting data signals are set between edge data middle stations of different organizations, and therefore, the edge data middle stations of different organizations cannot communicate with each other over the network, and different second edge data middle stations within the same organization cannot communicate with each other over the network; The group data processing module is used to perform data governance on the corresponding area through the first edge data middle platform set up in the area with organizational management responsibilities, and send the corresponding data governance results and the data governance results received from the second edge data middle platform to the central data middle platform.

Images