Multi-source heterogeneous data processing method based on split item engineering and spatial dimension cross-correlation core elements

Abstract

The invention discloses a multi-source heterogeneous data processing method based on split item projects and spatial dimension cross-correlation core elements. The method comprises the following steps: defining standard split item projects of a bridge, a roadbed and a tunnel; defining standard spatial dimensions of the bridge, the roadbed and the tunnel; setting an association rule of the split item project and the spatial dimension, and constructing a dimension model based on the association rule; constructing a relationship between the core elements and the dimension model based on the core elements of the bridge, the roadbed and the tunnel; and selecting a summary dimension based on the use scene, and performing data fusion based on the summary dimension and the relationship between the core element and the dimension model to obtain fused data. According to the data processing method based on split item engineering and spatial dimension cross-correlation core elements, the problem of data islands is effectively solved. Compared with the existing method, the method has higher adaptability and high efficiency.

Description

Technical Field

[0001] The present invention belongs to the field of data processing technology, and in particular relates to a multi-source heterogeneous data processing method based on core elements of cross-correlation between sub-item engineering and spatial dimensions. Background Art

[0002] Multi-source heterogeneous data fusion is an important research direction in the field of big data, which refers to the process of integrating multiple data sources to generate more valuable information than a single data source. It includes structured data, semi-structured data, and unstructured data, as well as data between different systems and platforms.

[0003] In the railway engineering management platform, different professions and different project sections have their own system platforms. While providing convenient business processing functions for the project, it also brings about the problem of data islands. The data between the systems are heterogeneous, which makes it difficult to share data. In the existing technology, the method of fusing multi-source heterogeneous data has poor fusion effect, and the applicable data structure types are limited, which cannot meet the data fusion requirements of various business systems. Therefore, a new data processing method is urgently needed to better solve the problem of information islands. Summary of the invention

[0004] In order to solve the above technical problems, the present invention proposes a multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-items of engineering and spatial dimensions to solve the problems existing in the above-mentioned prior art.

[0005] To achieve the above object, the present invention provides a multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions, comprising the following steps:

[0006] Define standard sub-items for bridges, roadbeds and tunnels;

[0007] Define standard spatial dimensions for bridges, roadbeds, and tunnels;

[0008] Setting association rules between the sub-projects and space dimensions, and building a dimensional model based on the association rules;

[0009] Based on the core elements of bridges, roadbeds and tunnels, the relationship between the core elements and the dimensional model is constructed;

[0010] Aggregate dimensions are selected based on usage scenarios, and data fusion is performed based on the relationship between the aggregate dimensions and the core elements and the dimensional model to obtain fused data.

[0011] Preferably, the standard sub-projects of the bridge include pile foundations, caps, abutments and piers;

[0012] The standard sub-items of the roadbed project include foundation, cutting excavation, roadbed filling, slope support and anti-slip and drainage;

[0013] The standard sub-projects of a tunnel include support, geological prediction, tunnel excavation, invert, drainage and secondary lining.

[0014] Preferably, the standard spatial dimensions of bridges, roadbeds and tunnels include projects, sections, work areas, work sites, unit projects and components.

[0015] Preferably, the method for constructing a dimensional model based on the association rules includes:

[0016] Construct the bridge dimension model of sub-projects and spatial dimensions of bridges based on association rules;

[0017] Construct the sub-project and spatial dimension model of the roadbed based on association rules;

[0018] Construct tunnel dimension models of sub-projects and spatial dimensions of tunnels based on association rules;

[0019] The dimensional model is obtained by combining the bridge dimensional model, the roadbed dimensional model and the tunnel dimensional model.

[0020] Preferably, the association rules include:

[0021] The mapping relationship between the sub-projects and spatial dimensions of the bridge includes: mapping between unit project and abutment, mapping between work point and pile foundation, and mapping between project and abutment;

[0022] The mapping relationship between sub-projects and spatial dimensions of the roadbed includes: mapping between unit projects and drainage, mapping between work sites and foundations, and mapping between projects and slope support and sliding prevention;

[0023] The mapping relationship between the sub-projects and spatial dimensions of the tunnel includes: unit project and support mapping, work point and drainage mapping, and project and secondary lining mapping.

[0024] Preferably, the method for constructing the relationship between the core elements and the dimensional model includes:

[0025] Configure the mapping relationship between the core business elements of the bridge and the dimensional model, and establish a bridge relationship model that cross-correlates the core business elements of the bridge sub-projects with the spatial dimension;

[0026] Configure the mapping relationship between the core business elements of the roadbed and the dimensional model, and establish a roadbed relationship model that cross-correlates the core business elements of the roadbed spatial dimension and the sub-projects;

[0027] Configure the mapping relationship between the core business elements of the tunnel and the dimensional model, and establish a tunnel relationship model that cross-correlates the tunnel space dimensions with the core business elements of the sub-projects.

[0028] Preferably, the core business elements include inspection batches.

[0029] Preferably, the usage scenarios include construction monitoring scenarios, asset management scenarios, safety supervision scenarios, operation scheduling scenarios, maintenance scenarios and decision support scenarios.

[0030] Compared with the prior art, the present invention has the following advantages and technical effects:

[0031] The present invention proposes a multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-items and spatial dimensions. By defining standard sub-items and standard spatial dimensions, the redundancy and confusion of data are reduced, and data integration and unified management between different data sources of the same profession are achieved. By establishing a mapping relationship between sub-items and spatial dimensions and constructing a dimensional model, effective cross-cutting and full mining between data are achieved. By configuring the relationship between the core elements and the dimensional model and selecting different summary dimensions, data fusion between different systems and different professions is further achieved. Collaborative linkage between data is achieved. The data processing method based on the core elements of cross-correlation between sub-items and spatial dimensions proposed in this method effectively solves the problem of data islands. It is more adaptable and efficient than existing methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The drawings constituting a part of the present application are used to provide a further understanding of the present application. The illustrative embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0033] Figure 1 is a flow chart of a fusion method according to an embodiment of the present invention;

[0034] Figure 2 is a schematic diagram of sub-items of the definition standard of an embodiment of the present invention;

[0035] Figure 3 is a schematic diagram of defining spatial dimensions according to an embodiment of the present invention;

[0036] Figure 4 is a schematic diagram of a dimensional model of an embodiment of the present invention;

[0037] Figure 5 It is a schematic diagram of the relationship between the core business elements and the dimensional model of an embodiment of the present invention. DETAILED DESCRIPTION

[0038] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0039] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0040] Embodiment 1

[0041] like Figure 1 As shown, in this embodiment, a multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions is provided, including the following steps:

[0042] S1, defines standard sub-items for bridges, roadbeds and tunnels;

[0043] S2, defines the standard spatial dimensions of bridges, roadbeds, and tunnels;

[0044] S3, setting association rules between sub-projects and spatial dimensions, and building a dimensional model based on the association rules;

[0045] S4, constructs the relationship between core elements and dimensional models based on the core elements of bridges, roadbeds, and tunnels;

[0046] S5, select summary dimensions based on usage scenarios, perform data fusion based on the relationship between summary dimensions and core elements and dimensional models, and obtain fused data.

[0047] The specific implementation methods are as follows:

[0048] Step S1, define the standard sub-projects, such as Figure 2 As shown:

[0049] S11 defines the standard sub-projects of a bridge as: pile foundation, abutment, abutment and pier.

[0050] S12 defines the standard sub-projects of roadbed as: foundation, cutting excavation, roadbed filling, slope support and anti-slip, and drainage.

[0051] S13 defines the standard sub-projects of a tunnel as: support, geological prediction, tunnel excavation, invert, drainage, and secondary lining.

[0052] Furthermore, in this embodiment, step S2 defines the standard space dimensions, such as Figure 3 As shown:

[0053] The spatial dimensions of roads, bridges and tunnels are defined as: S21 project, S22 section, S23 work area, S24 work point, S25 unit project, and S26 component.

[0054] It should be noted that the definition standards of spatial dimensions and sub-items of multiple professions are often inconsistent, which makes data fusion cumbersome and complicated, and reduces the fusion rate. Therefore, defining the sub-item standards and spatial dimension standards of each profession facilitates data fusion and analysis, and improves fusion efficiency and reliability. In this embodiment, the three professions of bridges, roadbeds, and tunnels are selected as embodiments of this application, and the application of this method in other embodiments is also within the scope of the claims.

[0055] Furthermore, in this embodiment, step S3 sets association rules between sub-projects and space dimensions to construct a dimensional model, such as Figure 4 As shown:

[0056] S31 sets the mapping relationship between the sub-projects of the bridge and the spatial dimensions, and the constructed dimensional model is: ① unit project → pedestal; ② work point → pile foundation; ③ project → abutment.

[0057] S32 sets the mapping relationship between the sub-projects of the roadbed and the spatial dimensions, and the constructed dimensional model is: ① unit project → drainage; ② work site → foundation; ③ project → slope support and sliding prevention.

[0058] S33 sets the mapping relationship between the sub-projects and spatial dimensions of the tunnel, and the constructed dimensional model is: ① unit project → support; ② work point → drainage; ③ project → secondary lining.

[0059] It should be noted that the mapping relationship between spatial dimensions and sub-projects of multiple professions is not fixed, and can be one-to-one mapping or one-to-many mapping. The dimensional model should be established based on the experts in each industry and the degree of attention paid by project members to the required information. This embodiment only lists several examples that are easy to implement.

[0060] Furthermore, in this embodiment, step S4 configures the relationship between the core elements and the dimensional model, such as Figure 5 As shown:

[0061] S41 selects the inspection batch as the core element of the bridge specialty, and adopts the inspection batch inspection for the capping division of the bridge specialty. Construct the relationship between the core elements of the bridge specialty and the dimensional model.

[0062] S42 selects the inspection batch as the core element of the roadbed specialty, and adopts the inspection batch inspection for the drainage and watertightness division of the roadbed specialty. Construct the relationship between the core elements of the roadbed specialty and the dimensional model.

[0063] S43 selects the inspection batch as the core element of the tunnel specialty, and adopts the inspection batch inspection for the support division of the bridge specialty. Construct the relationship between the core elements of the tunnel specialty and the dimensional model.

[0064] It should be noted that there may be multiple core elements of each profession, and different relationships may be established with the dimensional model. The embodiments of the present application all use the inspection batch as the core element to facilitate the detailed description of the invention method in this specific example.

[0065] Furthermore, in this embodiment, step S5, selecting aggregation dimensions based on usage scenarios to achieve data fusion, specifically includes:

[0066] Select a suitable usage scenario and select a reasonable spatial dimension for aggregation based on the scenario.

[0067] This embodiment selects a construction monitoring scenario, selects a unit project dimension for dimensional aggregation, and realizes data fusion among multiple disciplines.

[0068] It should be noted that different aggregation dimensions should be selected according to different usage scenarios. The usage scenarios include but are not limited to construction monitoring scenarios, asset management scenarios, safety supervision scenarios, operation scheduling scenarios, maintenance scenarios, decision support scenarios, etc. There are also differences in the scenarios used by different professions, and the selection should be based on specific instances.

[0069] The present embodiment provides a multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions, including: defining standard sub-projects of the three professions of road, bridge and tunnel, defining standard spatial dimensions of the three professions of road, bridge and tunnel, setting association rules between sub-projects and spatial dimensions of the three professions of road, bridge and tunnel, constructing respective dimensional models, constructing the relationship between the core elements and the dimensional model with inspection batches as the core elements, selecting unit project dimensions based on construction monitoring scenarios for dimensional aggregation, and realizing data fusion.

[0070] The above are only preferred specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions, characterized in that: The following steps are involved: Define standard sub-items for bridges, roadbeds and tunnels; Define standard spatial dimensions for bridges, roadbeds, and tunnels; Setting association rules between the sub-projects and space dimensions, and building a dimensional model based on the association rules; Based on the core elements of bridges, roadbeds and tunnels, the relationship between the core elements and the dimensional model is constructed; Aggregate dimensions are selected based on usage scenarios, and data fusion is performed based on the relationship between the aggregate dimensions and the core elements and the dimensional model to obtain fused data.

2. The multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions according to claim 1 is characterized in that: Standard sub-projects of bridges include pile foundations, caps, abutments and piers; The standard sub-items of the roadbed project include foundation, cutting excavation, roadbed filling, slope support and anti-slip and drainage; The standard sub-projects of a tunnel include support, geological prediction, tunnel excavation, invert, drainage and secondary lining.

3. The multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions according to claim 1 is characterized in that: The standard spatial dimensions of bridges, roadbeds and tunnels include projects, sections, work areas, work sites, unit projects and components.

4. The multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions according to claim 1 is characterized in that: The method for constructing a dimensional model based on the association rules includes: Construct the bridge dimension model of sub-projects and spatial dimensions of bridges based on association rules; Construct the sub-project and spatial dimension model of the roadbed based on association rules; Construct tunnel dimension models of sub-projects and spatial dimensions of tunnels based on association rules; The dimensional model is obtained by combining the bridge dimensional model, the roadbed dimensional model and the tunnel dimensional model.

5. The multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions according to claim 4 is characterized in that: The association rules include: The mapping relationship between the sub-projects and spatial dimensions of the bridge includes: mapping between unit project and abutment, mapping between work point and pile foundation, and mapping between project and abutment; The mapping relationship between sub-projects and spatial dimensions of the roadbed includes: mapping between unit projects and drainage, mapping between work sites and foundations, and mapping between projects and slope support and sliding prevention; The mapping relationship between the sub-projects and spatial dimensions of the tunnel includes: unit project and support mapping, work point and drainage mapping, and project and secondary lining mapping.

6. The multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions according to claim 1 is characterized in that: The method of constructing the relationship between the core elements and the dimensional model includes: Configure the mapping relationship between the core business elements of the bridge and the dimensional model, and establish a bridge relationship model that cross-correlates the core business elements of the bridge sub-projects with the spatial dimension; Configure the mapping relationship between the core business elements of the roadbed and the dimensional model, and establish a roadbed relationship model that cross-correlates the core business elements of the roadbed spatial dimension and the sub-projects; Configure the mapping relationship between the core business elements of the tunnel and the dimensional model, and establish a tunnel relationship model that cross-correlates the tunnel space dimensions with the core business elements of the sub-projects.

7. The multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions according to claim 6 is characterized in that: The core business elements include inspection batches.

8. The multi-source heterogeneous data processing method based on the core elements of cross-correlation between sub-projects and spatial dimensions according to claim 1 is characterized in that: The usage scenarios include construction monitoring scenarios, asset management scenarios, safety supervision scenarios, operation scheduling scenarios, maintenance scenarios and decision support scenarios.

Images