Data processing method, data association system, and computer-readable storage medium

Abstract

The application relates to the technical field of computers, in particular to a data processing method, a data association system and a computer readable storage medium, wherein the method comprises the following steps: when an updating action for first data saved in a first database is received, a first key value of the first data is acquired; according to a pre-stored key value pair combination list and the first key value, a second key value of second data having a mapping relationship with the first data is determined; and according to the second key value and the first data after updating, the second data is updated in a second database. Through the establishment of data mapping between two different databases, the change of information in one database can be fed back to another database associated therewith in time, the consistency of material demand and site requirement is ensured, repeated adjustment of data is reduced, and the data processing efficiency is improved.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a data processing method, a data association system, and a computer-readable storage medium. Background Technology

[0002] Currently, material procurement plans at construction sites are mostly compiled based on project schedules. Schedules are typically created using software like Project, while material procurement plans are prepared using spreadsheets like Excel. These two tasks are performed using different software and each generates its own independent planning document.

[0003] The above solution has at least the following drawbacks: Drawback 1: Data cannot be linked, leading to frequent repetitive adjustments. Since there is no data linking between the two independent planning files, any adjustments to the schedule require manual verification and adjustment of the material procurement plan. Not only do on-site technicians need to make multiple adjustments to different tables, but repeated data input can easily cause errors and omissions, resulting in incorrect table results. Drawback 2: High frequency of data changes and untimely feedback of work results. Because the progress at the construction site is dynamic and changes in real time, the material procurement plan cannot keep up with the schedule changes, leading to inaccurate data. If the procurement plan is only based on the general schedule, it is easy for material requirements to not match on-site requirements. Drawback 3: The quantity of materials procured is not accurately calculated using two-dimensional drawings, often resulting in inaccurate material quantities. Therefore, the above solution easily leads to low material procurement efficiency and a high error rate.

[0004] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main objective of this invention is to provide a data processing method that aims to solve the problem of low data processing efficiency caused by the lack of data correlation between different databases in construction projects.

[0006] To achieve the above objectives, the present invention provides a data processing method, the method comprising:

[0007] Upon receiving an update action for the first data stored in the first database, the first key value of the first data is obtained;

[0008] Based on the pre-stored list of key-value pairs and the first key value, determine the second key value of the second data that has a mapping relationship with the first data;

[0009] The second data is updated in the second database based on the second key value and the updated first data.

[0010] Optionally, before the step of determining the first key value of the first data upon receiving an update action for the first data stored in the first database, the method further includes:

[0011] A three-dimensional architectural model of the target building is created based on architectural design data, and the first sub-data of the three-dimensional architectural model is saved to the first database;

[0012] The physical quantities of the target building are determined based on the architectural design data, and the second sub-data of the physical quantities are saved to the second database;

[0013] Create the key-value pair combination list based on the first sub-data and the second sub-data.

[0014] Optionally, creating the key-value pair combination list based on the first sub-data and the second sub-data includes:

[0015] Obtain the parameter names of the first sub-data and the second sub-data;

[0016] Identify the graphic element that matches the parameter name, and obtain the identification information and parameter value list group associated with the graphic element;

[0017] The key-value pair combination list is determined based on the identification information and the parameter value list group.

[0018] Optionally, before the step of updating the second data in the second database based on the second key value and the updated first data, the method further includes:

[0019] Obtain the data input form and data mapping form associated with the second data in the second database, wherein the data input form stores the unupdated second data, and the data mapping form stores the updated second data;

[0020] Based on the data input form and the data mapping form, the step of updating the second data in the second database according to the second key value and the updated first data is performed.

[0021] Optionally, before the step of obtaining the data input form and data mapping form associated with the second data in the second database, the method further includes:

[0022] Get the parameter name of the second data;

[0023] The second data, the data input form, and the data mapping form are associated based on the parameter name of the second data.

[0024] Optionally, the step of updating the second data in the second database based on the second key value and the updated first data, based on the data input form and the data mapping form, includes:

[0025] Upon receiving an update action for the second data stored in the second database, the position of the second data in the data input form is determined based on the second key value and the parameter name of the updated first data.

[0026] Map the location to the data mapping form, and update the second data in the data mapping form.

[0027] Optionally, before the step of determining the first key value of the first data, the method further includes:

[0028] Obtain the data identifier corresponding to the first data, and obtain the project identifier generated when the first data is used for inter-process communication;

[0029] The first key value is generated based on the data representation and the project identifier.

[0030] Optionally, after the step of updating the second data in the second database based on the second key value and the updated first data, the method further includes:

[0031] Output the updated second data and the first data, and generate a correlation chart based on the updated second data and the first data.

[0032] In addition, to achieve the above objectives, the present invention also provides a data association system, the data association system comprising: a memory, a processor, and a data processing program stored in the memory and executable on the processor, wherein the data processing program, when executed by the processor, implements the steps of the data processing method described above.

[0033] In addition, to achieve the above objectives, the present invention also provides a computer-readable storage medium storing a data processing program, which, when executed by a processor, implements the steps of the data processing method described above.

[0034] This invention provides a data processing method, a data association system, and a computer-readable storage medium. The method includes: upon receiving an update action for first data stored in a first database, obtaining a first key value of the first data; determining a second key value of second data that has a mapping relationship with the first data based on a pre-stored list of key-value pairs and the first key value; and updating the second data in a second database based on the second key value and the updated first data. By establishing a data mapping between two originally different databases, changes in information in one database can be promptly reflected in the associated database, ensuring consistency between material needs and on-site requirements, reducing redundant data adjustments, and improving data processing efficiency. Attached Figure Description

[0035] Figure 1 This is a schematic diagram of the hardware architecture of the data association system involved in an embodiment of the present invention;

[0036] Figure 2 This is a flowchart illustrating the first embodiment of the data processing method of the present invention;

[0037] Figure 3 This is a reference diagram of a building information model in one embodiment of the data processing method of the present invention;

[0038] Figure 4 A reference diagram of a key-value generation code block in one embodiment of the data processing method of the present invention;

[0039] Figure 5 This is a reference diagram for generating a correlation chart in one embodiment of the data processing method of the present invention;

[0040] Figure 6 This is a flowchart illustrating a second embodiment of the data processing method of the present invention;

[0041] Figure 7 This is a reference diagram of a data mapping form in one embodiment of the data processing method of the present invention;

[0042] Figure 8 A reference diagram of a data import code block is shown in one embodiment of the data processing method of the present invention;

[0043] Figure 9 This is a reference diagram of a data screening code block in one embodiment of the data processing method of the present invention;

[0044] Figure 10 This is a reference diagram of the data mapping and parameter writing code block in one embodiment of the data processing method of the present invention.

[0045] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0046] It should be understood that exemplary embodiments of the invention are shown in the accompanying drawings, and the invention may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the invention and to fully convey the scope of the invention to those skilled in the art.

[0047] As one implementation scheme, a data association system can be as follows: Figure 1 As shown.

[0048] The present invention relates to a data association system, which includes: a processor 101, such as a CPU, a memory 102, and a communication bus 103. The communication bus 103 is used to enable communication between these components.

[0049] Memory 102 can be high-speed RAM or stable memory (non-volatile memory), such as disk storage. Figure 1 As shown, the memory 102, which is a computer-readable storage medium, may include a data processing program; and the processor 101 may be used to call the data processing program stored in the memory 102 and perform the following operations:

[0050] Upon receiving an update action for the first data stored in the first database, the first key value of the first data is obtained;

[0051] Based on the pre-stored list of key-value pairs and the first key value, determine the second key value of the second data that has a mapping relationship with the first data;

[0052] The second data is updated in the second database based on the second key value and the updated first data.

[0053] In one embodiment, the processor 101 can be used to invoke a data processing program stored in the memory 102 and perform the following operations:

[0054] A three-dimensional architectural model of the target building is created based on architectural design data, and the first sub-data of the three-dimensional architectural model is saved to the first database;

[0055] The physical quantities of the target building are determined based on the architectural design data, and the second sub-data of the physical quantities are saved to the second database;

[0056] Create the key-value pair combination list based on the first sub-data and the second sub-data.

[0057] In one embodiment, the processor 101 can be used to invoke a data processing program stored in the memory 102 and perform the following operations:

[0058] Obtain the parameter names of the first sub-data and the second sub-data;

[0059] Identify the graphic element that matches the parameter name, and obtain the identification information and parameter value list group associated with the graphic element;

[0060] The key-value pair combination list is determined based on the identification information and the parameter value list group.

[0061] In one embodiment, the processor 101 can be used to invoke a data processing program stored in the memory 102 and perform the following operations:

[0062] Obtain the data input form and data mapping form associated with the second data in the second database, wherein the data input form stores the unupdated second data, and the data mapping form stores the updated second data;

[0063] Based on the data input form and the data mapping form, the step of updating the second data in the second database according to the second key value and the updated first data is performed.

[0064] In one embodiment, the processor 101 can be used to invoke a data processing program stored in the memory 102 and perform the following operations:

[0065] Get the parameter name of the second data;

[0066] The second data, the data input form, and the data mapping form are associated based on the parameter name of the second data.

[0067] In one embodiment, the processor 101 can be used to invoke a data processing program stored in the memory 102 and perform the following operations:

[0068] Upon receiving an update action for the second data stored in the second database, the position of the second data in the data input form is determined based on the second key value and the parameter name of the updated first data.

[0069] Map the location to the data mapping form, and update the second data in the data mapping form.

[0070] In one embodiment, the processor 101 can be used to invoke a data processing program stored in the memory 102 and perform the following operations:

[0071] Obtain the data identifier corresponding to the first data, and obtain the project identifier generated when the first data is used for inter-process communication;

[0072] The first key value is generated based on the data representation and the project identifier.

[0073] In one embodiment, the processor 101 can be used to invoke a data processing program stored in the memory 102 and perform the following operations:

[0074] Output the updated second data and the first data, and generate a correlation chart based on the updated second data and the first data.

[0075] Based on the hardware architecture of the aforementioned computer-based data association system, embodiments of the data processing method of the present invention are proposed.

[0076] Material procurement plans at construction sites are mostly compiled based on the project schedule. The schedule is created using software like Project, while the material procurement plan is compiled using spreadsheets like Excel. These two tasks are performed using different software, resulting in independent planning documents and belonging to different databases.

[0077] This presents at least four drawbacks for construction projects:

[0078] Disadvantage 1: Data cannot be linked, leading to frequent duplicate adjustments. Because the two plan files are independent and lack data linkage, any adjustments to the schedule require manual verification and adjustment of the material procurement plan. This not only forces on-site technicians to make multiple adjustments to different tables, but also easily introduces errors and omissions during repeated data entry, resulting in incorrect table results.

[0079] Disadvantage 2: High frequency of data changes and untimely feedback of work results. Because the progress at the construction site is dynamic and changes in real time, the material procurement plan cannot keep up with these changes, leading to inaccurate data. If procurement plans are only based on general project schedules, it can easily result in discrepancies between material needs and on-site requirements.

[0080] Disadvantage 3: The quantity of materials procured is not accurately calculated using two-dimensional drawings, often resulting in inaccurate quantities of materials.

[0081] Shortcoming 4: The two-dimensional data representation makes the result presentation less intuitive. Since software such as Project and Excel are used for plan representation, it is impossible to intuitively reflect the progress of specific construction components and the areas and contents of specific construction materials to be purchased.

[0082] Based on this, this application proposes to integrate the progress plan and material procurement information into the model components by establishing a three-dimensional BIM model, and then program through a visualization programming software. Output all component data progress and procurement information to an Excel file for batch modification, and then batch reverse map the modified data back into the BIM model to meet the need for real-time data linkage and synchronization.

[0083] Refer to Figure 2 , in the first embodiment, the data processing method includes the following steps:

[0084] Step S10, when receiving an update action for the first data saved in the first database, determine the first key value of the first data;

[0085] In this embodiment, the first database is a database that stores data for a certain type of project, and the first data is a certain subclass of data under this type of project. For example, the progress plan project is a type of project in construction engineering. Taking the progress plan project as an example, its corresponding database is used as the first database, and the "project start time" in this project is used as the first data. When updating the data in the progress plan project (such as adding, deleting, or modifying operations), determine the key value of the data as the first key value. The key value (Key-Value) can reflect the relationship between the number (Key) of the data stored in the database and the value (Value) of the stored data. For example, in the progress plan project, "project start time" is the key, and the string "XX, XX, 20XX" is the value. Determining the first key value means determining the mapping relationship between the input data in the first data and its corresponding storage location. In other words, determining the first key value of the first data means first associating the input and output of the first data in the first database.

[0086] Optionally, the first key value can be generated by the data identifier of the first data and the project identifier generated during inter-process communication (the generation of the second key value is the same). The data identifier is a value generated by the database kernel when accessing the first data. The project identifier is an ID value specified by the ftok function when the database establishes IPC communication (Inter-Process Communication). Based on the combination of the data identifier and the project identifier, the key value can be generated.

[0087] Step S20: Based on the pre-stored key-value pair combination list and the first key value, determine the second key value of the second data that has a mapping relationship with the first data;

[0088] Furthermore, the key-value pair combination list is a collection of key values. The key-value pair combination list stores multiple key values, which may come from the same or different databases. The second key value is the key value in the second data that has a mapping relationship with the first data. In this embodiment, the key-value pair combination list puts the first key value and the second key value in one set.

[0089] Optionally, before determining the second key value corresponding to the first key value, the mapping relationship between the two different databases is determined. For example, in one embodiment, it is necessary to establish a mapping relationship between the database of the schedule project (i.e., the first CNC database) and the database of the material procurement project (i.e., the second database). First, using Revit software, a BIM (Building Information Modeling) 3D model (e.g., ...) is created based on the design drawings. Figure 3 As shown), and form component-level physical quantities. Then, using the visual programming technology software (Dynamo), all data information involving schedule planning and material procurement is batch output to Excel software, and then the adjusted data in Excel is mapped back to the BIM model components in Revit software, realizing real-time dynamic linkage between Revit data and Excel data, thereby establishing the mapping relationship between the two.

[0090] It should be noted that for instructions on how to reverse-map adjusted data from Excel back to BIM model components in Revit software, please refer to [reference needed]. Figure 4 , Figure 4This is a code reference diagram for data reverse mapping (i.e., data output) based on code blocks in Dynamo programming. First, the "Select Model Elements" node selects the graphic elements in Revit. Then, the "Parameter.ParameterByName" key node matches pre-defined parameter names, filtering out the successfully matched graphic elements. Next, the "Element.Id" node retrieves the ID number (i.e., identification information) of these elements, and the "Element.GetParameterValueByName" node retrieves the list of parameter values ​​matched by these elements. The "List.AddItemToEnd" node is used to attach the ID number to each parameter value list group, achieving the matching and linking of the graphic element's identification information with the parameter information in the parameter value list group. Finally, the parameter information is exported and an Excel spreadsheet is generated. The "Data.ExportExcel" node integrates and exports the processed data, thus achieving bidirectional data linkage between different databases.

[0091] Step S30: Update the second data in the second database according to the second key value and the updated first data;

[0092] After determining the second key value associated with the first key value, the second data is updated in the second database based on the second key value and the updated first data. The first and second key values ​​act as a "bridge" connecting the first and second databases, automatically associating with the corresponding second data when updating the first data in the first database. In one embodiment, the first data is the "end time" data in the schedule project. When the actual construction project is completed, the "end time" needs to be entered in the schedule project. At this time, the material procurement project associated with the schedule project needs to stop purchasing materials for that project, ensuring consistency between material needs and on-site requirements.

[0093] Optionally, after updating the second data, in order to accurately and intuitively express the specific content of the second data and the first data, such as the progress of specific construction components (i.e., the first data) and the specific areas and contents of construction materials that need to be procured (i.e., the second data), in one embodiment, a correlation chart is generated using the data visualization software PowerBi, referring to... Figure 5 , Figure 5 This is a schematic diagram of the generated association chart.

[0094] In the technical solution provided in this embodiment, by establishing a data mapping between two originally different databases, changes in the information of the schedule project can be promptly fed back to the associated material procurement project, ensuring consistency between material requirements and on-site requirements, reducing redundant data adjustments, and improving data processing efficiency.

[0095] Reference Figure 6 In the second embodiment, based on the first embodiment, before step S30, the method further includes:

[0096] Step S40: Obtain the parameter name of the second data;

[0097] Step S50: Associate the second data, the data input form, and the data mapping form according to the parameter name of the second data.

[0098] Step S60: Obtain the data input form and data mapping form associated with the second data in the second database;

[0099] Step S70: Based on the data input form and the data mapping form, perform the step of updating the second data in the second database according to the second key value and the updated first data.

[0100] Optionally, this embodiment provides a data interaction mode within the second data and a method for using the database of the second data as the database of the visualization software. In this embodiment, a data mapping is created between the second data before and after the update to realize data association between the data within the second database. Specifically, after exporting the unupdated second data from the second database, a data input form is created. The header keywords in the data input form are associated with the data mapping form. The updated second data is stored in the data mapping form. In this way, when the data in the data input form changes dynamically, the updated data can be dynamically adjusted in batches through the data mapping form. In one embodiment, when the planned time in the schedule data of a construction project needs to be temporarily adjusted, the changed time amount in the planned time is dynamically adjusted in batches through data mapping, and the data is mapped back to the Revit model through visual programming to realize the interaction of internal data, and its database is used as the database of the visualization software.

[0101] Step S70 includes:

[0102] Step S71: Upon receiving an update action for the second data stored in the second database, determine the position of the second data in the data input form based on the second key value and the parameter name of the updated first data;

[0103] Step S72: Map the location to the data mapping form and update the second data in the data mapping form.

[0104] Optionally, after creating the data mapping, the second data update action is performed in the data input form that serves as the storage medium for the mapped data.

[0105] For example, in one embodiment, Excel data is used as the second data, Revit data is used as the first data, and the start date information (i.e., start time) of the special projects corresponding to the major regions in the schedule database is used as the data to be updated. The technical steps of using Dynamo code blocks to map the Excel data back to Revit elements are as follows:

[0106] I. Creating data mappings between Excel spreadsheets. (Refer to...) Figure 7 In an Excel file, create "Data Input" and "Data Mapping" forms. The "Data Mapping" form summarizes the start date information for specific projects in each region. By calling Excel's "VLOOKUP()" function, the "Start Time" parameter in the "Data Input" form is mapped to the "Start Time" parameter in each row of the "Data Mapping" form.

[0107] II. Real-time extraction of Excel data to Revit. (Refer to...) Figure 8 By using the "Data.ImportExcel" key node in Dynamo, all data from the "Data Input" form can be extracted into Revit.

[0108] III. Excel Data Sorting and Extraction. (Refer to...) Figure 9 By using the "List.TakeItems" key node, the "Start Time" and "ID" data can be separated from other Excel data.

[0109] IV. Create a data mapping relationship between Excel and Revit, and write parameter values ​​into the components. (Refer to...) Figure 10 The "ID" and "Start Time" data filtered out in step three are used to create a list of key-value pairs using the "Dictionary.ByKeysValues" node. Then, the "Dictionary.ValueAtKey" node is used to find the corresponding "Start Time" parameter value in the list of key-value pairs using the "ID" value in the Reivt component. Finally, the "Start Time" parameter value is written into the component using the "Element.SetParameterByName" node.

[0110] In the technical solution provided in this embodiment, by creating a data mapping between the second data before and after the update, and a storage form storing the second data before and after the update, the data update action is performed in the storage form based on the data mapping. In this way, the time of the schedule can be adjusted in batches, thereby improving the data processing efficiency.

[0111] Furthermore, the present invention also provides a computer-readable storage medium storing a data processing program, which, when executed by a processor, implements the steps of the data processing method described above.

[0112] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0113] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a computer-readable storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0114] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A data processing method, characterized in that, The method includes: A three-dimensional architectural model of the target building is created based on the architectural design data, and the first sub-data of the three-dimensional architectural model is saved to the first database; The physical quantities of the target building are determined based on the architectural design data, and the second sub-data of the physical quantities are saved to the second database. Based on the design drawings, a Building Information Model (BIM) model is created, and the corresponding physical quantities of the project are generated. Visual programming software is used to program the project, and all data information on the schedule and material procurement corresponding to the physical quantities of the project are output to Excel software. The data adjusted by the Excel software is reverse-mapped back to the BIM model to form a mapping relationship in the key-value pair combination list. Specifically, the parameter names of the first sub-data and the second sub-data are obtained, the graphic element components that match the parameter names are determined, and the identification information and parameter value list group associated with the graphic element components are obtained. The identification information is then attached to each of the parameter value list groups to achieve matching and attachment of the identification information and the parameter information in the parameter value list groups. Finally, the parameter information is exported and an Excel spreadsheet is generated. Upon receiving an update action for first data stored in the first database, determine the first key value of the first data; Based on the pre-stored list of key-value pairs and the first key value, determine the second key value of the second data that has a mapping relationship with the first data; The second data is updated in the second database based on the second key value and the updated first data.

2. The data processing method as described in claim 1, characterized in that, Before the step of updating the second data in the second database based on the second key value and the updated first data, the method further includes: Obtain the data input form and data mapping form associated with the second data in the second database, wherein the data input form stores the unupdated second data, and the data mapping form stores the updated second data; Based on the data input form and the data mapping form, the step of updating the second data in the second database according to the second key value and the updated first data is performed.

3. The data processing method as described in claim 2, characterized in that, Before the step of obtaining the data input form and data mapping form associated with the second data in the second database, the method further includes: Get the parameter name of the second data; The second data, the data input form, and the data mapping form are associated based on the parameter name of the second data.

4. The data processing method as described in claim 3, characterized in that, The step of updating the second data in the second database based on the second key value and the updated first data, based on the data input form and the data mapping form, includes: Upon receiving an update action for the second data stored in the second database, the position of the second data in the data input form is determined based on the second key value and the parameter name of the updated first data. Map the location to the data mapping form, and update the second data in the data mapping form.

5. The data processing method as described in claim 1, characterized in that, Before the step of determining the first key value of the first data, the method further includes: Obtain the data identifier corresponding to the first data, and obtain the project identifier generated when the first data is used for inter-process communication; The first key value is generated based on the data identifier and the project identifier.

6. The data processing method as described in claim 1, characterized in that, After the step of updating the second data in the second database based on the second key value and the updated first data, the method further includes: Output the updated second data and the first data, and generate a correlation chart based on the updated second data and the first data.

7. A data association system, characterized in that, The data association system includes: a memory, a processor, and a data processing program stored in the memory and executable on the processor, wherein the data processing program, when executed by the processor, implements the steps of the data processing method as described in any one of claims 1 to 6.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a data processing program, which, when executed by a processor, implements the steps of the data processing method as described in any one of claims 1 to 6.

Images