Conversion method for heterogeneous data, electronic equipment and storage medium

Abstract

The invention provides a heterogeneous data conversion method, electronic equipment and a storage medium, and relates to the technical field of information, and the method comprises the steps: obtaining a to-be-processed BIM data packet list, processing a to-be-processed BIM data packet, obtaining data structure information corresponding to the to-be-processed BIM data packet, and storing the data structure information in the to-be-processed BIM data packet list; inputting data structure information corresponding to the to-be-processed BIM data packet into the BIM format converter, obtaining conversion data of the to-be-processed BIM data packet, analyzing and processing the conversion data to obtain an analysis result corresponding to the conversion data, and determining whether to introduce a preset conversion rule according to the analysis result corresponding to the conversion data, and when the preset conversion rule is introduced, the preset conversion rule corresponding to the conversion data is obtained, and the data corresponding to the to-be-processed BIM data packet is converted according to the preset conversion rule corresponding to the conversion data, so that the final BIM data is generated, and the efficiency of the conversion process is improved.

Description

Technical Field

[0001] The present invention relates to the field of information technology, and in particular to a conversion method, electronic equipment and storage medium for heterogeneous data. Background Art

[0002] In recent years, my country's information technology has entered a stage of rapid development. During this stage, data processing and analysis brought by information technology have become an important support for corporate decision-making and operations. However, in the process of data processing, heterogeneous data from different sources poses a great challenge to data conversion. The conversion tools used in traditional data conversion generally require customized conversion scripts for specific data structures. This approach not only has high development costs, but also limits the versatility and adaptability of the tool. Especially when faced with non-standardized or other unknown data structures, such data conversion tools will be stretched.

[0003] Then we analyze the main problems of traditional data conversion tools when processing heterogeneous data. There are mainly three points: the first point is that the cost of writing and maintaining conversion rules is too high, which requires professional technicians to invest a lot of time and energy; the second point is that the adaptability to new data structures is insufficient. Every time a new data structure is encountered, the rules need to be rewritten, resulting in low work efficiency; the third point is that the data conversion process lacks flexibility and cannot meet the current changing business needs. Therefore, a conversion method is needed to realize data conversion of non-standardized or other unknown data structures. Summary of the invention

[0004] In view of the above technical problems, the technical solution adopted by the present invention is: a method for converting heterogeneous data, the method comprising the following steps: Obtain a list of BIM data packets to be processed, wherein the list of BIM data packets to be processed includes a plurality of BIM data packets to be processed, wherein different BIM data packets to be processed are provided by data sources of different BIM models; Process the BIM data packet to be processed and obtain data structure information corresponding to the BIM data packet to be processed; Inputting data structure information corresponding to the BIM data packet to be processed into the BIM format converter to obtain conversion data of the BIM data packet to be processed; Analyze and process the converted data to obtain analysis results corresponding to the converted data; Determine whether to introduce preset conversion rules according to the analysis results corresponding to the conversion data; When the preset conversion rule is introduced, the preset conversion rule corresponding to the conversion data is obtained and the data corresponding to the BIM data packet to be processed is converted according to the preset conversion rule corresponding to the conversion data, thereby generating final BIM data.

[0005] According to another aspect of the present invention, a non-transitory computer-readable storage medium is provided, in which at least one instruction or at least one program is stored, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the aforementioned method.

[0006] According to yet another aspect of the present invention, an electronic device is provided, comprising a processor and the aforementioned non-transitory computer-readable storage medium.

[0007] The present invention has at least the following beneficial effects: In summary, a list of BIM data packets to be processed is obtained, the BIM data packets to be processed are processed, data structure information corresponding to the BIM data packets to be processed is obtained, the data structure information corresponding to the BIM data packets to be processed is input into a BIM format converter, conversion data of the BIM data packets to be processed is obtained, the conversion data is analyzed and processed, and analysis results corresponding to the conversion data are obtained. According to the analysis results corresponding to the conversion data, it is determined whether to introduce preset conversion rules. When the preset conversion rules are introduced, the preset conversion rules corresponding to the conversion data are obtained and the data corresponding to the BIM data packets to be processed are converted according to the preset conversion rules corresponding to the conversion data, thereby generating final BIM data. The present invention converts the BIM data packets to be processed into data of the same format through data structure information, avoids the problem of rewriting the rules every time a new data structure is encountered, and improves the efficiency of the conversion process. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0009] Figure 1 A flowchart of a method for converting heterogeneous data provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0010] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0011] Embodiment 1, Embodiment 1 of the present invention provides a method for converting heterogeneous data. Figure 1 As shown, the method comprises the following steps: S100, obtaining a list of BIM data packets to be processed, wherein the list of BIM data packets to be processed includes a plurality of BIM data packets to be processed, wherein different BIM data packets to be processed are provided by data sources of different BIM models.

[0012] Specifically, obtain the list of BIM data packets to be processed A={A1, A2, ..., A i , …, A m}, A i is the i-th BIM data packet to be processed, the value range of i is 1 to m, and m is the number of BIM data packets to be processed.

[0013] S200: Process the BIM data packet to be processed and obtain data structure information corresponding to the BIM data packet to be processed.

[0014] S300: inputting data structure information corresponding to the BIM data packet to be processed into a BIM format converter to obtain conversion data of the BIM data packet to be processed.

[0015] Specifically, the BIM data format converter includes but is not limited to the data formats of commonly used architectural software such as Revit and Bentley. It supports the export of Revit model data to a specified format, and also supports the export of Bentley and other data to a specified format, unifies the BIM data formats of different software, and realizes data intercommunication between different software. It can be understood that the data structure information whose format does not meet the requirements is converted using the BIM data format converter, so as to obtain the conversion data of the BIM data packet to be processed.

[0016] S400, analyzing and processing the converted data to obtain analysis results corresponding to the converted data.

[0017] S500: Determine whether to introduce a preset conversion rule according to the analysis result corresponding to the conversion data.

[0018] S600, when the preset conversion rule is introduced, the preset conversion rule corresponding to the conversion data is obtained and the data corresponding to the BIM data packet to be processed is converted according to the preset conversion rule corresponding to the conversion data, so as to generate the final BIM data.

[0019] In summary, a list of BIM data packets to be processed is obtained, the BIM data packets to be processed are processed, the data structure information corresponding to the BIM data packets to be processed is obtained, the data structure information corresponding to the BIM data packets to be processed is input into a BIM format converter, the conversion data of the BIM data packets to be processed is obtained, the conversion data is analyzed and processed, and the analysis results corresponding to the conversion data are obtained. According to the analysis results corresponding to the conversion data, it is determined whether to introduce preset conversion rules. When the preset conversion rules are introduced, the preset conversion rules corresponding to the conversion data are obtained and the data corresponding to the BIM data packets to be processed are converted according to the preset conversion rules corresponding to the conversion data, so as to generate final BIM data. The present invention converts the BIM data packets to be processed into data of the same format through data structure information, avoids the problem of rewriting the rules every time a new data structure is encountered, and improves the efficiency of the conversion process.

[0020] In addition, the present invention provides highly customizable preset conversion rules and strategies, allowing users to flexibly adjust according to different business needs. This flexibility makes the technology widely applicable to various data processing scenarios. Moreover, the present invention can process heterogeneous data from different sources without writing customized conversion scripts, and is more adaptable to new data structures. There is no need to frequently update preset conversion rules, thereby reducing maintenance costs.

[0021] Specifically, the BIM data packet to be processed is processed, and the data structure information corresponding to the BIM data packet to be processed is obtained, including: The BIM data packet to be processed is processed to obtain text information of the BIM data packet to be processed.

[0022] Specifically, those skilled in the art know that any method of processing a BIM data packet to obtain text information in the prior art falls within the protection scope of the present invention and will not be described in detail here.

[0023] The text information of the BIM data packet to be processed is processed to obtain the attribute text data and parameter structured data of the BIM data packet to be processed.

[0024] The attribute text data is the metadata of the BIM data packet to be processed, and the parameter structured data is the feature value of the BIM data packet to be processed. Specifically, the types of the parameter structured data include grammatical structure features, semantic information features, and context-related features.

[0025] Specifically, in one embodiment of the present invention, a deep learning model is used to extract features from text information to obtain parameter structured data; wherein the deep learning model is such as a convolutional neural network (CNN) and a recurrent neural network (RNN).

[0026] The attribute text data and parameter structured data of the BIM data packet to be processed are input into a preset recognition model to obtain a target recognition template corresponding to the BIM data packet to be processed.

[0027] The attribute text data and parameter structured data of the BIM data packet to be processed are inserted into the target recognition template corresponding to the BIM data packet to be processed to obtain the data structure information corresponding to the BIM data packet to be processed.

[0028] In summary, the BIM data packet to be processed is processed to obtain text information of the BIM data packet to be processed, the text information of the BIM data packet to be processed is processed to obtain attribute text data and parameter structured data of the BIM data packet to be processed, the attribute text data and parameter structured data of the BIM data packet to be processed are input into a preset recognition model, the target recognition template corresponding to the BIM data packet to be processed is obtained, the attribute text data and parameter structured data of the BIM data packet to be processed are inserted into the target recognition template corresponding to the BIM data packet to be processed, and the data structure information corresponding to the BIM data packet to be processed is obtained.

[0029] Specifically, the preset recognition model is obtained through the following steps: A sample BIM data packet list is obtained, where the sample BIM data packet list includes several sample BIM data packets.

[0030] The sample BIM data packet is processed to obtain sample text information of the sample BIM data packet.

[0031] Based on the sample text information, obtain the sample attribute text data and sample parameter structured data corresponding to the sample BIM data package.

[0032] The sample attribute text data is metadata of the sample BIM data packet, and the sample parameter structured data is a characteristic value of the sample BIM data packet.

[0033] Based on the sample attribute text data and sample parameter structured data, and the matching relationship with the fields of the preset recognition template, a preset recognition model is constructed.

[0034] Specifically, the matching degree between the sample parameter structured data and the fields of the preset recognition template, the matching degree between the sample attribute text data and the field type of the preset recognition template are obtained, and the weighted sum of the matching degrees is obtained as the matching relationship value, so as to construct the corresponding relationship between the sample BIM data package and the preset recognition template.

[0035] Furthermore, based on the correspondence between the sample BIM data package and the preset recognition model, a preset recognition model is constructed.

[0036] Furthermore, based on the file size of the sample BIM data packets and the amount of sample parameter structured data, the sample BIM data packets are classified, and based on the correspondence between the classified sample BIM data packets and the preset recognition models, several preset recognition models are constructed.

[0037] Furthermore, for the BIM data packet to be processed, a corresponding preset recognition model is obtained based on the file size of the BIM data packet to be processed and the amount of parameter structured data of the BIM data packet to be processed.

[0038] In summary, obtain a list of sample BIM data packets, process the sample BIM data packets, obtain sample text information of the sample BIM data packets, obtain sample attribute text data and sample parameter structured data corresponding to the sample BIM data packets based on the sample text information, and build a preset recognition model based on the matching relationship between the sample attribute text data and the sample parameter structured data and the fields of the preset recognition template.

[0039] Furthermore, the converted data is analyzed and processed to obtain the analysis results corresponding to the converted data, including: The attribute text data and parameter structured data of the BIM data packet to be processed are compared with the data structure information corresponding to the BIM data packet to be processed to obtain a difference feature value list, wherein the difference feature value list includes a plurality of difference feature values. Specifically, the difference feature value is the data in the parameter structured data that is not filled in the target recognition template.

[0040] The difference characteristic values ​​are judged and the scores of the difference characteristic values ​​are obtained as the analysis results corresponding to the converted data.

[0041] Specifically, judging the difference feature value and obtaining the score of the difference feature value includes: obtaining triple information of the difference feature value based on the text information of the BIM data packet to be processed, and scoring the difference feature value based on the relationship between entities in the triple information, wherein the higher the matching degree between the difference feature value and the relationship, the higher the score of the difference feature value.

[0042] Further, according to the analysis result corresponding to the conversion data, determining whether to introduce a preset conversion rule includes: If the score of the difference feature value is greater than the preset matching threshold, it is determined that the preset conversion rule is introduced; if the score of the difference feature value is not greater than the preset matching threshold, it is determined not to introduce the preset conversion rule.

[0043] Specifically, the preset matching threshold can be set according to actual needs.

[0044] Further, when the preset conversion rule is introduced, the preset conversion rule corresponding to the conversion data is obtained and the data corresponding to the BIM data packet to be processed is converted according to the preset conversion rule corresponding to the conversion data, thereby generating the final BIM data further includes: Based on the difference feature value and the text information of the BIM data packet to be processed, a database corresponding to the difference feature value is obtained. Specifically, based on the text information of the BIM data packet to be processed, a triple information text containing the difference feature value and the difference feature value corresponding to the difference feature value is obtained and recorded as a new text, and the new text is matched with a preset conversion rule to obtain a database corresponding to the difference value.

[0045] The database corresponding to the difference characteristic value is combined with the conversion data to generate the final BIM data. Specifically, the database corresponding to the difference characteristic value is inserted into the conversion data to generate the final BIM data.

[0046] In summary, the conversion data is analyzed and processed to obtain the analysis results corresponding to the conversion data. According to the analysis results corresponding to the conversion data, it is determined whether to introduce the preset conversion rules. When the preset conversion rules are introduced, the preset conversion rules corresponding to the conversion data are obtained and the data corresponding to the BIM data packet to be processed is converted according to the preset conversion rules corresponding to the conversion data, so as to generate the final BIM data, and obtain the database corresponding to the difference feature values ​​that are not filled in the target recognition template, and combine it with the conversion data to generate the final BIM data, so that the final BIM data is richer.

[0047] An embodiment of the present invention also provides a non-transitory computer-readable storage medium, which can be set in an electronic device to store at least one instruction or at least one program related to implementing a method in a method embodiment. The at least one instruction or the at least one program is loaded and executed by the processor to implement the method provided in the above embodiment.

[0048] An embodiment of the present invention further provides an electronic device, comprising a processor and the aforementioned non-transitory computer-readable storage medium.

[0049] Although some specific embodiments of the present invention have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are only for illustration, not for limiting the scope of the present invention. It should also be understood by those skilled in the art that various modifications may be made to the embodiments without departing from the scope and spirit of the present invention.

Claims

1. A method for converting heterogeneous data, characterized in that: The method comprises the following steps: Obtain a list of BIM data packets to be processed, wherein the list of BIM data packets to be processed includes a plurality of BIM data packets to be processed, wherein different BIM data packets to be processed are provided by data sources of different BIM models; Process the BIM data packet to be processed and obtain data structure information corresponding to the BIM data packet to be processed; Inputting data structure information corresponding to the BIM data packet to be processed into the BIM format converter to obtain conversion data of the BIM data packet to be processed; Analyze and process the converted data to obtain analysis results corresponding to the converted data; Determine whether to introduce preset conversion rules according to the analysis results corresponding to the conversion data; When the preset conversion rule is introduced, the preset conversion rule corresponding to the conversion data is obtained and the data corresponding to the BIM data packet to be processed is converted according to the preset conversion rule corresponding to the conversion data, thereby generating final BIM data.

2. The method for converting heterogeneous data according to claim 1, characterized in that: Processing the BIM data packet to be processed, obtaining the data structure information corresponding to the BIM data packet to be processed includes: Process the BIM data packet to be processed and obtain text information of the BIM data packet to be processed; Processing the text information of the BIM data package to be processed, and obtaining the attribute text data and parameter structured data of the BIM data package to be processed; Input the attribute text data and parameter structured data of the BIM data package to be processed into a preset recognition model to obtain a target recognition template corresponding to the BIM data package to be processed; The attribute text data and parameter structured data of the BIM data packet to be processed are inserted into the target recognition template corresponding to the BIM data packet to be processed to obtain the data structure information corresponding to the BIM data packet to be processed.

3. The method for converting heterogeneous data according to claim 2, characterized in that: Obtain the preset recognition model through the following steps: Obtain a sample BIM data packet list, wherein the sample BIM data packet list includes a plurality of sample BIM data packets; Processing the sample BIM data packet to obtain sample text information of the sample BIM data packet; Based on the sample text information, obtain sample attribute text data and sample parameter structured data corresponding to the sample BIM data package; Based on the sample attribute text data and sample parameter structured data, and the matching relationship with the fields of the preset recognition template, a preset recognition model is constructed.

4. The method for converting heterogeneous data according to claim 1, characterized in that: The converted data is analyzed and processed to obtain the analysis results corresponding to the converted data, including: Compare the attribute text data and parameter structured data of the BIM data packet to be processed with the data structure information corresponding to the BIM data packet to be processed to obtain a difference feature value list, wherein the difference feature value list includes a plurality of difference feature values; The difference characteristic values ​​are judged and the scores of the difference characteristic values ​​are obtained as the analysis results corresponding to the converted data.

5. The method for converting heterogeneous data according to claim 1, characterized in that: Determining whether to introduce preset conversion rules based on the analysis results corresponding to the conversion data includes: If the score of the difference feature value is greater than the preset matching threshold, it is determined to introduce the preset conversion rule; If the score of the difference feature value is not greater than the preset matching threshold, it is determined not to introduce the preset conversion rule.

6. The method for converting heterogeneous data according to claim 1, characterized in that: When the preset conversion rule is introduced, the preset conversion rule corresponding to the conversion data is obtained and the data corresponding to the BIM data packet to be processed is converted according to the preset conversion rule corresponding to the conversion data, thereby generating the final BIM data further includes: Based on the difference characteristic value and the text information of the BIM data packet to be processed, a database corresponding to the difference characteristic value is obtained; The database corresponding to the difference feature values ​​is combined with the converted data to generate the final BIM data.

7. The method for converting heterogeneous data according to claim 2, characterized in that: The preset conversion rules are obtained based on preset expert texts.

8. The method for converting heterogeneous data according to claim 2, characterized in that: The deep learning model is used to process the text information of the BIM data package to be processed to obtain parameter structured data.

9. A non-transitory computer-readable storage medium, wherein at least one instruction or at least one program is stored in the storage medium, characterized in that: The at least one instruction or the at least one program is loaded and executed by the processor to implement the method for converting heterogeneous data as described in any one of claims 1-8.

10. An electronic device, characterized in that: The invention comprises a processor and the non-transitory computer-readable storage medium as claimed in claim 9.

Images