Knowledge graph construction and semantic query control method and system of BIM model

By transforming the BIM model into a knowledge graph and combining natural language processing technology, the problem of insufficient semantics and cumbersome query process in the integration of building information and Internet of Things data is solved, efficient semantic query and control are achieved, and the system's intelligence level and user experience are improved.

CN120086352AActive Publication Date: 2025-06-03BEIJING YUNMO SOFTWARE TECHNOLOGY CO LTD

Patent Information

Application Number
CN202510155678.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-02-12
Publication Date
2025-06-03
Estimated Expiration
2045-02-12

AI Technical Summary

Technical Problem

The prior art has problems such as insufficient semantics, cumbersome query and control processes, and lack of natural language interaction support in the integration of building information and Internet of Things data.

Method used

By converting BIM models into knowledge graphs and using natural language processing technology and large-scale model capabilities, unified query and control from building space information to semantic levels can be achieved. Specific steps include BIM model data preparation and attribute expansion, IFC data analysis and knowledge graph modeling, knowledge graph automatic construction tool development, Neo4j graph database storage and management, natural language processing and big model semantic understanding, Cypher query statement generation and IOT interface call.

Benefits of technology

It realizes efficient semantic query and control, simplifies user operation processes, reduces data integration and maintenance costs, and improves the user-friendliness and intelligence level of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120086352A_ABST
    Figure CN120086352A_ABST
Patent Text Reader

Abstract

The invention provides a knowledge graph construction and semantic query control method and system of a BIM (Building Information Modeling). Comprising the following steps of BIM model data preparation and attribute extension, IFC data analysis and knowledge graph modeling rule definition, knowledge graph automatic construction tool development, Neo4j graph database storage and management, natural language processing and large model semantic understanding, Cyber query statement generation and IOT interface calling, and query and control of an interaction process. According to the knowledge graph construction and semantic query control method for the BIM model, the BIM model is converted into the knowledge graph, and unified query and control from building space information to semantic level are realized by utilizing a natural language processing technology and large model capability.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of building information models, and particularly to a method and system for constructing a knowledge graph of a BIM model and semantic query control. Background Art

[0002] The technical field involved in the present invention is the integrated application of building information models and the Internet of Things, as well as semantic query and control technologies based on graph databases and knowledge graphs. The present invention is mainly applied to scenarios such as smart buildings, smart factories, and smart campuses. By converting the building space, equipment information, and relationships contained in the BIM model into a knowledge graph that can be semantically queried, the present invention can then achieve the query and control of equipment status based on natural language or semantic descriptions.

[0003] Currently, in the field of building facility management or smart buildings, BIM technology has become the main means of digitally describing building, mechanical, electrical, plumbing, and spatial information. Usually, BIM data is stored and exchanged in standard formats such as IFC. However, traditional BIM data management mainly relies on files and proprietary databases. Although the IFC standard has defined rich attributes, relationships, and semantic information, in actual applications, IFC files are not suitable for efficient semantic retrieval and real-time interaction. At the same time, in order to achieve refined management and intelligent control, various types of equipment in modern buildings are connected to the Internet of Things system and associated with their status data and control instructions through unique ID identifiers. However, most current solutions require relatively cumbersome manual mapping and data retrieval operations between the BIM platform and the IOT platform, lacking high-level semantic abstraction and customizable query methods.

[0004] Existing background art solutions relatively close to the present invention include:

[0005] Semanticization of IFC Data and SPARQL Query: Some researchers have used the IFC model as a basis, converted it into an OWL ontology, and then stored it in a triple database through RDF triples and supported SPARQL queries. For example, the literature "Pauwels, P., Zhang, S., & Lee, Y. C. (2017). Semantic web technologies in AEC industry: A literature overview. Automation in Construction, 73, 145–165." reviewed the existing research on using semantic web technologies to process IFC data. These methods have achieved semantic representation and query of IFC data to a certain extent, but usually only limited to the semantic model of RDF / OWL, and the query mainly relies on semantic web standard query languages such as SPARQL, lacking optimization for natural language dialogue scenarios and having limited support for the control of IOT devices.

[0006] System Docking Solution Based on the Integration of BIM and IOT: There are already some commercial or research software that record device information in the BIM platform and conduct data interaction with the IOT platform through external interfaces. For example, in existing device management systems or data visualization platforms, users can manually input the device ID in the BIM model and then query or control the corresponding device in an independent IOT management platform. However, these solutions often lack automated semantic mapping and natural language query capabilities. Users still need to switch between multiple platforms and remember or search for the device ID, rather than directly using semantic descriptions (such as "the air conditioner status in the computer room") for quick retrieval and control.

[0007] Although the above-mentioned background technology solutions have provided a certain foundation for the association between BIM data and Internet of Things information, there are still the following deficiencies in actual applications:

[0008] Insufficient Semantic Level and Complex Retrieval Method: Existing semantic methods based on means such as IFCOWL can convert building information into semantic web data structures and use SPARQL for query. However, SPARQL is not user-friendly for ordinary users. Users need to have a high technical threshold when performing queries and have a clear understanding of specific classes, attributes, and relationships. This makes it difficult to quickly locate the required device or space information in actual scenarios. In short, this method does not fully utilize the advantages of natural language processing and intelligent dialogue, resulting in a cumbersome query process and high costs.

[0009] The Connection between BIM and IOT Device Control is not Smooth Enough: Existing BIM and IOT integration solutions often require manually recording the device ID in the BIM model and querying or controlling the device in an independent IOT platform. When users perform spatial positioning and device status query or control, they need to first find the ID corresponding to the device through BIM tools and then switch to the IOT platform for relevant operations. This process lacks a unified semantic level abstraction and cannot directly use "room name" or "device function" as the query entry, resulting in a long operation chain and low intelligence level.

[0010] Lack of Direct Support for Natural Language Semantic Requirements: Existing technologies do not fully utilize natural language processing technologies. Users cannot directly obtain or control relevant devices through simple natural language descriptions (such as "Please query the air conditioner status in the computer room" or "Please dim the lights in the meeting room"). This defect still requires professionals or external systems to convert natural language requirements into relevant technical query statements and control instructions in actual use, reducing the convenience and efficiency of human-computer interaction.

[0011] Therefore, it is necessary to provide a method for constructing a knowledge graph and semantic query control of the BIM model to solve the above technical problems. Summary of the Invention

[0012] The present invention provides a method for constructing a knowledge graph and semantic query control of a BIM model, which solves the problems of insufficient semantic degree, cumbersome query and control processes, and lack of natural language interaction support in the integration of building information and Internet of Things data in the prior art.

[0013] To solve the above technical problems, a method and system for constructing a knowledge graph and semantic query control of a BIM model provided by the present invention include the following steps:

[0014] S1. Preparation and attribute extension of BIM model data: In the building information model design and management software, perform the following operations to prepare and extend the BIM model data;

[0015] S11. Definition of PMID attribute: Define an additional attribute PMID for each device in Revit, and fill in the PMID of each device to make it correspond to the device ID in the IOT system;

[0016] S12. Definition of spatial topology and device connection relationship: Define the spatial connection relationships among various spaces, pipelines, and devices in Revit, and ensure that the connection relationships among entities conform to the actual building structure and device layout through the built-in relationship management function of Revit;

[0017] S2. IFC data parsing and definition of knowledge graph modeling rules: After exporting the prepared BIM model to an IFC format file, perform IFC data parsing and knowledge graph modeling;

[0018] S21. Use the xBIM parsing library: Use xBIM as the IFC data parsing tool to parse the entity, attribute, and relationship information in the IFC file;

[0019] S22. Define the knowledge graph structure: Node types, relationship types, and attribute mappings;

[0020] S3. Development of a knowledge graph automatic construction tool: Develop a set of automated tools to achieve efficient conversion from an IFC format BIM model to a knowledge graph;

[0021] S31. IFC parsing module: Use the xBIM parsing library to read the IFC file and extract all relevant entities, attributes, and their relationships;

[0022] S32. Data mapping and conversion engine: According to the pre-defined knowledge graph modeling rules, convert the parsed IFC entity types, attributes, and relationships into nodes and relationships in the Neo4j graph database;

[0023] S33. Batch Import Program: Use the Neo4j library to batch insert the converted data into the Neo4j graph database through the Bolt protocol, ensuring transaction management during data import to guarantee data consistency and integrity.

[0024] S4. Storage and Management of Neo4j Graph Database: Store the constructed knowledge graph in the Neo4j graph database.

[0025] S41. Node Storage: Entities such as various spaces, devices, pipelines, etc. are stored as nodes, including their attributes.

[0026] S42. Relationship Storage: Various space association relationships, device association relationships, and space-device relationships are stored as relationships, defining the connection methods between nodes.

[0027] S43. Indexes and Constraints: Create indexes for commonly queried fields to improve query performance, and set unique constraints to ensure the uniqueness of each device's PMID and IOT ID in the graph database.

[0028] S5. Natural Language Processing and Large Model Semantic Understanding: To achieve the automatic generation of Cypher query statements from natural language, the system integrates a natural language processing module and a large model for semantic understanding.

[0029] S51. Semantic Parsing, Intent Recognition, Entity Extraction, and Context Understanding.

[0030] S6. Generation of Cypher Query Statements and Invocation of IOT Interfaces: According to the semantic parsing results, the system automatically generates corresponding Cypher query statements and realizes device status query or control through the IOT interface.

[0031] S61. Automatic Generation of Cypher Query Statements: Dynamically construct Cypher query statements based on the parsed intent and entity information.

[0032] S62. Invocation of IOT Interfaces;

[0033] S63. Result Feedback;

[0034] S7. Query and Control Interaction Process.

[0035] Preferably, the PMID attribute in S11 is used for the subsequent association between devices and the IOT system in the knowledge graph.

[0036] Preferably, the xBIM in S21 supports reading and operating IFC files and can extract the required building element and their relationship data.

[0037] Preferably, the node types in S22 include the following steps:

[0038] S22a1, Space: Represents various spaces in a building, such as rooms and corridors;

[0039] S22a2, Equipment: Represents various equipment, such as air conditioners, lighting, and sensors;

[0040] S22a3, Pipeline: Represents the pipeline system in a building;

[0041] S22a4, Sensor: Represents sensors used to monitor the status of equipment;

[0042] S22a5, Controller: Represents controllers used to control equipment.

[0043] Preferably, the relationship types in S22 include the following steps:

[0044] S22b1, Spatial association relationship: Used to connect IfcBuildingElement entities, representing the aggregation relationship between spaces.

[0045] S22b2, Equipment association relationship:

[0046] IfcRelFlowControlElements: Components under an external controller are associated with the elements they control through this relationship.

[0047] IfcRelConnectsPortToElement: Components under an internal controller are connected to IfcFlowSegment or IfcFlowFitting through this relationship;

[0048] IfcRelConnectsSegments: Pipe segments are connected to other pipe segments or pipe fittings through this relationship;

[0049] IfcRelConnectsPorts: Pipe fittings are connected to other pipe fittings or terminals through this relationship;

[0050] IfcRelConnectsToPipe or IfcRelConnectsToPort: Terminals are connected to the system through these two relationships;

[0051] IfcRelConnectsToElement: Energy conversion equipment and fluid storage equipment are connected to other building elements through this relationship;

[0052] IfcRelConnectsToProcess: Fluid moving equipment and fluid processing equipment are connected to the flow process through this relationship;

[0053] S22b3, Spatial Equipment Relationship: IfcRelContainedInSpatialStructure is used to represent the relationship that an equipment belongs to a certain space.

[0054] Preferably, the attribute mapping in S22: Extract the attribute information of ID, name, location coordinates, function description, and IOT corresponding ID from the IFC entity, and map it to the node attributes in the knowledge graph.

[0055] Preferably, the semantic parsing in S51: The user inputs a query or control request through the natural language interface;

[0056] Intention Recognition and Entity Extraction: Use the large model to parse the natural language input by the user, and identify the key information of the operation type, target space, and target equipment type;

[0057] Context Understanding: Combine the context information to process the complex query requirements of the user, such as adjusting the specific parameters of the equipment status.

[0058] Preferably, the result feedback in S63: Feed back the queried equipment status information or the execution result of the control instruction to the user through the natural language interface.

[0059] A knowledge graph construction and semantic query control system for BIM models, adopting the knowledge graph construction and semantic query control method of the BIM model, is characterized by including: BIM model data preparation and attribute extension module, IFC data parsing and knowledge graph modeling rule definition module, knowledge graph automatic construction tool development module, Neo4j graph database storage and management module, natural language processing and large model semantic understanding module, Cypher query statement generation and IOT interface call module, and query and control interaction process module. The input and output ends of the BIM model data preparation and attribute extension module are connected to the input end of the IFC data parsing and knowledge graph modeling rule definition module. The output end of the IFC data parsing and knowledge graph modeling rule definition module is connected to the input end of the knowledge graph automatic construction tool development module. The output end of the knowledge graph automatic construction tool development module is connected to the input end of the Neo4j graph database storage and management module. The output end of the Neo4j graph database storage and management module is connected to the input end of the natural language processing and large model semantic understanding module. The output end of the natural language processing and large model semantic understanding module is connected to the input end of the Cypher query statement generation and IOT interface call module. The output end of the Cypher query statement generation and IOT interface call module is connected to the input end of the query and control interaction process module.

[0060] Compared with the related technologies, a method for constructing a knowledge graph and semantic query control of a BIM model provided by the present invention has the following beneficial effects:

[0061] The present invention provides a method for constructing a knowledge graph and semantic query control of a BIM model. By converting the BIM model into a knowledge graph and utilizing natural language processing technology and the capabilities of large models, unified query and control from building spatial information to the semantic level are achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 It is a schematic structural diagram of a preferred embodiment of a method for constructing a knowledge graph and semantic query control of a BIM model provided by the present invention;

[0063] Figure 2 It is a schematic structural diagram of the knowledge graph;

[0064] Figure 3 It is a query and control flow chart;

[0065] Figure 4 It is a schematic diagram of IFC relationship mapping. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0066] The present invention will be further described below in conjunction with the drawings and embodiments.

[0067] Please refer to Figure 1 、 Figure 2 、 Figure 3 and Figure 4 , wherein, Figure 1 It is a schematic structural diagram of a preferred embodiment of a method for constructing a knowledge graph and semantic query control of a BIM model provided by the present invention; Figure 2 It is a schematic structural diagram of the knowledge graph; Figure 3 It is a query and control flow chart; Figure 4 It is a schematic diagram of IFC relationship mapping. A method and system for constructing a knowledge graph and semantic query control of a BIM model include the following steps:

[0068] S1. BIM model data preparation and attribute extension: In the building information model design and management software, perform the following operations to prepare and extend the BIM model data;

[0069] S11. PMID attribute definition: Define an additional attribute PMID for each device in Revit and fill in the PMID of each device to make it correspond to the device ID in the IOT system;

[0070] S12. Definition of Spatial Topology and Equipment Connection Relationships: Define the spatial connection relationships among various spaces, pipelines, and equipment in Revit, and ensure that the connection relationships among entities conform to the actual building structure and equipment layout through the built-in relationship management function of Revit;

[0071] S2. Definition of IFC Data Parsing and Knowledge Graph Modeling Rules: After exporting the prepared BIM model to an IFC format file, perform IFC data parsing and knowledge graph modeling;

[0072] S21. Use the xBIM (eXtensible Building Information Modeling) Parsing Library: Use xBIM (eXtensible Building Information Modeling) as an IFC data parsing tool to parse entity, attribute, and relationship information in the IFC file;

[0073] S22. Define the Knowledge Graph Structure: Node types, relationship types, and attribute mappings;

[0074] S3. Development of Knowledge Graph Automatic Construction Tools: Develop a set of automated tools to achieve efficient conversion from an IFC format BIM model to a knowledge graph;

[0075] S31. IFC Parsing Module: Use the xBIM (eXtensible Building Information Modeling) parsing library to read the IFC file and extract all relevant entities, attributes, and their relationships;

[0076] S32. Data Mapping and Transformation Engine: According to the pre-defined knowledge graph modeling rules, convert the parsed IFC entity types, attributes, and relationships into nodes and relationships in the Neo4j graph database;

[0077] S33. Batch Import Program: Use the Neo4j class library to batch insert the converted data into the Neo4j graph database through the Bolt protocol, ensure transaction management during the data import process, and guarantee data consistency and integrity;

[0078] S4. Storage and Management of the Neo4j Graph Database: Store the constructed knowledge graph in the Neo4j graph database;

[0079] S41. Node Storage: Entities such as various spaces, equipment, and pipelines are stored as nodes, including their attributes;

[0080] S42. Relationship Storage: Various spatial association relationships, equipment association relationships, and spatial equipment relationships are stored as relationships, defining the connection methods between nodes;

[0081] S43. Indexing and Constraints: Create indexes for frequently queried fields to improve query performance, and set unique constraints to ensure the uniqueness of PMID and IOT ID for each device in the graph database;

[0082] S5. Natural Language Processing and Large Model Semantic Understanding: To achieve the automatic generation of Cypher query statements from natural language, the system integrates a natural language processing module and a large model for semantic understanding;

[0083] S51. Semantic Parsing, Intent Recognition, Entity Extraction, and Context Understanding;

[0084] S6. Cypher Query Statement Generation and IOT Interface Invocation: Based on the semantic parsing results, the system automatically generates corresponding Cypher query statements and realizes device status query or control through the IOT interface;

[0085] S61. Automatic Generation of Cypher Query Statements: Dynamically construct Cypher query statements according to the parsed intent and entity information;

[0086] S62. IOT Interface Invocation;

[0087] S63. Result Feedback;

[0088] S7. Query and Control Interaction Process.

[0089] IOT Interface Invocation in S62: Query Operation:

[0090] Use the queried IOT ID to obtain the real-time status information (such as temperature value) of the device through the API interface of the IOT platform.

[0091] Control Operation: Generate corresponding control commands according to the user's instructions and send control instructions through the API interface of the IOT platform. For example, adjust the air conditioner temperature.

[0092] The PMID attribute in S11 is used for the subsequent association of devices and the IOT system in the knowledge graph.

[0093] The xBIM (eXtensible Building Information Modeling) in S21 supports reading and operating IFC files and can extract the required building element and their relationship data.

[0094] The node types in S22 include the following steps:

[0095] S22a1. Space: Represents various spaces in the building, such as rooms and corridors;

[0096] S22a2, Equipment: Represents various types of equipment, such as air conditioners, lighting, and sensors;

[0097] S22a3, Pipeline: Represents the pipeline system in a building;

[0098] S22a4, Sensor: Represents sensors used to monitor the status of equipment;

[0099] S22a5, Controller: Represents controllers used to control equipment.

[0100] The relationship types in S22 include the following steps:

[0101] S22b1, Spatial association relationship: Used to connect IfcBuildingElement entities, representing the aggregation relationship between spaces.

[0102] S22b2, Equipment association relationship:

[0103] IfcRelFlowControlElements: Components under an external controller are associated with the elements they control through this relationship.

[0104] IfcRelConnectsPortToElement: Components under an internal controller are connected to IfcFlowSegment or IfcFlowFitting through this relationship;

[0105] IfcRelConnectsSegments: Pipe segments are connected to other pipe segments or pipe fittings through this relationship;

[0106] IfcRelConnectsPorts: Pipe fittings are connected to other pipe fittings or terminals through this relationship;

[0107] IfcRelConnectsToPipe or IfcRelConnectsToPort: Terminals are connected to the system through these two relationships;

[0108] IfcRelConnectsToElement: Energy conversion equipment and fluid storage equipment are connected to other building elements through this relationship;

[0109] IfcRelConnectsToProcess: Fluid moving equipment and fluid processing equipment are connected to the flow process through this relationship;

[0110] S22b3, Spatial Equipment Relationship: IfcRelContainedInSpatialStructure is used to represent the relationship that equipment belongs to a certain space.

[0111] The attribute mapping in S22: Extract attribute information such as ID (e.g., PMID, IFC GUID), name, location coordinates, function description, and IOT corresponding ID from IFC entities, and map them to the node attributes in the knowledge graph.

[0112] The semantic parsing in S51: The user inputs a query or control request through the natural language interface (such as "Query the status of the air conditioner in the computer room" or "Turn off the lights in the meeting room");

[0113] Intention recognition and entity extraction: Use a large model to parse the natural language input by the user, and identify key information such as the operation type (query or control), target space (such as computer room, meeting room), and target equipment type (such as air conditioner, light).

[0114] Context understanding: Combine context information to handle the user's complex query requirements, such as adjusting specific parameters of the equipment status.

[0115] The result feedback in S63: Feed back the queried equipment status information or the execution result of the control instruction to the user through the natural language interface.

[0116] The typical workflow of the system is as follows:

[0117] User request: The user makes a query or control request through the natural language interface, such as "Query the status of the temperature sensor in the computer room" or "Turn off the lights in the meeting room";

[0118] Semantic parsing and intention recognition: The NLP module and the large model parse the user request to identify the operation type, target space, target equipment, and specific operation parameters;

[0119] Cypher query statement generation: According to the parsing result, the system automatically generates the corresponding Cypher query statement to query the IOT ID of the target equipment through the Neo4j graph database;

[0120] IOT interface interaction:

[0121] Query operation: Use the IOT ID to call the status query API of the IOT platform to obtain the real-time status information of the equipment;

[0122] Control operation: Generate a control instruction and send a control command to the target equipment through the control API of the IOT platform.

[0123] Result feedback: Convert the query result or the result of control execution into a natural language response and return it to the user.

[0124] Precise IFC relationship mapping:

[0125] The present invention defines in detail the specific association relationships among various spaces, equipment, and pipelines in the BIM model, and accurately extracts these relationships through the xBIM parsing library to ensure that the structure of the knowledge graph is consistent with the actual building.

[0126] Automated knowledge graph construction:

[0127] By developing an automated tool, the complex IFC data is efficiently converted into a knowledge graph in the Neo4j graph database, reducing manual intervention and improving the accuracy and efficiency of data conversion.

[0128] Seamless conversion from natural language to Cypher:

[0129] Utilizing the powerful understanding ability of large models for natural language, a seamless experience for users to query and control through natural language is achieved, greatly enhancing the user-friendliness and intelligence level of the system.

[0130] Deep integration of BIM and IOT:

[0131] At the knowledge graph level, the BIM model data and IOT device information are uniformly managed, establishing a close association among spaces, equipment, and control systems, supporting cross-platform semantic query and control operations, and significantly improving the operation and maintenance management efficiency of intelligent buildings.

[0132] Compared with traditional technologies, the present invention significantly improves efficiency and quality in the following aspects:

[0133] Improved query and control efficiency:

[0134] The background technology usually requires users to frequently switch between the BIM platform and the IOT platform, manually search for device IDs and input query instructions or control parameters. However, through the direct interaction between natural language and the semantic knowledge graph of the present invention, only statements such as "query the air conditioner status in the computer room" or "lower the air conditioner temperature in the meeting room by 2 degrees" need to be input, and the device status can be quickly obtained or the control instruction can be issued. From the experimental test results, in the same test scenario, the query and control completion time of the present invention can be reduced by about 50% to 70% compared with the traditional manual operation method, greatly improving the operation efficiency.

[0135] Reduced data integration and maintenance costs:

[0136] In the traditional BIM and IOT data integration solution, it is necessary to manually add IOT device ID attributes to BIM components, and there is a lack of automated data relationship management. Through the IFC data parsing and automated knowledge graph construction tool of the present invention, a global device relationship graph based on Neo4j can be established in a short time. Compared with the traditional manual maintenance method, it can reduce the human cost of data processing by about 30% to 40%, and at the same time reduce the maintenance risks caused by data duplicate entry and ID matching errors, thereby improving data quality and consistency.

[0137] Improvement of usage experience and intelligent level:

[0138] Utilizing the natural language understanding ability of the large model, the present invention can seamlessly parse natural language queries and instructions, and is suitable for non-technical personnel and user groups who do not have knowledge of programming or professional graphic query languages. The learning cost for users to the system is significantly reduced. In internal tests, on-site operation and maintenance personnel with simple training can independently complete multiple query and control operations within less than 10 minutes when using this system for the first time, greatly reducing the learning threshold and operation difficulty.

[0139] Fast response and dynamic scalability:

[0140] Under test conditions, the present invention can obtain responses to query and control operations for various device types (such as HVAC, lighting, water pipes, sensors) within seconds. Compared with the traditional solution that relies on multiple platforms and multiple steps, the present invention provides a faster response time and dynamic expansion ability. As the types and quantities of IOT devices continue to grow, the system does not need to make a large number of modifications to the query process, and only needs to update the knowledge graph and large model prompts (Prompts) to quickly adapt to new query and control requirements.

[0141] Improvement of accuracy and traceability:

[0142] Through the unified knowledge graph structure and IFC standard relationship mapping rules, the present invention ensures the accuracy and traceability of data and relationships. In the test, for 100 randomly selected device query tasks, the present invention can correctly identify the device in the first query, and the accuracy rate of returning its IOT ID and status information exceeds 95%, which is about 20% higher than the traditional method of manually matching device IDs.

[0143] Intelligent decision-making support and future expansion:

[0144] Based on the semantic knowledge graph and natural language interaction capabilities established by the present invention, in the future, it can be further connected to intelligent decision-making modules and data analysis tools to achieve optimized control, automatic scheduling, and predictive maintenance of building environments and energy consumption. Through the rapid query analysis and remote control of sensor data in experimental scenarios, good results have been achieved in the energy consumption optimization of building air conditioning and lighting systems, and the comprehensive energy saving rate has been increased by about 5% to 10%.

[0145] In summary, the present invention has achieved remarkable results in terms of query and control efficiency, data maintenance cost, user experience, scalability, accuracy, and future intelligent decision-making and energy-saving optimization. Through theoretical derivation, test experimental data, and user experience feedback results.

[0146] Please refer to Figure 1 to learn about the overall process from BIM model data preparation, IFC data parsing, knowledge graph construction to natural language query and IOT control, and the relationships between each module.

[0147] Please refer to Figure 2 to learn about the representation forms of nodes such as space, equipment, and pipelines and their associated relationships in the Neo4j graph database.

[0148] Please refer to Figure 3 to learn about the detailed description of each step from user requests to final feedback and their interaction relationships.

[0149] Please refer to Figure 4 to learn about the specific mapping methods of various IfcRel* relationships in IFC in the knowledge graph.

[0150] Through precise IFC data parsing, automated knowledge graph construction, semantic understanding of natural language, and its deep integration with the IOT system, the present invention realizes the efficient conversion from space to semantics and significantly improves the intelligent management level of smart buildings.

[0151] Compared with related technologies, a method for constructing a knowledge graph and semantic query control of a BIM model provided by the present invention has the following beneficial effects:

[0152] The present invention provides a method for constructing a knowledge graph and semantic query control of a BIM model. By converting the BIM model into a knowledge graph and using natural language processing technology and the capabilities of large models, it realizes unified query and control from building space information to the semantic level.

[0153] A knowledge graph construction and semantic query control system for a BIM model, adopting the knowledge graph construction and semantic query control method for the BIM model, includes: a BIM model data preparation and attribute extension module, an IFC data parsing and knowledge graph modeling rule definition module, a knowledge graph automatic construction tool development module, a storage and management module for the Neo4j graph database, a natural language processing and large model semantic understanding module, a Cypher query statement generation and IOT interface call module, and a query and control interaction process module. The input and output end of the BIM model data preparation and attribute extension module is connected to the input end of the IFC data parsing and knowledge graph modeling rule definition module. The output end of the IFC data parsing and knowledge graph modeling rule definition module is connected to the input end of the knowledge graph automatic construction tool development module. The output end of the knowledge graph automatic construction tool development module is connected to the input end of the storage and management module for the Neo4j graph database. The output end of the storage and management module for the Neo4j graph database is connected to the input end of the natural language processing and large model semantic understanding module. The output end of the natural language processing and large model semantic understanding module is connected to the input end of the Cypher query statement generation and IOT interface call module. The output end of the Cypher query statement generation and IOT interface call module is connected to the input end of the query and control interaction process module.

[0154] The above are only the embodiments of the present invention, and do not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present invention, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present invention.

Claims

1. A knowledge graph construction and semantic query control method and system for a BIM model, characterized in that: The following steps are involved: S1. BIM model data preparation and attribute extension: In the building information model design and management software, perform the following operations to prepare and extend the BIM model data; S11. PMID attribute definition: define an additional attribute PMID for each device in Revit, and fill in the PMID of each device so that it corresponds to the device ID in the IOT system; S12. Definition of spatial topology and equipment connection relationship: Define the spatial connection relationship between various spaces, pipelines, and equipment in Revit. Through Revit's built-in relationship management function, ensure that the connection relationship between various entities conforms to the actual building structure and equipment layout; S2. IFC data parsing and knowledge graph modeling rule definition: After exporting the prepared BIM model into an IFC format file, perform IFC data parsing and knowledge graph modeling; S21. Use xBIM parsing library: Use xBIM as an IFC data parsing tool to parse the entities, attributes and relationship information in the IFC file; S22. Define the knowledge graph structure: node type, relationship type and attribute mapping; S3. Development of automatic knowledge graph construction tools: Develop a set of automated tools to achieve efficient conversion from IFC format BIM models to knowledge graphs; S31, IFC parsing module: Use the xBIM parsing library to read the IFC file and extract all relevant entities, attributes and their relationships; S32, data mapping and conversion engine: according to the pre-defined knowledge graph modeling rules, the parsed IFC entity types, attributes and relationships are converted into nodes and relationships in the Neo4j graph database; S33, Batch import program: Use Neo4j class library to batch insert converted data into Neo4j graph database through Bolt protocol to ensure transaction management during data import and ensure data consistency and integrity; S4. Storage and management of Neo4j graph database: Store the constructed knowledge graph in the Neo4j graph database; S41, Node storage: various spaces, equipment, pipelines and other entities are stored as nodes, including their attributes; S42, relationship storage: various types of space association relationships, device association relationships and space device relationships are stored as relationships to define the connection method between nodes; S43, Index and Constraint: Create indexes for commonly used query fields to improve query performance, set unique constraints to ensure that the PMID and IOTID of each device are unique in the graph database; S5. Natural language processing and large model semantic understanding: To realize the automatic generation of Cypher query statements from natural language, the system integrates the natural language processing module and the large model for semantic understanding; S51, semantic parsing, intent recognition, entity extraction and context understanding; S6, Cypher query statement generation and IOT interface call: According to the semantic analysis results, the system automatically generates the corresponding Cypher query statement and implements device status query or control through the IOT interface; S61. Automatic generation of Cypher query statements: Dynamically build Cypher query statements based on the parsed intent and entity information; S62, IOT interface call; S63, result feedback; S7, query and control interaction process.

2. The method for constructing a knowledge graph and controlling semantic queries of a BIM model according to claim 1, characterized in that: The PMID attribute in S11 is used to associate the device with the IOT system in the subsequent knowledge graph.

3. The knowledge graph construction and semantic query control method of the BIM model according to claim 1 is characterized in that: The xBIM in S21 supports reading and operating IFC files, and can extract the required building elements and their relationship data.

4. The knowledge graph construction and semantic query control method of the BIM model according to claim 1 is characterized in that: The node type in S22 includes the following steps: S22a1, Space: represents various types of spaces in a building, such as rooms and corridors; S22a2, Equipment: represents various types of equipment, such as air conditioning, lighting and sensors; S22a3, Pipeline: represents the piping system in the building; S22a4, Sensor: represents the sensor used to monitor the status of the device; S22a5, Controller: represents the controller used to control the device.

5. The method for constructing a knowledge graph and controlling semantic queries of a BIM model according to claim 1, characterized in that: The relationship type in S22 includes the following steps: S22b1, Spatial association relationship: used to connect IfcBuildingElement entities to represent the aggregation relationship between spaces. S22b2, Equipment association relationship: IfcRelFlowControlElements: The components under the external controller are associated with the elements it controls through this relationship. IfcRelConnectsPortToElement: The components under the internal controller are connected to IfcFlowSegment or IfcFlowFitting through this relationship; IfcRelConnectsSegments: The pipe segment is connected to other pipe segments or fittings through this relationship; IfcRelConnectsPorts: The pipe fitting is connected to other pipe fittings or terminals through this relationship; IfcRelConnectsToPipe or IfcRelConnectsToPort: The terminal is connected to the system through these two relationships; IfcRelConnectsToElement: Energy conversion equipment and fluid storage equipment are connected to other building elements through this relationship; IfcRelConnectsToProcess: Fluid moving equipment and fluid handling equipment are connected to the flow process through this relationship; S22b3, Spatial equipment relationship: IfcRelContainedInSpatialStructure is used to indicate that the equipment belongs to a certain space.

6. The method for constructing a knowledge graph and controlling semantic queries of a BIM model according to claim 1, characterized in that: The attribute mapping in S22: extracting the attribute information of ID, name, location coordinates, function description, and IOT corresponding ID from the IFC entity, and mapping them to node attributes in the knowledge graph.

7. The method for constructing a knowledge graph and controlling semantic queries of a BIM model according to claim 1, characterized in that: Semantic parsing in S51: the user inputs a query or control request through a natural language interface; Intent recognition and entity extraction: Use a large model to parse the natural language input by the user and identify key information such as operation type, target space, and target device type; Contextual understanding: Combine contextual information to process complex user query requirements, such as adjusting specific parameters of device status.

8. The method for constructing a knowledge graph and controlling semantic queries of a BIM model according to claim 1, characterized in that: The result feedback in S63 is: feeding back the queried device status information or the execution result of the control instruction to the user through a natural language interface.

9. A knowledge graph construction and semantic query control system for a BIM model, using the knowledge graph construction and semantic query control method for a BIM model as described in any one of claims 1 to 8, characterized in that: include: The BIM model data preparation and attribute extension module, the IFC data analysis and knowledge graph modeling rule definition module, the knowledge graph automatic construction tool development module, the Neo4j graph database storage and management module, the natural language processing and large model semantic understanding module, the Cypher query statement generation and IOT interface call module and the query and control interaction process module. The input and output ends of the BIM model data preparation and attribute extension module are connected to the input end of the IFC data analysis and knowledge graph modeling rule definition module, and the output end of the IFC data analysis and knowledge graph modeling rule definition module is connected to the knowledge graph automatic construction module. The input end of the knowledge graph automatic construction tool development module is connected, the output end of the knowledge graph automatic construction tool development module is connected to the input end of the Neo4j graph database storage and management module, the output end of the Neo4j graph database storage and management module is connected to the input end of the natural language processing and large model semantic understanding module, the output end of the natural language processing and large model semantic understanding module is connected to the input end of the Cypher query statement generation and IOT interface calling module, and the output end of the Cypher query statement generation and IOT interface calling module is connected to the input end of the query and control interaction process module.

Citation Information

Patent Citations

  • Method and system for querying SCD file of intelligent substation through natural language

    CN114168615A

  • IFC data management method and device based on semantic network

    CN116701357A

  • Systems and Methods for Using Server Side Cookies by a Demand Side Platform

    US20110246297A1

  • Composite symbolic and non-symbolic artificial intelligence system for advanced reasoning and semantic search

    US20240386015A1

Cited By

  • Automatic building modeling method based on multi-modal information and knowledge graph

    CN120411389A

  • Automatic building modeling method based on multimodal information and knowledge graph

    CN120411389B

  • Method, device and equipment for intelligently controlling BIM model and storage medium

    CN121300741A

  • Device control method and system based on natural language and electronic device

    CN121502011A

  • BIM-based component-level knowledge graph construction method and system

    CN121660041A