Building system commissioning using mixed reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Building system commissioning is a time-consuming and error-prone process due to the lack of event-driven checklists and real-time validation, requiring significant expertise and often resulting in unrecoverable damages and productivity issues, as engineers rely on documents and diagrams for ontology mapping during installation and commissioning of devices.
Innovation Solution
The implementation of mixed reality devices and systems that retrieve configuration data from a remote distributed database, display project instructions and checklists, and synchronize data for commissioning activities, enabling hands-free commissioning with real-time validation and reduced errors through mixed reality displays and sensors for gesture, gaze, and voice control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If engineers refer to documents and diagrams on computing devices or physical papers during commissioning, then they can access ontology mapping information, but the commissioning process becomes time-consuming and requires carrying physical materials
Solution Approach 1:
The patent creates a digital copy of ontology mapping information and commissioning checklists within the mixed reality environment. Instead of referring to physical papers or documents on computing devices, engineers access virtualized versions of these documents overlaid in the mixed reality display, eliminating the need to carry physical materials and reducing time spent searching for and referencing documents during commissioning activities
Solution Approach 2:
The patent transitions information from two-dimensional physical papers or screen displays to a three-dimensional mixed reality environment. Ontology mapping information and commissioning checklists are rendered as virtual objects in the mixed reality space, allowing engineers to access information in the same spatial context as the physical equipment, thereby eliminating the need to switch between physical documents and the commissioning site
2Reliability
If engineers rely on expertise and experience for commissioning devices, then they can handle complex situations, but the process requires significant expertise and experience that not all engineers possess
Solution Approach 1:
The patent implements event-driven checklists that provide real-time feedback and validation during the commissioning process. The system monitors commissioning activities, compares them against predefined ontological models and best practices, and provides immediate guidance and validation to engineers. This feedback mechanism ensures commissioning accuracy by guiding engineers through required steps and validating their actions, reducing reliance on individual expertise while maintaining high standards
Solution Approach 2:
The patent pre-configures commissioning checklists and validation rules based on ontological models before commissioning activities begin. Device configurations, commissioning steps, and validation criteria are predetermined and stored in the system, allowing engineers to follow structured procedures rather than relying on ad-hoc expertise. This preliminary preparation ensures consistency and accuracy across different engineers and projects
3Device complexity
If no event-driven checklist or run-time validation is available during commissioning, then the system remains simple, but issues occurring during commissioning may result in unrecoverable damages and productivity issues
Solution Approach 1:
The patent implements run-time validation that continuously monitors commissioning activities and provides immediate feedback on compliance with ontological models. The system validates device configurations, connection statuses, and commissioning steps in real-time, alerting engineers to potential issues before they result in unrecoverable damages. This feedback mechanism adds safety without requiring complex manual verification procedures
Solution Approach 2:
The patent enables the commissioning system to automatically validate configurations and detect issues without requiring external verification. The system self-monitors commissioning progress, compares actual states against expected states defined in ontological models, and automatically identifies deviations or errors. This self-validation capability enhances reliability while maintaining relatively simple system architecture
Data Source
AI summary
Methods, devices, and systems for building system commissioning using mixed reality are described herein. One system includes a computing device comprising computer readable instructions stored thereon that are executable by a processor to retrieve configuration data for a physical controller from a remote distributed database in response to receiving a query, display the configuration data for the physical controller in a mixed reality display on a mixed reality device, and install the configuration data on the physical controller.


