Building system commissioning using mixed reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Building system commissioning is a time-consuming and error-prone process due to the lack of event-driven checklists and real-time validation, requiring significant expertise and often resulting in unrecoverable damages and productivity issues, as engineers rely on documents and diagrams for ontology mapping during installation and commissioning of devices.

Innovation Solution

The implementation of mixed reality devices and systems that retrieve configuration data from a remote distributed database, display project instructions and checklists, and synchronize data for commissioning activities, enabling hands-free commissioning with real-time validation and reduced errors through mixed reality displays and sensors for gesture, gaze, and voice control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If engineers refer to documents and diagrams on computing devices or physical papers during commissioning, then they can access ontology mapping information, but the commissioning process becomes time-consuming and requires carrying physical materials

Engineering Contradiction:
Improveontology mapping informationVSAvoidcommissioning time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent creates a digital copy of ontology mapping information and commissioning checklists within the mixed reality environment. Instead of referring to physical papers or documents on computing devices, engineers access virtualized versions of these documents overlaid in the mixed reality display, eliminating the need to carry physical materials and reducing time spent searching for and referencing documents during commissioning activities

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions information from two-dimensional physical papers or screen displays to a three-dimensional mixed reality environment. Ontology mapping information and commissioning checklists are rendered as virtual objects in the mixed reality space, allowing engineers to access information in the same spatial context as the physical equipment, thereby eliminating the need to switch between physical documents and the commissioning site

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If engineers rely on expertise and experience for commissioning devices, then they can handle complex situations, but the process requires significant expertise and experience that not all engineers possess

Engineering Contradiction:
Improvecommissioning accuracyVSAvoidease of commissioning
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent implements event-driven checklists that provide real-time feedback and validation during the commissioning process. The system monitors commissioning activities, compares them against predefined ontological models and best practices, and provides immediate guidance and validation to engineers. This feedback mechanism ensures commissioning accuracy by guiding engineers through required steps and validating their actions, reducing reliance on individual expertise while maintaining high standards

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent pre-configures commissioning checklists and validation rules based on ontological models before commissioning activities begin. Device configurations, commissioning steps, and validation criteria are predetermined and stored in the system, allowing engineers to follow structured procedures rather than relying on ad-hoc expertise. This preliminary preparation ensures consistency and accuracy across different engineers and projects

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If no event-driven checklist or run-time validation is available during commissioning, then the system remains simple, but issues occurring during commissioning may result in unrecoverable damages and productivity issues

Engineering Contradiction:
Improvecommissioning system complexityVSAvoidcommissioning safety
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent implements run-time validation that continuously monitors commissioning activities and provides immediate feedback on compliance with ontological models. The system validates device configurations, connection statuses, and commissioning steps in real-time, alerting engineers to potential issues before they result in unrecoverable damages. This feedback mechanism adds safety without requiring complex manual verification procedures

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent enables the commissioning system to automatically validate configurations and detect issues without requiring external verification. The system self-monitors commissioning progress, compares actual states against expected states defined in ontological models, and automatically identifies deviations or errors. This self-validation capability enhances reliability while maintaining relatively simple system architecture

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10760815B2Building system commissioning using mixed reality
Publication Date: 2020.09.01 HONEYWELL INTERNATIONAL INC
  • US10760815B2 patent drawing
  • US10760815B2 patent drawing
  • US10760815B2 patent drawing

AI summary

Methods, devices, and systems for building system commissioning using mixed reality are described herein. One system includes a computing device comprising computer readable instructions stored thereon that are executable by a processor to retrieve configuration data for a physical controller from a remote distributed database in response to receiving a query, display the configuration data for the physical controller in a mixed reality display on a mixed reality device, and install the configuration data on the physical controller.