AR Commissioning of Building Automation Devices via Code Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current commissioning processes for building automation systems lack precision and reliability in real-world scenarios, leading to inefficiencies and potential errors due to the unavailability of precise optical detection of devices, especially in augmented reality contexts.
Innovation Solution
A method and system that utilize real-time data from sensors to identify and localize codes on building automation devices, generating virtual content for augmented reality support, allowing for real-time interaction and updating based on device position and user inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional commissioning methods are used without augmented reality, then device detection relies on manual reference to documentation and separate diagnostic tools, but this leads to time-consuming troubleshooting and potential wiring errors
Solution Approach 1:
The patent merges the camera feed with device information display by overlaying virtual content (device details, wiring instructions, diagnostic data) directly onto the real-world view of the controller. This integration eliminates the need for separate documentation and diagnostic tools, allowing operators to view all necessary information in a single augmented reality interface, thereby reducing commissioning time and improving detection precision.
Solution Approach 2:
The patent introduces an intermediary system consisting of the camera, image processing algorithms, and augmented reality display that mediates between the physical controller and the operator. This intermediary captures real-time images, identifies controllers through image analysis, retrieves device information, and presents it overlaid on the camera feed, replacing manual documentation reference and separate diagnostic tools with an integrated digital intermediary layer.
2Productivity
If augmented reality is implemented for real-time device information display, then commissioning efficiency improves, but the system complexity increases due to integration of camera, image processing, and virtual content generation
Solution Approach 1:
The patent implements a multi-functional system where a single integrated platform performs multiple tasks: the camera captures images, the image processing algorithms identify controllers and extract features, the system retrieves device information from databases, generates virtual content, and overlays it on the real-time video feed. This universal system handles detection, identification, information retrieval, and display functions within one augmented reality application, improving productivity while managing complexity through functional integration rather than separate systems.
3Ease of operation
If optical detection methods using pre-prepared images or markers are used, then object detection can be achieved, but precision and reliability are insufficient for real-world commissioning scenarios
Solution Approach 1:
The patent applies preliminary action by pre-training image processing algorithms with training images of controllers during system setup. The system captures images of controllers in the specific installation environment and uses these training images to teach the image processing algorithm what to look for. This preliminary training enables the system to accurately identify controllers in real-world scenarios without requiring physical markers or pre-prepared reference images during actual commissioning, thereby improving both ease of operation and measurement precision.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for supporting commissioning and/or maintenance of a building automation system (100) and/or a building automation device (5), the method comprising the steps of: a) receiving (81) real-time data (2) about a real-world infrastructure environment (3) from a sensor arrangement (4), said real-world infrastructure environment (3) comprising at least one building automation device (5) arranged in an infrastructure, wherein said building automation device (5) comprises a code (6); b) analyzing (82) the real-time data (2) to identify and localize said code (6) within the real-world infrastructure environment (3); c) generating (83) virtual content (7) based on the identified code (6), said virtual content (7) comprising support information (71) for commissioning and/or maintaining the building automation device (5); d) presenting (84) the virtual content (7) to an operator.