Wearable AR Building Automation Control for Hidden Device Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current building automation management systems restrict users' ability to effectively control devices in real-time, especially when devices are not directly visible, requiring users to navigate through management stations and building plans, which can be cumbersome and inefficient.

Innovation Solution

A method using a wearable device that determines coordinates within the building automation environment, renders a representative view of devices through an environment map, and allows for gesture-based or voice-based input to modify operation parameters, utilizing cloud computing and Building Information Modelling Standards for precise device detection and communication via protocols like BACnet, Modbus, and DALI.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a management station with graphical or hierarchical navigation is used to locate devices, then users can access device parameters, but the operation becomes cumbersome and time-consuming especially when devices are not directly visible

Engineering Contradiction:
Improvedevice location informationVSAvoiddevice navigation
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent introduces an augmented reality interface as an intermediary between the user and the building automation devices. This AR interface overlays device information directly into the user's field of view, eliminating the need to navigate through management stations. The AR system acts as a mediator that translates physical device locations into visible digital annotations, solving the contradiction by providing both complete information access and effortless operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transitions from two-dimensional navigation interfaces (graphical or hierarchical menus on management stations) to a three-dimensional augmented reality overlay that maps device information directly onto the physical environment. This dimensional shift allows users to see device parameters and control options superimposed on actual devices, eliminating navigation steps and providing intuitive spatial awareness of device locations and statuses.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If traditional management stations are used to control devices, then device parameters can be modified, but real-time control is restricted especially for devices not directly visible to users

Engineering Contradiction:
Improvedevice control efficiencyVSAvoidreal-time device control
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The augmented reality interface serves as a real-time intermediary that maintains a live connection between the user and building automation devices. The system continuously updates device status and control options in the AR overlay, enabling users to monitor and adjust parameters instantly without returning to management stations. This resolves the contradiction by providing both high control efficiency and effortless real-time operation through the AR mediator.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent moves control functionality from a separate 2D management station interface to a 3D augmented reality overlay that appears directly in the user's field of view. This allows users to see and control devices in their physical context, enabling immediate adjustments without navigation. The dimensional transformation provides both rapid productivity and intuitive ease of operation by embedding control capabilities within the physical workspace.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If users rely on building plans and electrical schemas to identify devices, then accurate device identification is possible, but the process becomes complex and time-consuming

Engineering Contradiction:
Improvedevice identification accuracyVSAvoiddevice location time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The augmented reality system acts as a mediator that automatically maps device identifiers from building automation systems to their physical locations. Instead of requiring users to manually cross-reference building plans and electrical schemas, the AR interface directly annotates devices with their identities and locations in the field of view. This eliminates time-consuming lookup processes while maintaining precise device identification through automated spatial mapping.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the 2D information lookup process (checking building plans and electrical schemas on screens or paper) into a 3D augmented reality experience where device information is overlaid directly onto the physical environment. This dimensional shift allows users to identify devices by looking at their actual locations rather than searching through documentation, achieving both precise identification and immediate results without time loss.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11698614B2Systems, device and method of managing a building automation environment
Publication Date: 2023.07.11 SIEMENS SCHWEIZ AG
  • US11698614B2 patent drawing
  • US11698614B2 patent drawing
  • US11698614B2 patent drawing

AI summary

Various embodiments include a method of managing a building automation environment comprising: determining coordinates of a wearable device and an associated wearer in the building automation environment; rendering a representative view of a portion of the building automation environment based on the determined coordinates and an environment map associated with the building automation environment, wherein the representative view includes a multi-dimensional view of the portion of the building automation environment and wherein the portion includes one or more devices in the building automation environment; and modifying operation parameters of the portion of the building automation environment through one of gesture-based and voice-based input.