Augmented Reality Interface for Secure IoT Device Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In enterprise settings, managing interactions with IoT devices and physical objects is challenging due to security risks and inefficiencies in accessing and entering device information, requiring manual look-ups and installations which delay interactions.

Innovation Solution

The implementation of an augmented reality system that allows enterprise information to be overlaid onto the physical world, enabling IT administrators to centrally manage client devices, IoT devices, and other objects through a management service, which includes a user interface that detects objects and provides role-specific actions based on authentication data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If device information is posted in public locations for easy access, then ease of operation is improved, but security is compromised due to unauthorized access risks

Engineering Contradiction:
Improveaccess to device informationVSAvoidunauthorized access
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an augmented reality interface as an intermediary between users and device information. Instead of posting information publicly or requiring manual lookups, the AR system mediates access by displaying device information and control options only when the user points the device at the physical object, providing security while maintaining ease of operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If manual look-up and entry of device information is required, then security is maintained, but productivity decreases due to time-consuming processes

Engineering Contradiction:
ImprovesecurityVSAvoidinteraction efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system enables self-service interaction where the device automatically identifies and retrieves information about the physical object being viewed through the AR interface. Users simply need to point the device at the object, and the system automatically provides device information and available actions without requiring manual look-up or entry, thus maintaining security while dramatically improving productivity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical process of manual information lookup and entry with an automated optical recognition system. The device uses camera-based object recognition and AR technology to automatically identify physical objects and retrieve associated information, substituting manual operations with automated visual recognition and information retrieval processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If installation of applications and drivers is required for interactions, then device compatibility is ensured, but time is lost due to installation delays

Engineering Contradiction:
Improvedevice compatibilityVSAvoidinteraction delay
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-configuring and staging the necessary applications, drivers, and interaction protocols before the user needs to interact with the device. When a user points the AR device at a physical object, the system has already prepared the appropriate software components and can immediately initiate interactions without requiring on-the-spot installation, thus maintaining compatibility while eliminating installation delays.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10964110B2Managed actions using augmented reality
Publication Date: 2021.03.30 OMNISSA LLC
  • US10964110B2 patent drawing
  • US10964110B2 patent drawing
  • US10964110B2 patent drawing

AI summary

Disclosed are various examples for performing actions using augmented reality. In some examples, a user interface that includes a field of view is generated. The field of view is currently captured using a camera of a client device. Object data in the field of view is detected. Position data is determined. The position data includes a location of the client device and an orientation vector that indicates a direction the camera of the client device. A request for actions is transmitted to a management service. The request includes the object data and the position data. An action and an identity of a managed object are received from the management service. The user interface is updated to include an identity of a managed object, and a user interface element that when selected causes an action to be performed.