AR Device Object Recognition for Network Management Automation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual entry of information and interaction with data across disparate systems in remote network management is inefficient, posing challenges in initiating management operations and delivering services effectively.

Innovation Solution

The implementation of augmented reality (AR) devices that capture images of real objects, recognize them in real-time, and transmit messages to a remote network management platform to retrieve and display associated management data, enabling automated input and interaction with management data and operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual entry of information is used for data retrieval and interaction in remote network management, then system complexity is reduced, but productivity and time efficiency deteriorate

Engineering Contradiction:
Improvedata retrieval efficiencyVSAvoidtime for manual information entry
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system enables self-service through automated object recognition. The AR device automatically captures images, identifies managed objects, retrieves associated data, and presents information without requiring manual data entry by support personnel. The system serves itself by autonomously completing the entire workflow from object identification to data retrieval.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Manual mechanical data entry operations are replaced with automated optical recognition and electronic data retrieval systems. The AR device uses imaging components to capture visual data, processes it through object recognition algorithms, and electronically retrieves management data from databases, substituting the manual typing and form-filling process entirely.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If manual entry of information is used for identifying managed objects, then device complexity is reduced, but ease of operation deteriorates

Engineering Contradiction:
Improveease of data interactionVSAvoidcomplexity of AR device system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The AR device performs multiple functions through a single integrated system: capturing images of managed objects, automatically recognizing and identifying them, retrieving associated management data from databases, and presenting the information to users. This multi-functional approach simplifies the user experience despite the underlying system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If automated AR-based object recognition is implemented, then productivity and ease of operation improve, but device complexity increases

Engineering Contradiction:
Improvemanagement operation speedVSAvoidcomplexity of automated recognition system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The AR device serves as an intermediary between the physical managed objects and the remote network management platform. It captures images of objects, processes them through recognition algorithms, transmits relevant data to the management platform, and receives management data for display. This intermediary role automates the workflow while managing system complexity through modular architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11468641B2Augmented reality assistant
Publication Date: 2022.10.11 SERVICENOW INC
  • US11468641B2 patent drawing
  • US11468641B2 patent drawing
  • US11468641B2 patent drawing

AI summary

An augmented reality AR device may be communicatively connected to a remote network management platform configured to support a managed network. The AR device may capture an image of a real object in the field of view of an imaging component of the AR device. The real object may be recognized as a known managed object of the managed network. The AR device may also concurrently determine context information indicating a location or physical environment. The AR device may then transmit an identifier of the known managed object and the context information in a message to the management platform. In response, the AR device may receive data associated with the known managed. The AR device may then display a virtual object in a virtual space superimposed on the captured image of the real object, where the virtual object and the virtual space are based on the received management data.