IoT Device Identification via Visual Interrogation and Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In the context of the Internet of Things (IoT), identifying specific devices within a local environment is challenging due to the use of generic names, MAC, or IP addresses that do not specify the device type, leading to ambiguity among multiple devices of the same type.

Innovation Solution

An interrogation-based device identification system that uses a camera to capture images of unknown devices, performs object recognition, and accesses a registry to determine the device type by observing responses to specific actuations or stimuli, allowing for precise identification of IoT devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If generic names, MAC, or IP addresses are used to identify IoT devices, then device communication and network connectivity are enabled, but device identification precision deteriorates due to ambiguity among multiple devices of the same type

Engineering Contradiction:
Improvedevice identification precisionVSAvoididentification system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The identification system is segmented into multiple independent modules: image capture module, object recognition module, registry access module, and interrogation module. Each module performs a specific function in the identification process, allowing the system to handle complex identification tasks through coordinated simple operations rather than a monolithic complex system

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Visual images captured by the camera serve as an intermediary representation of the physical device. The object recognition module processes this visual intermediary to extract device characteristics, which then bridge the gap between physical device identity and digital identification, enabling precise identification without direct device interaction

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If object recognition and registry access methods are implemented to identify device types, then device differentiation capability is improved, but information processing time increases due to multiple processing steps

Engineering Contradiction:
Improvedevice type identification accuracyVSAvoididentification processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

A registry is pre-populated with device type information, characteristics, and identification criteria before runtime. When a device needs identification, the system queries this pre-prepared registry rather than creating identification rules on the fly, significantly reducing processing time while maintaining high identification accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses an efficient query mechanism that skips unnecessary processing steps. The object recognition module extracts key features and directly queries the registry for matching device types, bypassing exhaustive comparison of all possible device characteristics and rapidly identifying the device type

Inventive Principle:
Principle #21Skipping (Rushing through)

3Adaptability or versatility

If camera-based object recognition is used to capture device images, then device identification capability is improved, but system complexity and cost increase due to additional hardware requirements

Engineering Contradiction:
Improvedevice identification capabilityVSAvoidsystem hardware complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The camera module serves multiple functions: capturing device images for identification, providing visual feedback to users about detected devices, and potentially monitoring device status changes. This multi-functionality justifies the addition of the camera while maximizing its utility across different system operations

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The object recognition module uses publicly available image data and automated image processing algorithms to identify devices without requiring manual device configuration, user input, or specialized proprietary image capture equipment. The system serves itself by automatically extracting features from standard images and matching them against the registry

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10762328B2Method and apparatus for identifying a device within the internet of things using interrogation
Publication Date: 2020.09.01 DELL PROD LP
  • US10762328B2 patent drawing
  • US10762328B2 patent drawing
  • US10762328B2 patent drawing

AI summary

A method of identifying an unknown device via interrogation may comprise determining a communication address of an unknown device in communication with an information handling system, capturing a digital image of the unknown device, determining the unknown device belongs to a known class of devices via an object recognition algorithm to analyze the digital image, accessing a device class registry listing a plurality of candidate object identifications associated with the known class of devices, identifying a stimulus action or actuation associated with a first of the plurality of candidate device identifications. The method may also comprise performing the stimulus action, receiving an indication via the communication address indicating the unknown device detected the stimulus action, and associating the communication address of the unknown device with the first of the plurality of candidate device identifications.