Hybrid IoT Device Identification via Signal and Image Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In data communication between IoT devices and data processing apparatuses, such as computer game machines, there is a challenge in accurately determining the location of IoT devices in the real environment due to the limitations of wireless data communication protocols, which often rely on signal strength that does not accurately reflect the device's position.

Innovation Solution

A hybrid detection technique that combines wireless signal strength analysis with image processing to estimate the separation of IoT devices from the apparatus, using the inverse square law relationship for signal strength and geometric scaling of image sizes to associate visual and communication data, allowing for precise location mapping.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If wireless signal strength is used to determine device location, then communication range is extended, but measurement precision of device position deteriorates

Engineering Contradiction:
Improvecommunication rangeVSAvoiddevice position accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent combines wireless signal strength detection with visual image processing to create a hybrid detection system. The wireless communication circuitry detects signal strength while the camera captures images of the IoT device, and the data processor integrates both data sources to determine device location, thereby maintaining extended communication range while improving position accuracy

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces visual image data as an intermediary element that bridges the gap between wireless signal strength and actual device position. The camera captures visual information about the device's location, which serves as a mediator to correct and refine the position estimates derived from wireless signal strength alone

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If hybrid detection technique combining wireless signal strength and image processing is used, then measurement precision of device location is improved, but device complexity increases

Engineering Contradiction:
Improvedevice location accuracyVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The data processor is designed to perform multiple functions: it processes wireless signal strength data, processes visual image data, and integrates both to determine device location. This multi-functionality reduces the need for separate dedicated processing units for each detection method, thereby managing device complexity while achieving improved measurement precision

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses existing components (camera and wireless communication circuitry) that are already part of the data processing apparatus, making them serve dual purposes: their primary functions plus the additional function of location detection through the hybrid technique, thereby reducing the need for additional dedicated hardware

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method enables accurate detection and identification of IoT device locations, enhancing the apparatus's ability to communicate effectively with IoT devices by correlating wireless signal strengths with visual cues, thereby improving the reliability of data communication and device positioning.

Implementation Method 1

using the inverse square law relationship for signal strength

Methodology Applied
Scientific EffectInverse square law:

Implementation Method 2

geometric scaling of image sizes to associate visual and communication data

Methodology Applied
Scientific EffectGeometric scaling:

Data Source

PatentUS11446568B2Image-based data communication device identification
Publication Date: 2022.09.20 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11446568B2 patent drawing
  • US11446568B2 patent drawing
  • US11446568B2 patent drawing

AI summary

Data processing apparatus includes data communication circuitry to communicate data, by wireless radio frequency communication, with a set of one or more external devices, the data communication circuitry being configured to detect a corresponding wireless signal strength of a data communication from each of the set of external devices; a data processor to detect a respective estimated separation of each of the set of external devices from the apparatus in dependence upon the respective detected wireless signal strengths; and an image processor to detect, in images captured by a camera, an image of an external device having image properties consistent with the estimated separation of a given one of the set of external devices from the apparatus and to associate the external device detected in the images captured by the camera with data communications between the apparatus and the given one of the set of external devices.