Mixed-Reality Cloud Service for IoT Device Re-localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge lies in accurately tracking and managing the location and sensor data of Internet-of-Things (IoT) devices within environments, particularly due to their portability and diverse operational conditions, which complicates their re-localization and operational coverage area management.

Innovation Solution

The implementation of a system that utilizes sensor data from IoT devices to update digital maps of their environments, allowing head-mounted devices (HMDs) and server computer systems to visualize and manage the devices' locations and operational coverage areas, even when the devices change positions, through a mixed-reality cloud service.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If IoT devices are made portable for easy movement, then ease of operation is improved, but tracking and monitoring their location becomes more difficult

Engineering Contradiction:
ImproveportabilityVSAvoidlocation tracking
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces an intermediary system consisting of a mixed-reality cloud service and digital twin technology. The physical IoT device communicates with its virtual counterpart in the mixed-reality cloud, which maintains continuous location tracking and environmental mapping. This intermediary layer resolves the contradiction by enabling easy device portability while maintaining accurate location monitoring through the virtual representation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a digital twin (virtual copy) of the physical IoT device in the mixed-reality cloud. This copy maintains all location and operational data, allowing the physical device to move freely while its virtual counterpart continues to be tracked and monitored. The copying principle enables portability without losing location awareness.

Inventive Principle:
Principle #26Copying

2Measurement precision

If sensor data is continuously collected and mapped in real-time, then measurement precision is improved, but use of energy increases

Engineering Contradiction:
Improvelocation accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements partial action by selectively updating only the necessary portions of the digital twin and sensor readings map. Instead of continuously refreshing all data, the system updates location and environmental information only when changes occur or when triggered by specific events. This approach maintains high measurement precision while significantly reducing energy consumption compared to continuous real-time updates.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If digital maps are continuously updated with sensor data, then reliability of location information is improved, but device complexity increases

Engineering Contradiction:
Improvelocation information accuracyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The mixed-reality cloud service acts as an intermediary that handles the complexity of continuous map updates and data management. The physical IoT device itself remains relatively simple, while the cloud-based digital twin manages the sophisticated tasks of maintaining accurate location information and environmental mapping. This distributes system complexity from the device to the cloud infrastructure.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces complex local processing and storage mechanisms with cloud-based digital twin technology. Instead of requiring the physical device to maintain complex local maps and processing systems, the solution uses remote cloud-based virtual representations to manage location and environmental data, simplifying the physical device architecture while maintaining high reliability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11961192B2Mapping sensor data using a mixed-reality cloud
Publication Date: 2024.04.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11961192B2 patent drawing
  • US11961192B2 patent drawing
  • US11961192B2 patent drawing

AI summary

Improved techniques for re-localizing Internet-of-Things (IOT) devices are disclosed herein. Sensor data digitally representing one or more condition(s) monitored by an IOT device is received. In response, a sensor readings map is accessed, where this map is associated with the IOT device. The map also digitally represents the IOT device's environment and includes data representative of a location of the IOT device within the environment. The map also includes data representative of the conditions monitored by the IOT device. Additionally, the map is updated by attaching the sensor data to the map. In some cases, a coverage map can also be computed. Both the sensors readings map and the coverage map can be automatically updated in response to the IOT device being re-localized.