Virtual AR IoT Control Through Mobile Orientation Sensors

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies lack efficient methods for users to interact with and control IoT devices using augmented reality (AR) interfaces on mobile devices, particularly through intuitive and immersive interactions.

Innovation Solution

Implementing an IMU control system on portable electronic devices, such as smartphones and wearable devices, to enable users to control IoT devices by tilting the device and interacting with a virtual rotational interface displayed near the IoT product, using the device's inertial measurement unit (IMU) to adjust features like volume, brightness, or color hue.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional touch-based interfaces are used to control IoT devices, then ease of operation is maintained, but user interaction becomes less intuitive and immersive

Engineering Contradiction:

Improveintuitiveness of controlVSAvoidinteraction complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces traditional touch-based mechanical input with inertial sensing. The IMU sensor detects device orientation and motion in 3D space, allowing users to control IoT devices through natural physical gestures rather than touchscreen interactions. This substitution enables more intuitive control while maintaining operational simplicity.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent extends control from 2D touchscreen interactions to 3D spatial gestures. By utilizing the third dimension through device orientation and rotation detection via IMU, users can interact with virtual interfaces in augmented reality space, making control more intuitive and immersive without increasing operational complexity.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Ease of operation

If AR interfaces are implemented for IoT control, then user interaction becomes more immersive, but device complexity increases

Engineering Contradiction:

Improveimmersive interactionVSAvoidsystem complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent leverages the mobile device's existing IMU sensor, which serves multiple functions including step counting, screen orientation, and now AR gesture control. By making the IMU sensor multi-functional, the system achieves immersive AR interaction without adding dedicated hardware, thus avoiding increased device complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the mobile device's own IMU sensor to provide all necessary motion and orientation data for AR control. Rather than requiring separate sensors or external devices, the system is self-sufficient, using existing components to deliver immersive interaction capabilities.

Inventive Principle:

Principle #25Self-service

3Ease of operation

If IMU-based control is implemented, then ease of operation improves through natural gestures, but measurement precision requirements increase

Engineering Contradiction:

Improvegesture-based controlVSAvoidorientation detection accuracy

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The system continuously monitors IMU sensor data and provides real-time feedback by updating the virtual interface based on device orientation. This continuous feedback loop allows the system to compensate for minor measurement variations and maintain precise control interpretation, enabling natural gesture-based operation without requiring extremely high measurement precision.

Inventive Principle:

Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive and immersive control of IoT devices through AR interfaces, enhancing user interaction and simplifying the management of IoT products by allowing users to adjust features via device orientation.

Implementation Method 1

using the inertial measurement unit (IMU) of a mobile device

Methodology Applied

Scientific EffectInertial measurement: Inertia

Data Source

PatentUS12405658B2Virtual AR interfaces for controlling IoT devices using mobile device orientation sensors

Publication Date: 2025.09.02 SNAP INC

AI summary

Described are virtual AR interfaces for generating a virtual rotational interface for the purpose of controlling connected IoT devices using the inertial measurement unit (IMU) of a portable electronic device. The IMU control application enables a user of a portable electronic device to activate a virtual rotational interface overlay on a display and adjust a feature of a connected IoT product by rotating a portable electronic device. The device IMU moves a slider on the virtual rotational interface. The IMU control application sends a control signal to the IoT product which executes an action in accordance with the slider position. The virtual rotational interface is presented on the display as a virtual object in an AR environment. The IMU control application detects the device orientation (in the physical environment) and in response presents a corresponding slider element on the virtual rotational interface (in the AR environment).