Hybrid Reality IoT Control via Head Movement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current hybrid reality technologies face challenges in enabling real-time interaction and control of IoT-based objects between the virtual and real worlds, including manual effort requirements and limitations in live video detection and location-based content definition.
Innovation Solution
A system and method utilizing a mobile electronic device with a hybrid reality application and a virtual reality platform, such as Google Cardboard, to capture and visualize IoT-based objects, providing a user interface for remote, hands-free interaction and control through head movements, with the ability to send commands to IoT devices via a PHP script on a Raspberry Pi controller.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual interaction methods are used with IoT objects, then ease of operation is maintained, but productivity and automation are reduced
Solution Approach 1:
The patent replaces manual mechanical interaction with voice-based and gesture-based control systems. The voice recognition module captures vocal commands, and the gesture recognition module detects hand movements, substituting the need for physical manual operations while maintaining ease of use and significantly improving productivity through automated processing of these inputs.
Solution Approach 2:
The system enables self-service operation where IoT objects can be controlled autonomously through voice commands and gestures without requiring direct manual manipulation. The processor automatically interprets these inputs and executes appropriate commands, allowing the system to serve itself and reducing the need for continuous human intervention.
2Ease of operation
If virtual reality platforms are used for IoT interaction, then ease of operation improves through hands-free control, but device complexity increases
Solution Approach 1:
The system segments the VR interaction functionality into separate modular components: a virtual reality platform module, a voice recognition module, a gesture recognition module, and a processor. This segmentation allows each component to be developed and optimized independently, reducing overall system complexity while maintaining hands-free operational ease.
Solution Approach 2:
The virtual reality platform is designed to handle multiple interaction modes (voice commands, gestures, and traditional controls) through a single unified interface. This multi-functionality consolidates what would otherwise require multiple separate systems into one device, improving ease of operation without proportionally increasing complexity.
3Measurement precision
If live video detection is implemented for IoT objects, then measurement precision improves, but use of energy and processing requirements increase
Solution Approach 1:
The live video detection system operates periodically rather than continuously, activating the camera and processing only when triggered by motion detection or user initiation. This periodic operation maintains measurement precision when needed while significantly reducing energy consumption during idle periods compared to continuous monitoring.
Data Source
Figure 1
Figure 2a
Figure 2b
AI summary
A system and method for real time interaction of a real world with a virtual world through an augmentation concept has been provided. The system includes a mobile electronic device compatible with all operating system. The mobile electronic device is having a virtual reality application, on running the application and mounting the mobile electronic device in a virtual reality platform, the display provides two scenes. First scene is a menu scene and the second scene provides stereoscopic image with wide field view in a virtual environment. The system captures a real time image and scans characteristics of IoT based devices. Based on movement of virtual reality platform, the system provides guidance to perform actions on the IoT based devices from the virtual environment.