Mobile Device Mixed Reality Control via Image Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies lack intuitive methods for interacting with and controlling mixed reality objects, which are a combination of real and virtual elements, especially in universal and heterogeneous environments.
Innovation Solution
A mobile device is used to capture images of real-world objects, deriving command sets to control mixed reality objects, including virtual and real-world elements, by utilizing image data and network connections to provide an interface for commanding and controlling these objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a mobile device captures images of real-world objects to derive command sets for mixed reality objects, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The patent introduces an intermediary system comprising image processing software and command derivation mechanisms that bridge the mobile device camera and the mixed reality objects. This intermediary layer automatically processes captured images, extracts object features, derives appropriate command sets, and interfaces with target objects, thereby shielding users from underlying system complexity while enabling intuitive interaction through familiar mobile device interfaces.
2Adaptability or versatility
If the system supports universal and heterogeneous environments with multiple command or control protocols, then adaptability is improved, but device complexity increases
Solution Approach 1:
The patent implements a universal command derivation system that can handle multiple command or control protocols through a single integrated interface. The system derives appropriate command sets based on the captured object's characteristics and the target environment's requirements, enabling the mobile device to interact with heterogeneous mixed reality objects (virtual objects, augmented reality objects, and real-world objects) using a unified approach rather than requiring separate protocols for each object type.
Solution Approach 2:
The system dynamically adjusts command set parameters based on the identified object type and target environment. By analyzing image data and deriving object-specific command sets, the system changes operational parameters to match the requirements of different mixed reality objects and protocols, thereby achieving broad adaptability without hardcoding multiple protocol implementations.
3Measurement precision
If image data is used to identify and control mixed reality objects, then measurement precision is improved, but difficulty of detecting and measuring increases
Solution Approach 1:
The patent enables the mobile device's camera and image processing system to automatically perform object detection, identification, and command derivation without requiring manual intervention. The system self-services by capturing images, processing the visual data, identifying target objects, and generating appropriate command sets autonomously, thereby achieving precise object control while minimizing the user's burden despite the underlying computational complexity.
Data Source
AI summary
Methods of interacting with a mixed reality are presented. A mobile device captures an image of a real-world object where the image has content information that can be used to control a mixed reality object through an offered command set. The mixed reality object can be real, virtual, or a mixture of both real and virtual.