XR Remote Controller Using SLAM for External Display Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional XR systems lack the ability to interact with physical devices like televisions directly from within the XR environment, requiring users to remove head-mounted displays to control external devices.
Innovation Solution
A remote-control system that includes a remote-controller with an image capture device and a computing device, which uses SLAM algorithms to build a map of the environment and determine the location of displays, allowing the system to control these displays remotely.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the conventional remote-controller is used to interact with external devices like television, then the user must take off the head mounted display, but this interrupts the XR experience and reduces operational continuity
Solution Approach 1:
The remote-controller is enhanced with an image capture device and SLAM algorithm capability, enabling it to perform both traditional remote control functions and environmental mapping functions. This multi-functionality allows the controller to track the HMD's position and control external displays without requiring the user to remove the HMD, thus maintaining XR experience continuity while enabling external device interaction.
2Adaptability or versatility
If the remote-controller is equipped with image capture device and SLAM algorithm, then the ability to locate and control external displays is improved, but the device complexity increases
Solution Approach 1:
The system introduces a computing device as an intermediary that receives location information from the remote-controller and generates control commands for external displays. This mediator architecture allows the remote-controller to focus on its core strength (capturing images and calculating location via SLAM) while delegating the complexity of display control to a specialized computing device, thus managing overall system complexity.
3Measurement precision
If the computing device controls multiple displays based on location information, then the precision of display control is improved, but the quantity of processing requirements increases
Solution Approach 1:
The system segments the processing tasks between the remote-controller and the computing device. The remote-controller performs the computationally intensive SLAM algorithm and environmental mapping, while the computing device receives the resulting location information and handles display control logic. This segmentation allows each component to specialize in its optimal processing tasks, improving overall efficiency.
Data Source
AI summary
A remote-control system, a remote-controller, and a remote-control method are provided. The remote-control method includes: obtaining environmental image data by an image capture device of a remote-controller; building a map according to the environmental image data based on simultaneous localization and mapping (SLAM) algorithm, and obtaining first location information of a first display in the map according to the environmental image data by the remote-controller; and receiving the first location information from the remote-controller and controlling the first display according to the first location information by a computing device.