Inside-Out Controller Position Estimation for Wearable HMDs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current position estimation technologies for users wearing Head Mounted Displays (HMDs) rely heavily on external cameras, while controllers used with these systems are not adequately developed for inside-out type tracking, limiting user mobility and requiring external camera recognition.
Innovation Solution
An information processing apparatus and method that includes a user-position estimating unit on the HMD and a controller-position estimating unit on the controller, both using internal cameras to capture images and estimate positions relative to recognized environment information, eliminating the need for external cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If an outside-in type tracking system using an external camera is used for position estimation, then position estimation accuracy is improved, but device complexity and cost increase due to requiring external cameras
Solution Approach 1:
The patent inverts the conventional outside-in tracking approach by implementing an inside-out tracking system where the HMD's internal camera captures images of the controller and environment. The controller includes a light emitting unit that emits light recognizable by the HMD's camera, enabling the HMD to track the controller's position and posture without requiring external cameras.
Solution Approach 2:
The HMD system performs self-service by using its own internal camera and processing units to execute both environment mapping and controller position estimation. The system leverages its existing resources (camera, processor) to achieve tracking functionality that previously required external dedicated devices.
2Measurement precision
If an outside-in type tracking system with external camera is used, then position estimation is achieved, but user mobility is limited due to external camera requirements
Solution Approach 1:
By inverting the tracking architecture to inside-out type, the system eliminates external camera requirements that constrained user movement. The HMD's internal camera continuously captures the controller and environment, allowing the user to move freely without being limited by external camera placement or line-of-sight constraints.
3Adaptability or versatility
If controllers are designed for outside-in type tracking, then compatibility with external camera systems is achieved, but adaptability to inside-out type systems is insufficient
Solution Approach 1:
The controller is designed with multi-functionality to be compatible with both outside-in and inside-out tracking systems. It includes a light emitting unit for inside-out tracking and can work with external cameras for outside-in tracking. The controller's processor executes multiple types of position estimation algorithms, making it universally applicable to different tracking methodologies.
Data Source
AI summary
There is provided an information processing apparatus and an information processing method capable of performing position estimation of a controller corresponding to a wearable device having an inside-out type. The information processing apparatus includes a user-position estimating unit that recognizes, based on a first captured image that is captured by a first image capturing unit provided to a wearable device mounted on a user, peripheral environment information of the user to execute position estimation of the user in a real space and a controller-position estimating unit that executes, based on a second captured image captured by a second image capturing unit that is provided to a controller being operated by the user, position estimation of the controller with reference to the recognized environment information.