HMD Camera Tracking With Dual Exposure for Synchronous Gamepad DoF
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing localization and tracking technologies for head-mounted display devices and gamepads require additional sensors like electromagnetic or ultrasonic sensors, leading to high power consumption, poor stability, and high costs, and cannot synchronize tracking between the two devices using a single camera.
Innovation Solution
A method and platform that utilizes a head-mounted display device equipped with tracking cameras to collect images with different exposure durations to determine the Degree of Freedom (DoF) information of both the device and gamepad, using a Simultaneous Localization and Mapping (SLAM) algorithm and Inertial Measurement Units (IMUs) for precise tracking without additional hardware.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If electromagnetic sensors or ultrasonic sensors are arranged on the gamepad, then localization and tracking of the gamepad can be realized, but power consumption increases and system complexity increases
Solution Approach 1:
The patent merges the tracking functions for both the head-mounted display device and gamepad into a single camera system. The camera collects images with different exposure durations to simultaneously track both devices, eliminating the need for separate sensors on each device and thereby reducing overall power consumption and system complexity.
Solution Approach 2:
The single camera system performs multiple functions: it tracks the head-mounted display device using one exposure duration and tracks the gamepad using a different exposure duration. This multi-functional approach replaces what would traditionally require separate specialized sensors for each tracking task.
2Adaptability or versatility
If infrared cameras or depth cameras are added on the head-mounted display device for bare-hand tracking, then bare-hand tracking is enabled, but device complexity and cost increase
Solution Approach 1:
The existing camera system is made multi-functional by using different exposure durations for different tracking tasks. The same camera hardware that tracks the head-mounted display device can also track the gamepad and bare hands by adjusting exposure parameters, eliminating the need for additional infrared or depth cameras.
Solution Approach 2:
The patent changes the exposure duration parameter of the camera to adapt to different tracking scenarios. By collecting images with different exposure durations, the system can optimize for different objects (head-mounted device, gamepad, bare hands) without changing the hardware, only adjusting the exposure parameter.
3Reliability
If separate tracking systems are used for head-mounted display device and gamepad, then each device can be tracked independently, but synchronous tracking cannot be realized and system cost increases
Solution Approach 1:
The patent combines the tracking of the head-mounted display device and gamepad into a single unified camera-based system. By collecting images with different exposure durations from the same camera, the system achieves synchronous tracking of both devices, maintaining tracking reliability while reducing system complexity and eliminating the need for multiple independent tracking systems.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables synchronous tracking of the head-mounted display device and gamepad, reducing power consumption and improving user experience by utilizing the same hardware for both, while maintaining accuracy and robustness.
Implementation Method 1
one or more images of odd frames that are collected with a preset first exposure duration by one or more tracking cameras arranged on a head-mounted display device as well as one or more images of even frames that are collected with a preset second exposure duration by the one or more tracking cameras
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
Embodiments of the present disclosure provide a localization and tracking method, a localization and tracking platform, a head-mounted display system, and a computer-readable storage medium. The method includes that: one or more images of odd frames that are collected with a preset first exposure duration by one or more tracking cameras arranged on a head-mounted display device as well as one or more images of even frames that are collected with a preset second exposure duration by the one or more tracking cameras arranged on the head-mounted display device are acquired, the one or more images of even frames at least containing blobs corresponding to multiple luminous bodies arranged on a gamepad, and the gamepad being in communication connection with the head-mounted display device (S201); Degree of Freedom (DoF) information of the head-mounted display device is determined according to the one or more images of odd frames and attitude information of the head-mounted display device (S202); and DoF information of the gamepad is determined according to the one or more images of even frames, attitude information of the gamepad, and the DoF information of the head-mounted display device (S203).