3D Pointing via Light Tracking and Relative Position Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D pointing devices are primarily relative pointing devices, relying on motion sensors and often incorporating imaging devices within the pointing device, which limits their ability to utilize console computing power and display surface imaging capabilities, leading to reduced effectiveness and inconvenience, especially when the pointing device leaves and reenters the display surface boundary.
Innovation Solution
A direct pointing system that leverages the computing power of a console and the imaging capabilities of a display surface, using a pointing/input device with a light source and motion sensor module, where the computing device processes images from one or more imaging devices to accurately calculate the light source's position and motion, ensuring the displayed pointer always coincides with the aimed point, even when the pointing device crosses the display surface boundary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a motion sensor module is used to provide relative position information, then the pointing device can determine its movement, but the displayed point does not always coincide with the aimed point when the device leaves and reenters the display surface boundary
Solution Approach 1:
An imaging device is introduced as an intermediary to capture images of the display surface and determine the aimed point's location. This mediator bridges the gap between the pointing device's motion sensor data and the actual display surface coordinates, enabling accurate direct pointing even when the device leaves and reenters the display boundary.
Solution Approach 2:
The patent replaces the traditional mechanical/relative motion sensing approach with an optical imaging approach. Instead of relying solely on motion sensors that provide relative displacement, the system uses an imaging device to directly capture the aimed point's position on the display surface, substituting mechanical measurement with optical field-based measurement.
2Measurement precision
If an imaging device is included in the pointing device to capture display surface images, then the aimed point can be precisely identified, but the system cannot fully utilize console computing power and requires high-bandwidth wireless transmission
Solution Approach 1:
The imaging function is extracted from the pointing device and relocated to the display surface or console system. Instead of requiring the pointing device to contain an imaging device, the system uses the display surface's own imaging capabilities or the console's imaging resources, thereby reducing the pointing device's complexity while maintaining accurate aimed point identification.
Solution Approach 2:
The display surface or console imaging system serves multiple functions: it displays content and simultaneously captures images of the aimed point. This multi-functionality eliminates the need for dedicated imaging devices in the pointing device, reducing overall system complexity while maintaining precise positioning capabilities.
3Measurement precision
If compensation techniques are used to correct the difference between aimed point and displayed point, then some accuracy can be improved, but the effectiveness is reduced because the location of the pointing device relative to the display surface is not known
Solution Approach 1:
The imaging device provides real-time feedback by capturing images of the display surface and determining the aimed point's location. This feedback loop allows the system to continuously update and correct the displayed point's position, ensuring it always coincides with the aimed point regardless of the device's movement or position relative to the display surface.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for more flexible and accurate direct pointing, utilizing the full computing power of the console and display surface imaging, providing consistent and intuitive pointing performance without the need for high-bandwidth wireless transmission or additional imaging devices on the pointing device.
Implementation Method 1
an imaging device such as an infrared (IR) camera 32 may be included in the pointing device 2 whereby images of light emitted by light sources 34 in a sensor bar 36 are used
Data Source
AI summary
A computing system for direct three-dimensional pointing includes at least one computing device, and a pointing/input device including at least one light source and a motion sensor module for determining absolute and relative displacement of the pointing/input device. At least one imaging device is configured for capturing a plurality of image frames each including a view of the light source as the pointing/input device is held and/or moved in a three-dimensional space. Two or more imaging devices may be provided. A computer program product calculates at least a position and/or a motion of the light source in three-dimensional space from the plurality of sequential image frames and from the pointing/input device absolute and relative displacement information, and renders on the graphical user interface a visual indicator corresponding to the calculated position and/or the motion of the light source. Methods for direct three-dimensional pointing and command input are described also.