Universal Pointing Device for AR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems, especially those using handheld devices, are cumbersome and uncomfortable for users due to the need to hold the device at eye level, causing distraction and lack of intuitive pointing and interacting capabilities with objects in the surroundings.
Innovation Solution
A universal pointing and interacting (UPI) device with an elongated shape, equipped with electronic components like a camera, LIDAR (optional), accelerometer, magnetometer, and communication modules, allowing users to point at objects and interact with them by providing information or activating them, using data from the device and accessible databases to identify and triangulate location parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If simplified AR applications on handheld devices are used, then commercial penetration is improved, but user comfort and intuitiveness deteriorate due to the need to hold the device at eye level
Solution Approach 1:
The system is divided into two separate components: a handheld device for viewing AR content and a separate UPI device for pointing and interaction. This segmentation allows the viewing function to remain on the handheld device while the pointing function is transferred to a more comfortable, wand-like device that can be held at a natural angle.
Solution Approach 2:
The UPI device acts as an intermediary between the user and the AR system. It transmits pointing data (orientation, azimuth, location parameters) wirelessly to the handheld device, enabling interaction with AR objects without requiring the user to hold the handheld device at an uncomfortable eye level position.
2Adaptability or versatility
If simplified AR applications on handheld devices are used, then commercial penetration is improved, but intuitiveness of pointing and interacting capabilities deteriorates
Solution Approach 1:
Instead of using the handheld device screen as both the viewing surface and the pointing interface, the system inverts this approach by using a separate UPI device for pointing. This allows the pointing action to occur naturally in 3D space while the screen remains solely for viewing, making the interaction more intuitive.
Solution Approach 2:
The pointing interaction is moved from the 2D screen surface to 3D physical space. The UPI device captures orientation, azimuth, and location parameters in three dimensions, allowing users to point at AR objects in their natural spatial environment rather than constraining interaction to the flat screen surface.
3Adaptability or versatility
If handheld devices are held at eye level for AR viewing, then AR functionality is enabled, but user distraction from immediate surroundings increases
Solution Approach 1:
By separating the viewing function (handheld device) from the interaction function (UPI device), users can hold the UPI device at a comfortable, lower angle while maintaining AR functionality. This reduces the need to hold the device at eye level, thereby reducing distraction from the immediate surroundings.
4Device complexity
If current AR systems use handheld devices for both viewing and interaction, then device complexity is reduced, but pointing precision and interaction accuracy deteriorate
Solution Approach 1:
The system segments the AR functionality into viewing (handheld device) and precise pointing (UPI device). The UPI device is specifically optimized for pointing precision with its elongated shape, orientation sensors, and azimuth measurement capabilities, while the handheld device focuses on display and processing.
Solution Approach 2:
Each device is optimized for its specific function: the UPI device has local quality features for precise pointing (elongated shape, orientation sensors at the tip) while the handheld device has features for viewing and processing. This specialized design improves pointing precision without requiring either device to be overly complex.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The UPI device enables comfortable and intuitive interaction with objects, reducing user distraction and improving accuracy in identifying and activating objects, while leveraging existing databases for location and visual data to enhance pointing precision.
Implementation Method 1
a camera (110) positioned at the tip (102) and facing the frontal direction, configured to capture at least one image
Implementation Method 2
a LIDAR (115) positioned at the tip (102) and facing the frontal direction, configured to measure distances
Implementation Method 3
an accelerometer (122) configured to measure acceleration parameters
Implementation Method 4
a magnetometer (124) configured to measure magnetic field parameters
Implementation Method 5
a gyroscope (126) configured to measure angular velocity parameters
Data Source
AI summary
Location services in handheld devices provide the user with information about objects of interest in the user's surroundings, which require identifying the location of the user and identifying the locations of objects of interest in the surroundings. This invention describes a novel approach in providing location services, by employing a universal pointing and interacting (UPI) device to identify objects of interest in the surroundings pointed at by the UPI device. Once an object of interest is identified, the UPI device may further be used to provide the user with information about the identified object, or to activate the identified object by the user of the UPI device.