Projected User Interface Invisible Cursor Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The limited size of user device displays, such as mobile phones and PDAs, restricts the size and functionality of user interfaces, making it difficult to interact with content effectively, especially when trying to perform precise operations like scrolling, selecting, or navigating menus.
Innovation Solution
A method and apparatus that project a user interface onto a surface using a projector and capture an invisible cursor emitted by a pointer device, such as an infrared laser, allowing the user device to determine the cursor's position and generate a visible cursor for interaction, enabling precise control and navigation through the projected interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the display size of user devices is increased, then the user interface size and interaction capability are improved, but the portability and compactness of the device deteriorate
Solution Approach 1:
The patent projects the user interface from the two-dimensional device display onto a three-dimensional external surface, allowing the interface to extend beyond the physical boundaries of the device. This enables a large display area while maintaining device compactness, as the projection can cover walls, tables, or other surfaces in the environment.
Solution Approach 2:
The patent introduces a camera as an intermediary to capture the projected interface and track the pointer position. The camera acts as a mediator between the projection system and the control system, enabling the device to detect cursor position and user interactions on the projected interface without requiring a large physical display.
2Measurement precision
If a visible cursor is projected to improve user interaction, then the precision of cursor detection is improved, but the visibility of projected content is reduced
Solution Approach 1:
The patent applies different optical properties to different parts of the projection system. The cursor is projected with higher intensity or different wavelength (infrared) compared to the general interface content, making it detectable by the camera while maintaining content visibility. This local differentiation allows precise cursor detection without compromising overall interface visibility.
Solution Approach 2:
The patent utilizes different wavelengths or intensities of light for the cursor versus the interface content. The cursor may be projected in infrared or a distinct color range that the camera can detect, while the interface content remains in the visible spectrum. This spectral differentiation enables simultaneous optimization of cursor precision and content visibility.
3Illumination intensity
If an invisible cursor is used to maintain projected content visibility, then the visibility of projected content is improved, but the precision of cursor detection deteriorates
Solution Approach 1:
The patent applies different optical properties to different parts of the projection system. The cursor is projected with higher intensity or different wavelength (infrared) compared to the general interface content, making it detectable by the camera while maintaining content visibility. This local differentiation allows precise cursor detection without compromising overall interface visibility.
Solution Approach 2:
The patent utilizes different wavelengths or intensities of light for the cursor versus the interface content. The cursor may be projected in infrared or a distinct color range that the camera can detect, while the interface content remains in the visible spectrum. This spectral differentiation enables simultaneous optimization of cursor precision and content visibility.
4Measurement precision
If mapping between projected coordinate space and device coordinate space is implemented, then the accuracy of input operations is improved, but the system complexity increases
Solution Approach 1:
The patent performs coordinate space mapping and calibration in advance, before actual user interactions occur. By pre-establishing the transformation relationships between projected coordinates and device coordinates, the system avoids complex real-time calculations during interaction, reducing operational complexity while maintaining accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution allows users to interact with projected user interfaces on larger surfaces with high precision, overcoming the limitations of small device displays by providing a visible cursor that corresponds to the invisible cursor, enabling intuitive and accurate control of on-screen elements like scrolling, selecting, and multi-touch operations.
Implementation Method 1
projecting a content associated with a user device
Implementation Method 2
receiving, by the pointer device, the input; and transmitting, by the pointer device, the input to the user device, wherein the pointer device corresponds to an infrared laser pointer device
Implementation Method 3
A camera is used to capture the image of the projected computer output
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
A method including projecting a content associated with a user device; receiving a projected content including an invisible cursor content; determining a position of the invisible cursor content with respect to the projected content; outputting a visible cursor having a position in correspondence to the invisible cursor content; receiving an input from a pointer device; mapping a position of a visible cursor content to the content; and performing an input operation that interacts with the content and corresponds to the input from the pointer device and the position of the visible cursor content.