Stylus 3D Positioning via Bezel Image and Distance Sensor
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The limitations of direct touch operations with a stylus, such as distance constraints, restrict the diversity of control methods available for interacting with electronic devices, necessitating a more precise method for estimating stylus position relative to the display.
Innovation Solution
A stylus system equipped with an image capturing device and a distance sensor, which captures images of the display and detects the distance between the stylus and the display, allowing for the determination of the stylus's spatial position using the display bezel in the image and distance data, enabling enhanced control functions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a stylus is used for direct touch operation on the display, then the operation precision is improved, but the user must be close to the display which limits the distance between user and device
Solution Approach 1:
The patent transitions from 2D touch screen coordinates to 3D spatial positioning by incorporating depth information from the distance sensor. The stylus position is determined not just by X-Y coordinates on the screen but also by the Z-axis distance from the display surface, enabling spatial awareness and extended interaction zones beyond direct contact.
Solution Approach 2:
The patent introduces an image capturing device as an intermediary between the stylus and display. The captured image of the display bezel serves as a reference medium that enables the system to calculate spatial position indirectly through image processing and geometric relationships, rather than requiring direct physical contact.
2Ease of operation
If direct touch operation is used, then the control method is simple, but the diversity of control methods is limited
Solution Approach 1:
The patent enables the stylus to perform multiple functions beyond simple touch input. By detecting spatial position through image capture and distance sensing, the stylus can execute diverse control methods including gesture recognition, spatial-based commands, and contextual interactions that adapt to different usage scenarios and display orientations.
Solution Approach 2:
The patent introduces dynamic control capabilities where the stylus can detect not only position but also movement patterns, orientation, and spatial relationships. This enables adaptive control methods that respond to user gestures and motions, transforming the static touch interface into a dynamic spatial interaction system.
3Measurement precision
If an image capturing device and distance sensor are added to the stylus, then the spatial position estimation accuracy is improved, but the device complexity increases
Solution Approach 1:
The patent combines the image capturing device and distance sensor into a single integrated stylus unit. By merging these sensing components with the stylus tip, the system achieves coordinated data collection where the image provides contextual spatial references and the distance sensor provides direct depth measurement, working together to calculate precise 3D position.
Solution Approach 2:
The stylus performs self-positioning by using its own captured image of the display bezel as a reference frame. The image capturing device autonomously acquires spatial information without requiring external calibration equipment or additional infrastructure, enabling the stylus to independently determine its position relative to the display.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for more diverse and precise control methods by accurately determining the stylus's spatial position relative to the display, enabling interactions beyond traditional touch operations, such as gesture-based commands and 3D object manipulation.
Implementation Method 1
An image is captured towards a display through an image capturing device disposed on a stylus
Implementation Method 2
A distance between the stylus and the display is detected through a distance sensor disposed on the stylus
Data Source
AI summary
A method for estimating stylus position and a stylus are provided. The method includes the following operation. An image is captured towards a display through an image capturing device disposed on a stylus. A distance between the stylus and the display is detected through a distance sensor disposed on the stylus. A display bezel of the display in the image is detected. A spatial position of the stylus relative to the display is determined according to the display bezel in the image and the distance.