Optical Input Detection via Surface Structure Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for controlling display functions on electronic devices, such as tablets and touchscreens, are limited in capturing three-dimensional touch gestures and orientations, particularly in capturing movements around all three axes (roll, tilt, and inclination) using special input devices or fingers.
Innovation Solution
A method that captures an image sequence of a surface structure of an input object on a touchscreen from the side facing away from the user, recognizes patterns, and determines the orientation and position of the input object by analyzing changes in the pattern, allowing for control of display functions through motion vectors, enabling any object with a suitable surface structure to be used as an input device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If special input devices with sensors (accelerometer, gyro sensor, optical and magnetic) are used to capture 3D orientation and movement, then measurement precision of input device orientation is improved, but device complexity increases
Solution Approach 1:
The patent replaces complex mechanical sensor systems (accelerometers, gyro sensors, magnetic sensors) with an optical recording apparatus that captures images of the input device's surface structure. The computing unit then determines orientation and position by analyzing these images, eliminating the need for embedded sensors in the input device while achieving comprehensive 3D movement capture.
Solution Approach 2:
Instead of using sensors to directly measure physical quantities, the system creates optical copies (images) of the input device's surface structure. The recording apparatus captures visual information about the input device's position, orientation, and movement, which the computing unit then processes to determine spatial parameters, replacing direct physical measurement with optical replication and analysis.
2Ease of operation
If inductive methods with magnetic fields and coils are used to detect input device orientation, then ease of operation is improved, but measurement precision of three-dimensional orientation (roll, tilt, inclination) deteriorates
Solution Approach 1:
The patent transitions from two-dimensional magnetic field detection (which can only detect orientation in specific planes) to three-dimensional spatial detection by capturing images from the rear side of the display. The recording apparatus observes the input device from a different dimensional perspective, enabling accurate detection of roll, tilt, and inclination angles simultaneously by analyzing the surface structure in 3D space.
3Ease of operation
If force sensors are used to capture touch inputs and gestures, then ease of operation is improved, but adaptability to different input objects deteriorates
Solution Approach 1:
The patent creates a universal input system that works with any object having a distinguishable surface structure, not just fingers or specialized styluses. The recording apparatus captures optical information from any input object, and the computing unit analyzes the surface structure patterns to determine orientation and position, making the system adaptable to fingers, styluses, tokens, or any other objects with detectable surface features.
4Ease of operation
If tokens with barcodes are used for parameter adjustment, then ease of operation is improved, but device complexity increases due to special input medium requirements
Solution Approach 1:
The patent extracts the identification function from specialized tokens with barcodes and integrates it directly into the input device's surface structure. Instead of requiring separate tokens that must be applied to the screen, the input device itself carries distinguishable surface structure patterns that can be continuously observed and analyzed by the recording apparatus, eliminating the need for separate identification media.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method allows for 3D input with all degrees of freedom (rotation, translation, and pressure) using any object with a non-reflecting surface, eliminating the need for a dedicated input device and enabling new operating approaches, while ensuring secure input control through authorized patterns.
Implementation Method 1
Capturing images of an image sequence of a surface structure of an input object in an input region on a user-facing side of a screen surface
Data Source
AI summary
A method controls a display function of a display apparatus by any input object by a touchscreen. A camera of a recording apparatus creates an image sequence of a user-facing screen surface of the display apparatus. In images of the image sequence, a computing unit of the recording apparatus tracks when the input object is tilted, inclined or rolled away relative to the screen surface. The computing unit searches for a pattern comprising a depth profile in a surface structure of the input object and evaluates a change in the image values relating to a contrast, the definition of the pattern, or, additionally or alternatively, a visible portion of the surface structure in the image sequence. From the change in the pattern or in the portion of the surface structure visible to the camera, the computing unit determines a motion vector of the input object to control the display function.