Augmented Keyboard Key Generation via Computer Vision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face inefficiencies and negative experiences due to broken or missing keyboard keys, as well as differences in preferred and accessed keyboard layouts, leading to reduced productivity and efficiency.
Innovation Solution
A computing system uses machine learning computer vision image processing to identify missing or defective keys and generate augmented versions, which are displayed on a user's device for selection, allowing users to execute key functions and adapt to different keyboard layouts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If an on-screen keyboard or external keyboard is used as a workaround for broken keys, then the keyboard functionality can be maintained, but the user efficiency and productivity are reduced
Solution Approach 1:
The patent creates a virtual copy of the missing or broken keyboard key on the touchscreen display. This virtual key replicates the functionality of the defective physical key, allowing users to access the same character or function without using workarounds like on-screen keyboards. The virtual key is positioned to correspond with the location of the missing physical key, maintaining the familiar keyboard layout and enabling efficient typing.
2Adaptability or versatility
If a different keyboard layout is used due to travel or flexible seating, then accessibility is maintained, but the user experience and productivity are negatively affected
Solution Approach 1:
The system dynamically adapts the virtual keyboard overlay to match the user's preferred keyboard layout. When a user connects their keyboard, the system detects the layout type (e.g., QWERTY, Dvorak, AZERTY) and configures the virtual keys accordingly. This dynamic adaptation allows users to maintain their preferred typing layout regardless of the physical keyboard being used, preserving productivity and user experience across different environments.
3Measurement precision
If machine learning computer vision is used to identify missing keys, then automatic detection accuracy is improved, but the system complexity increases
Solution Approach 1:
The patent replaces manual inspection or simple sensor-based detection with machine learning computer vision algorithms. The system uses image processing to capture and analyze the keyboard layout, automatically identifying missing or broken keys with high accuracy. This substitution of mechanical/direct detection methods with intelligent algorithms enables precise detection while the system manages the complexity through automated processing.
4Adaptability or versatility
If augmented keys are displayed on a separate user device rather than the keyboard itself, then the solution is versatile and works with different keyboard types, but the ease of operation is reduced
Solution Approach 1:
The patent merges the virtual keyboard overlay with the physical keyboard by positioning the virtual keys to visually align with the corresponding physical key locations. This spatial merging creates a unified interface where users can see both the physical key and its virtual counterpart in the same visual field, reducing the cognitive load and improving ease of operation. The system combines the tangibility of physical keys with the adaptability of virtual keys in a single integrated interface.
Data Source
AI summary
Methods and systems for augmented key generation are described herein. A computing system may receive, from a first user device, an image of a keyboard of a second user device. The computing platform may detect, based on the image, a first missing key of the keyboard, and may generate an augmented version of the first missing key. The computing platform may send, to the first user device, the augmented version of the first missing key and commands directing the first user device to display the augmented version of the first missing key, which may cause the first user device to display the augmented version of the first missing key. Selection of the augmented version of the first missing key on the first user device may cause display of a character, corresponding to the first missing key, to be displayed at the second user device.