Hardware and software typewriting input system for displaying position relation between fingers and keyboard on screen
By installing high-definition cameras and image processing technology on the keyboard, combined with deep learning algorithms, the interaction between the user's fingers and the keyboard is monitored in real time, and the error operation and accuracy problems in traditional keyboard input is solved, achieving a more efficient and accurate input experience.
Patent Information
- Application Number
- CN202510013708.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-06
- Publication Date
- 2025-03-07
AI Technical Summary
Traditional physical keyboards are prone to problems such as misoperation, difficulty in balancing input speed and accuracy, and key fatigue during use. The existing software-level input enhancement technology cannot effectively solve these physical problems.
The high-definition camera is used to capture the interaction between the user's fingers and the keyboard in real time, and combine image processing technology and deep learning algorithms to identify finger positions and characters input intent, correct misoperations in real time, and improve input accuracy and efficiency.
Through real-time misoperation detection and correction, the accuracy and speed of input can be improved, key fatigue is reduced, adapted to a variety of environments, and improved user experience.
Smart Images
Figure CN119576143A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of input devices and image processing technology, and in particular to a system that uses a camera and image processing technology to enhance the input experience of a traditional physical keyboard. The system can improve the recognition accuracy of a user when inputting on the keyboard, reduce input errors, and improve the user experience, and is particularly suitable for high-accuracy input and long-term input scenarios. Background Art
[0002] As one of the most common input devices, physical keyboards are widely used in computers, mobile phones, industrial control and other fields. Although traditional physical keyboards have good user acceptance in many scenarios, there are still some problems in actual use, such as misoperation, balance between input speed and accuracy, key fatigue, etc. Most of the existing input enhancement technologies are concentrated at the software level, such as automatic error correction, predictive input, etc. However, these software methods cannot solve the physical problems of the keyboard itself, such as accidental touches, mispresses, or too frequent key overlaps. Therefore, the present invention aims to monitor the interaction between the user's fingers and the physical keyboard in real time through the combination of camera deep learning algorithms and image processing technology, and enhance the key input process to improve input efficiency and accuracy. Summary of the invention
[0003] The purpose of the present invention is to provide a hardware and software typing input system, which can display the position relationship between fingers and keyboard on the screen in real time to improve the accuracy and efficiency of typing.
[0004] Technical solution: The technical solution of the present invention includes the following parts: Camera unit: At least one high-definition camera is used to capture the interaction between the user's fingers and the keyboard in real time. The camera is installed in a suitable position (such as above or on the side of the keyboard) to obtain the movement trajectory of the user's fingers and the contact information with the keyboard keys.
[0005] Image processing unit: Receives image data captured by the camera and performs image preprocessing, finger recognition and positioning. The image processing unit uses edge detection, feature extraction and other technologies to accurately identify the key position where the user's finger is located.
[0006] Input enhancement algorithm: Through deep learning or image matching algorithms, the finger movement is compared with the keyboard layout, the characters that the user intends to input are identified, and misoperation correction is performed in real time. For example, when it is detected that the user's finger does not fully contact the key, the system can automatically cancel the input or issue a prompt.
[0007] Real-time feedback unit: This unit displays the user's input content in real time through a display screen or other output devices, and provides feedback when necessary to help users quickly correct incorrect input.
[0008] System advantages: Real-time misoperation detection and correction: The system can identify the contact between fingers and keys in real time, correct mis-touch or mis-operation in time, and reduce input errors.
[0009] Improve input accuracy: Through camera and image processing technology, the system can accurately determine the position of fingers, reduce key overlap and mispresses, and improve input accuracy.
[0010] Improve input speed: By automatically predicting and identifying user intent, the system can improve input fluency and reduce the time for repeated corrections.
[0011] Adapt to a variety of environments: Whether in a bright office environment or a dark indoor environment, the system can maintain good performance without drastically changing the user's original input habits. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] . Figure 1 A schematic top view of the present invention; Figure 2 A schematic side view of the present invention; Figure 3 A functional diagram of the supporting software of the present invention; Reference numerals: 100. Camera; 200. Screen; 210. Software real-time feedback unit. DETAILED DESCRIPTION
[0013] .Camera unit: The system uses at least one high-definition camera installed above or on the side of the keyboard. The camera captures the interaction between fingers and keyboard in real time to obtain visual data in the input scene. The camera can capture every detail at a high frame rate to ensure that the contact between fingers and keys can still be accurately identified during high-speed input.
[0014] Image processing unit: After preprocessing, the image data obtained by the camera enters the image processing unit. The image processing unit uses edge detection and feature extraction algorithms to analyze the contact between the finger and the key position and generate coordinate information of the finger position. By comparing it with the standard keyboard layout, the user's current input target is determined.
[0015] Input enhancement and feedback mechanism: The system combines finger recognition and input algorithms to automatically determine the characters entered by the user and provide real-time feedback on the user's input content through the display screen. In addition, the system can automatically correct misoperations and provide prompts when necessary to ensure the accuracy of user input.
Claims
1. A hardware and software typing input system for displaying the position relationship between fingers and keyboard on a screen, comprising: Hardware: The system keyboard has more camera modules than traditional keyboards. The cameras are placed around the keyboard or in the gaps between the keys to capture the position of the user's fingers and the keyboard in real time. Software: Image capture, using camera drivers to capture video streams, and image processing libraries such as OpenCV to process real-time video streams; Image processing unit: image data is first pre-processed by denoising, graying, and other steps. Then, deep learning algorithms (such as convolutional neural networks), feature detection algorithms (such as edge detection, morphological operations, etc.), and tracking algorithms (such as Kalman filters or particle filters) are used to identify the specific positions of fingers and keyboards. The recognition process includes finger detection, trajectory analysis, and key recognition. Finally, the movement of the finger is mapped to the corresponding keyboard position. Input recognition and feedback mechanism: the system will recognize the characters that the user wants to input in real time based on the finger position and motion trajectory provided by the image processing unit. The system will provide real-time feedback on the user's input content through display devices (such as computer screens, projectors, etc.), and can also mark the current interaction status of the finger and keyboard on the screen to improve input accuracy and user operation feedback.
2. The system according to claim 1, characterized in that The camera is a high-definition camera and is arranged around the keyboard or in the gaps between keys.
3. The system according to claim 1, characterized in that The image processing unit uses a feature detection algorithm and a tracking algorithm to identify the contact between the user's fingers and the keyboard keys, and generates coordinate information of the contact between the fingers and the keys.
4. The system according to claim 1, characterized in that The deep learning algorithm and image matching technology can automatically determine the characters that the user intends to input based on the user's finger position, and correct incorrect operations in real time.
5. The system according to claim 1, characterized in that The real-time feedback unit displays the user input content in real time through the display screen, and provides real-time feedback when the input is wrong, including but not limited to visual prompts or sound prompts.
6. The system according to claim 1, characterized in that The system adapts to different ambient lighting conditions and can maintain good input recognition accuracy in bright and dark environments.
7. The system according to claim 1, characterized in that The system is suitable for efficient and high-accuracy input, and is particularly suitable for high-speed and accurate input requirements in computers, intelligent devices and industrial control systems.