Typing method and device based on virtual keyboard

Abstract

The invention provides a typing method and device based on a virtual keyboard. The method relates to the technical field of input methods, and comprises the steps of: obtaining an eye image of a user,and recognizing the current motion state of the eyes of the user according to the area proportion and position information of a target object in the eye image, wherein the motion state comprises a monocular motion state and a binocular motion state; based on the current motion state or the combined motion state, determining operation information with a corresponding mapping relationship, the combined motion state comprising the current motion state and a preset number of historical motion states, and the operation information comprising at least one operation instruction; according to the operation information, executing corresponding typing operation on the virtual keyboard, and typing different operation information in through the eye movement state. The method can flexibly adapt to multiple application scenes, and accurate typing is achieved.

Description

technical field [0001] The invention relates to the technical field of input methods, in particular to a virtual keyboard-based input method and device. Background technique [0002] With the development of science and technology, devices and scenarios involving user interaction are more and more widely used, and the user's information instructions are generally input through the keyboard. However, in some special application scenarios, it is inconvenient for the user to directly touch the keyboard to input information due to health and safety considerations. [0003] In order to solve the above-mentioned problems, nowadays, voice input is generally used to realize non-contact keying, that is, the user inputs voice information instead of manually typing instructions. However, due to the limitations of this method, it cannot be applied in many application scenarios. For example, if the user's pronunciation is not standard, there are dialects, or in a relatively noisy applica...

AI Technical Summary

Problems solved by technology

However, due to the limitations of this method, it cannot be applied in many application scenarios. For example, if the user's pronunciation is not standard, there are dialects, or in a relatively noisy application environment, it often results in the inability to achieve accurate input, which in turn brings trouble to the user. Inconvenient to come, poor experience

Images