Non-contact type intelligent inputting method based on video images and device using the same

Abstract

The invention discloses an interactive intelligent inputting method based on video images. The interactive intelligent method based on the video images is capable of enabling a user to achieve non-contact type operations. Through collecting information like motion paths, speed and acceleration of two hands of the user, the input function of an entity keyboard is achieved, and the collected information is outputted in the mode of characters for upper layer software to invoke and achieve customized application. The non-contact type intelligent inputting method based on the video images is capable of further achieving dynamic adjustment of the operation range of the virtualized keyboard according to the change of the motion range of the two hands of the user. When the two hands of the user are arranged in the working area of an image collection device, a displaying device displays the relative positions of the virtualized keyboard and virtualized fingers of the user, the user can achieve the corresponding operations of the buttons of the virtualized keyboard through the pressing actions of the fingers. In view of being compatible with habits of pressing the keyboard of all kinds of users, the device using the interactive intelligent method based on the video images provides a supervising function of the inputting of the virtualized keyboard, and corrects differences of accuracy brought by all kinds of actions which are not the keyboard inputting action. The non-contact type intelligent inputting method based on the video images is characterized in that a user does not need any auxiliary positioning areas and auxiliary positioning objects for inputting, and the inputting action can be achieved at any position inside the working area of the image collection device. The interactive intelligent method based on the video images is low in cost, wide in applicability, and intelligently interactive. The invention further provides the realizing device based on the interactive intelligent method based on the video images.

Description

technical field [0001] The invention relates to the field of non-contact intelligent input, in particular to a non-contact intelligent input method and device based on video images Background technique [0002] With the rapid development of smart TVs, smart phones and other fields, touch screens have penetrated into every corner of society. Excellent user interaction experience greatly enhances the added value and technological content of products in the consumer field, providing more differentiated and intelligent experiences. Currently, two mainstream virtual input methods are soft keyboards and additional keyboards. Most of the smart phones (such as Apple's iPhone series) use touch screens to draw the shape of a virtual full keyboard as a medium for user input. This input method has also been applied and promoted in portable devices such as tablet computers, but this technology requires the support of touch screen technology, and there is still a gap between the accurac...

AI Technical Summary

Problems solved by technology

In addition to the above two types of virtual input methods, there are also virtual input methods based on camera and video image processing, but the existing methods based on video processing impose various restrictions on the user's usage methods, and some methods require an auxiliary positioning object , such as a template with keyboard keys or paper containing printed images of keyboard keys

Some methods do not need objects for auxiliary positioning, but still need to have a fixed support surface, such as a table (see related patent documents CN1439151A, US5767842), this requirement for auxiliary positioning objects and working surfaces does not meet the needs of users in some occasions For example, for TV users, many users like to lean on sofas or chairs in a comfortable and casual posture to watch their favorite program content. If a table or other plane is needed to realize data input, the user experience will be reduced.

Images