Method for simulating mouse input and device thereof

Abstract

The invention provides a method for simulating mouse input and a device thereof. The method comprises the following steps: acquiring images containing a main image; identifying the main image of the acquired images, and determining the coordinates of the identified main image in the acquired images; determining the output coordinates of the simulated mouse according to the coordinates of the determined main image; and generating and outputting a mouse clicking command according to a detected vibration or / and sound signal for simulating mouse clicking. The device comprises an image acquisition module (11), an image processing module (12), a vibration acquisition module (13) / sound acquisition module (15), a vibration processing module (14) / sound processing module (16) and a target determination module (17). By using the method and the device, object images can be acquired by utilizing an equipment camera to realize flexibility and convenience of mouse operation on various electronic devices, in particular mobile electronic devices.

Description

technical field [0001] The invention provides a human-computer interaction technology related to a virtual reality system, in particular a method and device for simulating mouse input. Background technique [0002] With the rapid development of electronic equipment nowadays, the interaction between man and machine is becoming more and more frequent. Traditional human-computer interaction devices such as mice and keyboards have certain limitations in ergonomic design. Long-term use will cause human muscle fatigue and even muscle damage. Moreover, for mobile devices, mice and keyboards are undoubtedly a kind of burden. Although the touch screen solves the problem of inconvenient portability of the mouse and keyboard to a certain extent, there is a problem that the screen needs to be blocked during operation. [0003] In order to solve this problem, video recognition technology is introduced into the field of human-computer interaction. For example, the Chinese patent applic...

AI Technical Summary

Problems solved by technology

[0005] In view of this, the main purpose of the present invention is to provide a method and device for simulating mouse input, to solve the problem of fingers blocking the screen when operating on the touch screen and to realize the purpose of manufacturing such devices with small volume and low cost

Images