Real time human-machine interaction method and system based on moving detection of hand held equipment

Abstract

The invention discloses a real-time human-computer interaction method based on the motion detection of hand-held devices. The method comprises the following steps: videos gathered by the hand-held devices are pretreated to obtain blocking image frames; all blocks of the blocking image frames carry on the motion vector search and are marked by an effective motion vector classifier, thus obtaining effective local motion vector; according to the local motion vector, the global motion vector is obtained; according to the global motion vector and corresponding interactive instructions, the human-computer interaction is carried out. The invention also discloses a real-time human-computer interaction system based on the motion detection of the hand-held devices. The interaction method and the interaction system provided by the invention accurately analyze bi-dimensional global motion vector, understand the movement of devices and then complete the human-computer interaction method with operation being determined by controlling equipment movement by a user and the analysis on the shot video by the hand-held devices, which can complete the real-time, accurate interaction applications and have naturality, understandability for the user.

Description

technical field [0001] The invention relates to the technical fields of digital image processing and computer vision, in particular to a real-time human-computer interaction method and system based on motion detection of a handheld device. Background technique [0002] At present, video-based motion detection technology has been more and more widely used. Researchers have proposed many detection methods for specific target motion, but so far there is no existing method that can universally solve different resolutions. Problems with motion detection in videos of different capture qualities (especially low resolution and low quality capture devices). From the perspective of the development of motion detection, it mainly includes the detection of partial area motion of each frame in the video and the global motion or camera motion detection of the image background. The former is widely used in the field of video compression and distribution, and the latter is mainly used in th...

AI Technical Summary

Problems solved by technology

[0014] The problem to be solved by the embodiments of the present invention is to provide a real-time human-computer interaction method and system based on motion detection of handheld devices to overcome the defects of limited data input methods and poor naturalness of user interaction in the prior art

Images