Human-computer interaction device and method adopting eye tracking in video monitoring

Abstract

The invention belongs to the technical field of video monitoring and in particular relates to a human-computer interaction device and a human-computer interaction method adopting human-eye tracking in the video monitoring. The device comprises a non-invasive facial eye image video acquisition unit, a monitoring screen, an eye tracking image processing module and a human-computer interaction interface control module, wherein the monitoring screen is provided with infrared reference light sources around; and the eye tracking image processing module separates out binocular sub-images of a left eye and a right eye from a captured facial image, identifies the two sub-images respectively and estimates the position of a human eye staring position corresponding to the monitoring screen. The invention also provides an efficient human-computer interaction way according to eye tracking characteristics. The unified human-computer interaction way disclosed by the invention can be used for selecting a function menu by using eyes, switching monitoring video contents, regulating the focus shooting vision angle of a remote monitoring camera and the like to improve the efficiency of operating videomonitoring equipment and a video monitoring system.

Description

technical field [0001] The invention belongs to the technical field of video monitoring, and in particular relates to a human-computer interaction device and method for controlling by visual tracking. Background technique [0002] In the existing field of video surveillance, the monitoring video captured by all the cameras in the video surveillance network is often collected and recorded through the monitoring command room. According to the needs of users, adjust the operating console to control the camera's shooting angle, focus adjustment, video zoom, video matrix switching, menu selection and other functions. With the increasing amount of monitoring data and the increasing number of remote camera connections, the user's operation skills, intensity and difficulty are increasing. At the same time, with the increase of monitoring pictures, sometimes users even need to frequently view hundreds of real-time monitoring pictures. Switching back and forth in the selection, and i...

AI Technical Summary

Problems solved by technology

When these devices are in use, they need to be worn on the user's head or face, which is not human-machine friendly, especially in the case of multiple users or frequent replacement of operators, it is necessary to re-wear the human eye Cumbersome steps like image capture device, position recalibration, etc.

At the same time, the current technology also lacks a human-computer interaction interface designed for the characteristics of eye-tracking, especially in the field of video surveillance where multiple users need to use eye-tracking devices for a long time, and users often cannot use intrusive image acquisition methods for a long time. Enduring wearing the acquisition device for a long time and controlling it through the line of sight, although the high-strength operation table was partially solved, the inventor also discovered some problems existing in the current technology:

[0004] 1. Wearable image acquisition equipment is not very human-machine friendly, and it is difficult for users to wear it for a long time

[0005] 2. In video surveillance, the related technology of human-computer interaction interface for eye-tracking has not yet fully utilized the display resources of the surveillance screen

[0006] 3. The existing technology cannot fully use the line of sight trajectory path as a method of input information

[0007] 4. The linkage between eye-tracking operation and surveillance camera control is not strong, and the user experience is not intuitive enough

Images