Method and device for determining drop point position of eyes of operator on screen of terminal equipment

Abstract

The invention provides a method and a device for determining a drop point position of eyes of an operator on a screen of terminal equipment, the method and the device are suitable for a terminal equipment control scene, and the method comprises the following steps: generating a virtual space including an operator eye model and a terminal equipment model according to a collected image of the operator; recording a corresponding relationship between different concerned positions of a screen of the terminal equipment model and feature information of the operator eye model when the operator eye model pays attention to the screen of the terminal equipment model in the virtual space; and according to the human eye feature information in the image of the operator and the corresponding relationship, determining a drop point position of the eye of the operator on the screen of the terminal equipment, so that the terminal equipment generates a control instruction according to the drop point position. According to the method, the requirement on the performance of the image acquisition equipment of the terminal equipment is low, the method is not influenced by the environment, and the terminal equipment is accurately controlled by the eyes of an operator under the condition that manual operation is not needed.

Description

technical field [0001] This article relates to a device control method, and in particular to a method and device for determining the position of an operator's gaze on a screen of a terminal device. Background technique [0002] With the development of society, terminal equipment plays a very important role in people's life and work, and the control methods of the latest terminal equipment mainly include capacitive screen induction control, voice command (voice assistant) control, and gesture control based on the front camera. Wait. Although the above control methods can control the terminal equipment, they all have certain limitations, which are specifically reflected in: [0003] 1. For the method of capacitive screen sensing control: when the weather is cold or the hands are occupied, the control effect of the terminal device will be affected; [0004] 2. For the way of voice command control: command recognition is not accurate in noisy environments, it is not suitable f...

AI Technical Summary

Problems solved by technology

[0006] This article is used to solve the problem that in the prior art, the landing position on the screen of the terminal device and the control of the terminal device are realized by the operator's manual control and voice control, and there is a problem that the user experience will be affected by the environment, for example, the environment is too cold, making The operator cannot control the terminal equipment by hand

Images