Method and device for determining drop point position of eyes of operator on screen of terminal equipment

A technology for terminal equipment and determining methods, applied in the input/output process of data processing, input/output of user/computer interaction, image data processing, etc. problem, to achieve the effect of low performance requirements and precise control

Pending Publication Date: 2021-12-07
张也弛
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] This article is used to solve the problem that in the prior art, the landing position on the screen of the terminal device and the control of the terminal device are realized by the operator's manual control and voice control, and there is a problem that the user experience will be affected by the environment, for example, the environment is too cold, making The operator cannot control the terminal equipment by hand

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for determining drop point position of eyes of operator on screen of terminal equipment
  • Method and device for determining drop point position of eyes of operator on screen of terminal equipment
  • Method and device for determining drop point position of eyes of operator on screen of terminal equipment

Examples

Experimental program
Comparison scheme
Effect test

other Embodiment approach

[0071] In other embodiments, the process of determining the operator's human eye model includes:

[0072] S1, in the three-dimensional lattice model of each face of the operator (such as image 3 ), search and extract the operator's human eye feature information 401, it should be noted that the extracted human eye feature 401 is the same as the feature recognized by the face recognition software in the real image of the operator (such as Figure 4 As shown, it includes at least the dot matrix of the iris edge of the human eye, and these dot matrix are connected into a curve to form the iris edge curve), wherein, the three-dimensional dot matrix models of each face of the operator are in the process of the operator 501 staring at the calibration board 502 one by one, Obtained by pre-scanning by the three-dimensional scanner 503 (such as Figure 5 shown).

[0073] S2. Construct the human eye model of the operator according to the human eye characteristic information extracted ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device for determining a drop point position of eyes of an operator on a screen of terminal equipment, the method and the device are suitable for a terminal equipment control scene, and the method comprises the following steps: generating a virtual space including an operator eye model and a terminal equipment model according to a collected image of the operator; recording a corresponding relationship between different concerned positions of a screen of the terminal equipment model and feature information of the operator eye model when the operator eye model pays attention to the screen of the terminal equipment model in the virtual space; and according to the human eye feature information in the image of the operator and the corresponding relationship, determining a drop point position of the eye of the operator on the screen of the terminal equipment, so that the terminal equipment generates a control instruction according to the drop point position. According to the method, the requirement on the performance of the image acquisition equipment of the terminal equipment is low, the method is not influenced by the environment, and the terminal equipment is accurately controlled by the eyes of an operator under the condition that manual operation is not needed.

Description

technical field [0001] This article relates to a device control method, and in particular to a method and device for determining the position of an operator's gaze on a screen of a terminal device. Background technique [0002] With the development of society, terminal equipment plays a very important role in people's life and work, and the control methods of the latest terminal equipment mainly include capacitive screen induction control, voice command (voice assistant) control, and gesture control based on the front camera. Wait. Although the above control methods can control the terminal equipment, they all have certain limitations, which are specifically reflected in: [0003] 1. For the method of capacitive screen sensing control: when the weather is cold or the hands are occupied, the control effect of the terminal device will be affected; [0004] 2. For the way of voice command control: command recognition is not accurate in noisy environments, it is not suitable f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T19/00G06K9/00G06F3/0488
CPCG06F3/013G06T19/006G06F3/04886
Inventor 不公告发明人
Owner 张也弛
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap