Multi-model fusion driven eye movement tracking method and system for mobile equipment

A mobile device, eye tracking technology, applied in biological neural network model, mechanical mode conversion, character and pattern recognition and other directions, can solve the problems of low camera resolution, weak CPU processing power, limited hardware conditions, etc. Low computational cost, improve eye tracking accuracy, and avoid the effect of parameter adjustment

Active Publication Date: 2019-08-20
ZHEJIANG UNIV OF TECH
View PDF10 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current problems of mobile devices include: (1) limited hardware conditions, such as weak CPU processing power, low camera resolution, and small memory capacity; (2) complex use environment and large lighting changes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-model fusion driven eye movement tracking method and system for mobile equipment
  • Multi-model fusion driven eye movement tracking method and system for mobile equipment
  • Multi-model fusion driven eye movement tracking method and system for mobile equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The following will clearly and completely describe the mobile device-oriented multi-model fusion-driven eye movement tracking method of the present invention in conjunction with the accompanying drawings. Obviously, the described examples are only some examples of the present invention, not all examples, and cannot be understood To limit the present invention. Based on the examples in the present invention, all other examples obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0025] refer to figure 1 , a kind of mobile device-oriented multi-model fusion eye movement tracking method that the example of the present invention proposes, comprises the following steps:

[0026] (1) Eye movement feature analysis based on appearance model;

[0027] Firstly, the data set is prepared, and the synthetic human eye image is used for preprocessing operations such as scaling, grayscale, and filt...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-model fusion driven eye movement tracking method for mobile equipment. The method comprises the following steps: (1) eye movement characteristic analysis based on an appearance model; (2) eye movement data mapping based on a feature model; and (3) eye movement fixation point calculation based on multi-model fusion. The invention further provides a multi-model fusion driven eye movement tracking system for the mobile equipment. The system comprises the following modules which are sequentially connected and feed data: an eye movement feature analysis module basedon an appearance model; an eye movement data mapping module based on the feature model; and an eye movement fixation point calculation module based on multi-model fusion. The eye movement tracking method on the current mobile device is expanded, and the eye movement tracking precision, the calculation speed and the stability of the mobile device in a complex interaction environment are improved.

Description

technical field [0001] The invention relates to an eye movement tracking method and system. Background technique [0002] Commonly used eye-tracking methods mainly include appearance model-based and feature-based models: the appearance-based eye-tracking method inputs the appearance image of the human eye, and then constructs a convolutional neural network as the appearance model to extract the unexplainable hidden features of the human eye image. Contains features, and then calculates the eye movement fixation point; the eye movement tracking method based on the feature model inputs clear and interpretable human eye image features, preprocesses the human eye image, extracts image features, and then establishes image features and eye movement fixation points The mapping equation between them is used to calculate the eye movement fixation point. The advantages and disadvantages of the two methods are as follows: The eye tracking method based on the appearance model has the a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00G06K9/62G06N3/04
CPCG06F3/013G06V40/165G06V40/19G06N3/045G06F18/25G06F18/214
Inventor 程时伟张章伟
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap