Method and device for operating browser based on eye-movement tracking

An eye tracking and browser technology, applied in the input/output process of instruments, data processing, user/computer interaction input/output, etc., can solve the problem of inconvenient use, inability to feel user experience, and difficult to browse and other issues to achieve the effect of improving the user experience

Active Publication Date: 2013-10-02
ALIBABA (CHINA) CO LTD
View PDF5 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, if the user is inconvenient to operate the browser with both hands, for example, the user is taking a bus, and there are too many people on the bus, the user has to hold the handrail with one hand and hold the mobile terminal device (such as mobile terminal device with a large screen), it is difficult for him to perform related browsing operations; or the user is ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for operating browser based on eye-movement tracking
  • Method and device for operating browser based on eye-movement tracking
  • Method and device for operating browser based on eye-movement tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Various aspects of the disclosure are described below. It should be appreciated that the teachings herein may be embodied in a wide variety of forms and that any specific structure, function, or both disclosed herein are merely representative. Based on the teachings herein one skilled in the art should appreciate that an aspect disclosed herein may be implemented independently of any other aspects and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented or a method practiced using any number of the aspects set forth herein. In addition, such an apparatus may be implemented or such a method may be practiced with other structure, functionality, or structure and functionality in addition to or in addition to one or more of the aspects set forth herein. Additionally, any aspect described herein may comprise at least one element of a claim.

[0026] The present invention proposes a browser operation method based on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for operating a browser based on eye-movement tracking. The method comprises the steps of shooting a facial image of a user through a camera at every set time and describing the facial image to a Canvas, describing eyeball images to the Canvas after the eyeball images are extracted from the facial image, and acquiring the pixel data of the eyeball images from the Canvas; acquiring the eyeball data shot every time according to the pixel data and a set eyeball catching algorithm, and determining the user to be focused on a special content in a browser page when the difference valve of every adjacent two-time eyeball positions is less than a preset threshold valve and the retention time of eyeballs is more than the set time of the eyeballs; if the semi-diameters of pupils are detected to be amplified, looking for corresponding focal coordinates of the pupils in a webpage, and determining dom element label objects corresponding to the focal coordinates; and executing corresponding browsing operation according to relative relations between the preset dom element label subjects and performed actions. The execution of the browsing relative operation can be realized based on the eyeball movement by using the method.

Description

technical field [0001] The present invention relates to the technical field of mobile communication, and more specifically, to a method and device for operating a browser based on eye tracking. [0002] Background technique [0003] At present, most of the browsing operations of mobile terminal browsers are performed through touch operations. For example, when viewing web pages, clicks and manipulations are required. However, if the user is inconvenient to operate the browser with both hands, for example, the user is taking a bus, and there are too many people on the bus, the user has to hold the handrail with one hand and hold the mobile terminal device (such as mobile terminal device with a large screen), it is difficult for him to perform related browsing operations; or the user is a disabled person who only holds a mobile terminal device in one hand, so he can only use a mobile terminal device with a small screen. This makes it impossible to feel the user experience b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06F3/0487
Inventor 梁捷周耀庭
Owner ALIBABA (CHINA) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products