Unlock instant, AI-driven research and patent intelligence for your innovation.

A translation method and system based on eye tracking

An eye tracking and translation system technology, applied in the computer field, can solve the problems of interfering with the user's reading coherence, cumbersome operation process, etc., and achieve the effect of good user experience, coherence guarantee, and simplified operation.

Active Publication Date: 2016-12-28
XIAOMI INC
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can be seen that this operation process is very cumbersome and seriously interferes with the continuity of users' reading.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A translation method and system based on eye tracking
  • A translation method and system based on eye tracking
  • A translation method and system based on eye tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] figure 1 It is a flow chart of the translation method based on eye tracking. As shown in the figure, the translation method based on eye tracking includes:

[0053] S1, tracking and collecting the user's eye movement by an eye tracking device to obtain eye state information; the eye state information at least includes gaze coordinates of the eye gazing at the screen;

[0054] As mentioned above, eye tracking technology is a new somatosensory technology emerging in recent years, and its technology has been applied in various electronic products. The eye tracking technology captures and tracks the state and changes of the user's eyeballs, and then analyzes the screen position that the user is currently staring at. The embodiment of the present invention utilizes this technology to capture the user's reading position. Therefore, no matter what kind of implementation and working principle of the eye tracking device is used to capture the user's reading position, as long ...

Embodiment 2

[0065] This embodiment provides a specific implementation scheme for judging whether to trigger the translation process according to the collected eyeball state information. Said judging whether to trigger the translation process according to the collected eye state information includes:

[0066] According to the gaze coordinates in the eyeball state information, it is judged whether the gaze range of the user exceeds the set range value within the set time range; if the gaze range of the user does not exceed the set range value within the set time range, then Trigger the translation process; if the user's gaze exceeds the set range value within the set time range, the translation process will not be triggered.

[0067] As can be seen from the foregoing, the eye state information obtained by the eye tracking device includes the gaze coordinates of the eye gazing at the screen. According to the gaze coordinates, it can be judged whether the gaze range of the user within the se...

Embodiment 3

[0071] This embodiment provides another specific implementation scheme for judging whether to trigger the translation process according to the collected eyeball state information.

[0072] The eye state information also includes the user's eye movement information;

[0073] Said judging whether to trigger the translation process according to the collected eye state information includes:

[0074] Judging whether the eye movement information is a translation trigger action; if the eye movement information is a translation trigger action, then trigger the translation process; if the eye movement information is not a translation trigger action, then do not trigger the translation process.

[0075] As can be seen from the foregoing, the eye tracking device can not only obtain gaze coordinates, but also obtain eye movement information (such as blinking movement information, etc.). Through the method provided in this embodiment, the user can actively trigger the translation process ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a translation method and a system based on eyeball tracking. The method comprises the steps that eyeball state information is obtained by tracking and collecting eyeball movement of a user through an eyeball tracking device; whether a translation processing procedure is triggered is judged according to the collected eyeball state information; to-be-translated language information is extracted from a reading content according to staring coordinates; the extracted to-be-translated language information is translated; and translated language information is obtained, and displayed. According to the translation method and the system, the user can obtain reading translation support without any operation, so that the operation of the user is simplified; the reading coherence of the user is guaranteed; and user experience is better.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to an eye tracking-based translation method and system. Background technique [0002] When people read foreign language materials through mobile phones, tablet computers and other electronic devices, they often encounter unfamiliar words or phrases that need to be translated. At this time, the user needs to copy the word to the clipboard, exit the reader, find the dictionary application, copy the contents of the clipboard to the dictionary input box, and return to the reader. It can be seen that this operation process is very cumbersome and seriously interferes with the continuity of the user's reading. Therefore, we need a more convenient reading and translation method to simplify the user's operation of querying new words. Contents of the invention [0003] The main purpose of the embodiments of the present invention is to provide a translation method and system based on eye...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06F17/28
Inventor 刘道宽翁海斌王斌
Owner XIAOMI INC