Unlock instant, AI-driven research and patent intelligence for your innovation.

A method of realizing virtual mouse by combining eye tracker and asynchronous motion imagery technology

A virtual mouse and motion imagery technology, applied in the fields of brain science and cognitive science, can solve problems such as limited use and lack of confirmation, and achieve great practical effects

Active Publication Date: 2022-04-22
NAT UNIV OF DEFENSE TECH
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, because it can only track the gaze trajectory of the human eye, and does not have functions such as confirmation, its practical use in daily life is very limited. It is usually used for games or professional psychological analysis.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of realizing virtual mouse by combining eye tracker and asynchronous motion imagery technology
  • A method of realizing virtual mouse by combining eye tracker and asynchronous motion imagery technology
  • A method of realizing virtual mouse by combining eye tracker and asynchronous motion imagery technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will describe in detail with reference to the drawings and specific embodiments.

[0041] Aiming at the existing problems, the present invention provides a method for realizing a virtual mouse in combination with an eye tracker and asynchronous motion imagery technology. The embodiment of the shaking invention includes that the eye tracker collects the user's visual trajectory in real time, and associates the position of the mouse pointer with the user's visual trajectory through python (a computer programming language) so as to realize the movement and selection of the virtual mouse. The left and right hand tasks in motor imagery were used as the left and right buttons of the mouse respectively.

[0042] Eye movement and motor imagery are two different modalities, and realize different functions. The eye movement signal is mainly to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method for realizing a virtual mouse in combination with an eye tracker and asynchronous motion imagery technology, including the following steps: Step S1, realizing the movement function of the mouse through eye movement signals: collecting the user's visual trajectory in real time through the eye tracker, and obtaining the user's The coordinates of the eye movement fixation point, and data processing is performed on the coordinates of the user's eye movement fixation point, and the pointer position of the virtual mouse is associated with the user's visual track to realize the movement function of the virtual mouse; step S2, realizing the movement of the mouse through motion imagination Left and right button click function: The user imagines the actions associated with the left and right buttons, and realizes the left and right button click function of the mouse by decoding the brain wave signal in the motor area. The invention combines the eye tracker and the asynchronous motion imagery technology to realize the virtual mouse to select the target, so that the user can realize the remote control of the computer only by the eyes and the brain without taking any action.

Description

technical field [0001] The invention relates to the technical fields of brain science and cognitive science, in particular to a method for realizing a virtual mouse in combination with an eye tracker and asynchronous motion imagery technology. Background technique [0002] Brain computer interface (BCI) is an interactive system built between humans and machines. Generally, the signal acquisition of brain-computer interface can be divided into three types: non-invasive, semi-invasive and invasive. Among them, the non-invasive method may be the first to be applied to real life in the future because it does not cause harm to the human body. According to whether the EEG signal is caused by external stimuli, BCI technology can be divided into evoked and spontaneous. Common evoked BCI technologies include steady-state visual evoked potential (SSVEP) and event-related potential (ERP). SSVEP is mainly a method for judging the intention of the subject by evoking a harmonic signal ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06F3/0487G06F3/0484
CPCG06F3/013G06F3/0487G06F3/0484
Inventor 于扬叶泽祺曾令李周宗潭胡德文卢惠民
Owner NAT UNIV OF DEFENSE TECH