Unlock instant, AI-driven research and patent intelligence for your innovation.

Eye movement track identification method and system

A trajectory and eye movement technology, applied in neural learning methods, eye testing equipment, character and pattern recognition, etc., can solve problems such as time-consuming, labor-intensive, highly subjective, and inability to receive treatment as soon as possible.

Pending Publication Date: 2021-10-01
中科人工智能创新技术研究院(青岛)有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods rely heavily on professional physicians to make judgments based on their professional knowledge, which is time-consuming, labor-intensive, and highly subjective, which will cause many patients to not be diagnosed in time, so that they cannot be treated as soon as possible

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Eye movement track identification method and system
  • Eye movement track identification method and system
  • Eye movement track identification method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] Embodiment 1 of the present invention provides an eye movement trajectory identification system, which includes:

[0051] An acquisition module, configured to acquire the eye track to be identified;

[0052] The identification module is used to use the trained identification model to process the acquired eye movement trajectory to be identified, and obtain the identification result that the eye movement track to be identified is normal or abnormal; wherein, the trained identification model Obtained by training with a training set, the training set includes original pictures and corresponding normal children's visual salience pictures and autistic children's visual salience pictures, and the original pictures are respectively obtained by multiple normal children and multiple autistic children Browse and mark the location information of the fixation point and the duration of the fixation point.

[0053] In this embodiment 1, the above-mentioned system is used to realize ...

Embodiment 2

[0088] like figure 1 As shown, in the present embodiment 2, a kind of children's autism detection method based on eye movement track identification is provided, in this method, network is trained to obtain the discrimination model of eye track, and the network of training mainly comprises by 3 volumes A convolutional deep network composed of product layers, 2 pooling layers and a fully connected layer, and a long short-term memory network composed of a double-layer long short-term memory network layer, a fully connected layer and a Sigmoid layer. The model includes two processes of training and recognition:

[0089] Both the training process and the recognition process use the Saliency4ASD data set, such as figure 2 as shown, figure 2 (a) is the original picture of the data set, and the subject recorded the eye movement trajectory after viewing the original picture, that is, the coordinates and time information of the gaze point, figure 2 (b) for figure 2 (a) The corre...

Embodiment 3

[0133] Embodiment 3 of the present invention provides a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium includes instructions for executing an eye movement trajectory identification method, and the method includes:

[0134] Obtain the eye track to be identified;

[0135] Utilize the trained identification model to process the obtained eye movement track to be identified, and obtain the identification result that the eye track to be identified is normal or abnormal; wherein, the trained identification model is trained using a training set Obtained, the training set includes original pictures and corresponding normal children's visual salience pictures and autistic children's visual salience pictures, and the original pictures are browsed by a plurality of normal children and a plurality of autistic children respectively. Position information and gaze point duration are marked.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an eye movement track identification method and system, and belongs to the technical field of vision thereof, and the method comprises the steps: obtaining a to-be-identified eye movement track; processing the obtained to-be-identified eye movement track by using the trained identification model to obtain an identification result that the to-be-identified eye movement track is normal or abnormal, wherein the trained identification model is obtained by training through a training set, the training set comprises original pictures and corresponding normal child visual saliency pictures and autistic child visual saliency pictures, and the original pictures are browsed by a plurality of normal children and a plurality of autistic children respectively; and marking the position information of the fixation point and the duration of the fixation point. According to the method, the features of the eye movement track on the visual saliency map and the time information and sequence dependency relationship of the fixation point of the fixation position are extracted, and finally the category is judged through a loss function. In this way, the infantile autism of children can be well identified according to the sequence of the eye movement track on the saliency map.

Description

technical field [0001] The invention relates to the technical field of machine vision, in particular to an eye movement track identification method and system based on visual salience image differences. Background technique [0002] Autism spectrum disorder (autism for short) is a severe mental developmental disorder. Patients usually show abnormalities in interpersonal communication barriers, communication barriers, and interests and behaviors, especially in early childhood development. mental development. [0003] The traditional methods of autism diagnosis are developmental screening and comprehensive diagnostic evaluation, both of which require a professional diagnosis by a doctor. However, these methods rely heavily on professional physicians to make judgments based on their professional knowledge, which is time-consuming, labor-intensive, and highly subjective, which will cause many patients to be diagnosed untimely and thus unable to receive early treatment. For the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06N3/04G06N3/08G06T7/00G06T7/246A61B3/00A61B3/113A61B5/00A61B5/16
CPCA61B5/163A61B5/7282A61B3/113A61B3/0025G06N3/049G06N3/08G06T7/0016G06T7/246G06T2207/20081G06T2207/20084G06T2207/30041G06N3/047G06N3/048G06N3/045G06F18/2415
Inventor 王亮郭奕君黄岩单彩峰李凯
Owner 中科人工智能创新技术研究院(青岛)有限公司