Virtual immersion type autistic child treatment system based on electroencephalogram signals and eye tracker

Abstract

The invention discloses a virtual immersion type autistic child treatment system based on electroencephalogram signals and an eye tracker. The virtual immersion type autistic child treatment system comprises an artificial intelligence voice interaction module, an electroencephalogram detection module, an eye movement detection module, a machine learning recognition module and a virtual reality module; the electroencephalogram detection module is used for detecting electroencephalogram signals and performing feature extraction; the eye movement detection module is used for sampling eye movement data, constructing eye sight lines and performing three-dimensional visualization on eye movement fixation point data and individual movement track data; the machine learning recognition module performs pattern recognition on the data acquired by the electroencephalogram detection module and the eye movement detection module through a pre-trained machine learning model, and feeds back a recognition result; and the virtual reality module is used for building a 3D scene, reading an instruction of a feedback signal and adjusting and controlling the virtual reality scene. The system is combined with VR eye movement detection equipment, so that the reason of the emotion change of a patient can be known, and the purpose of treating the patient in a targeted manner is achieved.

Description

technical field [0001] The invention belongs to the technical field of virtual reality and human-computer interaction, and relates to a virtual immersive treatment system for children with autism based on electroencephalogram signals and eye trackers. Background technique [0002] At present, the treatment method for children with autism is mainly that doctors provide psychological counseling to children through conversation. However, this method has many defects: first, the diagnosis and treatment plan using the chat method must be present by a psychological counselor, and the patient’s emotions are too unstable, which may cause harm to the personnel; secondly, the patient has privacy concerns, There is distrust of the principle of confidentiality of consultants. Generally, autistic patients are too inferior and unwilling to let relatives and friends know more about their own situation. They will conceal or refuse to communicate with others when they report; finally, due to...

AI Technical Summary

Problems solved by technology

However, this method has many defects: first, the diagnosis and treatment plan using the chat method must be present by a psychological counselor, and the patient’s emotions are too unstable, which may cause harm to the personnel; secondly, the patient has privacy concerns, There is distrust of the principle of confidentiality of consultants. Generally, autistic patients are too inferior and unwilling to let relatives and friends know more about their own situation. They will conceal or refuse to communicate with others when they report; finally, due to nervousness of patients, their self-expression is not obvious enough , psychological counselors easily ignore relevant important situations, which seriously affects the treatment effect

Through the EEG detection module, combined with the big data emotion recognition system, the system can respond to the patient's mental activities online in real time, but cannot understand the reasons for the changes in mental activities

Images