Adaptive virtual maze training system

Abstract

This disclosure provides an adaptive virtual maze training system, comprising an eye-tracking device, a multimodal physiological detection device, a brain activity detection device, a controller, and a display device. The eye-tracking device tracks eye movement. The multimodal physiological detection device detects physiological parameters. The brain activity detection device detects brain activity. The controller includes an emotion state judgment module, a brain state judgment module, a learning state judgment module, and an adaptive maze training module. The adaptive maze training module generates a virtual maze to train the user and automatically adjusts the configuration information within the virtual maze based on at least one of the emotion state, brain state, and learning state. The display device displays the virtual maze. This allows for adaptive and dynamic adjustment of the virtual maze, improving training effectiveness.

Claims

1. An adaptive virtual maze training system, comprising: an eye-tracking device for tracking the eye state of a user; a multimodal physiological detection device for detecting a physiological parameter of the user, wherein the physiological parameter includes at least a heart rate variability and a skin conductance; a brain activity detection device for measuring an electroencephalogram (EEG) and / or nerve cell activity, and detecting a brain activity of the user; and a controller, signal-connected to the eye-tracking device, the multimodal physiological detection device, and the brain activity detection device, and comprising: an emotional state judgment module for receiving the eye state and the physiological parameter, and determining an emotional state of the user based on at least one of the eye state and the physiological parameter; and a brain state judgment module for receiving the brain activity and determining a brain state of the user based on the brain activity, wherein the brain state includes a focus and a cognitive load. A learning state judgment module, signal-connected to the emotional state judgment module and the brain state judgment module, determines the user's learning state based on the emotional state and brain state, and determines whether the user has formed memory or increased neuroplasticity; an adaptive maze training module, signal-connected to the emotional state judgment module, the brain state judgment module and the learning state judgment module, generates a virtual maze to train the user, and automatically adjusts a configuration information in the virtual maze based on at least one of the emotional state, the brain state and the learning state, and the user's training data in the virtual maze, wherein the configuration information is used to adjust the user's cognitive load or promote neuroplasticity; and a display device, signal-connected to the adaptive maze training module and used to display the virtual maze.

2. The adaptive virtual maze training system as described in claim 1, wherein the configuration information includes a maze difficulty level, a sound effect, background music, lighting, and a hint.

3. The adaptive virtual maze training system as described in claim 1 further includes a haptic feedback device, and the controller further includes a haptic feedback module that is signal-connected to the haptic feedback device, the haptic feedback module controlling the haptic feedback device to provide haptic feedback to the user.

4. The adaptive virtual maze training system as described in claim 1, wherein the brain activity detection device comprises an EEG instrument or a functional near-infrared photoencephalograph.

5. The adaptive virtual maze training system as described in claim 1, wherein the controller further includes a learning assessment and planning module, which is signal-connected to the emotion state judgment module, the brain state judgment module and the learning state judgment module to provide a learning assessment result and a learning plan content.

Images