Independent view steady-state visual stimulation method based on wearable display

By independently presenting steady-state visual stimulation on the left and right screens of the wearable display, the problem of the binocular differential stimulation method needs to be optimized separately is solved, the recognition accuracy of SSVEP is improved, and the characteristics are increased without changing the user's visual effect is achieved. Quantity effect.

CN118963546APending Publication Date: 2024-11-15NORTHWESTERN POLYTECHNICAL UNIV
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410960945.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-17
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

In the existing brain-computer interface technology based on steady-state visual evoked potential (SSVEP), binocular differential stimulation methods need to be individually optimized for each user to improve the number of SSVEP features, resulting in insufficient complexity and recognition accuracy.

Method used

The left and right screens using wearable displays independently present different steady-state visual stimulations to the left and right field of the human eye. The visual stimulation pattern is divided into two parts through the vertical line of the center, and is displayed on the left and right screens respectively, and is not allowed to be used. When changing the user's visual effects, adjust the flicker frequency and phase to acquire multi-frequency and phase SSVEP.

Benefits of technology

Without individual optimization for each user, the number of recognition features of SSVEP has been increased, and the recognition accuracy has been improved. It is suitable for scientific research, intelligent control, and leisure and entertainment fields.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118963546A_ABST
    Figure CN118963546A_ABST
Patent Text Reader

Abstract

The invention discloses an independent visual field steady-state visual stimulation method based on a wearable display, and the method employs a left screen and a right screen of the wearable display to independently present different steady-state visual stimuli for the left visual field and the right visual field of human eyes. Specifically, a user wears the wearable display and always looks towards a red visual fixation point, and a visual stimulation pattern is divided into a left part and a right part by taking a central vertical line as a boundary and is respectively displayed on a left screen and a right screen of the wearable display. Stimulation patterns of the left and right screens of the wearable display begin to flicker at different frequencies and phases at the same time. After the stimulation pattern flickers for t seconds, electroencephalogram signals with the length of t seconds are collected. SSVEP with two stimulation frequencies and phases respectively exist in electroencephalograms of the left part and the right part of the scalp of the user. According to the method, under the condition that the visual effect of the user is not changed, the number of the features used for identifying the SSVEP can be increased without independently optimizing each user, and the identification accuracy of the SSVEP is improved. The method can be applied to the fields of scientific research, intelligent control, entertainment and the like.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of wearable devices, and in particular relates to an independent field of view steady-state visual stimulation method based on a wearable display. Background Art

[0002] The brain-computer interface (BCI) based on steady-state visual evoked potentials (SSVEP) realizes human-computer interaction by detecting brain waves generated by periodic visual stimulation.

[0003] In order to improve the recognition accuracy of SSVEP, people have invented a binocular difference stimulation method, that is, the steady-state visual stimulation viewed by the left and right eyes of the user is different to increase the number of SSVEP features that can be used for classification. According to the structure of the visual pathway of the human brain, the visual cortex of the left and right hemispheres will process visual stimulation from both eyes. This makes the response to SSVEP complex and difficult to estimate. Considering the individual differences between different users, this method needs to be optimized for each user to achieve an increase in the number of features. Summary of the invention

[0004] In order to overcome the shortcomings of the prior art, the present invention provides an independent visual field steady-state visual stimulation method based on a wearable display, using the left and right screens of the wearable display to independently present different steady-state visual stimulations to the left and right visual fields of the human eye. Specifically, the user wears the wearable display, always looks at the red visual fixation point, and divides the visual stimulation pattern into two parts, left and right, with the central vertical line as the boundary, and displays them on the left and right screens of the wearable display respectively. The stimulation patterns on the left and right screens of the wearable display start flashing at the same time with different frequencies and phases. After the stimulation pattern flashes for t seconds, the t-second-long EEG signal is collected. There are two SSVEPs of stimulation frequency and phase in the EEG of the left and right parts of the user's scalp, respectively. The present invention can increase the number of features used to identify SSVEP without changing the user's visual effect, without optimizing it separately for each user, thereby improving the recognition accuracy of SSVEP. It can be applied to scientific research, intelligent control, leisure and entertainment and other fields.

[0005] The technical solution adopted by the present invention to solve the technical problem is as follows:

[0006] Step 1: The computer transmits the real-time generated visual stimulation picture to the wearable display for display, providing visual stimulation to the user; the acquisition device collects the user's EEG signal and transmits the EEG signal to the computer;

[0007] The left and right screens of the wearable display include two display schemes:

[0008] Scheme A: In the left screen, the left half of the visual stimulus pattern is presented to the left of the red visual fixation point; in the right screen, the right half of the visual stimulus pattern is presented to the right of the red visual fixation point;

[0009] Scheme B: In the left screen, the right half of the visual stimulus pattern is presented to the right of the red visual fixation point; in the right screen, the left half of the visual stimulus pattern is presented to the left of the red visual fixation point;

[0010] Step 2: The user wears the wearable display and always looks at the red visual fixation point. The visual stimulus pattern is presented according to Scheme A or Scheme B and remains stationary.

[0011] Step 3: The left and right screens of the wearable display present the stimulus pattern of the i-th frame, and the transparency of the i-th frame pattern on the left screen is O 左 (i) and the transparency O of the i-th frame pattern on the right screen 右 The calculation method of (i) is as follows:

[0012]

[0013] Among them, FPS refers to the screen refresh rate of the wearable device, f 左 refers to the flickering frequency of the stimulus pattern on the left screen, refers to the flicker phase of the stimulus pattern on the left screen; f 右 refers to the flickering frequency of the stimulus pattern on the right screen, refers to the flicker phase of the stimulus pattern on the right screen;

[0014] Step 4: Synchronously collect the user's EEG signal;

[0015] After the stimulus pattern flashes for t seconds, an EEG signal of t seconds is collected.

[0016] Furthermore, in step 4:

[0017] If presented according to scheme A: the EEG signal on the right half of the user's scalp contains a frequency of f 左 , the phase is The SSVEP of the left half of the user's scalp contains a frequency of f 右 , the phase is SSVEP;

[0018] If presented according to scheme B: the EEG signal on the left half of the user's scalp contains a frequency of f 左 , the phase is The SSVEP of the user's right scalp contains the EEG signal with a frequency of f 右 , the phase is SSVEP.

[0019] The beneficial effects of the present invention are as follows:

[0020] The present invention can increase the number of features that can be used to identify SSVEP without changing the user's visual effect and without optimizing for each user separately, thereby improving the recognition accuracy of SSVEP. It can be applied to scientific research, intelligent control, leisure and entertainment and other fields. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A block diagram for implementing the method of the present invention;

[0022] Figure 2 This is a schematic diagram of the left and right screen display images of a wearable display according to an embodiment of the present invention;

[0023] Figure 3 This is a flow chart of the independent field of view steady-state visual stimulation method based on a wearable display of the present invention. DETAILED DESCRIPTION

[0024] The present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0025] In order to avoid the stimulation information from the left and right visual pathways affecting one half of the brain together, the present invention proposes an innovative method. The left and right screens of the wearable display are used to independently present different steady-state visual stimuli to the left and right visual fields of the human eye. The present invention can increase the number of features that can be used to identify SSVEP without changing the user's visual effect and without optimizing it for each user separately, thereby improving the recognition accuracy of SSVEP. It can be applied to scientific research, intelligent control, leisure and entertainment and other fields.

[0026] In order to solve the problem that the binocular difference stimulation method needs to optimize the design scheme for each user separately, the present invention proposes an independent visual field steady-state visual stimulation method based on a wearable display, which presents different steady-state visual stimulations to the left and right visual fields of the human eye through the left and right screens of the wearable display. The specific invention contents are as follows:

[0027] The visual stimulation pattern is divided into two parts, left and right, with the central vertical line as the boundary, and displayed on the left and right screens of the wearable display, respectively. The left screen displays the left half of the pattern and the right screen displays the right half of the pattern, or the left screen displays the right half of the pattern and the right screen displays the left half of the pattern. The two parts of the pattern can change in terms of flicker frequency and flicker phase.

[0028] Example:

[0029] The implementation method is as follows Figure 1As shown, the computer transmits the real-time generated visual stimulation picture to the wearable display for display, providing visual stimulation to the user. The acquisition device collects the user's EEG signal and transmits the EEG signal to the computer.

[0030] The diagram of the left and right screens of the wearable display is shown in the attached figure. Figure 2 As shown, there are two display schemes: A. Above the dotted line: In the left screen, the left half of the visual stimulus pattern is presented to the left of the red visual fixation point; in the right screen, the right half of the visual stimulus pattern is presented to the right of the red visual fixation point. B. Below the dotted line: In the left screen, the right half of the visual stimulus pattern is presented to the right of the red visual fixation point; in the right screen, the left half of the visual stimulus pattern is presented to the left of the red visual fixation point.

[0031] The flowchart of the independent visual field steady-state visual stimulation method based on wearable display is as follows Figure 3 shown.

[0032] Step 1: The user wears the wearable display and always looks at the red visual fixation point. The visual stimulus pattern is presented according to Scheme A or Scheme B and remains stationary.

[0033] Step 2: The left and right screens of the wearable display present the stimulus pattern of the i-th frame, and the transparency of the i-th frame pattern on the left screen is O 左 (i) and the transparency O of the i-th frame pattern on the right screen 右 The calculation method of (i) is as follows:

[0034]

[0035] Among them, FPS refers to the screen refresh rate of the wearable device, f 左 refers to the flickering frequency of the stimulus pattern on the left screen, refers to the flicker phase of the left screen stimulus pattern. 右 refers to the flickering frequency of the stimulus pattern on the right screen, refers to the flicker phase of the stimulus pattern on the right screen.

[0036] Step 3: Synchronously collect the user's EEG signal. After the stimulation pattern flashes for t seconds, collect the EEG signal of t seconds. If presented according to scheme A: the EEG signal on the right half of the user's scalp contains a frequency of f 左 , the phase is The SSVEP of the left half of the user's scalp contains a frequency of f 右 , the phase is If presented according to scheme B: the EEG signal on the left half of the user's scalp contains a frequency of f 左 , the phase is The SSVEP of the user's right scalp contains the EEG signal with a frequency of f 右 , the phase is SSVEP.

Claims

1. A method for independent visual field steady-state visual stimulation based on a wearable display, characterized in that: The steps include: Step 1: The computer transmits the real-time generated visual stimulation picture to the wearable display for display, providing visual stimulation to the user; the acquisition device collects the user's EEG signal and transmits the EEG signal to the computer; The left and right screens of the wearable display include two display schemes: Scheme A: In the left screen, the left half of the visual stimulus pattern is presented to the left of the red visual fixation point; In the right screen, the right half of the visual stimulus pattern was presented to the right of the red visual fixation point; Scheme B: In the left screen, the right half of the visual stimulus pattern is presented to the right of the red visual fixation point; In the right screen, the left half of the visual stimulus pattern was presented to the left of the red visual fixation point; Step 2: The user wears the wearable display and always looks at the red visual fixation point. The visual stimulus pattern is presented according to Scheme A or Scheme B and remains stationary. Step 3: The left and right screens of the wearable display present the stimulus pattern of the i-th frame, and the transparency of the i-th frame pattern on the left screen is O 左 (i) and the transparency O of the i-th frame pattern on the right screen 右 The calculation method of (i) is as follows: Among them, FPS refers to the screen refresh rate of the wearable device, f 左 refers to the flickering frequency of the stimulus pattern on the left screen, refers to the flicker phase of the stimulus pattern on the left screen; f 右 refers to the flickering frequency of the stimulus pattern on the right screen, refers to the flicker phase of the stimulus pattern on the right screen; Step 4: Synchronously collect the user's EEG signal; After the stimulus pattern flashes for t seconds, an EEG signal of t seconds is collected.

2. The method for independent visual field steady-state visual stimulation based on a wearable display according to claim 1, characterized in that: In step 4: If presented according to scheme A: the EEG signal on the right half of the user's scalp contains a frequency of f 左 , the phase is The SSVEP of the left half of the user's scalp contains a frequency of f 右 , the phase is SSVEP; If presented according to scheme B: the EEG signal on the left half of the user's scalp contains a frequency of f 左 , the phase is The SSVEP of the user's right scalp contains the EEG signal with a frequency of f 右 , the phase is SSVEP.

Citation Information

Cited By

  • Brain-computer interaction normal form, implementation method, brain-computer interaction method and system

    CN119987539A