Brain plasticity objective quantitative evaluation method based on band command training

Abstract

The invention discloses a band command training-based brain plasticity objective quantitative evaluation method. The method comprises the following steps of outputting music questions, music rhythm information and command gesture information which are used for band command training of a user through a display or a loudspeaker; acquiring beat information of band command training of a user through a beat detection system, and acquiring three-axis acceleration information of band command training of the user through an IMU (Inertial Measurement Unit) sensor; according to the obtained beat information and the three-axis acceleration information of the band command training of the user, calculating the average reaction time and the average accuracy of the band command training of the user; and respectively obtaining scores of the average reaction time and the average accuracy according to a large number theorem, and obtaining a quantitative evaluation result of the brain plasticity in the band command training process of the user through information fusion. The invention provides an objective quantitative evaluation method for brain plasticity evaluation.

Description

Technical Field

[0001] The present invention relates to the field of signal processing technology, and in particular to an objective quantitative evaluation method for brain plasticity based on band conducting training. Background Art

[0002] Brain plasticity, also known as neuroplasticity, refers to the brain's ability to enhance or reshape its own functions through changes in synaptic connections, reorganization of neural networks, and adaptive adjustments in brain region function in response to different environmental stimuli, learning processes, and rehabilitation training. This characteristic plays a key role in the development of individual cognitive abilities, skill acquisition, recovery from neural damage, and intervention in neurodegenerative diseases. Therefore, objective assessment of brain plasticity not only helps understand the mechanisms of brain learning and adaptation but can also be used in research on neurorehabilitation, motor skill training, and cognitive improvement.

[0003] Currently, methods for assessing brain plasticity primarily fall into two categories: those based on neuroimaging technology and those based on behavioral studies. The former, such as functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), transcranial magnetic stimulation (TMS), and functional near-infrared spectroscopy (FNIR), can provide relatively accurate information on changes in brain function or structure. However, these methods are expensive, require limited experimental environments, and have a high barrier to entry, making them difficult to apply on a large scale. The latter, such as cognitive task tests, reaction time measurements, and motor skill assessments, while less expensive, lack a single assessment method and low ecological validity. The experimental tasks are often disconnected from real-world learning processes or skill training, making it difficult to truly reflect the actual effects of neuroplasticity.

[0004] Band conducting training is a complex task that relies heavily on timing control, motor coordination, and multisensory integration, involving the coordinated interaction of multiple functional brain regions, such as the motor cortex, prefrontal cortex, and cerebellum. Therefore, it not only serves as an effective training method to promote brain plasticity, but also reflects an individual's ability to adjust the coordination between rhythm, perception, and movement in real time by analyzing the dynamic changes in reaction time and the timing accuracy of conducting movements during the conducting process, thereby quantifying their behavioral adaptability during training. Therefore, developing a simple, convenient, and objective method for assessing and quantifying brain plasticity based on band conducting training has important application value and significance. Summary of the Invention

[0005] In order to solve the above-mentioned defects in the prior art, the present invention discloses an objective quantitative evaluation method for brain plasticity based on band conducting training.

[0006] A method for objectively quantifying brain plasticity assessment based on band conducting training comprises the following steps:

[0007] S1. Outputting the music title, music tempo information, and conducting gesture information for the user to perform band conducting training via a display or speaker;

[0008] S2, obtaining the beat information of the user during the band conducting training through the beat detection system, and obtaining the three-axis acceleration information of the user during the band conducting training through the IMU sensor;

[0009] S3. Calculating the average reaction time and average accuracy of the user during the band conducting training based on the obtained beat information and the three-axis acceleration information of the user during the band conducting training;

[0010] S4. The average reaction time and the average accuracy scores are obtained respectively according to the law of large numbers, and a quantitative evaluation result of the brain plasticity of the user during the band conducting training is obtained through information fusion.

[0011] Furthermore, in step S1, the music beat information refers to the time step information of each beat in each measure of the music, and the conducting gesture information refers to the acceleration transient information and velocity zero point detection information of each beat.

[0012] Furthermore, the step S1 includes the following steps:

[0013] S101, according to the difficulty of the music beat and the complexity of the conducting gesture, set multiple rounds of music titles in an increasing trend as a music library;

[0014] S102, according to the round of band conducting training performed by the user, find the corresponding music title, music beat information and conducting gesture information in the music library;

[0015] S103: Display the music title, the music tempo information, and the conducting gesture information on a display in the form of animation, or play them through a speaker in the form of audio.

[0016] Furthermore, step S4 includes the following steps:

[0017] S401: According to the law of large numbers, set quantitative scoring standards for the average reaction time and average accuracy of the user in the band conducting training, and combine the average reaction time and the average accuracy calculated in step S3 to obtain scores for the average reaction time and the average accuracy;

[0018] S402. Set the weights of the average reaction time and the average accuracy in the brain plasticity assessment during the user's band conducting training, perform weighted fusion on the scores of the average reaction time and the average accuracy, and obtain a brain plasticity score.

[0019] The present invention has the following advantages and effects compared to the prior art:

[0020] 1) This invention uses IMU (Inertial Measurement Unit) sensors to collect data. Compared with expensive neuroimaging equipment, IMU sensors are small in size, low in cost, and can be used in conventional laboratory or home environments without the need for professional medical or neuroscience equipment.

[0021] 2) The band conducting training employed in this study is a natural and highly interactive task that involves precise timing control, motor coordination, and multisensory integration (vision, hearing, and motor perception), more closely resembling real-world learning processes. Compared to traditional cognitive or motor tasks, this training model is more closely aligned with everyday skill learning, helping to increase subject engagement and long-term viability.

[0022] 3) This invention uses IMU sensors to precisely measure the user's motion trajectory, acceleration, and angular velocity, enabling objective quantification of the accuracy of command actions. Furthermore, by integrating reaction time and accuracy, a more comprehensive assessment of brain plasticity can be obtained, rather than relying solely on a single behavioral metric.

[0023] 4) Unlike methods that require specific equipment operation or even involve exposure to magnetic fields or radiation, the present invention only relies on motion detection equipment, is non-invasive, painless, safe and reliable, and can be widely applied to individuals of different age groups. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is an objective quantitative assessment method of brain plasticity based on band conductor training in an embodiment of the present invention;

[0025] Figure 2 Schematic diagram of two-beat, three-beat and four-beat basic conducting methods in an embodiment of the present invention;

[0026] Figure 3 is a beat detection flow chart in a beat detection framework in an embodiment of the present invention;

[0027] Figure 4 Schematic diagram of the acceleration and angular velocity actually measured by the IMU in an embodiment of the present invention;

[0028] Figure 5 is a schematic diagram of a method for implementing quantitative assessment of brain plasticity using information fusion in an embodiment of the present invention;

[0029] Figure 6 is a reference diagram of the time accuracy distribution in an embodiment of the present invention;

[0030] Figure 7 It is a reference diagram of the command accuracy distribution in an embodiment of the present invention. DETAILED DESCRIPTION

[0031] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0032] Example

[0033] This embodiment discloses an objective quantitative evaluation method for brain plasticity based on band conductor training, such as Figure 1 The specific steps are as follows:

[0034] S1, a display or speaker or other device outputs the question, provides the music beat information and the conducting gesture information;

[0035] The system first uses beat detection technology to extract the precise beat time sequence from the prepared training music, and then presents the rhythm to the subject (i.e., the user) through a display or speaker to ensure that the subject can accurately perceive the beat characteristics of the music. The music beat information can be presented to the subject through a combination of beating beat marks on the display and beat sounds or beat emphasis to optimize the subject's rhythm synchronization ability. At the same time, basic conducting gesture information is based on the conducting gesture diagram, such as Figure 2 As shown in the figure, supplemented by instructional videos, participants learned basic conducting gestures by watching standardized conducting demonstration videos and corresponding conducting diagrams. The system simultaneously played beat information and conducting gesture instructional videos throughout the process, enabling participants to imitate conducting with multi-sensory input.

[0036] The left and right hands were tested separately, with six rounds of questions each, featuring songs in two-beat, three-beat, and four-beat time, as well as at varying BPMs. To better detect the limits of brain plasticity during conducting training, a moderate level of stress was incorporated into the questions, with each round increasing in difficulty.

[0037] S2. Obtain information such as acceleration and angular velocity commanded by the user through the IMU sensor.

[0038] The beat information is obtained through the beat detection system, and the three-axis acceleration information commanded by the user is obtained through the IMU sensor.

[0039] like Figure 3The figure shows the beat detection flow chart. The features are extracted by performing logarithmic STFT calculation on the audio, and the beat activation function is obtained through the pre-trained RNN network. Finally, the final beat detection sequence is obtained through DBN. The obtained beat detection sequence will have a certain range of error with the beat activation function, and the error is acceptable within the range of ±50.

[0040] like Figure 4 The diagram shows angular velocity and acceleration. The IMU sensor obtains the acceleration and angular velocity commanded by the user. First, the user needs to wear the assembled IMU sensor on the back of the hand and swing the racket in two, three, or four beats according to the information given. During the swing, the three-axis acceleration of the user's hand will be recorded and calculated through the acceleration norm. When the acceleration norm reaches a peak, it is considered as the actual hitting moment of the user. The norm The calculation is as follows:

[0041]

[0042] S3. Calculate the average reaction time and average accuracy based on the beat time information and the actual beat time during the subject's conducting process.

[0043] The subject's conducting timing fit is calculated based on the beat detection time information and the subject's actual beat time during conducting, and the overall accuracy is calculated based on the deviation between the subject's actual beat time during conducting and the beat detection time;

[0044] In step S2, all the acceleration information obtained during the conduction of the next round of questions and the corresponding beat detection sequence are recorded. The target beat sequence generated by the beat detection is shown in the following formula:

[0045]

[0046] The acceleration norm obtained during the command training process The moment when the peak value is reached is taken as the actual beat time series, as shown in the following formula:

[0047]

[0048] Since the swinging behavior of different users is uncertain, there are situations such as swinging correctly, swinging incorrectly, swinging too much, swinging too little, etc., it is necessary to first align the time series of the actual swinging with the time series of the beat detection of the test music. The upbeat and downbeat transition time between the two bars in the aligned actual swinging sequence is subtracted from the transition time of the two bars in the beat detection to obtain the time accuracy (that is, the average reaction time). The moment of each beat obtained by the aligned beat detection and the moment of each beat obtained by the actual swing are compared one by one to obtain the conducting accuracy (that is, the average accuracy). S4. According to the law of large numbers, the reaction speed and accuracy scores are respectively obtained. Through information fusion, the evaluation results of the influence of the band conductor on brain plasticity are obtained.

[0049] like Figure 5 The diagram below shows the principle behind command evaluation using information fusion. Time accuracy and command accuracy are tracked and measured over time, and a quantitative scoring standard is established based on the law of large numbers. When a random experiment is repeated, as the number of trials increases, the average of the results tends to stabilize and accurately reflect the true probability of the event. In other words, when the experiment is repeated sufficiently often, the sample average approaches the true probability. After collecting a large amount of data, statistical analysis is performed on both time accuracy and command accuracy, and preliminary scoring standards are established. The resulting time accuracy score (i.e., the average reaction time score) and command accuracy score (i.e., the average accuracy score) are obtained.

[0050] like Figure 6 In the time accuracy distribution shown, very few people are outside -300ms to the left and 300ms to the right. In this case, 0ms is set as a time accuracy score of 100 points, and outside -300ms to the left and outside 300ms to the right are set as 0 points. In this way, 1 point is subtracted for every 3ms interval from 0ms, and a time accuracy scoring standard of 100 is obtained.

[0051] like Figure 7 In the command accuracy distribution shown, very few people are below 20%, so 100% is set as a command accuracy score of 100 points, and 20% and below is set as 0 points. In this way, 1 point is subtracted for every 0.8% interval from 100%, and a command accuracy scoring standard based on a percentage system is obtained.

[0052] The time accuracy score and the conducting accuracy score were weighted and combined to obtain the brain plasticity score under band conducting training. The calculation formula is as follows:

[0053] S Plasticity =λ·S Time +μ·S Accuracy

[0054] Among them, S Plasticityrepresents the calculated brain plasticity score, S Time represents the time accuracy score, S Accuracy represents the command accuracy score, λ and μ represent the weights of time accuracy and command accuracy in brain plasticity, respectively, which are set based on a large amount of experimental data.

[0055] The above embodiments are preferred implementation modes of the present invention, but the implementation modes of the present invention are not limited to the above embodiments. Any other changes, modifications, substitutions, combinations, and simplifications that do not deviate from the spirit and principles of the present invention should be considered as equivalent replacement methods and are included in the scope of protection of the present invention.

Claims

1. An objective quantitative assessment method for brain plasticity based on band conductor training, characterized in that: The following steps are involved: S1. Outputting the music title, music tempo information, and conducting gesture information for the user to perform band conducting training via a display or speaker; S2, obtaining the beat information of the user during the band conducting training through the beat detection system, and obtaining the three-axis acceleration information of the user during the band conducting training through the IMU sensor; S3. Calculating the average reaction time and average accuracy of the user during the band conducting training based on the obtained beat information and the three-axis acceleration information of the user during the band conducting training; S4. The average reaction time and the average accuracy scores are obtained respectively according to the law of large numbers, and a quantitative evaluation result of the brain plasticity of the user during the band conducting training is obtained through information fusion.

2. The objective quantitative assessment method for brain plasticity based on band conductor training according to claim 1, characterized in that: In step S1 , the music beat information refers to the time step information of each beat in each measure of the music, and the conducting gesture information refers to the acceleration transient information and velocity zero point detection information of each beat.

3. The objective quantitative assessment method for brain plasticity based on band conductor training according to claim 1, characterized in that: The step S1 comprises the following steps: S101, according to the difficulty of the music beat and the complexity of the conducting gesture, set multiple rounds of music titles in an increasing trend as a music library; S102, according to the round of band conducting training performed by the user, find the corresponding music title, music beat information and conducting gesture information in the music library; S103: Display the music title, the music tempo information, and the conducting gesture information on a display in the form of animation, or play them through a speaker in the form of audio.

4. The objective quantitative assessment method for brain plasticity based on band conductor training according to claim 1, characterized in that: The step S4 comprises the following steps: S401: According to the law of large numbers, set quantitative scoring standards for the average reaction time and average accuracy of the user in the band conducting training, and combine the average reaction time and the average accuracy calculated in step S3 to obtain scores for the average reaction time and the average accuracy; S402. Set the weights of the average reaction time and the average accuracy in the brain plasticity assessment during the user's band conducting training, perform weighted fusion on the scores of the average reaction time and the average accuracy, and obtain a brain plasticity score.

Images