Brain ability objective quantification detection method based on plucking behavior

Abstract

The application discloses a kind of brain capacity objective quantification detection method based on plucking behavior, the reaction time of specified musical note, plucking accuracy parameter are measured, the speed score of time dimension and the ability score of spatial dimension are calculated, the control of brain to limb, spatial orientation and adaptive capacity are evaluated, defined as piano merchant.The steps are as follows: in controllable questioner with screen, show the question in an easy-to-understand animation form, accurately record the question time of to-be-plucked musical note and musical note pitch;Through electronic organ with scanning function, record the plucking time and plucking key number;Two are compared to calculate the reaction time and plucking accuracy, wherein, reaction time is used to represent the control speed of brain to limb, and plucking accuracy is used to represent the positioning and adaptive capacity of brain to space;Through the way of information fusion, finally evaluate the piano merchant.The application can provide a non-destructive, non-invasive, interesting and self-help at home means for active response to brain health.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of mobile communication, in particular to a brain capacity objective quantification detection method based on plucking behavior. BACKGROUND

[0002] At present, people's pursuit of health is mainly reflected in the concern for physical fitness, and there are many scientific physical exercise methods for enhancing physical fitness, and the training effect can be fed back through the physical fitness test system. However, relatively less attention is paid to brain health, and the overall system for training brain development and evaluating brain function is still immature.

[0003] The existing means for evaluating brain health are mainly neurosurgical examinations such as nuclear magnetic resonance, which have the risk of radiation damage, and the possibility of frequent examination is low. The collection of biological signals such as electroencephalogram has higher requirements for the measurement environment, and usually requires the subjects to maintain relative stillness for a period of time. The cognitive function series scale observes the subjects' reactions and the quality of answers to the spoken questions through inquiry, which may be affected by factors such as the dialects of the testers and the cultural levels of the subjects, and the evaluation is relatively subjective. Other side evaluation methods, such as hand function test, require the subjects to complete as many repetitive operations as possible, and analyze the related brain function by observing the peripheral behavior, which requires a high level of tester's expertise, and the test questions are fixed, lacking expansion and interest.

[0004] The existing brain exercise means are mainly computerized cognitive training, which brings certain visual and auditory stimulation through multimedia integration on a specific network platform or cognitive training software, improves the interest and participation of users, and can adaptively adjust the task difficulty according to the training performance of the users to develop a personalized training plan. However, the human-computer interaction mode mainly relies on the mouse or joystick to realize feedback, and the coverage of brain and hand coordination training is small.

[0005] Therefore, it is of great significance to explore a quantitative detection method based on plucking behavior, indirectly evaluate brain capacity based on objective data, and serve brain exercise, in combination with the beneficial effect of music intervention on brain plasticity. SUMMARY

[0006] The purpose of the present application is to solve the above-mentioned defects in the prior art, and to provide a brain capacity objective quantification detection method based on plucking behavior.

[0007] The purpose of the present application can be achieved by adopting the following technical solutions:

[0008] A brain capacity objective quantification detection method based on plucking behavior, the detection method comprising the following steps:

[0009] S1, display the question in an understandable animation form on a controllable screen-equipped questioner, and accurately record the question time and the note pitch of the to-be-played note;

[0010] S2, record the playing time and the playing key number through the electronic piano with scanning function;

[0011] S3, calculate the reaction time according to the question time and the playing time, and calculate the playing accuracy according to the note pitch and the playing key number;

[0012] S4, give the evaluation result of the piano dealer through information fusion according to the reaction time and the playing accuracy.

[0013] Further, in the step S1, the question is displayed in an animation form as follows:

[0014] According to the note sequence given by the question, display each note picture from left to right in the order of the question time of each note from small to large, and indicate the pitch of the to-be-played note represented in the piano score rule; connect a horizontal line after each note picture, and the total width of the note picture and the horizontal line indicates the duration of the to-be-played note; at the same time, the note picture with high pitch frequency is displayed above the note picture with relatively low pitch frequency, indicating the relative pitch change between the to-be-played notes; through the scrolling of a vertical progress line, indicate the starting playing time and playing duration of each to-be-played note. This way of displaying the question in an animation form directly shows the rules that need to be played on the screen, which is simple and easy to understand, and reduces the detection errors caused by the difficulty of understanding complex rules by the subjects.

[0015] Further, in the step S1, the question time refers to the time when the to-be-played note needs to start playing, and the question time is displayed on the screen as the time when the vertical progress line scrolls to the left boundary of the to-be-played note picture. This setting of the question time is clear and avoids the subjects from making mistakes and not reflecting the brain ability truly.

[0016] Further, the step S1 is as follows:

[0017] S101, generate different question note sequences according to the chord matching of piano playing; according to the piano music theory knowledge, record the time when each note in the question note sequence needs to start playing as the question time of each note; record the position of each note corresponding to the position of the piano key, that is, the key number of 1-88 piano keys, as the note pitch of each note; according to the number of notes and the complexity of playing, the playing difficulty of the question note sequence is marked, and the question set is finally determined. This step selects the question based on the music language, and the international name of the note name is universal, which avoids the error detection caused by language barrier and inability to understand the question; this step requires the subject to play on the piano key according to the question guidance, and the measurement is extended to ten fingers, which widens the coverage; this step selects the question from the comfortable matching of music, improves the interest and appreciation of the subject in completing the question, and the formed question set has strong expansion, which can be flexibly changed into a melody matching or a popular song matching question set according to the actual demand;

[0018] S102, set multiple rounds of questions in an increasing trend of playing difficulty through a controllable questioner; the setting of difficulty increasing applies appropriate playing pressure to better stimulate the potential of the subject and detect the brain capacity boundary that the subject can bear; each round randomly extracts a question note sequence from the question set as a question, which is displayed in the form of animation on the screen;

[0019] S103, according to the extracted question note sequence, find the question time and note pitch of the corresponding note to be played in the question set and record them accurately. This step realizes the digital automatic storage of the parameters of the note to be played by computer, without manual recording.

[0020] Further, in the step S2, the structure of the electronic piano with scanning function includes a key sensing module, a scanning control module and a data transmission module. The key sensing module is used to determine whether the piano key is in the state of being played; the scanning control module is used to query the position of the played piano key, obtain the playing key number, calculate the playing time of the piano key, and obtain the playing time; the data transmission module is used to transmit the packaged playing key number and playing time information; at the same time, the electronic piano is directly connected to the controllable questioner through a wire, and a timing signal is transmitted at each question time to ensure strict synchronization of time. The electronic piano with scanning function does not need to record the playing behavior of the subject first and then transcribe it digitally; and the data recording accuracy in time and space dimensions is high, which avoids the problem of inaccurate positioning of the starting point of the note caused by the influence of multiple harmonics of the piano sound during recording and transcription.

[0021] Further, the step S2 is as follows:

[0022] S201, the controllable questioner displays the arrival of the question time of a certain to-be-played note in an animation form on the screen, and the electronic keyboard with a scanning function produces a playing behavior accordingly; at this time, the key sensing module judges that a key is in a playing state;

[0023] S202, according to the keyboard scanning principle, the scanning control module inquires at a fixed frequency, obtains the position of the played key, obtains the played note number according to the mapping relationship between the note number and the physical space position of the electronic keyboard, and calculates the time of the played key according to the accumulation result of the timer, and obtains the playing time; this step records the playing time in time and the playing note number in space of the playing behavior of the subject according to the question in real time and accurately;

[0024] S203, the data transmission module encapsulates the playing note number and playing time information in a fixed data format, and transmits by means of serial communication;

[0025] S204, the receiving end connected to the data transmission module parses the playing note number and playing time according to the fixed data format, and stores and records; this step obtains the playing behavior parameters collected by the electronic keyboard by the computer, and stores automatically and digitally without manual recording.

[0026] Further, the step S3 is as follows:

[0027] S301, after one round of questions of the controllable questioner, the receiving end records the playing note number and playing time of all playing behaviors, and constitutes a playing note sequence; according to the playing behavior including playing, wrong playing, missing playing and multiple playing, the playing note sequence is aligned with the question note sequence; this alignment ensures that the notes in the playing note sequence can form a corresponding relationship with the notes in the question note sequence;

[0028] S302, after alignment, the playing time of each note in the playing note sequence is subtracted from the question time of the corresponding note in the question note sequence, and the reaction time of each note in the playing note sequence is obtained; the average of all reaction times is taken as the reaction time of the round of questions.

[0029] Further, in the step S302, when multiple notes in the playing note sequence correspond to the same note in the question note sequence, the reaction times of the multiple notes are averaged first, and then the average is taken with the reaction times of other notes in the playing note sequence; the playing note number of each note in the playing note sequence is compared with the pitch of the corresponding note in the question note sequence, the proportion of the correctly played notes in the total number of notes in the playing note sequence is calculated, and the playing accuracy of the round of questions is taken as the playing accuracy. This step automatically calculates the gap between the parameters of the playing behavior and the question parameters according to the question guide without subjective judgment.

[0030] Further, the step S4 is as follows:

[0031] S401, according to the big number theorem, long-term tracking measurement is carried out on the playing behavior;

[0032] S402, according to the data obtained by long-term tracking measurement on reaction time and playing accuracy, statistical analysis is carried out respectively, reference standard is preliminarily set, and the scores of speed measure and ability measure are given;

[0033] S403, the scores of speed and ability are weighted and fused to give the evaluation result of the piano merchant. Through long-term tracking measurement, the overall law followed by the collected sample data is counted, and the brain ability based on the playing behavior is objectively quantified.

[0034] Further, the piano merchant is a concept corresponding to intelligence quotient, emotional quotient and musical quotient, refers to the quotient of the control of the brain on the limbs, spatial positioning and adaptive ability under the playing behavior, the reaction time and playing accuracy parameters of the specified musical notes are measured, the speed score in the time dimension and the ability score in the space dimension are calculated, and the control of the brain on the limbs, spatial positioning and adaptive ability are evaluated. The piano merchant is better to describe the objective quantification of the brain ability index, and is easier to be understood and accepted according to the transfer concept.

[0035] The present application has the following advantages and effects relative to the prior art:

[0036] 1) The present application randomly generates questions based on the music language and the chord matching of the piano through the controllable question generator, and displays the questions in the form of animation on the screen. The musical note names and singing names in the music language are internationally used, which solves the possible communication barrier problem in the cognitive function series scale questionnaire; the question set can select a wide range of question banks, and the chord matching has appreciation value, which solves the possible problems of fixed test questions, lack of expansion and interest in operation in the side evaluation method; the rules of the questions are clearly and easily understood through animation, and the subjects can easily understand the questions, reducing the detection errors caused by understanding complex rules.

[0037] 2) The present application requires the subjects to make corresponding left and right hand playing behavior according to the questions displayed on the screen of the controllable question generator, which is non-destructive and non-invasive, simple to operate, and can be measured at home, solving the possible radiation damage risk and the problem of difficult frequent examination in neurosurgery examination; at the same time, the detection of brain ability in the present application is expanded to the movement of both hands and ten fingers, solving the limitation that the traditional human-computer interaction method can only rely on single finger touch mouse or double finger joystick.

[0038] 3) The present application collects the playing behavior of the subject by the electronic organ with scanning function, without the need of recording and transcribing, with strong real-time performance, ensuring the accuracy of playing time and playing key number; the receiving computer communicates with the electronic organ, transmits data, automatically stores and calculates the difference between playing time and question time, obtains the reaction time, calculates the difference between playing key number and note pitch, obtains the playing accuracy, without the need of artificial recording and judgment, solving the problem of subjectivity of traditional brain evaluation method.

[0039] 4) The present application calculates the speed and ability from time and space dimensions by long-term tracking measurement of playing behavior, and the overall law followed by the statistical sample data, and objectively quantifies the brain ability based on playing behavior, providing a scientific and technological response means for preventing senile dementia, popularizing music aesthetic education and other livelihood issues, serving the public health, and having strong practicability. BRIEF DESCRIPTION OF DRAWINGS

[0040] The drawings described herein are used to provide further understanding of the present application, and form a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application, and do not constitute an improper limitation of the present application. In the drawings:

[0041] Figure 1 is a flow chart of the objective quantification detection method of brain ability based on playing behavior disclosed in the embodiments of the present application;

[0042] Figure 2 is a schematic diagram of displaying questions in the form of animation on the screen of the controllable questioner in the embodiments of the present application;

[0043] Figure 3 is a process diagram of playing behavior detection in the embodiments of the present application;

[0044] Figure 4 is a relationship diagram of question note sequence and playing note sequence in the embodiments of the present application;

[0045] Figure 5 is a schematic diagram of aligning the error playing behavior in the embodiments of the present application;

[0046] Figure 6 is a principle diagram of realizing the evaluation of the organ quotient by information fusion in the embodiments of the present application;

[0047] Figure 7 is a reference diagram of reaction time distribution in the embodiments of the present application;

[0048] Figure 8 is a reference diagram of playing accuracy distribution in the embodiments of the present application. DETAILED DESCRIPTION

[0049] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0050] Embodiment 1

[0051] This embodiment discloses a brain ability objective quantification detection method based on plucking behavior, as shown in the following steps: Figure 1

[0052] S1, display the question in an easily understandable animation form on a controllable question generator with a screen, and accurately record the question time and the note pitch of the to-be-plucked note;

[0053] As shown in the following figure, it is a schematic diagram of displaying the question in an animation form on the screen of the controllable question generator. The animation form displaying the question includes: according to the note sequence given by the question, display each note picture from small to large, from left to right, to indicate the pitch of the to-be-plucked note in the piano tablature rule; connect a horizontal straight line after each note picture, and the total width of the note picture and the horizontal straight line indicates the time length of the to-be-plucked note; at the same time, the note picture with high pitch frequency is displayed in the position above the note picture with relatively low pitch frequency, to indicate the relative pitch change between the to-be-plucked notes; through the scrolling of a vertical progress line, the starting plucking time and the plucking time length of each to-be-plucked note are indicated. i Figure 2

[0054] Among them, the question time is the time when the to-be-plucked note needs to start plucking. It is displayed on the screen as the moment when the vertical progress line scrolls to the left boundary of the to-be-plucked note picture.

[0055] According to the commonly used simple chord combination of piano plucking, different question note sequences are generated. According to the knowledge of piano music theory, the rhythm of the question note sequence, the starting beat and the duration of the note are analyzed, the time when each note needs to start plucking is converted into milliseconds, and recorded as the question time of each note; the position of each note corresponding to the position of the to-be-plucked note on the piano key, i.e. the key number of 1-88 keys, is recorded in the form of digital characters as the note pitch of each note; according to the number of notes and the complexity of plucking, the plucking difficulty level of the question note sequence is determined, and 1, 2 and 3 are used to represent low, medium and high plucking difficulty levels respectively, and finally the question set is determined. ​​​

[0056] The left and right hand playing behaviors are tested separately, and 5 rounds of questions are set by the controllable question generator, and the total test time is about 15 minutes. In order to better detect the boundary of brain capacity, moderate pressure is added in the question, and the first round of question is set as difficulty level 1 playing, the second and third rounds of question are set as difficulty level 2 playing, and the fourth and fifth rounds of question are set as difficulty level 3 playing.

[0057] According to the above rules, a random number is generated in each round within the range of the question set, and if the extracted question note sequence does not meet the playing difficulty level set in the current round, the random number is regenerated until the extracted question note sequence meets the playing difficulty level setting. The extracted question note sequence is taken as the question and displayed in the form of animation on the screen.

[0058] According to the extracted question note sequence, the corresponding position in the question set is found, and the question time and note pitch of the to-be-played note are accurately recorded.

[0059] S2, record the playing time and playing key number through the electronic piano with scanning function;

[0060] The electronic piano with scanning function comprises a key sensing module, a scanning control module and a data transmission module, wherein the key sensing module is used to judge whether the piano key is in a playing state; the scanning control module is used to query the position of the played piano key, obtain the playing key number, calculate the playing time of the piano key, and obtain the playing time; and the data transmission module is used to transmit the packaged playing key number and playing time information.

[0061] It is particularly pointed out that the electronic piano is directly connected to the controllable question generator through a wire, and a timing signal is transmitted at each question time to ensure strict synchronization of time. Figure 3 As shown in the process diagram of the playing behavior detection. The electronic piano with scanning function is respectively installed with a contact A and a contact B under each piano key, and the use of conductive silicone has increased the contact area and the conductivity efficiency. All the piano key contact circuits form a keyboard network, and each piano key is independently read without affecting each other. When the controllable question generator displays the question time T i of a to-be-played note in the form of animation on the screen, the corresponding playing time P i of the electronic piano is generated. The played piano key is in contact with the contact A and the contact B in turn, and the key sensing module judges that the piano key is in a playing state at this time. According to the keyboard scanning principle, the scanning control module queries at a fixed frequency to obtain the position of the playing piano key, and according to the mapping relationship between the piano key number and the physical space position of the electronic piano, the playing key number is obtained. Based on the strict synchronization of time, the playing time of the piano key is calculated based on the cumulative result of the timer to obtain the playing time Pi The data transmission module encapsulates the playing key number and playing time information obtained by the scanning control module according to a fixed data format and transmits in a serial communication mode. The receiving end connected to the data transmission module parses the playing key number and playing time according to the fixed data format and stores and records them.

[0062] S3, calculating the reaction time according to the question time and playing time, and calculating the playing accuracy according to the note pitch and playing key number;

[0063] After one round of questions of the controllable questioner, the receiving end records the playing key number and playing time of all playing behaviors by step S2 to form a playing note sequence. As shown in Figure 4 The figure shows the relationship between the question note sequence and the playing note sequence. Each note in the question note sequence records the corresponding question time T1, T2, …, T n and note pitch H1, H2, …, H n Each note in the playing note sequence also records the corresponding playing time P1, P2, …, P m and playing key number K1, K2, …, K m .

[0064] Since the playing behaviors of different subjects are random, there are several cases such as playing correctly, playing incorrectly, missing playing and playing multiple times, and the length of the playing note sequence and the question note sequence may not be equal, so the playing note sequence and the question note sequence need to be aligned first.

[0065] As shown in Figure 5The alignment of the error playing behavior is shown. Under the piano tablature rules, notes 1, 2, 3, 4, 5 correspond to the names do, re, mi, fa, sol. In the case of missing, the question note sequence shows do, re, mi, and the playing note sequence only plays do, mi. Through alignment, the note do in the playing note sequence corresponds to the note do in the question note sequence, the note mi in the playing note sequence corresponds to the note mi in the question note sequence, and the note re in the question note sequence is missing. In the case of wrong playing, the question note sequence shows do, re, mi, and the playing note sequence plays do, mi, re. Through alignment, the note do in the playing note sequence corresponds to the note do in the question note sequence, the note mi in the playing note sequence corresponds to the note re in the question note sequence, the note re in the playing note sequence corresponds to the note mi in the question note sequence, and the notes re and mi in the question note sequence are played out of order. In the case of multiple playing, the question note sequence shows do, re, mi, and the playing note sequence plays do, re, sol, fa, mi. Through alignment, the note do in the playing note sequence corresponds to the note do in the question note sequence, the note re in the playing note sequence corresponds to the note re in the question note sequence, the notes sol, fa, mi in the playing note sequence all correspond to the note mi in the question note sequence, and the notes sol and fa are played multiple times.

[0066] The alignment method is illustrated in the case of multiple playing. According to the dynamic programming algorithm, the playing key numbers corresponding to the playing note sequence do, re, sol, fa, mi are represented as K=K1, K2, K3, K4, K5; the note pitches corresponding to the question note sequence do, re, mi are represented as H=H1, H2, H3; a 5x3 matrix grid is constructed, and the matrix element (i, j) represents the Euclidean distance of K i and H j . The smaller the distance is, the higher the similarity between two notes is. A path is found in the matrix grid, which passes through several grid points in the grid, so that the total distance cost is minimized. The grid points passed by the path are connected in turn, which is the alignment result of the two note sequences.

[0067] After alignment according to the above method, the playing time of each note in the playing note sequence is subtracted from the playing time of the corresponding note in the question note sequence to obtain the reaction time of each note in the playing note sequence. The average of all reaction times is taken as the reaction time of the question. In particular, when multiple notes in the playing note sequence correspond to the same note in the question note sequence, the reaction times of the multiple notes are first averaged, and then the average is taken with the reaction times of other notes in the playing note sequence. The playing key number of each note in the playing note sequence is compared with the note pitch of the aligned question note sequence to calculate the proportion of correctly played notes in the total number of notes, which is taken as the playing accuracy of the question.

[0068] S4, according to the reaction time and playing accuracy, the evaluation result of the piano merchant is given by information fusion.

[0069] Among them, the piano merchant is a concept corresponding to intelligence quotient, emotional quotient, and musical quotient, which refers to the quotient of brain control over limbs, spatial positioning, and adaptability in playing behavior.

[0070] As Figure 6 shown is a principle diagram for realizing piano merchant evaluation by information fusion. According to the law of large numbers, under the condition of constant test, repeated tests multiple times, the frequency of random events is approximately equal to its probability. The playing behavior of multiple subjects is tracked and collected, and the reaction time and playing accuracy are recorded. According to a large amount of data, combined with related physiological models, the reaction time data and playing accuracy data are statistically analyzed. The reference standard for scoring is preliminarily set, and the scoring based on the speed measure of the statistical model and the scoring based on the ability measure are given respectively. The speed score is used to represent the control speed of the brain over the limbs, and the ability score is used to represent the positioning and adaptability of the brain to the space. The speed score and the ability score are weighted and fused to finally give the evaluation result of the piano merchant.

[0071] Embodiment 2

[0072] Based on the brain capacity objective quantification detection method based on playing behavior disclosed in embodiment 1, this embodiment further discloses the implementation process of the brain capacity objective quantification detection method based on playing behavior, and the specific steps are as follows:

[0073] S1, on the basis of embodiment 1, the controllable questioner displays a question note sequence of a round of questions as quarter notes 1, 4, 5, 2, 4, and 6 under the rules of piano tablature, corresponding to note names do, fa, sol, re, fa, and la. According to the knowledge of piano music theory, the playing time of a quarter note is 1 beat, and at a normal playing speed, 80 beats per minute are played, so the controllable questioner accurately records the playing time and note pitch of the to-be-played note, as shown in Table 1 below:

[0074] Table 1. Question parameter record table in Example 2

[0075] Question time [T1] [T2] [T3] [CD AT T4] [T5] [T6] 0 ms 750 ms 1500 ms 2250 ms 3000 ms 3750 ms Note pitch [H1] [H2] [H3] [H4] [H5] [H6] 40 45 47 42 45 49

[0076] S2, on the basis of Example 1, the electronic piano with scanning function real-time accurately collects the playing behavior of the subjects according to the above question guidance, and the receiving end computer records the playing time and playing key number of all playing behaviors, as shown in Table 2 below:

[0077] Table 2. Playing parameter record table in Example 2

[0078] Striking time [P1] [P2] [P3] [P4] [P5] [P6] 1082 ms 1893 ms 2961 ms 3841 ms 4571 ms 5348 ms Striking key number [K1] [K2] [K3] [K4] [K5] [K6] 40 44 47 42 45 51

[0079] S3, referring to the corresponding steps in Example 1, the results of reaction time and playing accuracy are calculated, as shown in Table 3 below:

[0080] Table 3. Reaction time and playing accuracy result table in Example 2

[0081] Reaction time 1407 ms Striking accuracy 66％

[0082] S4, on the basis of Example 1, as shown in Figure 7 is a reference diagram of the distribution of reaction time, and as shown in Figure 8 is a reference diagram of the distribution of playing accuracy.

[0083] Figure 7 In the distribution of reaction time, a few people react in the time range of 0-150ms, which is determined as very fast speed, and the reference is set to 100 points; some people react in the time range of 150-400ms, which is determined as fast speed, and the reference is set to 90 points; most people react in the time range of 400-870ms, which is determined as ordinary speed, and the reference is set to 80 points; some people react in the time range of 870-1000ms, which is determined as slow speed, and the reference is set to 60 points; a few people react in the time range of 1000-4000ms, which is determined as slow speed, and the reference is set to 40 points; and very few people react in more than 4000ms, which is determined as very slow speed, and the reference is set to 20 points.

[0084] Figure 8 In the distribution of playing accuracy, for a few people with playing accuracy below 30%, it is determined as insufficient ability, and the reference is set to 30 points; for some people with playing accuracy of 30-60%, it is determined as deviated ability, and the reference is set to 50 points; for most people with playing accuracy of 60-80%, it is determined as medium ability, and the reference is set to 70 points; for some people with playing accuracy of 80-100%, it is determined as better ability, and the reference is set to 90 points; and for a few people with playing accuracy of 100%, it is determined as excellent, and the reference is set to 100 points.

[0085] According to the above rules, the evaluation of the subject for the current round of questions is shown in Table 4:

[0086] Table 4. Evaluation table of speed, ability and string gauge in Example 2

[0087] Speed 40 Ability 70 Pianist 55

[0088] The final string gauge of the subject, i.e. the control ability of the brain to the limbs and the spatial positioning and adaptive ability, takes the weight of 0.5 for each of the speed and the ability, and is evaluated as 55 points. The subjective evaluation of the subject for the current round of questions is shown in Table 5:

[0089] Table 5. Subjective evaluation table in Example 2

[0090]

[0091] Compared with the subjective evaluation, the string gauge can better reflect the current level of the subject, and realizes the quantification of the brain ability through the objective measurement of the playing behavior.

[0092] The above examples are the preferred embodiments of the present application, but the embodiments of the present application are not limited by the above examples, and any changes, modifications, substitutions, combinations, simplifications made without departing from the spirit and principles of the present application should be equivalent replacement methods, and are all included in the protection scope of the present application.

Claims

1. A brain capacity objective quantification detection method based on plucking behavior, characterized in that, The detection method comprises the following steps: S1, displaying the question in an understandable animation form on a controllable question presenter with a screen, and accurately recording the question time and the note pitch of the to-be-played note; S2, recording the playing time and the playing key number through an electronic piano with a scanning function; S3, calculating the reaction time according to the question time and the playing time, and calculating the playing accuracy according to the note pitch and the playing key number; the step S3 is as follows: S301, after one round of questions of the controllable question presenter ends, the receiving end records the playing key number and the playing time of all playing behaviors, and forms a played note sequence; according to the playing behavior conditions including playing, wrong playing, missing playing and multiple playing, the played note sequence is aligned with the question note sequence; S302, after alignment, the playing time of each note in the played note sequence is subtracted from the question time of the corresponding note in the question note sequence, and the reaction time of each note in the played note sequence is obtained; the average of all reaction times is taken as the reaction time of the round of questions; in the step S302, when multiple notes in the played note sequence correspond to one note in the question note sequence, the reaction times of the multiple notes are averaged first, and then the average is taken with the reaction times of other notes in the played note sequence; the playing key number of each note in the played note sequence is compared with the note pitch of the corresponding note in the question note sequence, and the proportion of the correctly played notes in the total number of notes in the played note sequence is calculated as the playing accuracy of the round of questions; S4, according to the reaction time and the playing accuracy, the evaluation result of the piano merchant is given through information fusion; the step S4 is as follows: S401, according to the law of large numbers, the playing behavior is tracked and measured for a long time; S402, according to the data obtained by long-term tracking and measurement of the reaction time and the playing accuracy, statistical analysis is carried out respectively, the reference standard is preliminarily set, and the speed measure and the ability measure are scored; S403, the scores of speed and ability are weighted and fused to give the evaluation result of the piano merchant; the piano merchant refers to the quotient of the control of the brain on the limbs, the spatial positioning and the adaptability, the reaction time and the playing accuracy parameters of the specified note are measured, the speed score in the time dimension and the ability score in the space dimension are calculated, and the control of the brain on the limbs, the spatial positioning and the adaptability are evaluated.

2. The method of claim 1, wherein the method is characterized by, The question displayed in the animation form is as follows: According to the note sequence given by the question, each note picture is displayed from left to right in the order of the question time of each note from small to large, indicating the pitch of the to-be-played note represented in the piano score rule; a horizontal straight line is connected after each note picture, and the total width of the note picture and the horizontal straight line indicates the length of time that the to-be-played note needs to be played; at the same time, the note picture with high pitch frequency is displayed in the position above the note picture with relatively low pitch frequency, indicating the relative pitch change between the to-be-played notes; through the rolling of a vertical progress line, the starting playing time and the playing time of each to-be-played note are indicated.

3. The method of claim 1, wherein the method is characterized by, The question time is the time when the to-be-played note needs to start playing, and the question time is displayed on the screen as the time when the vertical progress line scrolls to the left boundary of the to-be-played note picture.

4. The method of claim 1, wherein the method is characterized by, The step S1 is as follows: S101, according to the chord matching of piano playing, different question note sequences are generated; according to the knowledge of piano music theory, the time when each note in the question note sequence needs to start playing is recorded as the question time of each note; the position of each note corresponding to the position of the to-be-played note on the piano key, i.e. the key number of 1-88 piano keys, is recorded as the note pitch of each note; according to the number of notes and the complexity of playing, the playing difficulty of the question note sequence is calibrated, and finally the question set is determined; S102, through the controllable questioner, multiple rounds of questions are set in an increasing trend according to the playing difficulty; each round randomly selects a question note sequence from the question set as a question, which is displayed in the form of animation on the screen; S103, according to the extracted question note sequence, the question time and note pitch of the to-be-played note in the question set are found and accurately recorded.

5. The method of claim 1, wherein the method is characterized by, The structure of the electronic piano with scanning function includes a key sensing module, a scanning control module and a data transmission module, wherein the key sensing module is used to determine whether the piano key is in a played state; the scanning control module is used to query the position of the played key, obtain the played key number, calculate the playing time of the played key, and obtain the playing time; the data transmission module is used to transmit the packaged playing key number and playing time information; at the same time, the electronic piano is directly connected to the controllable questioner through a wire, and a timing signal is transmitted at each question time to ensure strict synchronization of time.

6. The method of claim 5, wherein the method is characterized by, The step S2 is as follows: S201, the controllable questioner displays the question time of a to-be-played note in the form of animation on the screen, and the electronic piano with scanning function produces a playing behavior accordingly; at this time, the key sensing module determines that a piano key is in a played state; S202, according to the keyboard scanning principle, the scanning control module queries at a fixed frequency to obtain the position of the played key, and according to the mapping relationship between the key number of the electronic piano and the physical space position, the played key number is obtained; based on the strict synchronization of time, the playing time of the played key is calculated according to the cumulative result of the timer, and the playing time is obtained; S203, the data transmission module encapsulates the playing key number and playing time information in a fixed data format and transmits it in the form of serial communication; S204, the receiving end connected to the data transmission module parses the playing key number and playing time according to the fixed data format and stores the record.

Images