Attention testing and training device and system based on immersive hand-foot hybrid
Through an immersive mixed attention training device for hands and feet, combined with virtual reality technology, the precise operation of hands and feet forces is used to solve the problem of poor attention training effect in the existing system, and more efficient attention training effect is achieved .
Patent Information
- Application Number
- CN201910944897.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-10-01
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2039-10-01
AI Technical Summary
The existing attention training system is difficult to effectively combine the mixed operation of hands and feet, resulting in poor training results and is easily disturbed by external audiovisual information, affecting the efficiency of attention training.
A kind of attention training device based on immersive hand and foot mixing is designed. By combining the hand and foot force stroke acquisition module, the force stroke AD conversion module and the data processing module are used to present the virtual reality audiovisual cognitive tasks. Module, analyze and generate training plans to achieve accurate operation and training of hand and foot force.
The device activates tactile perception through the combination of hands and feet forces, maximizes the activation of tactile functions, avoids external interference, increases the proportion of attention in brain cognitive activities, and achieves more efficient attention training.
Smart Images

Figure CN111067549B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of testing and training devices, and in particular, relates to an attention testing and training device and system based on immersive hand and foot mixing. Background Art
[0002] Human cognitive abilities include orientation, perception, language, calculation, memory and attention. Attention is the basis of all cognitive abilities and the most critical factor in human learning, work and life. With the rapid development of modern society, various learning and work tasks have gradually increased the requirements for attention. For children, only children with focused attention can master more knowledge in the same time, or master knowledge more efficiently. If children are not focused, a series of consequences will occur, such as: easy to be distracted, lack of focus on learning tasks, low efficiency in listening to classes, declining grades, carelessness, and procrastination in homework. In the long run, they will become less and less confident, easily dependent on others, and even prone to extreme tempers such as irritability. For adults, the nature of certain jobs, such as pilots, drivers, athletes, etc., requires a high degree of attention control ability to ensure the smooth implementation and development of work and the accuracy of time. Therefore, testing and training of attention ability can help parents and teachers understand the attention level of children, intervene and train children with low attention levels, or develop adaptive education and teaching methods, so as to better care for children and care for their growth. Testing of attention ability can help human resources departments assess employees' competence in jobs that require attention, and can help adults self-assess their attention levels. On this basis, effective targeted training can be carried out to improve attention and then cognitive ability, which is more in line with the requirements of modern society for talent concentration.
[0003] For example, a Chinese patent document discloses an attention training system that combines immersive vision and discrete force control tasks [application number: CN106128201B]. The system uses frequent attention and finger focus training and an adaptive algorithm to automatically adjust the difficulty of the training task to adapt to the user's increasing control ability or individual differences. At the same time, the user's enthusiasm for the training task and attention are always maintained at the highest level, thereby achieving the purpose of improving the attention and finger control of the target population. However, there are still technical problems such as inconvenience in training attention. Summary of the invention
[0004] The purpose of the present invention is to address the above-mentioned problems and to provide a device and system for training attention based on vision and hearing, an immersive combination of hands and feet, which has a reasonable design and is convenient for training attention.
[0005] To achieve the above-mentioned objectives, the present invention adopts the following technical solutions: This immersive hand-foot mixed attention testing and training device is characterized in that it includes: at least one hand force stroke acquisition module and at least one foot force stroke acquisition module, the hand force stroke acquisition module and the foot force stroke acquisition module are respectively connected to the force stroke AD conversion module, the force stroke AD conversion module is connected to the force stroke data processing module, the hand force stroke acquisition module, the force stroke AD conversion module and the force stroke data processing module are respectively connected to the power supply module, and the force stroke data processing module is connected to the main control module with built-in attention testing / training software through wireless and / or wired communication.
[0006] In the above-mentioned immersive hand-foot mixed attention training device, the hand force stroke acquisition module includes a handheld body, and at least one button is connected to the handheld body. Each button is connected to a hand force stroke variable voltage output mechanism arranged in the handheld body, and when the button is pressed, the output voltage of the hand force stroke variable voltage output mechanism changes with the button stroke.
[0007] In the above-mentioned immersive hand-foot mixed attention testing and training device, the foot force stroke acquisition module includes a base, on which a pedal is hinged, the pedal is tilted, and a foot force stroke variable voltage output mechanism is provided on the base below the upper end of the pedal. The upper end of the pedal acts on the foot force stroke variable voltage output mechanism and when the pedal is moved, the output voltage of the foot force stroke variable voltage output mechanism changes with the pedal stroke.
[0008] In the above-mentioned immersive hand and foot mixed attention testing and training device, the force stroke AD conversion module includes an analog-to-digital converter in an Arduino based on Mega2560, mini or Nano architecture or an analog-to-digital converter in an stm32 core circuit board. The force stroke AD conversion module is used to convert the analog signal of the voltage change of the hand force stroke variable voltage output mechanism and / or the foot force stroke variable voltage output mechanism into a digital signal. The analog-to-digital conversion accuracy is 10-16 bits and the sampling rate is 500Hz; the force stroke data processing module performs Kalman filtering on the current digital signal caused by the voltage change to remove interference and noise signals in the acquisition process, and sends the force stroke data to the main control module via a USB data cable or a wireless Bluetooth protocol; the power supply module is a 3.3-5V DC power supply, and the power supply module is an external DC power supply or a USB interface connected to the main control module.
[0009] In the above-mentioned immersive hand and foot mixed attention training device, the main control module includes any one of a desktop computer, a laptop computer, an all-in-one computer, and a single-chip microcomputer. The main control module is connected to a speaker or earphone, and the main control module has its own or external display screen, a digital TV screen, an all-in-one screen, and a flat-panel screen.
[0010] In the above-mentioned immersive hand-foot mixed attention testing and training device, the number of the hand force stroke acquisition modules is two and they are arranged in parallel, one of which is used for the left hand and the other is used for the right hand.
[0011] In the above-mentioned immersive hand-foot mixed attention testing and training device, the number of the foot force stroke acquisition modules is two and they are arranged in parallel, one of which is used for the left foot and the other is used for the right foot.
[0012] In the above-mentioned immersive hand-foot mixed attention testing and training system, it is characterized in that: the attention testing / training software includes a virtual reality audiovisual cognitive task presentation module, a normative database module, an attention test data analysis module, a report generation module, an attention training program generation module, an attention training process control module and a main control module, wherein the main control module is connected to the virtual reality audiovisual cognitive task presentation module; the main control module is connected to the attention test data analysis module, the normative database module, the report generation module and the output end of the force travel data processing module; the main control module is connected to the attention training program generation module and the attention training process control module; the main control module is connected to the output end of the force travel data processing module; the normative database module, the attention test data analysis module, the report generation module and the output end of the force travel data processing module are connected; wherein,
[0013] The main control module is configured to complete the control of visual and auditory cognitive task flow, visual and auditory cognitive task presentation, access to norm database module, attention test data analysis module and report generation module;
[0014] The virtual reality visual and auditory cognitive task presentation module is configured to complete immersive visual and auditory information presentation;
[0015] The attention test data analysis module is configured to automatically analyze the force travel data generated by the user's foot-operated hand force travel acquisition module (1) in a visual and auditory cognitive task environment, obtain a series of parameters that reflect attention, and compare them with the data of the same age and gender in the norm database module to obtain the user's attention level parameters relative to the norm data;
[0016] The report generation module is configured to automatically display the user's attention level parameters in a certain graphic structure in the form of charts and text, word or PDF documents, and automatically further analyze and explain the meaning and score of the main parameters;
[0017] The norm database module is configured to store attention parameters collected and counted by people with normal attention using an attention testing and training device based on the hand force stroke of the visual and auditory pathway;
[0018] The attention training program generation module is configured to classify the attention level results according to the attention test data analysis module results, and divide the attention training programs into different programs according to the classification;
[0019] The attention training process control module is configured to realize the preservation of the user's training program, the recording of the program's progress, the historical performance recording of completed training, and the query function.
[0020] In the above-mentioned immersive hand-foot mixed attention test and training system, the norm data in the norm database module are distinguished by age and gender, from 6 to 18 years old each year as a statistical data segment; from 19 to 24 years old every two years as a statistical data segment; from 25 to 50 years old every five years as a statistical data segment; from 51 to 60 years old as a statistical data segment; from 61 years old and above as a statistical data segment; including a comprehensive quotient (parameter) related to attention and control and four total quotients (parameters) about attention and control of visual and auditory channels: The system includes four parameters: auditory response control quotient, visual response control quotient, auditory attention quotient, and visual attention quotient; it also includes multiple specific quotients (parameters) about the attention and control of the auditory and visual channels: auditory retention ability quotient, visual retention ability quotient, auditory speed quotient, visual speed quotient, auditory and visual balance quotient, auditory responsiveness ability quotient, visual responsiveness ability quotient, auditory consistency quotient, visual consistency quotient, auditory attention concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, visual discrimination ability quotient, and the standard deviation parameters of the above quotients.
[0021] In the above-mentioned immersive hand-foot mixed attention testing and training system, the comprehensive quotient (parameter) related to attention and control is obtained by weighted calculation based on the auditory response control quotient, visual response control quotient, auditory attention quotient, and visual attention quotient; the specific quotient (parameter) is obtained by standardized calculation; the auditory response control quotient, visual response control quotient, auditory attention quotient, visual attention quotient, auditory retention ability quotient, visual retention ability quotient, auditory speed quotient, visual speed quotient, visual-auditory balance quotient, auditory response ability quotient, visual response ability quotient, auditory consistency quotient, visual consistency quotient, auditory attention concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, and visual discrimination ability quotient are respectively obtained by analyzing the data collected by the hand force stroke collection module (1).
[0022] Compared with the existing technology, the advantages of the present immersive hand-foot hybrid attention training device and system are: 1. Reasonable design, easy to train attention. 2. The combination of force and hand travel is in line with the perception of touch, which can maximize the activation of tactile perception function. 3. The operation is in the visual and auditory information processing environment, which can increase the proportion of attention in brain cognitive activities, thereby avoiding the interference and influence of other cognitive activities in brain function on attention, so that the attention ability in the present invention can be trained more efficiently. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Figure 1 The present invention is a schematic diagram of the composition of an attention testing system for hand and foot force travel based on an immersive virtual reality visual and auditory sensory pathway.
[0024] Figure 2 This is a schematic diagram of the structure of an immersive virtual reality head mounted device of the present invention.
[0025] Figure 3 It is a structural schematic diagram of the hand force stroke acquisition module of the present invention.
[0026] Figure 4 It is a schematic diagram of the design principle of the hand force stroke acquisition module of the present invention.
[0027] Figure 5 It is a structural schematic diagram of the foot force stroke acquisition module of the present invention.
[0028] Figure 6 It is a schematic diagram of the design principle of the foot force stroke acquisition module of the present invention.
[0029] Figure 7 It is a schematic diagram of the visual response operation in the attention test phase of the present invention.
[0030] Figure 8Schematic diagram of auditory response operation in the attention test phase of the present invention.
[0031] Fig. 9 It is a flow chart of the visual and auditory attention test of the present invention.
[0032] Fig.10 It is a schematic diagram of the visual response operation in the attention training stage of the present invention.
[0033] Fig.11 It is a schematic diagram of the auditory response operation in the attention training stage of the present invention.
[0034] Fig.12 This is a flow chart of the visual and auditory attention (80 times) training of the present invention.
[0035] In the figure, there are a hand force stroke acquisition module 1, a foot force stroke acquisition module 2, a force stroke AD conversion module 3, a force stroke data processing module 4, a power supply module 5, a main control module 6, a handheld body 1a, a button 1b, a hand force stroke variable voltage output mechanism 7, a second resistor 72, a first resistor 71, a first spring 73, a first connecting rod 74, a second variable resistance conductive spring 75, a base 2a, a pedal 2b, a third resistor 82, a second spring 84, a second connecting rod 85, a second variable resistance conductive spring 86, a connecting ring 87, a virtual reality audio-visual cognitive task presentation module 9, a normative database module 10, an attention test data analysis module 11, a report generation module 12, an attention training program generation module 13, and an attention training process control module 14. DETAILED DESCRIPTION
[0036] like Figure 1-12 As shown, the present immersive hand-foot mixed attention testing and training device comprises: at least one hand force stroke acquisition module 1 and at least one foot force stroke acquisition module 2, the hand force stroke acquisition module 1 and the foot force stroke acquisition module 2 are respectively connected to the force stroke AD conversion module 3, the force stroke AD conversion module 3 is connected to the force stroke data processing module 4, the hand force stroke acquisition module 1, the force stroke AD conversion module 3 and the force stroke data processing module 4 are respectively connected to the power supply module 5, the force stroke data processing module 4 is connected to the main control module 6 with built-in attention testing / training software via wireless and / or wired communication.
[0037] More specifically, the hand force stroke acquisition module 1 includes a handheld body 1a, to which is connected at least one button 1b, each button 1b is connected to a hand force stroke variable voltage output mechanism 7 disposed in the handheld body 1a, and when the button 1b is actuated, the output voltage of the hand force stroke variable voltage output mechanism 7 changes with the stroke of the button 1b.
[0038] The hand force stroke variable voltage output mechanism 7 includes a first resistor 71 and a second resistor 72 which are parallel to each other, a first spring 73 and a connecting rod 74 pressed between the first spring 73, an inner end of the first connecting rod 74 is provided with a variable resistance conductive spring sheet 75, and the two sides of the second variable resistance conductive spring sheet 75 are respectively electrically contacted with the first resistor 71 and the second resistor 72, the first resistor 71 and the second resistor 72 are respectively connected to the positive and negative electrodes of the power supply module 4, a first fixed resistor is connected between the second resistor 72 and the negative electrode of the power supply module 4, a fixed resistor is connected between the second resistor 72 and the power supply module 5, and the outer end of the first connecting rod 74 extends out of the handheld body 1 and is fixed with the button 1b connected thereto.
[0039] Preferably, five buttons 1b are connected to the handheld body 1a, and the five buttons 1b are adapted to the distribution of fingers on the same hand.
[0040] Preferably, the handheld body 1a is also provided with a wearing structure for easy fixation on the hand, and the wearing structure includes any one of a Y-shaped belt or a fingerless glove.
[0041] The foot force stroke acquisition module 2 includes a base 2a, on which a pedal 2b is hinged, and the pedal 2b is arranged at an angle. A foot force stroke variable voltage output mechanism 8 is arranged on the base 2a and is located below the upper end of the pedal 2b. The upper end of the pedal 2b acts on the foot force stroke variable voltage output mechanism 8 and when the pedal 2b moves, the output voltage of the foot force stroke variable voltage output mechanism 8 changes with the stroke of the pedal 2b.
[0042] The foot force stroke variable voltage output mechanism 8 includes a third resistor 82 and a fourth resistor 83 vertically fixed on the base 2a. The third resistor 82 and the fourth resistor 83 are arranged parallel to each other and a second spring 84 and a second connecting rod 85 pressed between the second spring 84 are provided therebetween. A second variable resistance conductive spring sheet 86 is provided at the lower end of the second connecting rod 85. The two ends of the second variable resistance conductive spring sheet 86 are respectively electrically contacted with the third resistor 82 and the fourth resistor 83. The third resistor 82 and the fourth resistor 83 are respectively connected to the positive and negative electrodes of the power supply module 4. A second fixed resistor is connected between the fourth resistor 83 and the negative electrode of the power supply module 4. A fixed resistor 14 is connected between each fourth resistor 83 and the power supply module 4. The upper end of the second connecting rod 85 is connected to the upper end of the pedal 2b. A spherical connecting end is provided at the upper end of the second connecting rod 85, and a connecting ring 87 is provided on the back of the upper end of the pedal 2b.
[0043] The force stroke AD conversion module 3 includes an analog-to-digital converter in an Arduino based on Mega2560, mini or Nano architecture or an analog-to-digital converter in an stm32 core circuit board. The force stroke AD conversion module 3 is used to convert the analog signal of the voltage change of the hand force stroke variable voltage output mechanism 7 and / or the foot force stroke variable voltage output mechanism 8 into a digital signal. The analog-to-digital conversion accuracy is 10-16 bits and the sampling rate is 500Hz; the force stroke data processing module 4 performs Kalman filtering on the current digital signal caused by the voltage change to remove interference and noise signals in the acquisition process, and sends the force stroke data to the main control module 6 via a USB data cable or a wireless Bluetooth protocol; the power supply module 5 is a 3.3-5V DC power supply, and the power supply module 5 is an external DC power supply or a USB interface connected to the main control module 6.
[0044] The main control module 6 includes any one of a desktop computer, a notebook computer, an all-in-one computer, and a single-chip computer. The main control module 6 is connected to a speaker or earphone. The main control module 6 has its own or external display screen, a digital TV screen, an all-in-one computer screen, and a flat-panel screen.
[0045] Preferably, there are two hand force stroke acquisition modules 1 which are arranged in parallel, one of which is used for the left hand and the other is used for the right hand.
[0046] Preferably, the number of the foot force travel acquisition modules 2 is two and they are arranged in parallel, one of which is used for the left foot and the other is used for the right foot;
[0047] The attention test / training software includes a virtual reality audiovisual cognitive task presentation module 9, a norm database module 10, an attention test data analysis module 11, a report generation module 12, an attention training program generation module 13, an attention training process control module 14 and a main control module 6, wherein the main control module 6 is connected to the virtual reality audiovisual cognitive task presentation module 9; the main control module 6 is connected to the output end of the attention test data analysis module 11, the norm database module 10, the report generation module 12 and the force travel data processing module 4; the main control module 6 is connected to the attention training program generation module 13 and the attention training process control module 14; the main control module 6 is connected to the output end of the force travel data processing module 4; the norm database module 10, the attention test data analysis module 11, the report generation module 12 and the force travel data processing module 4 are connected; wherein,
[0048] The main control module 6 is configured to complete the control of the visual and auditory cognitive task flow, the control of the visual and auditory cognitive task presentation, the control of the access norm database module 10, the control of the attention test data analysis module 11 and the control of the report generation module 12;
[0049] The virtual reality visual and auditory cognitive task presentation module 9 is configured to complete immersive visual and auditory information presentation; the specific device for visual information presentation is a virtual reality head-mounted device, such as the desktop-level HTC vive series head-mounted device, Oculus system head-mounted device; such as the mobile-level bird-watching device. Auditory information presentation is mainly achieved by high-fidelity headphones.
[0050] The attention test data analysis module 11 is configured to automatically analyze the force travel data generated by the user's foot operation hand force travel acquisition module 1 in the visual and auditory cognitive task environment, solve a series of parameters that reflect attention and compare them with the data of the same age and gender in the norm database module 10 to solve the attention level parameters of the user relative to the norm data;
[0051] The report generation module 12 is configured to automatically display the user's attention level parameters in a certain graphic structure in the form of charts and text, word or PDF documents, and automatically further analyze and explain the meaning and score of the main parameters;
[0052] The norm database module 10 is configured to store attention parameters collected and counted by people with normal attention using an attention testing and training device based on the hand force stroke of the visual and auditory pathway;
[0053] The attention training program generation module 13 is configured to classify the attention level results according to the attention test data analysis module results, and divide the attention training programs into different programs according to the classification;
[0054] The attention training process control module 14 is configured to implement the functions of saving the user's training program, recording the progress of the program, recording the historical results of completed training, and querying.
[0055] The norm data in the norm database module 8 are differentiated according to age and gender, with each year from 6 to 18 years old as a statistical data segment; from 19 to 24 years old as a statistical data segment every two years; from 25 to 50 years old as a statistical data segment every five years; from 51 to 60 years old as a statistical data segment; and from 61 years old and above as a statistical data segment; it includes a comprehensive quotient parameter related to attention and control and four total quotient parameters about attention and control of the visual and auditory channels: auditory response control quotient, visual response control quotient, auditory attention quotient, and visual attention quotient; it also includes multiple specific quotient parameters about attention and control of the visual and auditory channels: auditory retention ability quotient, visual retention ability quotient, auditory speed quotient, visual speed quotient, visual and auditory balance quotient, auditory response ability quotient, visual response ability quotient, auditory consistency quotient, visual consistency quotient, auditory attention concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, visual discrimination ability quotient, and standard deviation parameters of the above quotients.
[0056] The comprehensive quotient parameters related to attention and control are obtained by weighted calculation based on the auditory response control quotient, visual response control quotient, auditory attention quotient, and visual attention quotient; the specific quotient parameters are obtained through standardized calculation; the auditory response control quotient, visual response control quotient, auditory attention quotient, visual attention quotient, auditory retention ability quotient, visual retention ability quotient, auditory speed quotient, visual speed quotient, auditory-visual balance quotient, auditory response ability quotient, visual response ability quotient, auditory consistency quotient, visual consistency quotient, auditory attention concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, and visual discrimination ability quotient are respectively obtained by analyzing the data collected by the hand force stroke acquisition module 1.
[0057] Each handheld device includes five buttons, corresponding to the finger positions when held. Each button has a displacement distance of 0-20 milliseconds when 0-10 Newtons are applied. The button contains a small sliding resistor. Depending on the test scenario and accuracy, the resistor value can be one of the following: 1K ohm-50K ohm. ( Figure 3 )
[0058] The hand force stroke module structure is divided into: buttons, connecting rods, resistor contact pieces, variable resistance sliders, springs, DC power supply, fixed resistance and other specific components. The working principle is that the hand holds the handheld device, and one finger presses the button, which produces a certain displacement distance, changes the position of the variable resistance slider, and thus changes the output resistance of the sliding resistor. Each variable resistor circuit is in a voltage divider circuit. Due to the change in resistance, the voltage change on the fixed resistance is generated. The voltage change is the force stroke voltage (analog parameter) output. ( Figure 4 )
[0059] The foot force travel acquisition module is mainly made of ABS plastic and is a pedal type. When the pedal is applied with 10-40 Newtons, the displacement distance is 0-50 milliseconds. There is a small sliding rheostat inside the pedal. Depending on the test scenario and accuracy, the resistance of the rheostat can be one of the following: 1K ohm-100K ohm. ( Figure 5 )
[0060] The core structure of the foot force stroke module is divided into: pedal, pedal connecting ring, pedal connecting shaft, base, pedal base connecting parts, connecting rod, resistor contact piece, variable resistance slider, spring, DC power supply, fixed value resistor and other specific parts. The working principle is that the foot is naturally placed on the pedal device, and the pedal is stepped on to produce a certain displacement distance, which changes the position of the variable resistance slider, thereby changing the output resistance of the sliding rheostat. Each variable resistor circuit is in a voltage divider circuit. Due to the change in resistance, the voltage change on the fixed value resistor is generated. The voltage change is the force stroke voltage (analog parameter) output. ( Figure 6)
[0061] The visual reaction operation in the attention test phase: First, the user uses his dominant hand (left or right hand) to hold the force stroke module, and can use one of the five fingers of one hand to press the button as an operation. The visual environment created by the immersive virtual reality device is a classroom in the daytime. The classroom is quiet, there are a certain number of desks and chairs, but no other people. The user's perspective is sitting, facing the blackboard in front of the classroom. A number, such as '1' or '2', appears in the center of the blackboard. After displaying for 200 milliseconds, the number disappears. However, two square boxes arranged up and down continue to be displayed in the center of the blackboard. When you see '1', you must quickly press the button to make the small ball under the blackboard move vertically from bottom to top to the top box. When you see '2', you must quickly press the button to make the small ball under the blackboard move vertically from bottom to top to the bottom box. The increase in stroke caused by pressing the button corresponds to the height of the small ball moving vertically from bottom to top. The lowest height (the bottom of the blackboard) is when there is no key stroke, and the highest height (the top of the blackboard) is when the key achieves the maximum stroke. When the small ball enters the square box and ensures that it is in the box for at least 100 milliseconds. The blackboard is cleared, the user releases the button, and the next operation is performed. If the user fails to make the ball enter the box within 2 seconds, the blackboard is cleared and the next operation is performed. Figure 7 )
[0062] The auditory response operation in the attention test phase is as follows: first, the user uses his or her dominant foot (left or right foot) to naturally place the foot on the force stroke module and uses the foot to step on the pedal as an operation. The visual environment created by the immersive virtual reality device is a classroom in the daytime. The classroom is quiet, with a certain number of desks and chairs, but no other people. The user's perspective is sitting, facing the blackboard in front of the classroom. After a sound such as '1' or '2' is heard in the headphones for 500 milliseconds, two square boxes arranged up and down are continuously displayed in the center of the blackboard. When you hear '1', you should quickly step on the pedal so that the small ball under the blackboard moves vertically from bottom to top to the top box. When you hear '2', you should quickly step on the pedal so that the small ball under the blackboard moves vertically from bottom to top to the bottom box. The increase in stroke caused by stepping on the pedal corresponds to the height of the small ball moving vertically from bottom to top. The lowest height (the bottom of the blackboard) is when there is no pedal stroke, and the highest height (the top of the blackboard) is when the pedal achieves the maximum stroke. When the small ball enters the square box and is guaranteed to be in the box for at least 100 milliseconds. The blackboard is cleared, the user releases the pedal, and the next operation is entered. If the user does not make the ball enter the box within 2 seconds, the blackboard is cleared and the next operation is entered. Figure 8 .
[0063] The auditory and visual attention test:
[0064] The attention test consists of two parts. The first part is the practice stage, which is mainly to familiarize the operation method of the hand and foot force stroke device in the visual and auditory cognitive task environment. In the practice stage, the numbers '1' and '2' are arranged 8 times each, a total of 16 visual response operations, 8 times each for the numbers '1' and '2', a total of 16 auditory response operations, and 16 times (the visual and auditory ratio of the numbers '1' and '2' is 4:4:4:4, and the arrangement order is pseudo-random, that is, the same operation of the numbers '1' and '2' will not appear consecutively.) Visual and auditory mixed response operations. In particular, during the practice stage, if the user does not make the ball enter the box within 2 seconds, the system will use a voice prompt that the operation is too slow.
[0065] The second part is the formal test phase, with a total of 200 operations, including 50 visual operations and 50 auditory operations for the number '1', and 50 visual operations and 50 auditory operations for the number '2'. The order of these operations is pseudo-random, that is, the same operation for the number '1' and the number '2' will not appear consecutively. Fig. 9 .
[0066] Visual response operation in the attention training stage:
[0067] First, the user holds a hand force stroke module with each of his hands, and can press a button with one of the five fingers of one hand for operation.
[0068] The visual program includes about 20 cognitive tasks of different types and difficulties. Thus, training can be carried out step by step. For example, a cognitive task of low difficulty is designed in the following embodiment:
[0069] A number such as '0'-'9' appears at the center of the blackboard but at any height. After displaying for 200 milliseconds, the number disappears. However, a square box continues to be displayed at the original position of the blackboard. When you see '0'-'4', quickly press the left hand button to make the small ball at the bottom of the blackboard move vertically from bottom to top into the square box. When you see '5'-'9', quickly press the right hand button to make the small ball at the bottom of the blackboard move vertically from bottom to top into the square box. The increase in stroke caused by pressing the button corresponds to the height of the small ball moving vertically from bottom to top. The lowest height (the bottom of the blackboard) is when there is no key stroke, and the highest height (the top of the blackboard) is when the key achieves the maximum stroke. When the small ball enters the square box and stays in the box for at least 100 milliseconds. The blackboard is cleared, the user releases the button, and the next operation is entered. If the user does not make the ball enter the box within 2 seconds, the blackboard is cleared and the next operation is entered. Fig.10 .
[0070] Auditory response operation in the attention training stage:
[0071] First, the user uses his or her feet to naturally step on a force stroke module, and can operate by stepping on a pedal.
[0072] The auditory program includes about 20 cognitive tasks of different types and difficulties. Thus, training can be carried out step by step. For example, a cognitive task of low difficulty is designed in the following embodiment:
[0073] Two columns of numbers are first displayed in the center of the blackboard. The numbers '0'-'4' are displayed from top to bottom in the center left position, and the numbers '5'-'9' are displayed from top to bottom in the center right position. After 500 milliseconds, the numbers disappear. However, ten square boxes are continuously displayed in the original position of the blackboard. The speaker or speaker plays a number from '0'-'9' for 500 milliseconds. If it is one of '0'-'4', the left pedal should be stepped on quickly to make the small ball under the blackboard move vertically from bottom to top into the corresponding square box. If it is one of '5'-'9', the right pedal should be stepped on quickly to make the small ball under the blackboard move vertically from bottom to top into the corresponding square box. When the small ball enters the square box and ensures that it stays in the box for at least 100 milliseconds. The blackboard is cleared, the user releases the pedal, and enters the next operation. If the user does not make the small ball enter the square box within 2 seconds, the blackboard is cleared and the next operation is entered. Fig.11 .
[0074] The auditory and visual attention training:
[0075] According to the results of the attention test data analysis module, the attention level results are divided into five plans: 100, 80, 60, 40 and 20 times. Each training includes 4 sub-training items, 2 sub-items for visual training, and 2 sub-items for auditory training, arranged in the order of "visual and auditory", each section is 10 minutes, and the rest time between each section is about 5 minutes. The training time is about 1 hour. Fig.12 .
[0076] There are still the following problems with various attention training or testing methods, especially methods and systems for improving attention using hand force as an operational control.
[0077] First of all, in terms of information processing mechanism, humans mainly use vision, hearing, touch and smell to perceive the world. Among them, the visual and auditory pathways receive and perceive about 94% of information, and touch is about 4%. Therefore, vision and hearing are the main information processing pathways for humans, and related research in brain science believes that visual and auditory functions are not independent, and the visual and auditory functions of healthy people are interconnected. According to the form of information processing pathways, it is divided into single-pathway processing of vision and hearing or mixed dual-pathway processing of vision and hearing. Therefore, attention to information is also mainly reflected in the form of these three visual and auditory sensory pathways. However, the cognitive function of the human brain is extremely complex, and humans do not process information in a single task or single information in cognitive activities. External visual and auditory information can easily affect and interfere with the completion of a single cognitive task. Therefore, isolating external visual and auditory noise information and creating and testing related visual and auditory scenes are very important for reflecting the user's true attention level.
[0078] Secondly, in terms of the mechanism of operation control, force operation can activate tactile perception, but there is no direct relationship between the magnitude of force and the degree of activation of tactile function. It is not the case that the greater the force, the stronger the tactile perception. And over a period of time, monotonous force operation on a single part of the limbs can easily make people tired, but will greatly affect their attention. Therefore, such a design scheme is not the best method for testing or training attention. The present invention innovatively proposes to use hand finger pressing and foot pedaling as an operation control method. The hand force combined with the stroke caused by the operation amplifies the degree of activation of the tactile perception of force. Compared with hand movement, foot movement is more special. The foot needs higher coordination of brain motor function control and related leg and foot muscle groups to complete more precise force movement. The present invention designs cognitive tasks under the visual and auditory channels, uses appropriate force, and presses the button under the action of force pressure to complete a certain distance of stroke training, and steps on the pedal to complete a certain distance of stroke movement. This operation of hand and foot force and the resulting stroke movement require the coordination of maximum attention, that is, the accuracy of the operation of hand and foot force leads to the accuracy of the stroke movement, and these accurate operations are positively correlated with the investment of attention. The way in which this force is combined with the hand and foot stroke is consistent with the perception of touch and can activate the tactile perception function to the maximum extent. In addition, the operation is in the visual and auditory information processing environment. Under such conditions, the joint action of the three sensory pathways greatly increases the proportion of attention in brain cognitive activities. Thereby avoiding the interference and influence of other cognitive activities that exist simultaneously in brain function on attention, so that the attention ability in the present invention can be trained more efficiently.
[0079] Although the present invention uses more terms such as hand force stroke acquisition module 1, foot force stroke acquisition module 2, force stroke AD conversion module 3, force stroke data processing module 4, power supply module 5, main control module 6, handheld body 1a, button 1b, hand force stroke variable voltage output mechanism 7, second resistor 72, first resistor 71, first spring 73, first connecting rod 74, second variable resistance conductive spring 75, base 2a, pedal 2b, third resistor 82, second spring 84, second connecting rod 85, second variable resistance conductive spring 86, connecting ring 87, virtual reality visual and auditory cognitive task presentation module 9, norm database module 10, attention test data analysis module 11, report generation module 12, attention training program generation module 13, attention training process control module 14, etc., it does not exclude the possibility of using other terms. These terms are used only to more conveniently describe and explain the essence of the present invention, and interpreting them as any additional restrictions is contrary to the spirit of the present invention.
Claims
1. An immersive hand-foot mixed attention testing and training device, characterized in that: include: At least one hand force travel acquisition module (1) and at least one foot force travel acquisition module (2), the hand force travel acquisition module (1) and the foot force travel acquisition module (2) are respectively connected to a force travel AD conversion module (3), the force travel AD conversion module (3) is connected to a force travel data processing module (4), the hand force travel acquisition module (1), the force travel AD conversion module (3) and the force travel data processing module (4) are respectively connected to a power supply module (5), and the force travel data processing module (4) is connected to a main control module (6) having built-in attention measurement / training software via wireless and / or wired communication; The hand force stroke acquisition module (1) comprises a handheld body (1a), the handheld body (1a) is connected to at least one button (1b), each button (1b) is connected to a hand force stroke variable voltage output mechanism (7) arranged in the handheld body (1a), and when the button (1b) is actuated, the output voltage of the hand force stroke variable voltage output mechanism (7) changes with the stroke of the button (1b); The foot force stroke acquisition module (2) comprises a base (2a), a pedal (2b) is hingedly connected to the base (2a), the pedal (2b) is arranged tilted, a foot force stroke variable voltage output mechanism (8) is arranged on the base (2a) and is located below the upper end of the pedal (2b), the upper end of the pedal (2b) acts on the foot force stroke variable voltage output mechanism (8), and when the pedal (2b) moves, the output voltage of the foot force stroke variable voltage output mechanism (8) changes with the stroke of the pedal (2b); The hand force stroke variable voltage output mechanism (7) comprises a first resistor (71) and a second resistor (72) which are parallel to each other; a first spring (73) and a connecting rod (74) pressed between the first spring (73) are provided between the first resistor (71) and the second resistor (72); a variable resistance conductive spring (75) is provided at the inner end of the first connecting rod (74); two sides of the variable resistance conductive spring (75) are respectively in electrical contact with the first resistor (71) and the second resistor (72); the first resistor (71) and the second resistor (72) are respectively connected to the positive electrode and the negative electrode of the power supply module (5); a first fixed value resistor is connected between the second resistor (72) and the negative electrode of the power supply module (5); a fixed value resistor is connected between the second resistor (72) and the power supply module (5); an outer end of the first connecting rod (74) extends out of the outside of the handheld body (1a) and is fixed with the key (1b); The foot force stroke variable voltage output mechanism (8) comprises a third resistor (82) and a fourth resistor (83) vertically fixed on the base (2a); the third resistor (82) and the fourth resistor (83) are arranged parallel to each other and a second spring (84) and a second connecting rod (85) pressed between the second spring (84) are arranged between the third resistor (82) and the fourth resistor (83); a second variable resistance conductive spring (86) is arranged at the lower end of the second connecting rod (85); two ends of the second variable resistance conductive spring (86) are respectively connected to the third resistor (82) and the fourth resistor (83); The third resistor (82) and the fourth resistor (83) are respectively connected to the positive electrode and the negative electrode of the power supply module (5); a second fixed value resistor is connected between the fourth resistor (83) and the negative electrode of the power supply module (5); a fixed value resistor (14) is connected between each fourth resistor (83) and the power supply module (5); the upper end of the second connecting rod (85) is connected to the upper end of the pedal (2b); the upper end of the second connecting rod (85) is provided with a spherical connecting end; and the back of the upper end of the pedal (2b) is provided with a connecting ring (87); The visual response operation in the attention test stage is as follows: first, the user holds the hand force travel acquisition module (1) with his or her dominant hand, and presses a button with one of the five fingers of the hand as an operation; the visual environment created by the immersive virtual reality device is a classroom in the daytime, which is quiet and has a certain number of desks and chairs, but no other people. The user's perspective is a sitting position, facing the blackboard in front of the classroom, and a number appears in the center of the blackboard. '1' or '2', after being displayed for 200 milliseconds, the number disappears; but two square boxes arranged up and down continue to be displayed in the center of the blackboard; when seeing '1', press the button to make the small ball at the bottom of the blackboard move vertically from bottom to top to the top box; when seeing '2', press the button to make the small ball at the bottom of the blackboard move vertically from bottom to top to the bottom box; the increase in stroke caused by pressing the button corresponds to the height of the small ball moving vertically from bottom to top; the lowest height is when there is no key stroke, and the highest height is when the key achieves the maximum stroke; when the small ball enters the square box and ensures that it stays in the box for at least 100 milliseconds; the blackboard is cleared, the user releases the button, and enters the next operation; if the user does not make the ball enter the box within 2 seconds, the blackboard is cleared and enters the next operation; The auditory response operation in the attention test stage is as follows: first, the user uses his or her dominant foot to naturally place the foot on the foot force stroke acquisition module (2) and use the foot to step on the pedal as an operation; the visual environment created by the immersive virtual reality device is a classroom in the daytime, the classroom is quiet, there are a certain number of desks and chairs, but no other people, the user's perspective is sitting, facing the blackboard in front of the classroom, and after a sound of '1' or '2' is heard in the headphones for 500 milliseconds, two square boxes arranged up and down are continuously displayed in the center of the blackboard; when '1' is heard, the pedal is stepped on so that the blackboard The small ball at the bottom moves vertically from bottom to top to the uppermost frame; when you hear '2', you need to step on the pedal to make the small ball at the bottom of the blackboard move vertically from bottom to top to the lowermost frame; the increase in stroke caused by stepping on the pedal corresponds to the height of the small ball moving vertically from bottom to top; the lowest height is when there is no pedal stroke, and the highest height is when the pedal achieves the maximum stroke; when the small ball enters the square frame and stays in the frame for at least 100 milliseconds; the blackboard is cleared, the user releases the pedal, and proceeds to the next operation; if the user fails to make the ball enter the frame within 2 seconds, the blackboard is cleared, and proceeds to the next operation.
2. The immersive hand-foot mixed attention training device according to claim 1 is characterized in that: The force-stroke AD conversion module (3) comprises an analog-to-digital converter in an Arduino based on a Mega2560, mini or Nano architecture or an analog-to-digital converter in an STM32 core circuit board. The force-stroke AD conversion module (3) is used to convert the analog signal of the voltage change of the hand force-stroke variable voltage output mechanism (7) and / or the foot force-stroke variable voltage output mechanism (8) into a digital signal, with an analog-to-digital conversion accuracy of 10-16 bits and a sampling rate of 500 Hz. The force-stroke data processing module (4) performs Kalman filtering on the current digital signal caused by the voltage change to remove interference and noise signals in the acquisition process, and sends the force-stroke data to the main control module (6) via a USB data cable or a wireless Bluetooth protocol. The power supply module (5) is a 3.3-5V DC power supply, and the power supply module (5) is an external DC power supply or a USB interface connected to the main control module (6).
3. The immersive hand-foot mixed attention training device according to claim 1 or 2, characterized in that: The main control module (6) comprises any one of a desktop computer, a notebook computer, an all-in-one computer, and a single-chip computer. The main control module (6) is connected to a speaker or earphone. The main control module (6) is provided with or externally connected to any one of a display screen, a digital television screen, an all-in-one computer screen, and a flat-panel screen.
4. The immersive hand-foot mixed attention training device according to claim 2 is characterized in that: The number of the hand force stroke acquisition modules (1) is two and they are arranged in parallel, one of which is used for the left hand and the other is used for the right hand.
5. The immersive hand-foot mixed attention training device according to claim 2 is characterized in that: The number of the foot force stroke acquisition modules (2) is two and they are arranged in parallel, one of which is used for the left foot and the other is used for the right foot.
6. An immersive hand-foot mixed attention testing and training system using the immersive hand-foot mixed attention testing and training device according to any one of claims 1 to 5, characterized in that: The attention test / training software comprises a virtual reality visual and auditory cognitive task presentation module (9), a norm database module (10), an attention test data analysis module (11), a report generation module (12), an attention training program generation module (13), an attention training process control module (14) and a main control module (6), wherein the main control module (6) is connected to the virtual reality visual and auditory cognitive task presentation module (9); the main control module (6) is connected to the output end of the attention test data analysis module (11), the norm database module (10), the report generation module (12) and the force travel data processing module (4); the main control module (6) is connected to the attention training program generation module (13) and the attention training process control module (14); the main control module (6) is connected to the output end of the force travel data processing module (4); the norm database module (10), the attention test data analysis module (11), the report generation module (12) and the force travel data processing module (4) are connected; wherein, The main control module (6) is configured to complete the control of the visual and auditory cognitive task process, the control of the visual and auditory cognitive task presentation, the control of the access to the norm database module (10), the control of the attention test data analysis module (11) and the control of the report generation module (12); The virtual reality visual and auditory cognitive task presentation module (9) is configured to complete immersive visual and auditory information presentation; The attention test data analysis module (11) is configured to automatically analyze the force stroke data generated by the user's foot-operated hand force stroke acquisition module (1) in a visual and auditory cognitive task environment, obtain a series of parameters that reflect attention, and compare them with the data of the same age and gender in the norm database module (10) to obtain the user's attention level parameters relative to the norm data; The report generation module (12) is configured to automatically display the user's attention level parameters in a certain graphic structure in the form of charts and text, or in a Word or PDF document, and automatically further analyze and explain the meaning of the main parameters and the score. The norm database module (10) is configured to store attention parameters collected and counted by people with normal attention using an attention testing and training device based on the hand force stroke of the visual and auditory pathways; The attention training program generation module (13) is configured to classify the attention level results according to the attention test data analysis module results, and divide the attention training programs into different programs according to the classification; The attention training process control module (14) is configured to realize the functions of saving the user's training program, recording the implementation of the program, and recording and querying the historical results of completed training.
7. The immersive hand-foot hybrid attention training system according to claim 6 is characterized in that: The norm data in the norm database module (10) are differentiated by age and gender, with each year from 6 to 18 years old being a statistical data segment; each two years from 19 to 24 years old being a statistical data segment; each five years from 25 to 50 years old being a statistical data segment; each five years from 51 to 60 years old being a statistical data segment; and each year from 61 years old and above being a statistical data segment; including a comprehensive quotient related to attention and control and four total quotients related to attention and control of the visual and auditory channels: auditory response control quotient, visual response control quotient, auditory attention quotient, and visual attention quotient; and also including a plurality of specific quotients related to attention and control of the visual and auditory channels: auditory retention ability quotient, visual retention ability quotient, auditory speed quotient, visual speed quotient, visual and auditory balance quotient, auditory response ability quotient, visual response ability quotient, auditory consistency quotient, visual consistency quotient, auditory attention concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, and visual discrimination ability quotient, as well as standard deviation parameters of the above quotients.
8. The immersive hand-foot hybrid attention training system according to claim 7 is characterized in that: The comprehensive quotient related to attention and control is obtained by weighted calculation based on the auditory response control quotient, visual response control quotient, auditory attention quotient, and visual attention quotient; the specific quotient is obtained by standardized calculation; the auditory response control quotient, visual response control quotient, auditory attention quotient, visual attention quotient, auditory retention ability quotient, visual retention ability quotient, auditory speed quotient, visual speed quotient, visual and auditory balance quotient, auditory response ability quotient, visual response ability quotient, auditory consistency quotient, visual consistency quotient, auditory attention concentration quotient, visual attention concentration quotient, auditory discrimination ability quotient, and visual discrimination ability quotient are respectively obtained by analyzing the data collected by the hand force stroke collection module (1).
