A cognitive assessment system for hand-eye collaborative hearing

Through the cognitive assessment system for the auditory auditory auditory of the hand eye, the use of speech recognition and the simultaneous evaluation of hand -eye recognition devices can be used to solve the problem of expensive equipment and complex testing process in existing technologies, and achieve efficient and accurate cognitive assessment.

CN117442160BActive Publication Date: 2025-01-24THE TWELFTH PEOPLE S HOSPITAL AFFILIATED TO GUANGZHOU MEDICAL UNIVERSITY
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311326609.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-10-13
Publication Date
2025-01-24
Estimated Expiration
2043-10-13

Smart Images

  • Figure CN117442160B_ABST
    Figure CN117442160B_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of cognitive assessment equipment, and in particular to a cognitive assessment system of hand-eye coordinated hearing, wherein the technical solution comprises: a speech recognition device, which is used to provide speech information to participants, obtain repetition sentences, and obtain speech repetition results; a hand-eye recognition device, which is used to provide visual information to participants, obtain hand movement information of participants, wherein the hand movement information includes a single hand movement score and a comprehensive hand movement score, a single hand movement score is obtained when the hand-eye recognition device operates alone, and a comprehensive hand movement score is obtained when the speech recognition device and the hand-eye recognition device operate together, the single hand movement score and the comprehensive hand movement score are processed to obtain a cognitive score result; an assessment processing device, which is used to perform cognitive assessment on participants according to the speech repetition results and the cognitive score results, reduce the impact of complex processes on detection accuracy, and improve the efficiency of cognitive assessment.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of cognitive assessment equipment, and in particular to a hand-eye coordinated hearing cognitive assessment system. Background Art

[0002] Auditory perception is one of the most important senses of living things. In addition to hearing, human perception of sound also requires understanding, that is, understanding of speech. In order to identify speech signals in the environment, listeners must first use auditory scene analysis and selective attention to extract target speech signals from interfering background noise. In auditory scene analysis, binaural cues, spectral cues, and temporal cues are used to identify different auditory sources in the auditory scene. Subsequently, attention is focused on a selected speech signal, while other signals are ignored. Once attention is focused on the target signal, the listener compares the extracted speech signal with the representation in semantic long-term memory. If the extracted signal matches the representation in semantic long-term memory, the vocabulary can be extracted quickly and correctly, and the incoming speech signal can also be easily recognized and understood. However, in fact, there are cases of hearing loss or cognitive decline. In the case of hearing loss, the incoming speech signal may be attenuated, and the incoming speech signal is usually not quickly recognized. After selecting the speech signal, listeners with cognitive decline cannot match it with the representation in semantic long-term memory in a timely and accurate manner, which affects the listener's judgment of the speech signal.

[0003] At present, listeners with hearing or cognitive impairment are usually examined using professional physical examination equipment, which requires obtaining the listener's brain activity, autonomic nervous system excitement, ear current, pupil changes, heart reaction, skin conduction, hormone levels and other parameters for comprehensive judgment to determine the cause of the subject's cognitive impairment. However, the relevant equipment is expensive, and the use of multiple devices increases the complexity of the detection process. The subjects are prone to resistance due to the complex detection process, which affects the accuracy of some detection parameters and thus affects the results of cognitive assessment. The above problems need to be solved. Summary of the invention

[0004] In order to reduce the impact of complex processes on detection accuracy and improve the efficiency of cognitive assessment, this application provides a hand-eye collaborative hearing cognitive assessment system, which adopts the following technical solutions:

[0005] The present application provides a cognitive assessment system for hand-eye coordinated hearing, comprising:

[0006] A speech recognition device, which is used to provide speech information to the participant, obtain the repetition sentence repeated by the participant according to the speech information, and obtain the speech repetition result;

[0007] A hand-eye recognition device, which is used to provide visual information to the participant and obtain the hand movement information performed by the participant according to the visual information, wherein the hand movement information includes a single hand movement score and a comprehensive hand movement score. When the hand-eye recognition device is operated alone, a single hand movement score is obtained. When the speech recognition device and the hand-eye recognition device are operated together, a comprehensive hand movement score is obtained. The single hand movement score and the comprehensive hand movement score are processed to obtain a cognitive score result;

[0008] The evaluation processing device is used to perform cognitive evaluation on the participant according to the verbal repetition result and the cognitive score result.

[0009] Preferably, the hand-eye recognition device comprises:

[0010] A screen display module, used to display a moving area that the participant needs to follow with his hands;

[0011] A hand information acquisition module is used to obtain the precise time of touching the moving area when the screen display module is touched;

[0012] A timing module, used to record the total touch time of the screen display module;

[0013] A calculation module, used for calculating a single hand movement score or a comprehensive hand movement score according to the touch precision time and the total touch time;

[0014] The hand-eye control processing module is used to control the start and stop of the picture display module, the hand information acquisition module and the timing module, and processes the single hand movement score and the comprehensive hand movement score to obtain the cognitive score result.

[0015] Preferably, when the hand-eye recognition device provides visual information to the participant alone, the hand-eye control processing module calculates a single hand movement score based on the precise touch time and the total touch time.

[0016] Preferably, when the hand-eye recognition device provides visual information to the participant and the speech recognition device provides speech information to the participant, the hand-eye control processing module calculates a comprehensive hand movement score based on the precise touch time and the total touch time.

[0017] Preferably, the speech recognition device comprises:

[0018] The word and sentence database module is used to store the speech tasks that participants need to repeat;

[0019] An audio output module for outputting the speech task to be repeated by the participant;

[0020] The speech control processing module is used to control the start and stop of the word and sentence database module and the audio output module, and obtain the repetition sentence, compare the repetition sentence with the speech task output by the audio output module, and obtain the speech repetition result.

[0021] Preferably, the speech recognition device further comprises:

[0022] The speech rate adjustment module is used to adjust the speech rate of the speech task output of the audio output module.

[0023] Preferably, the word and sentence database module is configured to divide the speech tasks into a number of speech task groups according to age groups;

[0024] The audio output module is configured to obtain the age information of the participant, compare the age information with several groups of age groups in the word and sentence database module, obtain a speech task group of a suitable age group, and output a speech task according to the speech task group.

[0025] Preferably, the word and sentence database module is configured to set a corresponding speech task output speech rate for each speech task group;

[0026] The speech rate adjustment module is configured to obtain the age information of the participant, compare the age information with several groups of age groups in the word and sentence database module, obtain the speech task output speech rate of the appropriate age group, and adjust the speech task output speech rate of the audio output module.

[0027] Preferably, the picture display module is configured to display a moving area moving along an elliptical path.

[0028] Preferably, the hand-eye recognition device further comprises:

[0029] The touch adjustment module is used to set whether the moving area of ​​the screen display module moves at a uniform speed. When the moving area moves at a uniform speed, the speed at which the moving area moves along the elliptical path is adjusted. When the moving area moves at a variable speed, the speed at which the moving area moves along the elliptical path is adjusted, and the duration of the corresponding speed of the moving area is adjusted.

[0030] Preferably, the speech recognition device further comprises:

[0031] The noise output module is used to output preset noise and provide participants with several signal-to-noise ratio environments.

[0032] Preferably, when the noise output module outputs noise, the speech tasks output by the audio output module in several signal-to-noise ratio environments are consistent, and the moving speed of the moving area of ​​the picture display module is consistent.

[0033] Preferably, the hand-eye control processing module is configured to, when obtaining a single hand movement score and a comprehensive hand movement score, subtract the single hand movement score from the several comprehensive hand movement scores obtained to obtain an auditory ability score, and then obtain a cognitive score result based on analysis of the score changes between the several auditory ability scores.

[0034] Preferably, the speech tasks stored in the word and sentence database module include several long sentences, short sentences and words; the speech tasks output by the audio output module are some long sentences, short sentences or words obtained from the word and sentence database module.

[0035] Preferably, the image display module is configured to be able to adjust the touch area of ​​the moving area.

[0036] In summary, compared with the prior art, the technical solution provided by this application has at least the following beneficial effects:

[0037] The present application uses a speech recognition device and a hand-eye recognition device to simultaneously provide speech information and visual information to participants, allowing participants to process two tasks at the same time. After obtaining the speech information, the participant orally repeats the sentence, and the speech recognition device obtains the speech repetition result based on the repeated sentence. At the same time, the participant inputs hand movement information to the hand-eye recognition device through the hand when obtaining visual information, and then obtains the cognitive score result. The evaluation processing device comprehensively evaluates the completion of the participant when completing the two tasks at the same time based on the speech repetition result and the cognitive score result. The method of low operating cost and low labor cost is used to evaluate the cognition of the participant, so that the participant can complete the evaluation in an easy and pleasant way, reduce the impact of complex processes on detection accuracy, and improve the efficiency of cognitive evaluation. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 It is a structural diagram of a cognitive assessment system for hand-eye collaborative hearing described in an embodiment of the present application.

[0039] Figure 2 It is a schematic diagram of the internal structure of the cognitive assessment system for hand-eye collaborative hearing described in an embodiment of the present application.

[0040] Figure 3 This is a parameter table for obtaining hand-eye recognition and speech recognition described in the embodiment of the present application.

[0041] Description of reference numerals:

[0042] 1. Speech recognition device; 2. Hand-eye recognition device; 3. Evaluation and processing device. DETAILED DESCRIPTION

[0043] The following combination Figure 1-Figure 3The present application is described in further detail. The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to be limiting.

[0044] Currently, the means of obtaining participants' brain activity, autonomic nervous system excitement, ear current, pupil changes, heart reaction, skin conduction, hormone levels and other parameters are usually tested with professional instruments. However, this type of instrument is expensive and requires a combination of multiple parameters and multiple test results to evaluate participants, which has low evaluation efficiency. In addition, due to the complex testing process and the long time spent on testing, it is easy to bring a bad experience to participants, causing participants to resist the complex testing process, which in turn affects the accuracy of some hormone, electrical signal and other tests, and the repeated testing that leads to a lower evaluation efficiency.

[0045] People's ability to process information is limited. When completing two or more tasks at the same time, most of the brain resources will be allocated to the main task to be completed, and the remaining small part of the brain resources will be used to complete the secondary task to be completed. When the difficulty of the main task increases, the residual resources used to complete the secondary task will decrease, causing the performance of the secondary task to decline. The decline in the performance of the secondary task represents an increase in allocation. Based on the above principles, this system adopts the method of setting up two small game devices to seize the brain resources of the participants, and evaluates the cognition of the participants according to the scores of the two devices, which simplifies the complex process of the current evaluation method, reduces the detection steps and detection content, and can customize the appropriate difficulty of the assessment process according to the specific situation of the participants, enhance the participants' sense of participation, and evaluate the cognitive function of the participants more accurately and efficiently at a low cost.

[0046] Reference Figure 1 The present application relates to a hand-eye coordinated hearing cognitive assessment system, which specifically includes:

[0047] A speech recognition device, which is used to provide speech information to the participant, obtain the repetition sentence, and obtain the speech repetition result;

[0048] A hand-eye recognition device, which is used to provide visual information to the participant and obtain the participant's hand movement information, wherein the hand movement information includes a single hand movement score and a comprehensive hand movement score. When the hand-eye recognition device operates alone, a single hand movement score is obtained. When the speech recognition device and the hand-eye recognition device operate together, a comprehensive hand movement score is obtained. The single hand movement score and the comprehensive hand movement score are processed to obtain a cognitive score result;

[0049] The evaluation processing device is used to perform cognitive evaluation on the participant according to the verbal repetition result and the cognitive score result.

[0050] Specifically, the speech recognition device provides speech information to the participants. The speech information is usually sentences and words pre-stored in the speech recognition device. The hearing system of the participants is stimulated by audio playback. The participants repeat the speech information after receiving it. After obtaining the repeated sentence, the speech recognition device compares the accuracy with the originally output speech information to obtain the speech repetition result. At the same time, the hand-eye recognition device provides visual information to the participants. The visual information is set as a moving picture that can be observed by the participants. The participants' hands move following the visual information. The hand-eye recognition device obtains the participant's hand movement information and obtains a single hand movement score and a comprehensive hand movement score. When the hand-eye recognition device operates alone, the hand-eye recognition device obtains a single hand movement score. When the speech recognition device and the hand-eye recognition device operate together, the hand-eye recognition device obtains a comprehensive hand movement score. The single hand movement score and the comprehensive hand movement score are processed to obtain a cognitive score result. The evaluation processing device comprehensively evaluates the participant's completion of the two tasks at the same time based on the speech repetition result and the cognitive score result. The low operating cost and low labor cost method is used to evaluate the participant's cognition, so that the participant can complete the evaluation in an easy and pleasant way, reduce the impact of complex processes on detection accuracy, and improve the efficiency of cognitive evaluation.

[0051] Reference Figure 2 As one of the embodiments, the hand-eye recognition device includes a screen display module, a hand information acquisition module, a timing module, a calculation module and a hand-eye control processing module. The screen display module is used to display the moving area that the participant needs to follow with his hands. The hand information acquisition module is used to obtain the precise touching time of the moving area when the screen display module is touched. The timing module is used to record the total touching time of the screen display module. The calculation module is used to calculate a single hand movement score or a comprehensive hand movement score based on the precise touching time and the total touching time. The hand-eye control processing module is used to control the start and stop of the screen display module, the hand information acquisition module and the timing module, and process the single hand movement score and the comprehensive hand movement score to obtain a cognitive score result.

[0052] Specifically, a moving area is set in the screen display module for the participant to touch and press. When the cognitive assessment system of hand-eye coordinated hearing is performed, the participant obtains the screen of the moving area and follows the moving area by touching the hand information acquisition module with his fingers, that is, the finger of the participant touching the hand information acquisition module moves with the moving area, and the hand information acquisition module records the time when the moving area is accurately touched by the participant. The timing module records the total time the hand information acquisition module is touched, and the precise touch time and the total touch time are calculated according to the calculation module, specifically the precise touch time / total touch time.

[0053] As one implementation manner, the picture display module is configured to display a moving area moving along an elliptical path.

[0054] Specifically, the moving area is a circular touch area, and the circular touch area moves around a preset elliptical path. The circular touch area acts as a target object and continues to move clockwise at a constant speed. Speed ​​changes and direction changes will cause interference due to individual differences in reaction ability. In the embodiment of the present application, the upper limit of the speed of the target object is 20 laps / minute, the lower limit is 4 laps / minute, and the step length is 2, that is, there are 9 speeds and the speed is 10 laps / minute.

[0055] As one of the implementation modes, when the hand-eye recognition device provides visual information to the participant alone, the hand-eye control processing module calculates a single hand movement score based on the precise touch time and the total touch time.

[0056] Specifically, before the speech recognition device and the hand-eye recognition device are used simultaneously, the hand-eye recognition device needs to perform a single-task detection on the participant separately, and the touch accuracy time of the single task / the total touch time of the single task is used to obtain the touch accuracy ratio, that is, the single hand movement score.

[0057] As one of the implementation modes, when the hand-eye recognition device provides visual information to the participant and the speech recognition device provides speech information to the participant, the hand-eye control processing module calculates a comprehensive hand movement score based on the precise touch time and the total touch time.

[0058] Specifically, when the speech recognition device and the hand-eye recognition device are used at the same time, the participant is disturbed by the speech recognition device, and the hand-eye recognition device obtains the touch accuracy time of the dual tasks / the total touch time of the single task at this time to obtain the touch accuracy ratio, that is, the comprehensive hand movement score.

[0059] As one embodiment, the speech recognition device includes a word and sentence database module, an audio output module and a speech control processing module. The word and sentence database module is used to store the speech tasks that the participants need to repeat. The audio output module is used to output the speech tasks to be repeated by the participants. The speech control processing module is used to control the start and stop of the word and sentence database module and the audio output module, and obtain the repeated sentences, compare the repeated sentences with the speech tasks output by the audio output module, and obtain the speech repetition results.

[0060] Specifically, the word and sentence database module stores several speech tasks. When two tasks are executed simultaneously, the speech control processing module controls the startup of the word and sentence database module and the audio output module. The audio output module can obtain the pre-stored speech tasks from the word and sentence database module. The speech tasks specifically include several long sentences, short sentences, words, etc. The audio output module plays the speech tasks to the participants according to the pre-set rules. After receiving the speech information, the participants need to repeat it within a certain period of time. The speech control processing module compares the repeated sentences with the speech tasks output by the audio output module, and then obtains the accuracy of the speech repetition, that is, the speech repetition result. At this time, the speech information provided by the speech recognition device is the main information obtained by the participants.

[0061] As one implementation manner, the speech recognition device further includes a noise output module, which is used to output a preset noise to provide a plurality of signal-to-noise ratio environments for the participants.

[0062] Specifically, the signal-to-noise ratio is the speech-noise level difference, that is, the difference between the sound signal intensity output by the sound source and the noise intensity output at the same time, expressed in decibels dB, and the signal-to-noise ratio SRN = effective value of speech signal sound pressure - effective value of noise signal sound pressure. For the speech recognition task, four signal-to-noise ratios are designed, namely 0dB, 5dB, 10dB, 15dB noisy environment and a quiet environment. Because most of the daily life environment is a noisy environment, it is necessary to test under different conditions, using a normal speaking speed of 300 words / minute, and the speech sound is controlled to 65dB, which is close to the speech sound size of daily communication. When the noise output module outputs noise, the speech tasks output by the audio output module in several signal-to-noise ratio environments are consistent, and the moving area movement speed of the picture display module is consistent.

[0063] As one of the implementation modes, the hand-eye control processing module is configured to, when obtaining a single hand movement score and a comprehensive hand movement score, subtract the single hand movement score from the several comprehensive hand movement scores obtained to obtain an auditory ability score, and then obtain a cognitive score result based on the analysis of the score changes between the several auditory ability scores.

[0064] Specifically, refer to Figure 3After obtaining the speech repetition results and cognitive score results, the evaluation and processing device performs a cognitive evaluation on the participant. The speech repetition results are the fluctuations in the speech recognition rate under various signal-to-noise ratio environments. The cognitive score results are the fluctuations in the hearing ability under various signal-to-noise ratio environments. The evaluation and processing device pre-stores a discrimination range for the speech recognition rate, which is used to judge the level of the participant's speech recognition rate, and makes a preliminary assessment of the quality of the participant's speech recognition rate, and then judges the participant's hearing according to the rise and fall of the speech recognition rate in various environments. The evaluation and processing device pre-stores a discrimination range for the hearing ability, which is used to judge the level of the participant's hearing ability, and makes a preliminary assessment of the quality of the participant's hearing ability, and then judges the participant's cognitive according to the rise and fall of the hearing ability in various environments.

[0065] from Figure 3 In the study, it was observed that in addition to hearing loss, participant N1 also had a significant increase in the amount of auditory coordination required, which means that the participant's cognitive ability has declined and is greatly affected by hearing loss. Improving hearing and conducting speech training are expected to help the participant reverse cognitive function. Although participant N2 has hearing loss, his auditory coordination score is relatively small, so his cognitive function is not greatly affected by hearing loss, and usually timely improvement of hearing is sufficient.

[0066] As one embodiment, the speech recognition device further includes a speech rate adjustment module for adjusting the speech rate of the speech task output of the audio output module. The word and sentence database module is configured to divide the speech tasks into a plurality of speech task groups according to age groups.

[0067] The audio output module is configured to obtain the age information of the participant, compare the age information with several groups of age groups in the word and sentence database module, obtain a speech task group of a suitable age group, and output a speech task according to the speech task group.

[0068] The word and sentence database module is configured to set a corresponding speech task output speech rate for each speech task group. The speech rate adjustment module is configured to obtain the age information of the participant, compare the age information with several groups of age groups in the word and sentence database module, obtain the speech task output speech rate of the appropriate age group, and adjust the speech task output speech rate of the audio output module.

[0069] Specifically, before the speech recognition device performs the speech repetition operation, it can improve the evaluation efficiency by adjusting the speech broadcast speed. The speech speed adjustment module adjusts the audio output module to the default output speed. When performing a single speech debugging task, the speech speed is gradually increased or decreased according to the participant's adaptation level, so that the participant can be evaluated at a suitable speech task playback speed. The age of the participant is obtained, and a suitable speech task group is selected according to the age of the participant, so that the initial value debugged by the speech speed adjustment module is a value more suitable for the current participant's adaptation level, thereby reducing the time for gradual adjustment.

[0070] As one implementation method, the word and sentence database module is configured to set a corresponding speech task output speech rate for each speech task group. The speech rate adjustment module is configured to obtain the age information of the participant, compare the age information with several groups of age groups in the word and sentence database module, obtain the speech task output speech rate of the appropriate age group, and adjust the speech task output speech rate of the audio output module.

[0071] The hand-eye coordinated hearing cognitive assessment system also includes a touch adjustment module, which is used to set whether the moving area of ​​the picture display module moves at a uniform speed. If the moving area moves at a uniform speed, the speed at which the moving area moves along the elliptical path is adjusted. If the moving area moves at a variable speed, several speeds at which the moving area moves along the elliptical path are adjusted, and the duration of the corresponding speed of the moving area is adjusted.

[0072] Specifically, before the hand-eye recognition device performs hand-eye tasks to obtain visual information, when performing hand-eye tasks alone, it can obtain a suitable moving area movement speed according to age, and then gradually adjust it to a speed value and uniform speed suitable for the current participant according to the touch adjustment module, thereby improving the efficiency of cognitive assessment.

[0073] As one implementation manner, the image display module is configured to be able to adjust the touch area size of the moving area.

[0074] Specifically, the size of the touch area of ​​the moving zone is adjusted according to the adaptability of the participants, so that the participants can perform the assessment in a situation that is more suitable for the embodiment of the present application, allowing the participants to complete the assessment in an easy and enjoyable manner, reducing the impact of complex processes on detection accuracy and improving the efficiency of cognitive assessment.

[0075] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described device and product can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0076] In several embodiments provided in this application, it should be understood that the disclosed methods, systems, devices and program products may be implemented in other ways.

[0077] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0078] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A cognitive assessment system for hand-eye coordination hearing, characterized in that: include: A speech recognition device, which is used to provide speech information to the participant, obtain the repetition sentence repeated by the participant according to the speech information, and obtain the speech repetition result; A hand-eye recognition device, which is used to provide visual information to the participant and obtain the hand movement information performed by the participant according to the visual information, wherein the hand movement information includes a single hand movement score and a comprehensive hand movement score. When the hand-eye recognition device is operated alone, a single hand movement score is obtained. When the speech recognition device and the hand-eye recognition device are operated together, a comprehensive hand movement score is obtained. The single hand movement score and the comprehensive hand movement score are processed to obtain a cognitive score result; The hand-eye recognition device includes a screen display module for displaying a moving area that the participant needs to follow with his hands; a hand information acquisition module for acquiring the precise time of touching the moving area when the screen display module is touched; and a timing module for recording the total touching time of the screen display module. A calculation module, used for calculating a single hand movement score or a comprehensive hand movement score according to the touch precision time and the total touch time; The hand-eye control processing module is used to control the start and stop of the image display module, the hand information acquisition module and the timing module, and processes the single hand movement score and the comprehensive hand movement score to obtain the cognitive score result; When the hand-eye recognition device provides visual information to the participant alone, the hand-eye control processing module calculates a single hand movement score according to the precise touch time and the total touch time; When the hand-eye recognition device provides visual information to the participant and the speech recognition device provides speech information to the participant, the hand-eye control processing module calculates a comprehensive hand movement score according to the precise touch time and the total touch time; The evaluation processing device is used to perform cognitive evaluation on the participant according to the verbal repetition result and the cognitive score result.

2. The cognitive assessment system for hand-eye coordination hearing according to claim 1, characterized in that: The speech recognition device comprises: The word and sentence database module is used to store the speech tasks that participants need to repeat; An audio output module for outputting the speech task to be repeated by the participant; The speech control processing module is used to control the start and stop of the word and sentence database module and the audio output module, and obtain the repetition sentence, compare the repetition sentence with the speech task output by the audio output module, and obtain the speech repetition result.

3. The cognitive assessment system for hand-eye coordination hearing according to claim 2, characterized in that: The speech recognition device also includes: The speech rate adjustment module is used to adjust the speech rate of the speech task output of the audio output module.

4. The cognitive assessment system for hand-eye coordination hearing according to claim 3, characterized in that: The word and sentence database module is configured to divide speech tasks into a plurality of speech task groups according to age groups; The audio output module is configured to obtain the age information of the participant, compare the age information with several groups of age groups in the word and sentence database module, obtain a speech task group of a suitable age group, and output a speech task according to the speech task group.

5. The cognitive assessment system for hand-eye coordination hearing according to claim 4, characterized in that: The word and sentence database module is configured to set a corresponding speech task output speech rate for each speech task group; The speech rate adjustment module is configured to obtain the age information of the participant, compare the age information with several groups of age groups in the word and sentence database module, obtain the speech task output speech rate of the appropriate age group, and adjust the speech task output speech rate of the audio output module.

6. The cognitive assessment system for hand-eye coordination hearing according to claim 1, characterized in that: The screen display module is configured to display a moving area moving along an elliptical path.

7. The cognitive assessment system for hand-eye coordination hearing according to claim 6, characterized in that: The hand-eye recognition device also includes: The touch adjustment module is used to set whether the moving area of ​​the screen display module moves at a uniform speed. When the moving area moves at a uniform speed, the speed at which the moving area moves along the elliptical path is adjusted. When the moving area moves at a variable speed, the speed at which the moving area moves along the elliptical path is adjusted, and the duration of the corresponding speed of the moving area is adjusted.

8. The hand-eye coordination hearing cognitive assessment system according to claim 2, characterized in that: The speech recognition device also includes: The noise output module is used to output preset noise and provide participants with several signal-to-noise ratio environments.

9. The cognitive assessment system for hand-eye coordination hearing according to claim 8, characterized in that: When the noise output module outputs noise, the speech tasks output by the audio output module in several signal-to-noise ratio environments are all consistent, and the moving speed of the moving area of ​​the picture display module is all consistent.

10. The cognitive assessment system for hand-eye coordination hearing according to claim 9, characterized in that: The hand-eye control processing module is configured to obtain a single hand movement score and a comprehensive hand movement score, and then subtract the single hand movement score from the obtained several comprehensive hand movement scores to obtain an auditory ability score, and then analyze the score changes between the several auditory ability scores to obtain a cognitive score result.

11. The cognitive assessment system for hand-eye coordination hearing according to claim 2, characterized in that: The speech tasks stored in the word and sentence database module include several long sentences, short sentences and words; the speech tasks output by the audio output module are some long sentences, short sentences or words obtained from the word and sentence database module.

12. The hand-eye coordination hearing cognitive assessment system according to claim 2, characterized in that: The image display module is configured to be able to adjust the touch area of ​​the moving area.

Citation Information

Patent Citations

  • Interactive cognitive-multisensory interface apparatus and methods for assessing, profiling, training, and / or improving performance of athletes and other populations

    CN104661713A

  • Method of testing an infant and suitable device for implementing the test method

    CN106999103A