Aphasia patient training method, device, medium and equipment

By using personalized aphasia training methods that combine speech, image, text, and body movement recognition, the training content can be adjusted to meet the needs of different patients, thus addressing the shortcomings of existing training methods and improving training effectiveness and patients' emotional management.

CN119418869BActive Publication Date: 2026-02-10DONGZHIMEN HOSPITAL OF BEIJING UNIV OF CHINESE MEDICINE
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202411551875.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-11-01
Publication Date
2026-02-10
Estimated Expiration
2044-11-01

AI Technical Summary

Technical Problem

Existing aphasia training methods lack personalization and cannot provide appropriate training intensity and content based on the age and severity of the disease of different patients, resulting in poor training effects.

Method used

By receiving training requests from aphasic patients, outputting training content and acquiring their input information, evaluating based on the input information, and adjusting the training content to suit the individual needs of patients, including interactive training with speech, images, and text, and combining body movement and facial expression recognition to improve the accuracy of the evaluation.

Benefits of technology

It improved the effectiveness of aphasia training and the patients' enthusiasm for training, ensured the personalization of training content and emotional stability, and enhanced the novelty and interest of training.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119418869B_ABST
    Figure CN119418869B_ABST
Patent Text Reader

Abstract

The application discloses an aphasia patient training method, device, medium and equipment. The method comprises the following steps: receiving a training request of an aphasia patient; outputting training content to the aphasia patient; wherein the training content comprises playing a voice, displaying an image and displaying a text; obtaining input information of the aphasia patient; wherein the input information comprises reply information given by the aphasia patient based on the training content; evaluating the aphasia patient based on the input information to obtain an evaluation result; and adjusting the training content of the aphasia patient based on the evaluation result. In the aphasia training process, the training content is outputted, the input information of the aphasia patient is obtained, the aphasia patient is evaluated based on the input information, and the training content of the aphasia patient is adjusted according to the evaluation result, so that the training content suitable for the aphasia patient can be generated, the effect of the aphasia training can be improved, and the emotion of the patient can be considered to ensure the training enthusiasm of the patient.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of aphasia training technology, specifically to a training method, device, medium, and equipment for aphasia patients. Background Technology

[0002] Aphasia is a common complication of stroke, resulting from damage to the brain's language center and its connecting tracts after a stroke. It manifests as speech impairment, primarily characterized by clear consciousness, no mental disturbances, no severe cognitive impairment, but the patient cannot understand others' speech, cannot express their own thoughts, and cannot comprehend or write words or phrases they could read or write before the stroke. This impairs the patient's ability to understand and express the human communicative symbol system, particularly affecting the understanding and expression of phonetics, vocabulary, grammar, language structure, and the content and meaning of language, as well as the decline and functional impairment of language cognitive processes, which are the foundation of language. Aphasia training is a long and arduous task, requiring multi-faceted training in listening, speaking, reading, writing, and calculation. For elderly stroke patients, aphasia training is an even more patient and demanding long-term endeavor. Therefore, the key to language training is the patient's active participation, understanding their psychological dynamics, providing timely psychological support, and maintaining emotional stability.

[0003] Existing aphasia training methods mostly employ a standardized model for language training of aphasic patients. However, different patients, such as those of different ages and with varying degrees of illness, require different training intensities. Therefore, a method is needed that can improve the training adaptability and effectiveness for aphasic patients. Summary of the Invention

[0004] To address the aforementioned technical problems, this application is proposed. Embodiments of this application provide a training method, apparatus, medium, and device for patients with aphasia.

[0005] According to one aspect of this application, a training method for an aphasic patient is provided, comprising: receiving a training request from the aphasic patient; outputting training content to the aphasic patient; wherein the training content includes playing audio, displaying images, and displaying text; acquiring input information from the aphasic patient; wherein the input information includes response information given by the aphasic patient based on the training content; evaluating the aphasic patient based on the input information to obtain an evaluation result; and adjusting the training content for the aphasic patient based on the evaluation result.

[0006] In one embodiment, the input information includes the aphasic patient repeating the audio input from the played audio; wherein, the evaluation of the aphasic patient based on the input information to obtain the evaluation result includes: comparing the similarity between the repeating audio and the played audio to obtain the evaluation result.

[0007] In one embodiment, the input information includes cognitive speech input by the aphasic patient in the displayed image; wherein, the evaluation of the aphasic patient based on the input information to obtain the evaluation result includes: semantic information of the cognitive speech; and obtaining the evaluation result based on the semantic information of the cognitive speech and the semantic information contained in the displayed image.

[0008] In one embodiment, the input information includes the aphasic patient reading aloud the displayed text input; wherein, the assessment of the aphasic patient based on the input information to obtain the assessment result includes: recognizing the text information of the read-aloud speech; and obtaining the assessment result based on the text information of the read-aloud speech and the displayed text.

[0009] In one embodiment, the training method for the aphasia patient further includes: acquiring the aphasia patient's movement information; wherein the movement information includes the aphasia patient's limb movements; identifying the movement information to obtain the aphasia patient's true intention; and evaluating the aphasia patient based on the input information to obtain an evaluation result, which includes: evaluating the aphasia patient based on the input information and the true intention to obtain the evaluation result.

[0010] In one embodiment, identifying the action information to obtain the true intention of the aphasic patient includes: inputting the action information into a true intention recognition model to obtain the true intention of the aphasic patient; wherein, the true intention recognition model is obtained through training on various limb movements and corresponding intentions of the aphasic patient.

[0011] In one embodiment, the training method for the aphasia patient further includes: acquiring the facial expression information of the aphasia patient; recognizing the facial expression information to obtain the urgency level of the aphasia patient; and issuing an alarm if the urgency level is greater than a preset urgency level threshold.

[0012] According to another aspect of this application, a training device for aphasic patients is provided, comprising: a training request receiving module for receiving training requests from aphasic patients; a training content output module for outputting training content to the aphasic patients; wherein the training content includes playing audio, displaying images, and displaying text; an input information acquisition module for acquiring input information from the aphasic patients; wherein the input information includes response information given by the aphasic patients based on the training content; an evaluation result generation module for evaluating the aphasic patients based on the input information and obtaining an evaluation result; and a training content adjustment module for adjusting the training content for the aphasic patients based on the evaluation result.

[0013] According to another aspect of this application, a computer-readable storage medium is provided, the storage medium storing a computer program for performing any of the methods described above.

[0014] According to another aspect of this application, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; the processor being configured to perform any of the methods described above.

[0015] This application provides a training method, apparatus, medium, and device for aphasia patients. The method involves receiving training requests from aphasia patients; outputting training content to the aphasia patients, including playing audio, displaying images, and displaying text; acquiring input information from the aphasia patients, including responses based on the training content; evaluating the aphasia patients based on the input information; and adjusting the training content based on the evaluation results. In other words, during aphasia training, by outputting training content and acquiring input information from the aphasia patients, evaluating them based on this input information, and adjusting the training content according to the evaluation results, suitable training content for aphasia patients can be generated. This not only improves the effectiveness of aphasia training but also considers the patient's emotions, ensuring their training motivation. Attached Figure Description

[0016] The above and other objects, features, and advantages of this application will become more apparent from the more detailed description of the embodiments of this application in conjunction with the accompanying drawings. The drawings are provided to further illustrate the embodiments of this application and form part of the specification. They are used together with the embodiments of this application to explain this application and do not constitute a limitation thereof. In the drawings, the same reference numerals generally represent the same components or steps.

[0017] Figure 1 This is a flowchart illustrating a training method for aphasic patients provided in an exemplary embodiment of this application.

[0018] Figure 2 This is a schematic diagram of the structure of a training device for aphasic patients provided in an exemplary embodiment of this application.

[0019] Figure 3 This is a structural diagram of an electronic device provided in an exemplary embodiment of this application. Detailed Implementation

[0020] Hereinafter, exemplary embodiments according to this application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this application, and not all embodiments of this application. It should be understood that this application is not limited to the exemplary embodiments described herein.

[0021] Figure 1 This is a flowchart illustrating a training method for aphasic patients provided in an exemplary embodiment of this application. Figure 1 As shown, the training method for this aphasia patient includes the following steps:

[0022] Step 110: Receive training requests from aphasic patients.

[0023] This application allows for the use of aphasia training devices to train aphasia patients. Aphasia patients can turn on the aphasia training devices manually or by voice control. Once the aphasia training devices receive the training request (i.e., the activation command) from the aphasia patient, they can begin aphasia training.

[0024] Step 120: Output training content to aphasic patients.

[0025] The training content includes playing audio, displaying images, and displaying text. During training, the aphasia training device outputs training content to aphasia patients; specifically, it can play audio, images, or text on the device to help them train their hearing, reading, and speaking skills.

[0026] Step 130: Obtain input information from aphasic patients.

[0027] The input information includes responses from aphasic patients based on the training content. The aphasic training device acquires this input information during training to enable interactive training, thus providing a fun and engaging learning experience that enhances the patient's motivation and enjoyment of the training.

[0028] Step 140: Based on the input information, assess the aphasia patient and obtain the assessment results.

[0029] After acquiring input information from aphasic patients, the aphasic training device assesses the patients based on this information to determine their severity of the condition and the degree of completion of training.

[0030] Step 150: Based on the assessment results, adjust the training content for patients with aphasia.

[0031] After obtaining the assessment results of aphasic patients, the training content for aphasic patients is adjusted based on these results. For example, during the initial training, the training level is determined based on the input information of aphasic patients. After a period of training or a certain number of courses, aphasic patients are assessed again, and the training content and training mode are adjusted according to the assessment results to ensure the training effect. Furthermore, by adjusting the training mode and training content, novelty is increased, thereby improving the training interest of aphasic patients.

[0032] This application provides a training method for aphasic patients, which involves receiving training requests from aphasic patients; outputting training content to aphasic patients, including playing audio, displaying images, and displaying text; acquiring input information from aphasic patients, including responses from aphasic patients based on the training content; evaluating aphasic patients based on the input information to obtain evaluation results; and adjusting the training content based on the evaluation results. In other words, during aphasic training, by outputting training content and acquiring input information from aphasic patients, evaluating them based on this input information, and adjusting the training content according to the evaluation results, suitable training content for aphasic patients can be generated. This not only improves the effectiveness of aphasic training but also considers the patient's emotions, ensuring their training motivation.

[0033] In one embodiment, the input information includes the aphasic patient repeating the played audio input; wherein, the specific implementation of step 140 above may be: comparing the similarity between the repeating audio and the played audio to obtain an evaluation result.

[0034] Aphasia training devices can play audio and record the aphasia patient's echo pronunciation after the audio is played. That is, by playing a piece of audio and recording the aphasia patient's echo pronunciation, the similarity between the played audio and the echo pronunciation is compared to evaluate the aphasia patient's echo pronunciation results.

[0035] It should be understood that this application can adaptively adjust the length and difficulty of the played audio based on the reading performance of aphasic patients. For example, if the reading performance of aphasic patients is poor, the difficulty of the played audio can be appropriately reduced, and the length of the played audio can be shortened to adapt to the training intensity of aphasic patients and ensure their training effect.

[0036] In one embodiment, the input information includes cognitive speech input from the image displayed to the aphasic patient; wherein, the specific implementation of step 140 above may be: recognizing the semantic information of the cognitive speech; and obtaining an evaluation result based on the semantic information of the cognitive speech and the semantic information contained in the displayed image.

[0037] Aphasia training devices can display images and receive the cognitive speech of aphasia patients on those images after displaying the images. For example, the device can display images of various commonly used objects in daily life and record the cognitive speech of aphasia patients on those images. After recognizing the semantic information of the cognitive speech, the device can determine whether the aphasia patient has recognized the images correctly, thereby obtaining an evaluation result.

[0038] It should be understood that when aphasic patients undergo image recognition training, they may be unable to accurately describe the object even though they recognize it due to insufficient language expression ability. Therefore, this application can play the recognized semantic information in the form of text or speech to aphasic patients during the recognition of cognitive speech, so that the aphasic patients can judge whether the semantic information is their true expression. If it is, an evaluation is performed based on the semantic information. If it is not, the cognitive speech is recognized again or the aphasic patients input it again. At the same time, it can increase the proportion of speech training or text training and reduce the proportion of image training.

[0039] In one embodiment, the input information includes the aphasic patient reading aloud the displayed text input; wherein, the specific implementation of the above step 140 may be: recognizing the text information of the read-aloud speech; and obtaining an evaluation result based on the text information of the read-aloud speech and the displayed text.

[0040] Aphasia training devices can generate audio by displaying text and having aphasia patients read it aloud. After recording the audio, the device identifies the text information in the audio and compares it with the displayed text to obtain the assessment results of the aphasia patient, that is, to assess the aphasia patient's ability to understand text.

[0041] It should be understood that during speech recognition training, aphasic patients may be unable to accurately express themselves despite recognizing the displayed text due to insufficient language expression ability. Therefore, this application can play the recognized text information in speech form to aphasic patients during speech recognition, allowing them to judge whether the text information is their true expression. If it is, an evaluation is performed based on the text information; if not, the speech is recognized again or the aphasic patient inputs it again. This approach can simultaneously increase the proportion of speech training and decrease the proportion of text training.

[0042] In one embodiment, the training method for aphasic patients may further include: acquiring the aphasic patient's movement information; wherein the movement information includes the aphasic patient's limb movements; identifying the movement information to obtain the aphasic patient's true intention; correspondingly, the specific implementation of step 140 may be: evaluating the aphasic patient based on the input information and the true intention to obtain the evaluation result.

[0043] Because the speech information expressed by different aphasic patients varies, especially for those with accents or regional accents, aphasia training devices often struggle to accurately identify the input information. Therefore, this application incorporates the patient's motor information. For instance, aphasic patients may use body movements to express their true intentions when inputting information. This application can acquire these body movements, such as hand, foot, and eye movements, using devices like cameras. By identifying the patient's true intentions, the application can determine their actual expression and assess the patient by comparing the input information with their true intentions, thus enabling personalized training.

[0044] In one embodiment, the method for obtaining the true intention of the aphasic patient may be: inputting action information into a true intention recognition model to obtain the true intention of the aphasic patient; wherein, the true intention recognition model is obtained through training on various limb movements and corresponding intentions of the aphasic patient.

[0045] Specifically, this application uses various limb movements and corresponding true intentions of aphasic patients as training samples to train the true intention recognition model, so as to obtain a model that can accurately recognize the intentions of the limb movements of aphasic patients. In practical applications, the movement information of aphasic patients is input into the true intention recognition model to obtain the true intentions of aphasic patients, thereby improving the efficiency and accuracy of obtaining the true intentions of aphasic patients.

[0046] In one embodiment, the training method for aphasic patients may further include: acquiring facial expression information of aphasic patients; recognizing the facial expression information to obtain the urgency level of aphasic patients; and issuing an alarm if the urgency level is greater than a preset urgency level threshold.

[0047] During the training process, this application also acquires facial expression information from aphasic patients, identifies this information to determine the urgency level of the situation, and issues an alarm when the urgency level is high. For example, if an aphasic patient becomes agitated during training, it may negatively impact their motivation and even their condition. Therefore, when the aphasic patient's facial expression indicates a poor mood, an alarm is triggered to notify nearby caregivers, especially elderly people living alone. In this case, a remote emergency contact can be automatically dialed for reassurance.

[0048] Figure 2 This is a schematic diagram of the structure of a training device for aphasic patients provided in an exemplary embodiment of this application. Figure 2 As shown, the training device 20 for aphasia patients includes: a training request receiving module 21 for receiving training requests from aphasia patients; a training content output module 22 for outputting training content to aphasia patients, wherein the training content includes playing audio, displaying images, and displaying text; an input information acquisition module 23 for acquiring input information from aphasia patients, wherein the input information includes response information given by aphasia patients based on the training content; an evaluation result generation module 24 for evaluating aphasia patients based on the input information and obtaining evaluation results; and a training content adjustment module 25 for adjusting the training content for aphasia patients based on the evaluation results.

[0049] This application provides a training device for aphasia patients. A training request receiving module 21 receives training requests from aphasia patients; a training content output module 22 outputs training content to the aphasia patients, including playing audio, displaying images, and displaying text; an input information acquisition module 23 acquires input information from the aphasia patients, including responses based on the training content; an evaluation result generation module 24 evaluates the aphasia patients based on the input information to obtain evaluation results; and a training content adjustment module 25 adjusts the training content based on the evaluation results. In other words, during aphasia training, by outputting training content and acquiring the input information from the aphasia patients, and evaluating them based on this input information, the training content can be adjusted according to the evaluation results. This generates training content suitable for aphasia patients, which not only improves the effectiveness of aphasia training but also takes into account the patient's emotions, ensuring their training motivation.

[0050] In one embodiment, the input information includes the aphasic patient repeating the played audio input; wherein, the evaluation result generation module 24 can be further configured to: compare the similarity between the repeating audio and the played audio to obtain the evaluation result.

[0051] In one embodiment, the input information includes cognitive speech input from the image displayed to the aphasic patient; wherein, the evaluation result generation module 24 can be further configured to: identify the semantic information of the cognitive speech; and obtain the evaluation result based on the semantic information of the cognitive speech and the semantic information contained in the image displayed.

[0052] In one embodiment, the input information includes the aphasic patient reading aloud the displayed text input; wherein, the aforementioned evaluation result generation module 24 can be further configured to: identify the text information of the read-aloud speech; and obtain the evaluation result based on the text information of the read-aloud speech and the displayed text.

[0053] In one embodiment, the training device 20 for aphasic patients can be further configured to: acquire the movement information of aphasic patients; wherein the movement information includes the limb movements of aphasic patients; identify the movement information to obtain the true intention of aphasic patients; correspondingly, the evaluation result generation module 24 can be further configured to: evaluate aphasic patients based on input information and true intention to obtain evaluation results.

[0054] In one embodiment, the training device 20 for aphasic patients can be further configured to: input action information into a true intention recognition model to obtain the true intention of the aphasic patient; wherein, the true intention recognition model is obtained through training the aphasic patient with various limb movements and corresponding intentions.

[0055] In one embodiment, the training device 20 for aphasic patients can be further configured to: acquire facial expression information of aphasic patients; identify the facial expression information to obtain the urgency level of aphasic patients; and issue an alarm if the urgency level is greater than a preset urgency level threshold.

[0056] Below, for reference Figure 3 This application describes an electronic device according to embodiments thereof. The electronic device may be either or both of a first device and a second device, or a standalone device independent of them, which may communicate with the first device and the second device to receive acquired input signals from them.

[0057] Figure 3 A block diagram of an electronic device according to an embodiment of this application is illustrated.

[0058] like Figure 3 As shown, the electronic device 10 includes one or more processors 11 and memory 12.

[0059] The processor 11 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

[0060] The memory 12 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 11 may execute the program instructions to implement the methods of the various embodiments of this application described above and / or other desired functions. Various contents such as input signals, signal components, and noise components may also be stored in the computer-readable storage medium.

[0061] In one example, the electronic device 10 may also include an input device 13 and an output device 14, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0062] When the electronic device is a standalone device, the input device 13 can be a communication network connector for receiving the collected input signals from the first device and the second device.

[0063] In addition, the input device 13 may also include, for example, a keyboard, a mouse, etc.

[0064] The output device 14 can output various information to the outside, including determined distance information, direction information, etc. The output device 14 may include, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0065] Of course, for the sake of simplicity, Figure 3 Only some of the components of the electronic device 10 relevant to this application are shown in this illustration; components such as buses, input / output interfaces, etc., are omitted. In addition, the electronic device 10 may include any other suitable components depending on the specific application.

[0066] In addition to the methods and apparatus described above, embodiments of this application may also be computer program products, which include computer program instructions that, when executed by a processor, cause the processor to perform the steps in the methods according to various embodiments of this application described in the "Exemplary Methods" section above.

[0067] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of this application. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0068] Furthermore, embodiments of this application may also be computer-readable storage media storing computer program instructions thereon, which, when executed by a processor, cause the processor to perform the steps in the methods according to various embodiments of this application described in the "Exemplary Methods" section above.

[0069] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.

[0070] The basic principles of this application have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this application are merely examples and not limitations, and should not be considered as essential features of each embodiment of this application. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the application to the necessity of employing the aforementioned specific details for implementation.

[0071] The block diagrams of devices, apparatuses, devices, and systems involved in this application are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0072] It should also be noted that in the apparatus, equipment, and methods of this application, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions of this application.

[0073] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of this application. Therefore, this application is not intended to be limited to the aspects shown herein, but rather to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0074] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this application to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.

Claims

1. A training method for patients with aphasia, characterized in that, include: Receive training requests from aphasic patients; Training content is output to the aphasic patient; wherein, the training content includes playing audio, displaying images, and displaying text; Obtain input information from the aphasic patient; wherein, the input information includes response information given by the aphasic patient based on the training content; Based on the input information, the aphasia patient is assessed to obtain the assessment results; Based on the assessment results, the training content for the aphasia patients was adjusted. The input information includes the cognitive speech input by the aphasia patient in recognizing the displayed image; wherein, the assessment of the aphasia patient based on the input information, and the resulting assessment, includes: Identify the semantic information of the cognitive speech; The semantic information is played to the aphasia patient in the form of text or voice, and the aphasia patient judges whether the semantic information is the aphasia patient's true expression; If so, the evaluation result is obtained based on the semantic information of the cognitive speech and the semantic information contained in the displayed image; If not, then the cognitive speech or the aphasia patient inputs again, and at the same time increase the proportion of speech training or text training and decrease the proportion of image training. The input information includes the aphasia patient reading aloud the displayed text input; wherein, the assessment of the aphasia patient based on the input information, and the resulting assessment, includes: Identify the text information of the read-out speech; The text information is played to the aphasia patient in the form of speech, and the aphasia patient judges whether the text information is the aphasia patient's true expression; If so, the evaluation result is obtained based on the text information; If not, the reading voice or the aphasic patient inputs again, and at the same time, the proportion of voice training is increased and the proportion of text training is decreased. The training methods for patients with aphasia also include: Obtain the facial expression information of the aphasic patient; The severity of the aphasia patient's condition is determined by recognizing the facial expressions. If the urgency level is greater than a preset urgency threshold, an alarm will be issued.

2. The training method for aphasia patients according to claim 1, characterized in that, The input information includes the aphasia patient repeating the audio input from the played audio; wherein, the assessment of the aphasia patient based on the input information, and the resulting assessment, includes: The evaluation result is obtained by comparing the similarity between the read-aloud speech and the played speech.

3. The training method for aphasia patients according to claim 1, characterized in that, The training methods for patients with aphasia also include: Acquire the movement information of the aphasia patient; wherein, the movement information includes the limb movements of the aphasia patient; By recognizing the action information, the true intention of the aphasic patient can be obtained; The assessment of the aphasia patient based on the input information yields the following results: Based on the input information and the true intention, the aphasia patient is evaluated to obtain the evaluation results.

4. The training method for aphasia patients according to claim 3, characterized in that, The process of identifying the action information to obtain the true intention of the aphasic patient includes: The action information is input into the true intention recognition model to obtain the true intention of the aphasia patient; wherein, the true intention recognition model is obtained through training on various limb movements and corresponding intentions of the aphasia patient.

5. A training device for patients with aphasia, characterized in that, include: The training request receiving module is used to receive training requests from aphasic patients; The training content output module is used to output training content to the aphasic patient; wherein, the training content includes playing audio, displaying images, and displaying text; An input information acquisition module is used to acquire the input information of the aphasic patient; wherein, the input information includes the response information given by the aphasic patient based on the training content; The assessment result generation module is used to assess the aphasia patient based on the input information and obtain the assessment result; The training content adjustment module is used to adjust the training content for the aphasia patient based on the evaluation results. The input information includes the cognitive speech input by the aphasic patient in recognizing the displayed image; wherein, the evaluation result generation module is further configured to: Identify the semantic information of the cognitive speech; The semantic information is played to the aphasia patient in the form of text or voice, and the aphasia patient judges whether the semantic information is the aphasia patient's true expression; If so, the evaluation result is obtained based on the semantic information of the cognitive speech and the semantic information contained in the displayed image; If not, then the cognitive speech or the aphasia patient inputs again, and at the same time increase the proportion of speech training or text training and decrease the proportion of image training. The input information includes the aphasic patient reading aloud the displayed text input; wherein, the evaluation result generation module is further configured to: Identify the text information of the read-out speech; The text information is played to the aphasia patient in the form of speech, and the aphasia patient judges whether the text information is the aphasia patient's true expression; If so, the evaluation result is obtained based on the text information; If not, the reading voice or the aphasic patient inputs again, and at the same time, the proportion of voice training is increased and the proportion of text training is decreased. The training device for aphasia patients is further configured as follows: Obtain the facial expression information of the aphasic patient; The severity of the aphasia patient's condition is determined by recognizing the facial expressions. If the urgency level is greater than a preset urgency threshold, an alarm will be issued.

6. A computer-readable storage medium, characterized in that, The storage medium stores a computer program for performing the method described in any one of claims 1-4.

7. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is used to execute the method described in any one of claims 1-4.

Citation Information

Patent Citations

  • Aphasia patient auxiliary rehabilitation training system and method based on fusion gesture recognition

    CN111126280A