Data processing method and device for aphasia rehabilitation training

By obtaining user language ability data, determining virtual scenes and training tasks, and using digital people and virtual scenes to assist patients in rehabilitation training, the problems of low intelligence and high labor costs in the existing technology are solved, and efficient language functions are achieved recover.

CN119028526APending Publication Date: 2024-11-26SHANGHAI FOURIER INTELLIGENCE CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411514618.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-29
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing aphasia rehabilitation training is low in intelligence and has high labor costs, making it difficult to effectively assist patients in recovering their language skills.

Method used

By obtaining the language ability data of the target user, determining the target virtual scene and training tasks, using the preset target digital people and virtual scenes to guide the user to perform the training tasks, and providing correction guidance when the user does not perform correctly until the task is completed.

Benefits of technology

It has improved the intelligence of aphasia rehabilitation training, reduced labor costs, and improved the targeted auxiliary training effect for the impaired user language function.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119028526A_ABST
    Figure CN119028526A_ABST
Patent Text Reader

Abstract

The invention discloses a data processing method and device for aphasia rehabilitation training. The method comprises the following steps: acquiring language ability data of a target user; determining a target virtual scene according to the language ability data; determining a target training task according to the language ability data and the target virtual scene; according to a preset target digital person, the target virtual scene and the target training task, outputting first guidance information to guide the target user to execute the target training task in the target virtual scene; and when it is detected that the target user does not correctly execute the target training task, outputting second guidance information according to the target digital person, the target virtual scene and the target training task to guide the target user to execute the target training task again until it is detected that the target user correctly executes the target training task. The training task is formulated according to the language function condition of the user, and the patient is assisted to execute the training task through the digital human and the virtual scene, so that the intelligent degree of aphasia rehabilitation training is improved, and the labor cost is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of information processing technology, and in particular to a data processing method and device for aphasia rehabilitation training. Background Art

[0002] Patients who suffer from aphasia due to brain trauma or stroke need targeted rehabilitation training to restore normal language ability. In the prior art, doctors or relatives usually guide and assist patients to conduct repeated training according to the rehabilitation training program, thereby promoting the patient's language reconstruction and recovery. However, the degree of intelligence of doctors or relatives to assist patients in rehabilitation training is low, and the labor cost of rehabilitation training is high. Therefore, how to improve the intelligence level of aphasia rehabilitation training and reduce the labor cost of aphasia rehabilitation training has become a further technical problem that needs to be solved. Summary of the invention

[0003] The present application proposes a data processing method and device for aphasia rehabilitation training to solve the problems of low intelligence level and high manpower cost of rehabilitation training, improve the intelligence level of aphasia rehabilitation training and reduce the manpower cost of aphasia rehabilitation training.

[0004] In a first aspect, an embodiment of the present application provides a data processing method for aphasia rehabilitation training, which is applied to a server in a rehabilitation training system, and the method includes: Acquiring language ability data of a target user, wherein the language ability data is used to characterize the impairment of the language function of the target user; determining a target virtual scene according to the language ability data; Determining a target training task according to the language ability data and the target virtual scene, wherein the target training task is used to train the impaired language function of the target user; Outputting first guidance information according to the preset target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene; When it is detected that the target user does not correctly perform the target training task, second guidance information is output according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again until it is detected that the target user correctly performs the target training task.

[0005] In a second aspect, an embodiment of the present application provides a data processing device for aphasia rehabilitation training, which is applied to a server in a rehabilitation training system, and the device includes: A first receiving unit, configured to obtain language ability data of a target user, wherein the language ability data is used to characterize the impairment of the language function of the target user; A first processing unit is used to determine a target virtual scene according to the language ability data; determine a target training task according to the language ability data and the target virtual scene, the target training task being used to train the impaired language function of the target user; output first guidance information according to a preset target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene; and, when it is detected that the target user does not correctly perform the target training task, output second guidance information according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again, until it is detected that the target user correctly performs the target training task.

[0006] In a third aspect, an embodiment of the present application provides a server, comprising a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the method described in any one of the first aspects.

[0007] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program / instruction stored thereon, wherein the computer program / instruction, when executed by a processor, implements the steps of the method described in any one of the first aspects.

[0008] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements part or all of the steps of the method described in any one of the first aspects of the embodiments of the present application.

[0009] It can be seen that in the present application, the server obtains the language ability data of the target user, and the language ability data is used to characterize the impaired language function of the target user; determines the target virtual scene according to the language ability data; determines the target training task according to the language ability data and the target virtual scene, and the target training task is used to train the impaired language function of the target user; outputs first guidance information according to the preset target digital human, target virtual scene and target training task to guide the target user to perform the target training task in the target virtual scene; when it is detected that the target user has not correctly performed the target training task, outputs second guidance information according to the target digital human, target virtual scene and target training task to guide the target user to perform the target training task again, until it is detected that the target user has correctly performed the target training task. Since the target virtual scene is determined according to the user's impaired language function, the target training task for the impaired language function is determined, and the user is guided to perform the target training task through the target digital human, the target virtual scene and the target training task, and when the user fails to perform the target training task correctly, the user is guided to perform the target training task again. In this way, compared with the prior art in which doctors or relatives and friends assist patients in rehabilitation training, the present application can formulate training tasks according to the user's impaired language function, and assist patients in conducting rehabilitation training according to the training tasks through digital humans and virtual scenes, thereby improving the intelligence level of aphasia rehabilitation training and reducing the manpower cost of aphasia rehabilitation training. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0011] Figure 1 is a structural schematic diagram of a rehabilitation training system provided in an embodiment of the present application; Figure 2 is a structural schematic diagram of another rehabilitation training system provided in an embodiment of the present application; Figure 3 is a structural diagram of a server in a rehabilitation training system provided in an embodiment of the present application; Figure 4 It is a flow chart of a data processing method for aphasia rehabilitation training provided in an embodiment of the present application; Figure 5 It is a scene schematic diagram of a data processing method for aphasia rehabilitation training provided in an embodiment of the present application; Figure 6is a schematic diagram of another scenario of a data processing method for aphasia rehabilitation training provided in an embodiment of the present application; Figure 7 This is a block diagram of the functional units of a data processing device for aphasia rehabilitation training provided by an embodiment of the present application; Figure 8 This is a block diagram of the functional units of another data processing device for aphasia rehabilitation training provided by an embodiment of the present application; Fig. 9 It is a structural block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0012] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0013] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0014] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0015] In the embodiments of the present application, "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B can represent the following three situations: A exists alone; A and B exist at the same time; B exists alone. Among them, A and B can be singular or plural.

[0016] In the embodiment of the present application, the symbol " / " can indicate that the objects associated with each other are in an "or" relationship. In addition, the symbol " / " can also indicate a division sign, that is, performing a division operation. For example, A / B can indicate A divided by B.

[0017] In the embodiments of the present application, "at least one item" or similar expressions refer to any combination of these items, including any combination of single items or plural items, and refer to one or more, and multiple refers to two or more. For example, at least one item of a, b, or c can represent the following seven situations: a, b, c, a and b, a and c, b and c, a, b, and c. Among them, each of a, b, and c can be an element or a set containing one or more elements.

[0018] In the embodiments of the present application, "equal to" can be used in conjunction with greater than, and is applicable to the technical solution adopted when greater than, and can also be used in conjunction with less than, and is applicable to the technical solution adopted when less than. When equal to is used in conjunction with greater than, it is not used in conjunction with less than; when equal to is used in conjunction with less than, it is not used in conjunction with greater than.

[0019] In order to better understand the solutions of the embodiments of the present application, the terminal devices, related concepts and backgrounds that may be involved in the embodiments of the present application are first introduced below.

[0020] Aphasia: lesions of brain tissue related to language function, such as stroke, brain trauma, brain tumor, brain inflammation, etc., which cause damage to the patient's ability to understand and express the human communication symbol system, especially the understanding and expression of speech, vocabulary, grammar and other components, language structure and language content and meaning, as well as the decline and functional damage of language cognitive processes as the basis of language. Aphasia does not include language symptoms caused by impaired consciousness and general intellectual impairment, nor does it include language, reading and writing disorders caused by damage to sensory and motor organs such as hearing, vision, writing and pronunciation.

[0021] Patients who suffer from aphasia due to brain trauma or stroke need targeted rehabilitation training to restore normal language ability. In the prior art, doctors or relatives usually guide and assist patients to conduct repeated training according to the rehabilitation training program, thereby promoting the patient's language reconstruction and recovery. However, the degree of intelligence of doctors or relatives assisting patients in rehabilitation training is low, and the labor cost of rehabilitation training is high.

[0022] To solve the above problems, the embodiments of the present application provide a data processing method and device for aphasia rehabilitation training. The method determines a target virtual scene according to the user's impaired language function, thereby determining a target training task for the impaired language function, and guides the user to perform the target training task through a target digital human, a target virtual scene and a target training task, and guides the user to perform the target training task again when the user fails to perform the target training task correctly. In this way, compared with the prior art in which doctors or relatives and friends assist patients in rehabilitation training, the present application can formulate training tasks according to the user's impaired language function, and assist patients in performing rehabilitation training according to the training tasks through digital humans and virtual scenes, thereby improving the intelligence level of aphasia rehabilitation training and reducing the manpower cost of aphasia rehabilitation training.

[0023] See also Figure 1 , Figure 1 Schematic diagram of a rehabilitation training system provided in an embodiment of the present application. Figure 1 As shown, the rehabilitation training system 100 includes a six-degree-of-freedom motion platform 110, an audio-visual subsystem 120, a motion capture subsystem 130 and a server 140, wherein the six-degree-of-freedom motion platform 110 is communicatively connected to the server 140, the audio-visual subsystem 120 includes an image module 121 and an audio module 122, the audio-visual subsystem 120 is communicatively connected to the server 140, and the motion capture subsystem 130 is communicatively connected to the server 140. The image module 121 can be a 180° flexible annular LED screen, and the audio module 122 can be a 7.1.2-channel stereo surround sound. The motion capture subsystem 130 can be an inertial motion capture device or a multi-lens high-definition optical motion capture system. The server 140 can be a server, or a server group consisting of multiple servers.

[0024] In daily use of the rehabilitation training system 100, the server 140 obtains the language ability data of the target user, and the language ability data is used to characterize the impaired language function of the target user; the target virtual scene is determined according to the language ability data; the target training task is determined according to the language ability data and the target virtual scene, and the target training task is used to train the impaired language function of the target user; according to the preset target digital human, target virtual scene and target training task, the first guidance information is output to guide the target user to perform the target training task in the target virtual scene; when it is detected that the target user does not perform the target training task correctly, the second guidance information is output according to the target digital human, target virtual scene and target training task to guide the target user to perform the target training task again, until it is detected that the target user performs the target training task correctly.

[0025] See also Figure 2 , Figure 2Schematic diagram of another rehabilitation training system provided in the embodiment of the present application. Figure 2 As shown, in the rehabilitation training system 100 , the six-degree-of-freedom motion platform 110 is placed in front of the audio-visual subsystem 120 , the motion capture subsystem 130 is placed on top of the audio-visual subsystem 120 , and the server 140 is placed in front of the audio-visual subsystem 120 and on the right side of the six-degree-of-freedom motion platform 110 .

[0026] See also Figure 3 , Figure 3 Schematic diagram of the structure of a server in a rehabilitation training system provided by an embodiment of the present application. Figure 3 As shown, the server 140 includes a processor 310 and a memory 320, and the processor 310 is in communication with the memory 320. Among them, one or more programs are stored in the memory 320, and the one or more programs are configured to be executed by the processor 310. The functions of the one or more programs are to obtain the language ability data of the target user, and the language ability data is used to characterize the impaired language function of the target user; determine the target virtual scene according to the language ability data; determine the target training task according to the language ability data and the target virtual scene, and the target training task is used to train the impaired language function of the target user; output the first guidance information according to the preset target digital person, target virtual scene and target training task to guide the target user to perform the target training task in the target virtual scene; when it is detected that the target user does not perform the target training task correctly, output the second guidance information according to the target digital person, target virtual scene and target training task to guide the target user to perform the target training task again, until it is detected that the target user performs the target training task correctly.

[0027] The following introduces a data processing method for aphasia rehabilitation training provided by an embodiment of the present application.

[0028] See also Figure 4 , Figure 4 is a flow chart of a data processing method for aphasia rehabilitation training provided in an embodiment of the present application, which is applied to Figure 1 The server 140 in the rehabilitation training system 100 shown in the figure, the rehabilitation training system 100 includes a six-degree-of-freedom motion platform 110, an audio-visual subsystem 120, a motion capture subsystem 130 and the server 140, the six-degree-of-freedom motion platform 110 is communicatively connected to the server 140, the audio-visual subsystem 120 includes an image module 121 and an audio module 122, the audio-visual subsystem 120 is communicatively connected to the server 140, and the motion capture subsystem 130 is communicatively connected to the server 140; Figure 4 As shown, the method comprises the following steps: Step S401, obtaining language ability data of a target user.

[0029] The language ability data is used to characterize the impairment of the language function of the target user.

[0030] Among them, the language ability data includes multiple scoring results, and the method for obtaining the language ability data includes the following steps: the server determines multiple test instructions based on a pre-stored aphasia test scale, and sends each of the multiple test instructions to the audio-visual subsystem in sequence, so that the audio-visual subsystem sends multiple test responses of the target user to the server; and scores the multiple test responses to obtain multiple scoring results.

[0031] The audio-visual subsystem receives each of the multiple test instructions in sequence; outputs a corresponding test question according to each test instruction; obtains a test response from the target user for the corresponding test content to obtain multiple test responses; and sends the multiple test responses to the server.

[0032] Wherein, each scoring result is the score of the target user's response to the test content in the aphasia test scale, and the server scores the multiple test responses to obtain multiple scoring results, including: scoring according to the scoring criteria of the test content corresponding to each test response to obtain the multiple scoring results. For example, the aphasia test scale is a Chinese aphasia measurement set, and the Chinese aphasia measurement set includes test contents for measuring language functions in the speaking fluency dimension as shown in Table 1:

[0033] Table 1 The server generates a corresponding test instruction according to the test content of the language function measuring the speaking fluency dimension, and sends the test instruction to the audio-visual subsystem. The audio-visual subsystem outputs the question voice and question text, obtains the test reply of the target user, and then sends the test reply to the server. After receiving the test reply, the server performs a preliminary score according to the scoring standard corresponding to the test content of the language function measuring the speaking fluency dimension, and obtains the scoring result of the test content for measuring the language function of the speaking fluency dimension. The scoring standard corresponding to the test content is shown in Table 2:

[0034] Table 2 Step S402: determining a target virtual scene according to the language ability data.

[0035] See also Figure 5 , Figure 5 Schematic diagram of a scenario of a data processing method for aphasia rehabilitation training provided in an embodiment of the present application. Figure 5As shown, the server 140 displays the target virtual scene in the audio-visual subsystem 120, and the target user performs aphasia rehabilitation training through the target virtual scene. The target user achieves the effect of exercising in the target virtual scene by exercising on the six-degree-of-freedom motion platform 110. The six-degree-of-freedom motion platform 110 adjusts the slope and movement speed of its own running belt according to the movement of the target user, so that the target user performs relatively static movement on the six-degree-of-freedom platform, so that the target user has a sense of scene immersion. At the same time, the motion capture subsystem 130 captures the motion of the target user.

[0036] In a possible embodiment, determining a target virtual scene according to the language ability data includes: determining multiple language ability levels of the target user according to the language ability data, the multiple language ability levels corresponding one-to-one to multiple language ability dimensions, the multiple language ability dimensions including a speaking fluency dimension, a listening comprehension dimension, a retelling dimension, and a naming dimension; obtaining a preset virtual material library, the virtual material library including multiple virtual materials and a material mapping relationship table, the material mapping relationship table being used to characterize the language ability level corresponding to a single virtual material; determining a target virtual material set in the virtual material library according to the multiple language ability levels and the material mapping relationship table; and determining the target virtual scene according to the target virtual material set.

[0037] Among them, a single language proficiency level is the percentage of the score of the corresponding scoring result equivalent to the response of the normal control group to the same measurement content, and the determination of the multiple language proficiency levels of the target user according to the language proficiency data includes: determining the percentage of the score of each scoring result in the multiple scoring results equivalent to the response of the normal control group to the same measurement content, and obtaining the multiple language proficiency levels. The score of the response of the normal control group to the corresponding measurement content is an empirical value, for example: the score of the normal control group to the test content measuring the language function of the speaking fluency dimension is 24 points, and the target user's score result for the test content measuring the language function of the speaking fluency dimension is 14 points, then the language proficiency level of the target user corresponding to the speaking fluency dimension is 58 (14 / 24=58%).

[0038] Each of the multiple virtual materials corresponds to at least one language proficiency level. For example, the apple model corresponds to language proficiency levels 0-80, which correspond to the listening comprehension dimension, the apple model also corresponds to language proficiency levels 0-30, which correspond to the retelling dimension, and the apple model also corresponds to language proficiency levels 0-48, which correspond to the naming dimension.

[0039] The step of determining a target virtual material set in the virtual material library according to the multiple language proficiency levels and the material mapping relationship table comprises: searching the material mapping relationship table for at least one virtual material corresponding to each of the multiple language proficiency levels; and filtering out from the virtual material library at least one virtual material corresponding to each language proficiency level to obtain a target virtual material set.

[0040] Wherein, determining the target virtual scene according to the target virtual material set refers to performing scene modeling according to the target virtual material to construct the target virtual scene.

[0041] It can be seen that in this example, the user's language ability level is determined based on the language ability data, and then the target virtual material set is determined from the virtual material library based on the language ability level, so that the target virtual scene for training is determined based on the target material set, allowing the user to perform rehabilitation training in the target virtual scene, thereby improving the intelligence level of aphasia rehabilitation training and reducing the manpower cost of aphasia rehabilitation training.

[0042] Step S403: determining a target training task according to the language ability data and the target virtual scene.

[0043] The target training task is used to train the impaired language function of the target user.

[0044] In a possible embodiment, determining the target training task based on the language proficiency data and the target virtual scene includes: determining the aphasia type of the target user based on the multiple language proficiency levels, the aphasia types including expressive aphasia, sensory aphasia and mixed aphasia; determining the target training task based on the aphasia type and the target virtual scene.

[0045] Among them, the expressive aphasia includes transcortical motor aphasia (TCM), thalamic aphasia (TA), basal aphasia (BaA); the sensory aphasia includes naming aphasia (AA), conduction aphasia (CA), transcortical sensory aphasia (TCS), Wernicke aphasia (WA); the mixed aphasia includes transcortical mixed aphasia (MT) and complete aphasia (GA).

[0046] See also Figure 6 , Figure 6 Schematic diagram of another scenario of a data processing method for aphasia rehabilitation training provided by the present application. Figure 6As shown, the determination of the aphasia type of the target user according to the multiple language ability levels includes: when the language ability level of the speaking fluency dimension is greater than a preset first level threshold, that is, greater than 67, judging whether the language ability level of the listening comprehension dimension is greater than a preset first listening comprehension level threshold, that is, 80; if so, judging whether the language ability level of the repetition dimension is greater than a preset first repetition level threshold, that is, 86, if so, determining that the aphasia type of the target user is AA, if not, determining that the aphasia type of the target user is CA; if not, judging whether the language ability level of the repetition dimension is greater than a second repetition level threshold, that is, 75, if so, determining that the aphasia type of the target user is TCS, if not, determining that the aphasia type of the target user is WA; when the speaking When the language ability level of the fluency dimension is less than the preset first level threshold, that is, less than 67, it is determined whether the language ability level of the listening comprehension dimension is greater than the preset second listening comprehension level threshold, that is, 55; if so, it is determined whether the language ability level of the repetition dimension is greater than the preset third repetition level threshold, that is, 72; if so, it is determined whether the language ability level of the naming dimension is greater than the preset first naming level threshold, that is, 80; if so, it is determined that the aphasia type of the target user is TCM; if not, it is determined that the aphasia type of the target user is TA or BaA; if not, it is determined whether the language ability level of the repetition dimension is greater than the fourth repetition level threshold, that is, 58; if so, it is determined that the aphasia type of the target user is MT; if not, it is determined that the aphasia type of the target user is GA.

[0047] It can be seen that in this example, the user's aphasia type is determined according to the language ability level, and then the target training task is determined according to the aphasia type and the target virtual scene, so that the user can perform the target training task in the target virtual scene, which improves the intelligence level of aphasia rehabilitation training and reduces the manpower cost of aphasia rehabilitation training.

[0048] In a possible embodiment, the target training task is composed of multiple sub-training tasks, and the target training task is determined according to the aphasia type and the target virtual scene, including: determining multiple training priorities according to the aphasia type, the multiple training priorities correspond one-to-one to the multiple language ability dimensions, and a single training priority is used to indicate the execution priority of the sub-training task of the language ability dimension corresponding to the training among the multiple sub-training tasks; determining multiple difficulty levels according to the multiple language ability levels, the multiple difficulty levels correspond one-to-one to the multiple language ability dimensions, and a single difficulty level is used to indicate the difficulty of the sub-training task of the language ability dimension corresponding to the training; determining the multiple sub-training tasks according to the multiple difficulty levels and the target virtual scene; arranging the multiple sub-training tasks according to a first constraint relationship to obtain the target training task, and the first constraint relationship is the size relationship of the training priorities corresponding to the multiple sub-training tasks.

[0049] Among them, determining multiple training priorities according to the aphasia type includes: obtaining a preset first mapping relationship table, the first mapping relationship table is used to characterize the training priority of each language ability dimension in the multiple language ability dimensions corresponding to each aphasia type; determining the multiple training priorities according to the aphasia type and the first mapping relationship table. As shown in Table 3, the first mapping relationship table can be, for example: the multiple training priorities corresponding to expressive aphasia include: the fourth-level training priority corresponding to the listening comprehension dimension, the first-level training priority corresponding to the speaking fluency dimension, the second-level training priority corresponding to the repetition dimension, and the third-level training priority corresponding to the naming dimension; the multiple training priorities corresponding to sensory aphasia include: the first-level training priority corresponding to the listening comprehension dimension, the fourth-level training priority corresponding to the speaking fluency dimension, the second-level training priority corresponding to the repetition dimension, and the third-level training priority corresponding to the naming dimension; the multiple training priorities corresponding to mixed aphasia include: the first-level training priority corresponding to the listening comprehension dimension, the second-level training priority corresponding to the speaking fluency dimension, the third-level training priority corresponding to the repetition dimension, and the fourth-level training priority corresponding to the naming dimension.

[0050]

[0051] Table 3 Among them, the sub-training task of the language ability dimension corresponding to the first-level training priority is executed first among the multiple sub-training tasks, and the sub-training task of the language ability dimension corresponding to the fourth-level training priority is executed last among the multiple sub-training tasks. For example, it can be: the aphasia type of the target user is TCS, which is sensory aphasia, and the corresponding target training task includes sub-training task 1, sub-training task 2 and sub-training task 3. Sub-training task 1 is a sub-training task for training listening comprehension dimension, sub-training task 2 is a sub-training task for training repetition dimension, and sub-training task 3 is a sub-training task for training naming dimension. Then, the priority of sub-training task 1 is the first level, the priority of sub-training task 2 is the second level, and the priority of sub-training task 3 is the third level. Sub-training task 1 is executed first, followed by sub-training task 2, and finally sub-training task 3.

[0052] The multiple difficulty levels are proportional to the multiple language ability levels.

[0053] It can be seen that in this example, multiple training priorities are determined according to the user's aphasia type, and multiple difficulty levels are determined according to multiple language ability levels, so that multiple sub-training tasks are determined according to the multiple difficulty levels and the target virtual scenes, and the multiple sub-training tasks are arranged according to the first constraint relationship to obtain the target training task for the user to perform rehabilitation training, so that the target training task is determined according to the user's specific aphasia condition and the target virtual scene, so that the user performs the target training task in the target virtual scene, which improves the intelligence level of aphasia rehabilitation training and reduces the manpower cost of aphasia rehabilitation training.

[0054] Step S404: outputting first guidance information according to the preset target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene.

[0055] The first guidance information is used to guide the target user to perform the target training task.

[0056] The target user performing the target training task in the target virtual scene specifically means that the target user performs the multiple sub-training tasks in sequence in the target virtual scene.

[0057] In a possible embodiment, the first guidance information includes multiple first guidance animations, and the multiple first guidance animations correspond one-to-one to the multiple sub-training tasks. The first guidance information is output according to the preset target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene, including: determining multiple first audio data and multiple first action data according to the multiple sub-training tasks, a single first audio data is used to instruct the target digital human to output guidance content for the corresponding sub-training task, and a single first action data is used to instruct the target digital human to output guidance body movements corresponding to the guidance content; determining multiple groups of first screen data according to the multiple first audio data, multiple first action data, the target digital human and the target virtual scene, and a single group of first screen data is used to instruct the target digital human to express the guidance content with the guidance body movements; generating the multiple first guidance animations according to the multiple groups of first screen data to guide the target user to perform the multiple sub-training tasks.

[0058] Among them, the multiple first audio data and multiple first action data are determined according to the multiple sub-training tasks. For example, it can be: sub-training task 1 is "pick up the apple on the table", then the guidance content of the first audio data 1 determined according to sub-training task 1 is "pick up the apple on the table", and the guidance body movement of the first action data 1 is to walk to the front of the table and pick up the apple on the table with one hand.

[0059] Among them, the multiple first guidance animations are generated according to the multiple groups of first screen data to guide the target user to perform the multiple sub-training tasks. For example, it can be: the first guidance animation 1 corresponding to sub-training task 1 shows the target digital person walking to the front of the table in the target virtual scene and picking up the apple on the table with one hand.

[0060] It can be seen that in this example, a guidance animation is generated according to the user's training task to guide the user to perform the task, giving the user multiple stimulations of hearing, vision and actual experience, so that the user can reconstruct and restore the damaged speech symbol system by performing the target training task in the target virtual scene, thereby improving the intelligence level of aphasia rehabilitation training and reducing the manpower cost of aphasia rehabilitation training.

[0061] Step S405, when it is detected that the target user does not correctly perform the target training task, second guidance information is output according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again, until it is detected that the target user correctly performs the target training task.

[0062] The second guidance information is used to guide the target user to correct errors made during the execution of the target training task and to execute the target training task again.

[0063] The re-executing of the target training task refers to re-executing the sub-training task in which an execution error occurs in the target training task.

[0064] In a possible embodiment, when it is detected that the target user has not correctly performed the target training task, second guidance information is output based on the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again, until it is detected that the target user has correctly performed the target training task, the method also includes: obtaining task execution data of the target user, the task execution data is used to characterize the execution of the current sub-training task by the target user, and the current sub-training task is the sub-training task currently performed by the target user; determining the execution similarity based on the task execution data and the target execution data corresponding to the current sub-training task; determining the execution result of the target user based on the execution similarity and the similarity threshold corresponding to the current sub-training task, and the execution result includes correctly executing the target training task and incorrectly executing the target training task.

[0065] Wherein, the task execution data is obtained through the motion capture subsystem.

[0066] Among them, the target execution data corresponding to each sub-training task in the multiple sub-training tasks is obtained by importing each sub-training task into a preset normal control group digital twin model for simulation.

[0067] It can be seen that in this example, the user's task execution data is obtained, and the task execution data is compared with the target execution data corresponding to the executed sub-training task to determine the user's execution result of the target training task, and then the second guidance information is output to guide the user to perform the training task again, thereby improving the intelligence level of aphasia rehabilitation training and reducing the labor cost of aphasia rehabilitation training.

[0068] In a possible embodiment, the second guidance information includes a second guidance animation, and when it is detected that the target user does not correctly perform the target training task, the second guidance information is output according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again until it is detected that the target user correctly performs the target training task, including: determining difference execution data according to the task execution data and the target execution data, the difference execution data is used to indicate an execution error that occurs when the target user performs the target training task; determining second audio data and second action data according to the difference execution data, the second audio data is used to instruct the target digital human to output correction content for the execution error, and the second action data is used to instruct the target digital human to output correction body movements corresponding to the correction content; determining second screen data according to the second audio data, the second action data, the target digital human and the target virtual scene, the second screen data is used to instruct the target digital human to express the correction content with the correction body movements; generating the second guidance animation according to the second screen data to guide the target user to perform the target training task again until it is detected that the target user correctly performs the target training task.

[0069] Among them, the second audio data and the second action data are determined according to the difference execution data, for example, it can be: the current sub-training task is sub-training task 1, sub-training task 1 is "pick up the apple on the table", then the target execution data is "pick up the apple on the table", and the task execution data of the target user is "pick up the orange on the table", then the difference execution data is "orange", and the correction content of the second audio data determined according to the difference execution data is "this is not an apple, this is an orange, this is an apple, pick up the apple on the table", and the correction body movements of the second action data are walking to the front of the table, picking up the orange on the table with one hand, putting the orange on the table and picking up the apple on the table with one hand.

[0070] Among them, the second guiding animation is generated according to the second screen data to guide the target user to perform the target training task again until it is detected that the target user correctly performs the target training task. For example, it can be: the second guiding animation corresponding to sub-training task 1 shows the target digital person walking to the front of the table in the target virtual scene, picking up the orange on the table with one hand when the second audio data plays "This is not an apple, this is an orange", putting the orange on the table when the second audio data plays "This is an apple", and picking up the apple on the table with one hand when the second audio data plays "Pick up the apple on the table".

[0071] It can be seen that in this example, the differential execution data is determined based on the user's task execution data and the target execution data corresponding to the executed sub-training task, and then the second guidance information guiding the user to perform the training task again is output based on the differential execution data, thereby improving the intelligence level of aphasia rehabilitation training and reducing the manpower cost of aphasia rehabilitation training.

[0072] It can be seen that in the present application, the server obtains the language ability data of the target user, and the language ability data is used to characterize the impaired language function of the target user; determines the target virtual scene according to the language ability data; determines the target training task according to the language ability data and the target virtual scene, and the target training task is used to train the impaired language function of the target user; outputs first guidance information according to the preset target digital human, target virtual scene and target training task to guide the target user to perform the target training task in the target virtual scene; when it is detected that the target user has not correctly performed the target training task, outputs second guidance information according to the target digital human, target virtual scene and target training task to guide the target user to perform the target training task again, until it is detected that the target user has correctly performed the target training task. Since the target virtual scene is determined according to the user's impaired language function, the target training task for the impaired language function is determined, and the user is guided to perform the target training task through the target digital human, the target virtual scene and the target training task, and when the user fails to perform the target training task correctly, the user is guided to perform the target training task again. In this way, compared with the prior art in which doctors or relatives and friends assist patients in rehabilitation training, the present application can formulate training tasks according to the user's impaired language function, and assist patients in conducting rehabilitation training according to the training tasks through digital humans and virtual scenes, thereby improving the intelligence level of aphasia rehabilitation training and reducing the manpower cost of aphasia rehabilitation training.

[0073] The above mainly introduces the scheme of the embodiment of the present application from the perspective of the execution process on the method side. It is understandable that, in order to realize the above functions, the controller includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiment provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0074] In accordance with the above-mentioned embodiments, please refer to Figure 7 , Figure 7 is a block diagram of the functional units of a data processing device for aphasia rehabilitation training provided by an embodiment of the present application, such as Figure 7 As shown, the data processing device 700 for aphasia rehabilitation training includes: a first receiving unit 701, used to obtain language ability data of a target user, wherein the language ability data is used to characterize the impairment of the language function of the target user; a first processing unit 702, used to determine a target virtual scene according to the language ability data; determine a target training task according to the language ability data and the target virtual scene, wherein the target training task is used to train the impaired language function of the target user; output first guidance information according to a preset target digital person, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene; and, when it is detected that the target user does not perform the target training task correctly, output second guidance information according to the target digital person, the target virtual scene and the target training task to guide the target user to perform the target training task again until it is detected that the target user performs the target training task correctly.

[0075] In a possible embodiment, in terms of determining the target virtual scene according to the language ability data, the first processing unit 702 is specifically used to: determine multiple language ability levels of the target user according to the language ability data, the multiple language ability levels correspond one-to-one to multiple language ability dimensions, and the multiple language ability dimensions include speaking fluency dimension, listening comprehension dimension, retelling dimension, and naming dimension; obtain a preset virtual material library, the virtual material library includes multiple virtual materials and a material mapping relationship table, and the material mapping relationship table is used to characterize the language ability level corresponding to a single virtual material; determine a target virtual material set in the virtual material library according to the multiple language ability levels and the material mapping relationship table; and determine the target virtual scene according to the target virtual material set.

[0076] In a possible embodiment, in terms of determining the target training task based on the language proficiency data and the target virtual scene, the first processing unit 702 is specifically used to: determine the aphasia type of the target user based on the multiple language proficiency levels, the aphasia types including expressive aphasia, sensory aphasia and mixed aphasia; determine the target training task based on the aphasia type and the target virtual scene.

[0077] In a possible embodiment, the target training task is composed of multiple sub-training tasks. In terms of determining the target training task according to the aphasia type and the target virtual scene, the first processing unit 702 is specifically used to: determine multiple training priorities according to the aphasia type, the multiple training priorities correspond one-to-one to the multiple language ability dimensions, and a single training priority is used to indicate the execution priority of the sub-training task of the language ability dimension corresponding to the training among the multiple sub-training tasks; determine multiple difficulty levels according to the multiple language ability levels, the multiple difficulty levels correspond one-to-one to the multiple language ability dimensions, and a single difficulty level is used to indicate the difficulty of the sub-training task of the language ability dimension corresponding to the training; determine the multiple sub-training tasks according to the multiple difficulty levels and the target virtual scene; arrange the multiple sub-training tasks according to a first constraint relationship to obtain the target training task, and the first constraint relationship is the size relationship of the training priorities corresponding to the multiple sub-training tasks.

[0078] In a possible embodiment, the first guidance information includes multiple first guidance animations, and the multiple first guidance animations correspond one-to-one to the multiple sub-training tasks. In terms of outputting the first guidance information according to the preset target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene, the first processing unit 702 is specifically used to: determine multiple first audio data and multiple first action data according to the multiple sub-training tasks, a single first audio data is used to instruct the target digital human to output guidance content for the corresponding sub-training task, and a single first action data is used to instruct the target digital human to output guidance body movements corresponding to the guidance content; determine multiple groups of first screen data according to the multiple first audio data, multiple first action data, the target digital human and the target virtual scene, and a single group of first screen data is used to instruct the target digital human to express the guidance content with the guidance body movements; generate the multiple first guidance animations according to the multiple groups of first screen data to guide the target user to perform the multiple sub-training tasks.

[0079] In a possible embodiment, when it is detected that the target user has not correctly performed the target training task, second guidance information is output according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again, until it is detected that the target user has correctly performed the target training task, the data processing device 700 for aphasia rehabilitation training is also used to: obtain task execution data of the target user, the task execution data is used to characterize the execution of the current sub-training task by the target user, and the current sub-training task is the sub-training task currently performed by the target user; determine the execution similarity according to the task execution data and the target execution data corresponding to the current sub-training task; determine the execution result of the target user according to the execution similarity and the similarity threshold corresponding to the current sub-training task, and the execution result includes correctly executing the target training task and incorrectly executing the target training task.

[0080] In a possible embodiment, the second guidance information includes a second guidance animation. In the aspect of outputting the second guidance information according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again when it is detected that the target user has not correctly performed the target training task until it is detected that the target user has correctly performed the target training task, the first processing unit 702 is specifically used to: determine difference execution data according to the task execution data and the target execution data, the difference execution data being used to indicate an execution error that occurs when the target user performs the target training task; determine second audio data and second action data according to the difference execution data, the second audio data being used to instruct the target digital human to output correction content for the execution error, and the second action data being used to instruct the target digital human to output correction body movements corresponding to the correction content; determine second screen data according to the second audio data, the second action data, the target digital human and the target virtual scene, the second screen data being used to instruct the target digital human to express the correction content with the correction body movements; generate the second guidance animation according to the second screen data to guide the target user to perform the target training task again until it is detected that the target user has correctly performed the target training task.

[0081] It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be synchronously adapted to the device embodiment part and will not be repeated here.

[0082] In the case of integrated units, such as Figure 8 As shown, Figure 8This is a block diagram of the functional units of another data processing device for aphasia rehabilitation training provided by an embodiment of the present application. Figure 8 In the present invention, the data processing device 700 for aphasia rehabilitation training includes: a processing module 812 and a communication module 811. The processing module 812 is used to control and manage the actions of the data processing device 700 for aphasia rehabilitation training, for example, to execute the steps of the first receiving unit 701 and the first processing unit 702, and / or other processes for executing the technology described herein. The communication module 811 is used to support the interaction between the data processing device 700 for aphasia rehabilitation training and other devices. Figure 8 As shown, the data processing device 700 for aphasia rehabilitation training may further include a storage module 813, and the storage module 813 is used to store program codes and data of the data processing device 700 for aphasia rehabilitation training.

[0083] Among them, the processing module 812 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements a computing function, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 811 can be a transceiver, an RF circuit or a communication interface, and the like. The storage module 813 can be a memory.

[0084] Among them, all relevant contents of each scenario involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here. The above aphasia rehabilitation training data processing device 700 can execute the above Figure 4 The data processing method for aphasia rehabilitation training is shown.

[0085] The above embodiments may be implemented in whole or in part by software, hardware, firmware or any other combination thereof. When implemented using software, the above embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium may be a solid-state hard disk.

[0086] Fig. 9 is a structural block diagram of a server provided in an embodiment of the present application. Fig. 9 As shown, the server 140 may include one or more of the following components: a processor 310, and a memory 320 coupled to the processor 310, wherein the memory 320 may store one or more computer programs 321, and the one or more computer programs 321 may be configured to implement the methods described in the above embodiments when executed by one or more processors 310.

[0087] The processor 310 may include one or more processing cores. The processor 310 uses various interfaces and lines to connect the various parts of the entire server 140, and executes various functions and processes data of the server 140 by running or executing instructions, programs, code sets or instruction sets stored in the memory 320, and calling data stored in the memory 320. Optionally, the processor 310 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 310 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It is understandable that the above-mentioned modem may not be integrated into the processor 310, but may be implemented separately through a communication chip.

[0088] The memory 320 may include a random access memory (RAM) or a read-only memory (ROM). The memory 320 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 320 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the server 140 during use, etc.

[0089] It is understandable that the server 140 may include more or fewer structural elements than those in the above structural block diagram, which is not limited here. The present application embodiment provides a computer-readable storage medium on which a computer program / instruction is stored, and when the computer program / instruction is executed by a processor, the steps of the method described in any possible embodiment are implemented.

[0090] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0091] In the several embodiments provided in the present application, it should be understood that the disclosed methods, devices and systems can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the unit is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0092] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0093] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0094] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a volatile memory or a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM) and direct RAM bus random access memory (DR RAM), among other media that can store program code.

[0095] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions without departing from the spirit and scope of the present invention, and can make various changes and modifications, including the combination of the above-mentioned different functions and implementation steps, including software and hardware implementation methods, all of which are within the scope of protection of the present invention.

Claims

1. A data processing method for aphasia rehabilitation training, characterized in that: The method is applied to a server in a rehabilitation training system, and comprises: Acquiring language ability data of a target user, wherein the language ability data is used to characterize the impairment of the language function of the target user; determining a target virtual scene according to the language ability data; Determining a target training task according to the language ability data and the target virtual scene, wherein the target training task is used to train the impaired language function of the target user; Outputting first guidance information according to the preset target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene; When it is detected that the target user does not correctly perform the target training task, second guidance information is output according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again until it is detected that the target user correctly performs the target training task.

2. The method according to claim 1, characterized in that The step of determining a target virtual scene according to the language ability data comprises: Determine multiple language ability levels of the target user according to the language ability data, wherein the multiple language ability levels correspond one-to-one to multiple language ability dimensions, and the multiple language ability dimensions include a speaking fluency dimension, a listening comprehension dimension, a retelling dimension, and a naming dimension; Acquire a preset virtual material library, wherein the virtual material library includes a plurality of virtual materials and a material mapping relationship table, wherein the material mapping relationship table is used to represent a language ability level corresponding to a single virtual material; Determining a target virtual material set in the virtual material library according to the multiple language ability levels and the material mapping relationship table; The target virtual scene is determined according to the target virtual material set.

3. The method according to claim 2, characterized in that The step of determining a target training task according to the language ability data and the target virtual scene includes: Determining the aphasia type of the target user according to the multiple language proficiency levels, the aphasia type including expressive aphasia, sensory aphasia and mixed aphasia; The target training task is determined according to the aphasia type and the target virtual scene.

4. The method according to claim 3, characterized in that The target training task is composed of a plurality of sub-training tasks, and the target training task is determined according to the aphasia type and the target virtual scene, including: Determine a plurality of training priorities according to the aphasia type, wherein the plurality of training priorities correspond one-to-one to the plurality of language ability dimensions, and a single training priority is used to indicate the execution priority of a sub-training task for training the corresponding language ability dimension among the plurality of sub-training tasks; Determining a plurality of difficulty levels according to the plurality of language proficiency levels, the plurality of difficulty levels corresponding one-to-one to the plurality of language proficiency dimensions, and a single difficulty level being used to indicate the degree of difficulty of a sub-training task for training the corresponding language proficiency dimension; Determining the plurality of sub-training tasks according to the plurality of difficulty levels and the target virtual scene; The multiple sub-training tasks are arranged according to a first constraint relationship to obtain the target training task, where the first constraint relationship is a size relationship of the training priorities corresponding to the multiple sub-training tasks.

5. The method according to claim 4, characterized in that The first guidance information includes a plurality of first guidance animations, the plurality of first guidance animations correspond to the plurality of sub-training tasks one by one, and the outputting of the first guidance information according to the preset target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene includes: Determine a plurality of first audio data and a plurality of first motion data according to the plurality of sub-training tasks, wherein a single first audio data is used to instruct the target digital human to output guidance content for the corresponding sub-training task, and a single first motion data is used to instruct the target digital human to output guidance body movements corresponding to the guidance content; Determine multiple groups of first screen data according to the multiple first audio data, the multiple first motion data, the target digital human and the target virtual scene, wherein a single group of first screen data is used to instruct the target digital human to express the guiding content with the guiding body motion; The plurality of first guiding animations are generated according to the plurality of sets of first screen data to guide the target user to perform the plurality of sub-training tasks.

6. The method according to claim 4, characterized in that When it is detected that the target user does not correctly perform the target training task, outputting second guidance information according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again, until it is detected that the target user correctly performs the target training task, the method further includes: Acquire task execution data of the target user, where the task execution data is used to characterize the execution status of the target user on the current sub-training task, where the current sub-training task is the sub-training task currently executed by the target user; Determining execution similarity according to the task execution data and target execution data corresponding to the current sub-training task; The execution result of the target user is determined according to the execution similarity and a similarity threshold corresponding to the current sub-training task, where the execution result includes correctly executing the target training task and incorrectly executing the target training task.

7. The method according to claim 6, characterized in that The second guidance information includes a second guidance animation, and when it is detected that the target user does not correctly perform the target training task, the second guidance information is output according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again until it is detected that the target user correctly performs the target training task, including: Determine differential execution data according to the task execution data and the target execution data, wherein the differential execution data is used to indicate an execution error that occurs when the target user executes the target training task; Determine second audio data and second motion data according to the difference execution data, wherein the second audio data is used to instruct the target digital human to output correction content for the execution error, and the second motion data is used to instruct the target digital human to output a correction body motion corresponding to the correction content; Determine second picture data according to the second audio data, the second action data, the target digital human and the target virtual scene, wherein the second picture data is used to instruct the target digital human to express the correction content with the correction body action; The second guiding animation is generated according to the second screen data to guide the target user to perform the target training task again, until it is detected that the target user correctly performs the target training task.

8. A data processing device for aphasia rehabilitation training, characterized in that: A server used in a rehabilitation training system, the device comprising: A first receiving unit, configured to obtain language ability data of a target user, wherein the language ability data is used to characterize the impairment of the language function of the target user; A first processing unit is used to determine a target virtual scene according to the language ability data; determine a target training task according to the language ability data and the target virtual scene, the target training task being used to train the impaired language function of the target user; output first guidance information according to a preset target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task in the target virtual scene; and, when it is detected that the target user does not correctly perform the target training task, output second guidance information according to the target digital human, the target virtual scene and the target training task to guide the target user to perform the target training task again, until it is detected that the target user correctly performs the target training task.

9. A server, characterized in that: The method comprises a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: A computer program / instruction is stored thereon, and when the computer program / instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Aphasia assessment and rehabilitation assistance method and system

    CN109166629A

  • Apraxia-of-speech rehabilitation training method based on virtual reality

    CN110176284A

  • Amphasia patient rehabilitation training method and system based on artificial intelligence

    CN114306871A

  • Mild cognitive impairment rehabilitation training method, device, equipment and medium

    CN118053548A