A method, system and apparatus for assessing motor and cognitive abilities

Abstract

The application discloses a kind of ability evaluation method, system and device of motion and cognition, belong to computer technology technical field.For the problem that motion ability and cognitive ability evaluation confusion leads to evaluation deviation, the application provides ability evaluation method of motion and cognition, including constructing motion instruction library, the motion instruction library includes text instruction, and multiple motion templates matched with the text instruction;Issue the text instruction, obtain the first motion data of evaluation object;Issue the motion template matched with the text instruction, obtain the second motion data of evaluation object;Judge whether the second motion data is matched with the motion template, and judge whether the second motion data is matched with the first motion data.The two-step motion data acquisition of text and action in the application makes the evaluation of evaluation object more comprehensive, so as to preliminarily distinguish motion ability and evaluation ability, improve evaluation accuracy.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a method, system, and apparatus for assessing motor and cognitive abilities. Background Technology

[0002] The human body is a comprehensive whole, with all parts closely related and various abilities influencing each other. For example, motor ability refers to the body's ability to control the coordination of all muscles and joints. Motor ability deficits typically manifest as decreased coordination of different parts of the body, motor incoordination, bradykinesia or spasticity, motor disability, intention tremor, and motor decline. Cognitive ability refers to the brain's ability to process, store, and retrieve information. Cognitive ability deficits typically manifest as decline in executive function, learning and memory, sensorimotor function, language, complex attention, and social cognition.

[0003] As cognitive abilities decline, motor skills also gradually decrease, making motor skills an important component of cognitive ability assessment. However, current assessments of either motor or cognitive abilities often struggle to differentiate between the two in the early stages, leading to assessment bias. Summary of the Invention

[0004] To address the problem of confusion between motor and cognitive ability assessments, which leads to assessment bias, this invention provides a method, system, and apparatus for assessing motor and cognitive abilities. By acquiring two-step motion data—text and action—the assessment of the subject becomes more comprehensive, thereby enabling a preliminary distinction between motor ability and assessment ability and improving assessment accuracy.

[0005] This application provides a method for assessing motor and cognitive abilities, including:

[0006] Construct a motion instruction library, which includes text instructions and multiple motion templates that match the text instructions;

[0007] Issue the text command to obtain the first motion data of the evaluation object;

[0008] Issue the motion template that matches the text instruction to obtain the second motion data of the evaluation object;

[0009] Determine whether the second motion data matches the motion template, and determine whether the second motion data matches the first motion data.

[0010] By adopting the above technical solution, a motion instruction library including multiple motion templates is constructed, which makes the judgment of motion actions more accurate. Furthermore, by obtaining two sets of motion data through two-step instructions—text instructions and motion templates that match the text instructions—the assessment of the evaluation object is more comprehensive. Through different matching judgments, the assessment object's motor ability and cognitive ability can be initially distinguished, thereby improving the accuracy of the assessment.

[0011] In some embodiments, determining whether the second motion data matches the motion template includes:

[0012] If the second motion data matches the motion template, then the motion ability of the evaluated object is qualified.

[0013] In some embodiments, determining whether the second motion data matches the first motion data includes:

[0014] If the second motion data matches the first motion data, then the cognitive ability of the assessment subject is qualified;

[0015] Otherwise, the cognitive ability of the person being assessed is not up to standard.

[0016] In some embodiments, issuing the motion template matching the text instruction includes:

[0017] Based on the matching degree with the first motion data, the multiple motion templates that match the text instruction are sorted in descending order;

[0018] If the matching degree between the first motion data and the first n sorted motion templates is greater than the first threshold, then the first motion template in the sort is selected and emitted;

[0019] Otherwise, randomly select any one of the motion templates from the sorted sequence and emit it;

[0020] Where n is a positive integer not less than 1.

[0021] By adopting the above technical solution, the motion templates that are subsequently issued and matched with the text instructions are more closely matched with the motion actions of the assessment object, thereby improving the accuracy of the initial assessment of motor ability and cognitive ability.

[0022] In some embodiments, determining whether the second motion data matches the motion template includes:

[0023] If the second motion data does not match the motion template, the motion templates are sent out sequentially according to the sorting, and the corresponding motion data of the evaluation object is obtained.

[0024] If the matching degree between any one of the multiple motion data and the corresponding motion template is greater than the second threshold, then the motion ability of the evaluation object is qualified.

[0025] Otherwise, the subject's motor skills are deemed unqualified.

[0026] Wherein, the second threshold is not greater than the first threshold.

[0027] By adopting the above technical solution, the impact of chance on the accuracy of the assessment is reduced, and the accuracy of the assessment of athletic ability is improved.

[0028] In some embodiments, the text instructions include a description of the type of motion or a description of the motion action.

[0029] In some embodiments, the plurality of motion templates include different types of templates for the same motion, different action templates for the same motion, and different angle templates for the same action.

[0030] This application also provides a motor and cognitive ability assessment system for performing any of the methods described above, and includes:

[0031] A motion instruction library, comprising text instructions and multiple motion templates matching the text instructions;

[0032] The instruction module is used to select and issue the text instruction from the motion instruction library, and to issue the motion template that matches the text instruction;

[0033] The acquisition module is used to acquire first motion data and second motion data of the evaluation object. The first motion data refers to the motion data performed by the evaluation object according to the text instruction issued by the instruction module, and the second motion data refers to the motion data performed by the evaluation object according to the motion template issued by the instruction module that matches the text instruction.

[0034] The judgment module is used to determine whether the second motion data acquired by the acquisition module matches the motion template, and to determine whether the second motion data acquired by the acquisition module matches the first motion data.

[0035] In some embodiments, it also includes:

[0036] The display module is used to display the text instructions issued by the instruction module and the motion template matching the text instructions.

[0037] This application embodiment also provides a motor and cognitive ability assessment device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement any of the methods described above;

[0038] The device also includes a display screen, a camera, and a microphone connected to the processor.

[0039] Other features and corresponding beneficial effects of this application will be described in the latter part of the specification, and it should be understood that at least some of the beneficial effects will become obvious from the description in this application. Attached Figure Description

[0040] Figure 1 This is a flowchart of the present invention;

[0041] Figure 2 This is a three-dimensional schematic diagram of the device of the present invention;

[0042] Figure 3 This is a front view schematic diagram of the device of the present invention.

[0043] The components include: 1. Housing; 2. Display screen; 3. Camera; 4. Microphone; 5. Pickup unit; 6. Buttons. Detailed Implementation

[0044] To better understand the above-mentioned objectives, features, and advantages of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that, unless otherwise specified, the embodiments and features described in these embodiments can be combined with each other.

[0045] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and therefore the scope of protection of the invention is not limited to the specific embodiments disclosed below.

[0046] Example 1:

[0047] like Figure 1 As shown in the embodiments of this application, a method for assessing motor and cognitive abilities is provided, including:

[0048] S1 builds a motion instruction library.

[0049] The motion instruction library includes text instructions and multiple motion templates that match the text instructions.

[0050] The text instructions can include descriptions of the type of movement or the movement actions. For example, the text instruction could be "swimming"; or, for another example, it could be "using both hands to move like swimming".

[0051] Multiple exercise templates can include different types of templates for the same exercise, different movement templates for the same exercise, and different angle templates for the same movement. For example, butterfly stroke template, backstroke template, breaststroke template, etc.; another example is butterfly stroke first arm movement template, butterfly stroke second arm movement template, etc.; another example is butterfly stroke front angle template, butterfly stroke side angle template, butterfly stroke 45° angle template, etc.

[0052] Yes, it is understandable. Motion templates can be in the form of images or videos, with video being preferred as it can better reflect the coordination between movements.

[0053] By using the above method, a motion instruction library including multiple motion templates can be constructed, making the judgment of motion actions more accurate.

[0054] S2 issues a text command to obtain the first motion data of the evaluation object, that is, to obtain the relevant data of the evaluation object's movement according to the text command, including but not limited to limb posture, movement duration, eye movement data, etc.

[0055] Preferably, limb posture acquisition simplifies limbs and joints into lines and points, improving the accuracy of motion acquisition and reducing the amount of data, thereby reducing computational difficulty and improving evaluation accuracy.

[0056] S3 issues a motion template that matches the text command and obtains the second motion data of the evaluation object, that is, obtains the relevant data of the evaluation object's movement according to the motion template, including but not limited to limb posture, movement duration, eye movement data, etc.

[0057] S4 determines whether the second motion data matches the motion template and whether the second motion data matches the first motion data.

[0058] Using the above method, two sets of motion data are obtained through a two-step instruction consisting of a text command and a motion template that matches the text command. This makes the assessment of the subject more comprehensive. Furthermore, by using different matching judgments, the assessment of the subject's motor and cognitive abilities can be preliminarily distinguished, thus improving the accuracy of the assessment.

[0059] In one implementation, determining whether the second motion data matches the motion template includes:

[0060] S41 If the second motion data matches the motion template, then the subject's motion ability is qualified.

[0061] Understandably, the second set of motion data reflects the motion achieved by the subject through imitation of the motion template; if the two match, that is, are the same within a certain range, it indicates that the subject's motion ability is qualified.

[0062] In one implementation, determining whether the second motion data matches the first motion data includes:

[0063] S42 If the second motion data matches the first motion data, then the cognitive ability of the subject being assessed is qualified.

[0064] Otherwise, the cognitive ability of the person being assessed is deemed unqualified.

[0065] Understandably, the first motion data reflects the subject's understanding of the text instructions, while the second motion data reflects the subject's understanding of the motion template. If the two match, meaning they are the same within a certain range, it indicates that the subject's understanding of the text instructions and their understanding of the motion template are basically the same, and it can be preliminarily judged that the subject's cognitive ability is qualified. If the two do not match, meaning there is a large difference between the subject's two motions, it indicates that the subject's understanding of the text instructions and their understanding of the motion template are different, and it can be preliminarily judged that the subject's cognitive ability is unqualified.

[0066] In one implementation, issuing a motion template matching a text instruction includes:

[0067] S21 sorts the multiple motion templates that match the text instruction in descending order based on their matching degree with the first motion data.

[0068] If the matching degree between the first motion data and the first n sorted motion templates is greater than the first threshold, then the first motion template in the sorted sequence is selected and emitted, where n is a positive integer not less than 1.

[0069] Otherwise, randomly select any motion template from the sorted sequence and send it out.

[0070] Preferably, the first threshold is 70% to 85%, for example, 75%, 80%, etc.

[0071] By using the above method, the motion templates that are subsequently issued and matched with the text instructions are more closely matched with the motion actions of the assessment object, thereby improving the accuracy of the initial assessment of motor and cognitive abilities.

[0072] Preferably, n is 1 / 3 of the number of multiple motion templates, thereby avoiding the impact of chance on the accuracy of the assessment and improving the accuracy of the assessment of athletic ability.

[0073] In one implementation, determining whether the second motion data matches the motion template includes:

[0074] S411 If the second motion data does not match the motion template, then the motion templates are sent out in order of sorting, and the corresponding motion data of the evaluation object is obtained.

[0075] If any one of the multiple motion data sets matches the corresponding motion template with a degree greater than the second threshold, then the subject's motion ability is considered qualified.

[0076] Otherwise, the subject's athletic ability will be deemed unqualified.

[0077] The second threshold is not greater than the first threshold. Preferably, the second threshold is 50% to 60%, for example, 55%, 58%, etc.

[0078] By using the above method, the mismatch in the motion imitation of the assessment object caused by the difference in difficulty between multiple motion templates can be avoided, that is, the impact of randomness on the accuracy of assessment can be reduced, and the accuracy of motion ability assessment can be improved.

[0079] Preferably, the evaluation objects that pass the second threshold are marked for subsequent in-depth evaluation.

[0080] Example 2:

[0081] Based on Embodiment 1, this application also provides a motor and cognitive ability assessment system for performing the method of Embodiment 1, and includes a motor instruction library, an instruction module, an acquisition module, and a judgment module.

[0082] The motion instruction library includes text instructions and multiple motion templates that match the text instructions.

[0083] The instruction module is used to select and issue text instructions from the motion instruction library, as well as issue motion templates that match the text instructions.

[0084] The acquisition module is used to acquire the first and second motion data of the evaluation object.

[0085] The first motion data refers to the motion data performed by the evaluation object according to the text instructions issued by the instruction module, and the second motion data refers to the motion data performed by the evaluation object according to the motion template issued by the instruction module that matches the text instructions.

[0086] The judgment module is used to determine whether the second motion data obtained by the acquisition module matches the motion template, and to determine whether the second motion data obtained by the acquisition module matches the first motion data.

[0087] In one embodiment, the motor and cognitive ability assessment system further includes a display module. The display module displays text instructions issued by the instruction module and motion templates matching the text instructions, thereby facilitating the assessment subject to perform movements according to the text instructions and the motion module.

[0088] Example 3:

[0089] Based on Embodiment 1, this application also provides a motor and cognitive ability assessment device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the method of Embodiment 1.

[0090] like Figure 2 and Figure 3 As shown, the device also includes a display screen 2, a camera 3, and a microphone 4 connected to the processor.

[0091] It is understood that the device includes a housing 1, with the memory and processor located inside the housing 1, and the display screen 2, camera 3 and microphone 4 located on the surface of the housing 1.

[0092] Display screen 2 can be a conventional display screen with only display function, used to display text instructions and motion templates matching the text instructions, facilitating the evaluation object to move according to the text instructions and motion modules. Preferably, display screen 2 can be a touch screen, thus facilitating interaction with the device via the touch screen for easy operation.

[0093] Camera 3 is used to acquire first motion data, second motion data, and other possible motion data of the evaluation object, and transmit the motion data to the processor, so that the processor can determine whether the second motion data matches the motion template and whether the second motion data matches the first motion data.

[0094] Microphone 4 can issue prompts or commands at appropriate times according to the processor's instructions, thereby improving the user experience.

[0095] In one embodiment, the two sides of the housing 1 are symmetrically arranged, that is, the display screen 2, camera 3 and microphone 4 on the surface of the housing 1 are symmetrically arranged, so that both sides of the device can provide evaluation operations for the evaluation object, thereby improving the efficiency of multi-person evaluation.

[0096] In one embodiment, the device further includes a button 6 disposed on the surface of the housing 1 and connected to the processor, thereby facilitating user operation.

[0097] In one embodiment, the device also includes a microphone 5, which enables voice interaction with the user and enhances the user experience.

[0098] In one example, the assessment subjects are elderly people, which will be described in detail:

[0099] The elderly person faces the camera on device 3 to begin the assessment;

[0100] The processor retrieves a text instruction from the motion instruction library in memory, such as "swimming with both hands" and sends it to display screen 2.

[0101] The elderly person performs corresponding movement actions according to the text instructions displayed on the display screen 2, and the camera 3 acquires the first motion data related to the movement action and transmits it to the processor;

[0102] After the elderly person completes the first movement, the processor obtains the corresponding movement template to be issued through the first movement data processing and sends it to the display screen 2;

[0103] That is, the processor sorts the multiple motion templates that match the text instruction in descending order based on their matching degree with the first motion data;

[0104] When the matching degree between the first motion data and the first n sorted motion templates is greater than the first threshold, the processor selects the first motion template in the sort and sends it out.

[0105] If the matching degree between the first motion data and the first n sorted motion templates is not greater than the first threshold, the processor randomly selects any one of the sorted motion templates and sends it out.

[0106] The elderly person performs corresponding movements based on the movement template displayed on the display screen 2, and the camera 3 acquires the second movement data related to the movement and transmits it to the processor;

[0107] The processor determines whether the second motion data matches the motion template and whether the second motion data matches the first motion data based on the received first motion data, second motion data, and issued text instructions and motion template.

[0108] If the second motor data matches the first motor data, the elderly person's cognitive ability is qualified; otherwise, the elderly person's cognitive ability is unqualified.

[0109] If the second set of motion data matches the motion template, the elderly person's motion ability is considered qualified; otherwise, the processor issues an instruction to guide the elderly person to demonstrate the motion again.

[0110] That is, the processor sends motion templates to the display screen 2 in order of sorting, and obtains the corresponding motion data of the elderly person through the camera 3;

[0111] If any one of the multiple motion data sets matches the corresponding motion template with a degree greater than the second threshold, then the elderly person's motion ability is qualified; otherwise, the elderly person's motion ability is unqualified.

[0112] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.

[0113] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units. They may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.

[0114] In addition, in the various embodiments of the present invention, each functional unit can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be implemented in hardware or in the form of hardware plus software functional units.

[0115] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0116] Alternatively, if the integrated units of this invention are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROM, RAM, magnetic disks, or optical disks.

[0117] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for assessing motor and cognitive abilities, characterized in that, include: Construct a motion instruction library, which includes text instructions and multiple motion templates that match the text instructions; Issue the text command to obtain the first motion data of the evaluation object; Issue the motion template that matches the text instruction to obtain the second motion data of the evaluation object; Determine whether the second motion data matches the motion template, and determine whether the second motion data matches the first motion data; The step of issuing the motion template matching the text instruction includes: Based on the matching degree with the first motion data, the multiple motion templates that match the text instruction are sorted in descending order; If the matching degree between the first motion data and the first n sorted motion templates is greater than the first threshold, then the first motion template in the sort is selected and emitted; Otherwise, randomly select any one of the motion templates from the sorted sequence and emit it; Where n is a positive integer not less than 1.

2. The method for assessing motor and cognitive abilities according to claim 1, characterized in that, The step of determining whether the second motion data matches the motion template includes: If the second motion data matches the motion template, then the motion ability of the evaluated object is qualified.

3. The method for assessing motor and cognitive abilities according to claim 1, characterized in that, The step of determining whether the second motion data matches the first motion data includes: If the second motion data matches the first motion data, then the cognitive ability of the assessment subject is qualified; Otherwise, the cognitive ability of the person being assessed is not up to standard.

4. The method for assessing motor and cognitive abilities according to claim 1, characterized in that, The step of determining whether the second motion data matches the motion template includes: If the second motion data does not match the motion template, the motion templates are sent out sequentially according to the sorting, and the corresponding motion data of the evaluation object is obtained. If the matching degree between any one of the multiple motion data and the corresponding motion template is greater than the second threshold, then the motion ability of the evaluation object is qualified. Otherwise, the subject's motor skills are deemed unqualified. Wherein, the second threshold is not greater than the first threshold.

5. The method for assessing motor and cognitive abilities according to claim 1, characterized in that, The text instructions include descriptions of the type of movement or descriptions of the movement actions.

6. The method for assessing motor and cognitive abilities according to claim 1, characterized in that, The multiple motion templates include different types of templates for the same motion, different action templates for the same motion, and different angle templates for the same action.

7. A system for assessing motor and cognitive abilities, characterized in that, For performing the method as described in any one of claims 1-6, and comprising: A motion instruction library, comprising text instructions and multiple motion templates matching the text instructions; The instruction module is used to select and issue the text instruction from the motion instruction library, and to issue the motion template that matches the text instruction; The acquisition module is used to acquire first motion data and second motion data of the evaluation object. The first motion data refers to the motion data performed by the evaluation object according to the text instruction issued by the instruction module, and the second motion data refers to the motion data performed by the evaluation object according to the motion template issued by the instruction module that matches the text instruction. The judgment module is used to determine whether the second motion data acquired by the acquisition module matches the motion template, and to determine whether the second motion data acquired by the acquisition module matches the first motion data.

8. A device for assessing motor and cognitive abilities, characterized in that, The system includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the program, implements the method of any one of claims 1-6; The device also includes a display screen, a camera, and a microphone connected to the processor.

Images