Methods and apparatus for assessing basic motor skills

Abstract

This invention discloses a method and apparatus for assessing basic motor skills. The method includes: acquiring two-dimensional video data of a user performing a predetermined basic movement; assessing the user's basic motor skills in performing the predetermined basic movement based on the video data using a pre-trained neural network to determine an assessment result; and displaying the determined assessment result. The method and apparatus for assessing basic motor skills according to this invention can quickly obtain the assessment result of the basic motor skills performed by a user using two-dimensional video data of the basic movement and a neural network, improving the accuracy, convenience, and efficiency of basic motor skill assessment, thereby helping users improve their basic motor skills in a timely manner based on the assessment results.

Description

Technical Field

[0001] This invention relates to the field of image processing, and in particular to a method and apparatus for assessing basic motor skills. Background Technology

[0002] As people's health awareness and demand for sports and leisure increase, their enthusiasm for various sports is constantly growing, and they are also paying more attention to the standard of the basic movements they perform, i.e., basic motor skills, during the process of engaging in sports.

[0003] Typically, in sports fields such as school physical education, fitness instruction, dance instruction, and even action games, when users performing basic movements want to know the assessment results of their basic motor skills, they need to have their skills assessed by professionally trained personnel. However, due to individual differences among professionals, the accuracy of the assessment results may not be high enough. Furthermore, in fields such as teaching and research, it may take a long time for users to receive the assessment results, potentially preventing them from promptly addressing the assessment findings and improving their basic motor skills.

[0004] Therefore, existing methods for assessing basic motor skills cannot accurately and efficiently determine assessment results. Summary of the Invention

[0005] The purpose of this invention is to provide a method and apparatus for assessing basic motor skills.

[0006] According to one aspect of the present invention, a method for evaluating basic motor skills is provided, the method comprising: acquiring two-dimensional video data of a user performing a predetermined basic movement; evaluating the user's basic motor skills in performing the predetermined basic movement based on the video data using a pre-trained neural network to determine an evaluation result of the basic motor skills; and displaying the determined evaluation result.

[0007] Optionally, the step of acquiring two-dimensional video data of a user performing a predetermined basic action includes: displaying a list of basic actions including at least one basic action; receiving a selection operation for selecting a basic action from the at least one basic action in the list of basic actions as the predetermined basic action; displaying an execution instruction corresponding to the predetermined basic action selected by the selection operation; and acquiring two-dimensional video data of the user performing the predetermined basic action.

[0008] Optionally, the step of evaluating the user's basic motor skills in performing the predetermined basic action based on the video data using a pre-trained neural network to determine the evaluation result of the basic motor skills includes: evaluating the user's limb movements in performing the predetermined basic action using the pre-trained neural network based on the video data to determine the limb movement evaluation result; and / or evaluating the motion trajectory of an object related to the user's performance of the predetermined basic action using the pre-trained neural network based on the video data to determine the object motion evaluation result; and using the determined limb movement evaluation result and / or object motion evaluation result as the evaluation result of the user's basic motor skills in performing the predetermined basic action.

[0009] Optionally, the predetermined basic action includes at least one action component, wherein the limb movement evaluation result includes at least one of the following result items: limb movement completion degree for each action component, limb movement score for each action component, overall limb movement completion degree for the at least one action component, and overall limb movement score for the at least one action component, wherein the object movement evaluation result includes at least one of the following result items: object movement standard degree for each action component, object movement score for each action component, overall object movement standard degree for the at least one action component, and overall object movement score for the at least one action component.

[0010] Optionally, the step of displaying the determined assessment results includes: displaying the determined result item whenever any result item included in the limb movement assessment result and / or object movement assessment result is determined.

[0011] Optionally, the method further includes storing the video data and / or evaluation results.

[0012] Optionally, the method further includes: receiving a viewing operation for viewing stored video data and / or evaluation results; displaying an authentication instruction for authenticating the user in response to the viewing operation; receiving an authentication operation corresponding to the authentication instruction; authenticating the user in response to the authentication operation; and, if it is determined that the user has passed authentication, displaying stored video data and / or evaluation results corresponding to the authenticated user.

[0013] Optionally, the neural network is trained using the following training data: at least one set of two-dimensional video data corresponding to at least one basic action, and labeled basic action information corresponding to each video data.

[0014] According to another aspect of the present invention, an apparatus for evaluating basic motor skills is provided, the apparatus comprising: a camera configured to capture two-dimensional video data of a user performing a predetermined basic movement; a processor configured to evaluate the user's basic motor skills in performing the predetermined basic movement based on the video data acquired from the camera using a pre-trained neural network, to determine an evaluation result of the basic motor skills; and a display configured to display the determined evaluation result under the control of the processor.

[0015] According to another aspect of the present invention, a computer program product is provided, wherein the computer program product includes a computer program that, when executed by a processor, causes the processor to implement the method for evaluating basic motor skills according to the present invention.

[0016] The method and apparatus for evaluating basic motor skills according to the present invention can quickly obtain the evaluation results of the basic motor skills performed by a user through two-dimensional video data of the user performing the basic motor skill and through a neural network, thereby improving the accuracy, convenience and efficiency of evaluating basic motor skills, and helping users to improve their basic motor skills in a timely manner based on the evaluation results. Attached Figure Description

[0017] The foregoing and other aspects of the invention will be more fully understood from the following detailed description taken in conjunction with the accompanying drawings, including:

[0018] Figure 1 A flowchart of a method for assessing basic motor skills according to an exemplary embodiment of the present invention is shown.

[0019] Figure 2 A block diagram of an apparatus for assessing basic motor skills according to an exemplary embodiment of the present invention is shown. Detailed Implementation

[0020] Below, some exemplary embodiments of the present invention will be described in more detail with reference to the accompanying drawings to better understand the basic ideas and advantages of the present invention.

[0021] Figure 1 A flowchart of a method for assessing basic motor skills according to an exemplary embodiment of the present invention is shown.

[0022] Reference Figure 1 In step S1, two-dimensional video data of the user performing a predetermined basic action is acquired.

[0023] Here, the two-dimensional video data acquired in step S1 can be video data captured by a camera used to capture two-dimensional video data. This camera can be a camera included in or connected to any electronic device (i.e., built-in or external). For example, the camera can be a webcam of a computer, tablet device, personal digital assistant, smartphone, etc.

[0024] Here, the predetermined basic action can be a user-specified basic action. To facilitate user specification of this predetermined basic action, step S1 may include the following steps as an example:

[0025] First, a list of basic actions, including at least one basic action, can be displayed.

[0026] For example, a list of basic actions, including at least one basic action, can be displayed to the user through the display of an electronic device.

[0027] Subsequently, a selection operation can be received for selecting one basic action from the at least one basic action in the basic action list as the predetermined basic action.

[0028] For example, when the list of basic actions is displayed on a touch screen, the user can select the corresponding basic action in the list as the predetermined basic action by performing selection operations such as touching, long pressing, or clicking on the corresponding basic action in the list.

[0029] Subsequently, in step S1, an execution instruction corresponding to the predetermined basic action selected by the selection operation can be displayed, and two-dimensional video data of the user performing the predetermined basic action can be obtained.

[0030] For example, an execution instruction corresponding to a predetermined basic action selected by the user can be displayed on a monitor. This execution instruction can, for example, prompt the user to start performing the basic action, the field of view of the camera capturing video data, and the trajectory of the predetermined basic action. Furthermore, two-dimensional video data of the user performing the predetermined basic action can be acquired simultaneously with or after the display of the execution instruction.

[0031] In step S2, a pre-trained neural network is used to evaluate the user's basic motor skills in performing the predetermined basic movements based on the video data, so as to determine the evaluation result of the basic motor skills.

[0032] For example, the pre-trained neural network can be any type of neural network capable of deep learning. Furthermore, the neural network can also be a neural network trained for one or more basic actions.

[0033] As an example, the neural network can be trained using the following training data: at least one set of two-dimensional video data corresponding to at least one basic action, and labeled basic action information corresponding to each video data.

[0034] Here, the basic motor skills of a user performing a predetermined basic action can be assessed by using the pre-trained neural network to evaluate the user's limb movements and / or the movement trajectories of objects related to the user's performance of the predetermined basic action.

[0035] As an example, step S2 may include the following steps: using the pre-trained neural network to evaluate the limb movements of the user performing the predetermined basic action based on the video data, so as to determine the limb movement evaluation result; and / or using the pre-trained neural network to evaluate the motion trajectory of an object related to the user performing the predetermined basic action based on the video data, so as to determine the object motion evaluation result.

[0036] Subsequently, in step S2, the determined limb movement assessment results and / or object movement assessment results can be used as the assessment results of the user's basic motor skills in performing the predetermined basic movement.

[0037] The above methods can be used to obtain evaluation results for evaluating a user's body movements alone, evaluating the movement trajectory of related items alone, or a comprehensive evaluation result combining body movements and the movement trajectory of items.

[0038] Here, the relevant items can be sports equipment that the user may use when performing the predetermined basic movement, such as rackets, balls, ribbons used in rhythmic gymnastics, fitness equipment, etc.

[0039] Furthermore, in fields such as teaching and scientific research, the predetermined basic action may consist of a series of action parts. For example, the predetermined basic action may include at least one action part.

[0040] In this case, the limb movement assessment results may include at least one of the following: limb movement completion rate for each movement part, limb movement score for each movement part, overall limb movement completion rate for the at least one movement part, and overall limb movement score for the at least one movement part.

[0041] Furthermore, the object motion evaluation results may include at least one of the following: object motion standard degree for each motion part, object motion score for each motion part, overall object motion standard degree for the at least one motion part, and overall object motion score for the at least one motion part.

[0042] By determining the limb movement assessment results and / or object movement assessment results, which include the corresponding outcome items mentioned above, a detailed assessment of the user's basic motor skills in performing predetermined basic movements can be conducted, enabling the user to have a comprehensive understanding of their basic motor skill level.

[0043] In step S3, the determined evaluation results are displayed.

[0044] For example, to facilitate users' timely access to their evaluation results, the evaluation results can be displayed to the user while the user performs predetermined basic actions. For instance, while acquiring video data in step S1, the evaluation result can be determined for the acquired video data in step S2, and whenever the evaluation result for the acquired video data is determined, that is, the determined evaluation result is displayed in step S3.

[0045] Furthermore, if the predetermined basic action performed by the user includes at least one action component, as an example, in step S3, the determined result item can be displayed whenever any of the above result items included in the limb movement assessment result and / or the object movement assessment result are determined.

[0046] Here, by displaying the confirmed assessment results in real time, users can know their basic motor skill level in real time, which helps them to quickly improve their basic motor skills based on the assessment results.

[0047] Here, after determining the evaluation result of the user performing a predetermined basic action through video data, in order to retain the corresponding video data and evaluation results for future use, as an example, the method for evaluating basic motor skills according to the present invention may further include: storing the video data and / or evaluation results.

[0048] For example, video data and / or evaluation results can be stored on the user's electronic terminal, or they can be stored on a server (cloud).

[0049] Furthermore, to facilitate users in viewing stored video data and / or evaluation results, as an example, the method for evaluating basic motor skills according to the present invention may further include the following steps:

[0050] First, it can receive viewing operations for viewing stored video data and / or evaluation results.

[0051] For example, an interface, such as relevant buttons, for viewing stored video data and / or evaluation results can be first displayed to the user on a monitor. The user can then perform a viewing operation through this interface or buttons. Alternatively, the viewing operation can be received by receiving an input operation from the user to enter a URL for viewing stored video data and / or evaluation results.

[0052] Subsequently, in response to the view operation, authentication instructions for authenticating the user can be displayed.

[0053] For example, after receiving the aforementioned viewing operation, an authentication instruction can be displayed on the screen to prompt the user to enter their username and password, or to perform fingerprint or facial recognition for identity verification. It should be understood that the above authentication instructions are merely examples, and any other authentication instructions can be displayed as needed. For instance, an authentication instruction could be displayed to prompt the user to scan a QR code representing their user information for identity verification.

[0054] Afterwards, you can receive authentication operations corresponding to the authentication instructions.

[0055] For example, in the above scenario, the received authentication operation could be an action performed by the user to enter a username and password, or an operation to perform fingerprint or facial recognition. Alternatively, the received authentication operation could also be an action performed by the user to scan their corresponding QR code.

[0056] In response to authentication operations, authenticate the user's identity.

[0057] For example, in the scenarios described above, user authentication can be performed by comparing the received username and password, or the acquired fingerprint or facial image, with pre-stored registered usernames and passwords, or registered fingerprints or facial images. Alternatively, user authentication can be performed by obtaining user information from a scanned QR code.

[0058] Finally, if it is determined that the user has passed authentication, the stored video data and / or evaluation results corresponding to the authenticated user can be displayed.

[0059] For example, the video data and / or evaluation results displayed at this time related to the user who has passed the identity verification may be the video data and / or evaluation results of that user and / or other users (e.g., the user's students).

[0060] The method for assessing basic motor skills according to the present invention can be implemented using any electronic device, such as a computer, tablet device, personal digital assistant, or smartphone. For example, the method for assessing basic motor skills according to the present invention can be implemented as an application (APP) in an electronic device, so that users can conveniently perform basic motor skill assessments anywhere.

[0061] The method for assessing basic motor skills according to the present invention can quickly obtain the assessment results of the basic motor skills performed by a user through two-dimensional video data of the user performing the basic motor skill and through a neural network, thereby improving the accuracy, convenience and efficiency of assessing basic motor skills, and helping users to improve their basic motor skills in a timely manner based on the assessment results.

[0062] Figure 2 A block diagram of an apparatus for assessing basic motor skills according to an exemplary embodiment of the present invention is shown.

[0063] Reference Figure 2 The apparatus for assessing basic motor skills according to the present invention includes: a camera 1, a processor 2, and a display 3.

[0064] Camera 1 is configured to capture two-dimensional video data of the user performing a predetermined basic action.

[0065] Processor 2 is configured to evaluate the user's basic motor skills in performing the predetermined basic action based on video data acquired from the camera using a pre-trained neural network, in order to determine the evaluation result of the basic motor skills. In other words, processor 2 can execute the method described above for evaluating basic motor skills.

[0066] Display 3 is configured to display the determined evaluation results under the control of the processor.

[0067] The apparatus for assessing basic motor skills according to the present invention can be implemented in any electronic device, such as a computer, tablet device, personal digital assistant, or smartphone. Furthermore, reference has been made to the above. Figure 1 The acquisition of two-dimensional video data, the evaluation results, and the display of the evaluation results have been described in detail, and will not be repeated here.

[0068] The apparatus for assessing basic motor skills according to the present invention can quickly obtain the assessment result of the basic motor skill of performing the basic action by means of two-dimensional video data of the user performing the basic action through a neural network, thereby improving the accuracy, convenience and efficiency of assessing basic motor skills, and thus helping the user to improve the basic motor skills in a timely manner based on the assessment results.

[0069] An exemplary embodiment of the present invention also provides a computer program product comprising a computer program, wherein, when executed by a processor, the computer program causes the processor to implement the method for evaluating basic motor skills according to the present invention. The computer program product may include computer programs, program code, instructions, or combinations thereof for independently or jointly commanding or configuring hardware devices to operate as needed. The computer program and / or program code may include programs or computer-readable instructions, software components, software modules, data files, data structures, etc., implementable by one or more hardware devices. Examples of program code include machine code generated by a compiler and higher-level program code executed using an interpreter.

[0070] Furthermore, the various units in the above-described apparatus and device according to exemplary embodiments of the present invention can be implemented as hardware components or software modules. Moreover, those skilled in the art can implement each unit, for example, using a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), or a processor, depending on the processing performed by each defined unit.

[0071] Although the invention has been described and illustrated herein with reference to specific embodiments, the invention is not limited to the details shown. Rather, various modifications to these details can be made within the scope of the invention.

[0072] List of reference numerals

[0073] S1 acquires two-dimensional video data of the user performing a predetermined basic action.

[0074] S2 uses a pre-trained neural network to evaluate the user's basic motor skills in performing the predetermined basic movements based on the video data, in order to determine the evaluation result of the basic motor skills.

[0075] S3 shows the definitive evaluation results.

[0076] 1 camera

[0077] 2 processors

[0078] 3. Monitors

Claims

1. A method for assessing basic motor skills, the method comprising: Acquire two-dimensional video data of the user performing a predetermined basic action; The basic motor skills of the user performing the predetermined basic actions are evaluated based on the video data using a pre-trained neural network to determine the evaluation result of the basic motor skills. as well as Showing confirmed assessment results, The step of evaluating the user's basic motor skills in performing the predetermined basic action based on the video data using a pre-trained neural network to determine the evaluation result of the basic motor skills includes: The pre-trained neural network evaluates the user's limb movements as they perform the predetermined basic action based on the video data to determine the limb movement evaluation result; and The pre-trained neural network evaluates the motion trajectory of an object related to the user's performance of the predetermined basic action based on the video data, thereby determining the object motion evaluation result; and The determined limb movement assessment results and object movement assessment results are used as the comprehensive assessment results of the user's basic motor skills in performing the predetermined basic movements. The predetermined basic action includes at least one action component. The limb movement assessment results include assessment results for each part of the movement, and the object movement assessment results include assessment results for each part of the movement. The steps to display the confirmed evaluation results include: Whenever any result item is determined in either the limb movement assessment result for each movement part included in the limb movement assessment result or the object movement assessment result for each movement part included in the object movement assessment result, the determined result item is displayed.

2. The method according to claim 1, wherein, The steps for obtaining two-dimensional video data of a user performing a predetermined basic action include: Display a list of basic actions, including at least one basic action; Receive a selection operation for selecting a basic action from the at least one basic action in the basic action list as the predetermined basic action; and Display the execution instruction corresponding to the predetermined basic action selected by the selection operation, and obtain two-dimensional video data of the user performing the predetermined basic action.

3. The method according to claim 1 or 2, in, The limb movement assessment results include at least one of the following: limb movement completion rate for each movement component, limb movement score for each movement component, overall limb movement completion rate for the at least one movement component, and overall limb movement score for the at least one movement component. The object motion evaluation results include at least one of the following: object motion standard degree for each motion part, object motion score for each motion part, overall object motion standard degree for the at least one motion part, and overall object motion score for the at least one motion part.

4. The method according to any one of claims 1-2, wherein, The method further includes storing the video data and / or evaluation results.

5. The method according to claim 4, wherein, The method further includes: Receive viewing operations for viewing stored video data and / or evaluation results; In response to a view operation, display authentication instructions for authenticating the user; Receive authentication operations corresponding to the authentication instructions; In response to an authentication operation, the user's identity is authenticated; and If the user is confirmed to be authenticated, display the stored video data and / or evaluation results corresponding to the authenticated user.

6. The method according to any one of claims 1-2, wherein, The neural network is trained using the following training data: at least one set of two-dimensional video data corresponding to at least one basic action, and labeled basic action information corresponding to each video data.

7. An apparatus for assessing basic motor skills, the apparatus comprising: The camera is configured to capture two-dimensional video data of the user performing a predetermined basic action; The processor is configured to evaluate the user's basic motor skills in performing the predetermined basic action based on video data acquired from a camera using a pre-trained neural network, in order to determine the evaluation result of the basic motor skills. as well as The display is configured to show defined evaluation results under the control of the processor. The step of evaluating the user's basic motor skills in performing the predetermined basic action based on the video data using a pre-trained neural network to determine the evaluation result of the basic motor skills includes: The pre-trained neural network evaluates the user's limb movements as they perform the predetermined basic action based on the video data to determine the limb movement evaluation result; and The pre-trained neural network evaluates the motion trajectory of an object related to the user's performance of the predetermined basic action based on the video data, thereby determining the object motion evaluation result; and The determined limb movement assessment results and object movement assessment results are used as the comprehensive assessment results of the user's basic motor skills in performing the predetermined basic movements. The predetermined basic action includes at least one action component. The limb movement assessment results include assessment results for each part of the movement, and the object movement assessment results include assessment results for each part of the movement. The display is also configured to: Whenever any result item is determined in either the limb movement assessment result for each movement part included in the limb movement assessment result or the object movement assessment result for each movement part included in the object movement assessment result, the determined result item is displayed.

8. A computer program product, wherein, The computer program product includes a computer program that, when executed by a processor, causes the processor to perform the method described in any one of claims 1-6.

Images