Training data monitoring method based on deep learning

Abstract

The invention discloses a training data monitoring method based on deep learning, and relates to the technical field of action recognition, and the method comprises the following steps: S1, collecting a training image of a user; s2, constructing a target interval according to a training feature map corresponding to the training image, and extracting a training action closed region of the training image; s3, correcting the training action closed region by using the angular points of the training action closed region to obtain a smooth training action closed region; and S4, performing similarity comparison on the smooth training action closed region and a standard training action, and when the similarity is lower than a set threshold value, judging that the training action of the user is unqualified. According to the training data monitoring method based on deep learning, compared with standard training actions, objective quantitative indexes are provided, subjective errors are reduced, disqualification is immediately judged when the similarity is lower than a threshold value, and instant reminding is supported.

Description

Technical Field

[0001] The present invention relates to the technical field of action recognition, and particularly to a training data monitoring method based on deep learning. Background Art

[0002] With the rapid development of artificial intelligence technology, deep learning has shown strong application potential in the fields of action recognition, pose estimation, and training monitoring. Traditional training monitoring methods mainly rely on manual observation or simple sensor data, suffering from problems such as strong subjectivity, low accuracy, and poor real-time performance. For example, in fitness training, rehabilitation training, or sports skill training, it is difficult for coaches or doctors to capture the subtle deviations of actions in real time, resulting in inaccurate training effect evaluation or increased risk of training injuries. Therefore, developing an automated training data monitoring method based on deep learning has important practical significance.

[0003] The disadvantages of traditional training monitoring methods are as follows: 1. Strong subjectivity, manual observation depends on experience, and different evaluators may have different evaluations of the same action; 2. Insufficient accuracy, traditional methods are difficult to capture the subtle changes of actions, resulting in rough evaluation results; 3. Poor real-time performance, manual monitoring cannot provide real-time feedback on action deviations, affecting training efficiency. Deep learning has shown many advantages in the field of action monitoring. For example, in high-precision feature extraction, deep learning models (such as convolutional neural network CNN) can automatically learn complex features in images and accurately identify action details. Therefore, the present invention proposes an action monitoring technology based on deep learning. Summary of the Invention

[0004] To solve the above problems, the present invention proposes a training data monitoring method based on deep learning.

[0005] The technical solution of the present invention is: a training data monitoring method based on deep learning includes the following steps:

[0006] S1. Collect training images of users;

[0007] S2. According to the training feature map corresponding to the training image, construct a target interval and extract the training action closed area of the training image;

[0008] S3. Use the corner points of the training action closed area to correct the training action closed area to obtain a smooth training action closed area;

[0009] S4. Compare the similarity between the smooth training action closed area and the standard training action. When the similarity is lower than the set threshold, it is determined that the training action of the user is unqualified.

[0010] In S4, the structural similarity index (SSIM) or cosine similarity can be used to take into account geometric and feature consistency.

[0011] Furthermore, S2 includes the following sub-steps:

[0012] S21. Use a convolution kernel to slide and traverse the user's training image to obtain a training feature map;

[0013] S22. Based on the training feature map, construct a target interval for the training image;

[0014] S23. Based on the target interval, construct a target function for the training image;

[0015] S24. Extract the corner points of the training image and construct constraint conditions;

[0016] S25. Use the target function and constraint conditions of the training image to generate a target constraint model;

[0017] S26. Take the pixel points in the training image whose pixel values are greater than the target constraint model as the training action closed area.

[0018] The beneficial effects of the above further solution are as follows: In the present invention, the convolution kernel (or filter) is the core component of the convolutional neural network (CNN). Through the sliding window mechanism, local features of the input image are extracted to generate a feature map, where each element is the feature value calculated by the convolution kernel in a certain local area. The target interval is adaptively generated based on the training feature map to enhance the robustness of the target constraint model to individual differences; by combining the target function and geometric constraint conditions, the accuracy and stability of the closed area extraction are improved.

[0019] Furthermore, in S22, take the mean value of all elements in the training feature map as the target weight, take the product of the target weight and the maximum pixel value in the training image as the right endpoint of the target interval, and take the product of the target weight and the minimum pixel value in the training image as the left endpoint of the target interval.

[0020] The beneficial effects of the above further solution are as follows: In the present invention, using the mean value of the feature map as the weight and combining with the extreme values of the image to generate the interval can adapt to the gray-scale distribution of different training images and avoid the sensitivity of the fixed threshold to pixel values.

[0021] Furthermore, in S23, the target function has the following expression:

[0022] ;

[0023] ;

[0024] In the formula, represents the number of elements in the target interval that are greater than the pixel value of the th pixel point in the training image, and represents the The deviation degree between a pixel point and the target interval denotes the right endpoint of the target interval denotes the left endpoint of the target interval denotes the Euclidean distance between the pixel point of the th pixel point in the training image and the pixel point of the maximum curvature point in the training image denotes the pixel point of the maximum curvature point in the training image denotes the pixel value of the

[0025] The beneficial effect of the above further scheme is that in the present invention, the maximum curvature point is introduced as a distance reference to strengthen the correlation between the closed region and the key structure As a geometric anchor point, it ensures the alignment of the closed region with the key parts of the action (such as joint points). Pixel points belonging to the target interval in the training feature map can be extracted as elements

[0026] Furthermore, in S24, the constraint condition has the expression of ; in the formula, denotes the number of elements in the target interval that are greater than the pixel value of the th pixel point in the training image denotes the deviation degree between the th pixel point and the target interval

[0027] The beneficial effect of the above further scheme is that in the present invention, the constraint condition can constrain pixel deviation, prevent overfitting or under-segmentation, and try to ensure the geometric continuity of the closed region boundary and the action structure (such as limb contour)

[0028] Furthermore, in S25, the result of multiplying the constraint condition by the Lagrange multiplier is added to the partial derivative of the objective function to serve as the objective constraint model of the training image

[0029] The Lagrange multiplier is used to balance the objective function and the constraint condition

[0030] Furthermore, S3 includes the following sub-steps

[0031] S31. Extract all corner points included in the closed region of the training action

[0032] S32. Correct the corner points with a curvature greater than the set curvature threshold to obtain a smooth closed region of the training action

[0033] Furthermore, in S32, the coordinate position of the corrected corner point is ; in the formula, denotes the abscissa of the original coordinate of the corner point represents the ordinate of the original coordinates of the corner point, represents the gradient magnitude of the first four-neighborhood pixel point near the corner point, represents the gradient magnitude of the second four-neighborhood pixel point near the corner point, represents the gradient magnitude of the third four-neighborhood pixel point near the corner point, represents the gradient magnitude of the fourth four-neighborhood pixel point near the corner point.

[0034] The beneficial effects of the above further solution are as follows: In the present invention, the corner point is a key geometric feature of the action closed area. The four-neighborhood gradient average is used to correct the corner point position, enhancing the geometric continuity of the boundary. The gradient magnitude reflects the pixel change intensity and can be used to guide the corner point to move towards the real boundary. The averaging operation smooths local mutations and avoids excessive offset of the corner point.

[0035] The beneficial effects of the present invention are as follows:

[0036] (1) The deep learning-based training data monitoring method adaptively generates a target interval based on the training feature map, enhancing the adaptability of the target constraint model to individual differences. By combining the objective function and the constraint conditions, it can accurately locate the action closed area as much as possible;

[0037] (2) The deep learning-based training data monitoring method eliminates sharp noise and enhances boundary continuity through curvature screening and gradient-weighted correction. It uses the four-neighborhood gradient average to enhance the robustness of the corner point position, adapts to dynamic deformation, and corrects key structures (such as joint points). The high-gradient area has a greater weight, guiding the corner point to move towards the real boundary; ensuring the accuracy of the training action closed area;

[0038] (3) The deep learning-based training data monitoring method compares with the standard training action, provides objective quantitative indicators, reduces subjective errors, and immediately determines non-conformity when the similarity is lower than the threshold, supporting immediate reminders. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 is a flowchart of the deep learning-based training data monitoring method. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0040] The following further describes the embodiments of the present invention with reference to the accompanying drawings.

[0041] As Figure 1 shown, the present invention provides a deep learning-based training data monitoring method, including the following steps:

[0042] S1. Collect the training images of the user;

[0043] S2. Construct a target interval based on the training feature map corresponding to the training image, and extract the closed area of the training action of the training image;

[0044] S3. Use the corner points of the closed area of the training action to correct the closed area of the training action to obtain a smoothed closed area of the training action;

[0045] S4. Compare the similarity between the smoothed closed area of the training action and the standard training action. When the similarity is lower than the set threshold, it is determined that the training action of the user is unqualified.

[0046] In S4, the structural similarity index (SSIM) or cosine similarity can be used to take into account both geometric and feature consistency.

[0047] In the embodiment of the present invention, S2 includes the following sub-steps:

[0048] S21. Use a convolution kernel to slide through the training image of the user to obtain a training feature map;

[0049] S22. Construct a target interval for the training image according to the training feature map;

[0050] S23. Based on the target interval, construct a target function for the training image;

[0051] S24. Extract the corner points of the training image and construct constraint conditions;

[0052] S25. Use the target function and constraint conditions of the training image to generate a target constraint model;

[0053] S26. Take the pixel points in the training image whose pixel values are greater than the target constraint model as the closed area of the training action.

[0054] In the present invention, the convolution kernel (or filter) is the core component of the convolutional neural network (CNN). Through the sliding window mechanism, local features of the input image are extracted to generate a feature map, where each element is the feature value calculated by the convolution kernel in a certain local area. The target interval is adaptively generated based on the training feature map to enhance the robustness of the target constraint model to individual differences; combining the target function with geometric constraint conditions improves the accuracy and stability of the extraction of the closed area.

[0055] In the embodiment of the present invention, in S22, the mean value of all elements in the training feature map is used as the target weight, the product of the target weight and the maximum pixel value in the training image is used as the right endpoint of the target interval, and the product of the target weight and the minimum pixel value in the training image is used as the left endpoint of the target interval.

[0056] In the present invention, the mean value of the feature map is used as the weight, combined with the generation interval of the image extreme value, to adapt to the gray-scale distribution of different training images and avoid the sensitivity of the fixed threshold to the pixel value.

[0057] In the embodiment of the present invention, in S23, the objective function has the following expression:

[0058] ;

[0059] ;

[0060] In the formula, represents the number of elements in the target interval that are greater than the pixel value of the th pixel point in the training image, represents the deviation degree between the th pixel point and the target interval, represents the right endpoint of the target interval, represents the left endpoint of the target interval, represents the Euclidean distance between the th pixel point in the training image and the pixel point of the maximum curvature point in the training image, represents the pixel point of the maximum curvature point in the training image, represents the pixel value of the th pixel point in the training image.

[0061] In the present invention, the maximum curvature point is introduced as a distance reference to strengthen the correlation between the closed region and the key structure. As a geometric anchor point, it ensures the alignment of the closed region with the key parts of the action (such as joint points).

[0062] In the embodiment of the present invention, in S24, the constraint condition has the following expression ; In the formula, represents the number of elements in the target interval that are greater than the pixel value of the th pixel point in the training image, represents the deviation degree between the th pixel point and the target interval.

[0063] In the present invention, the constraint condition can constrain the pixel deviation, prevent overfitting or under-segmentation, and try to ensure the geometric continuity of the closed region boundary and the action structure (such as the limb contour).

[0064] In the embodiment of the present invention, in S25, the result of multiplying the constraint condition by the Lagrange multiplier is added to the partial derivative of the objective function to serve as the target constraint model of the training image.

[0065] Lagrange multipliers are used to balance the objective function and the constraints.

[0066] In an embodiment of the present invention, S3 includes the following sub-steps:

[0067] S31. Extract all the corner points included in the closed region of the training action;

[0068] S32. Correct the corner points with a curvature greater than the set curvature threshold to obtain a smoothed closed region of the training action.

[0069] In an embodiment of the present invention, in S32, the coordinate position of the corrected corner point is ; where represents the abscissa of the original coordinate of the corner point, represents the ordinate of the original coordinate of the corner point, represents the gradient magnitude of the first four-neighborhood pixel point near the corner point, represents the gradient magnitude of the second four-neighborhood pixel point near the corner point, represents the gradient magnitude of the third four-neighborhood pixel point near the corner point, represents the gradient magnitude of the fourth four-neighborhood pixel point near the corner point.

[0070] In the present invention, the corner point is a key geometric feature of the action closed region. The position of the corner point is corrected using the average of the four-neighborhood gradients to enhance the geometric continuity of the boundary. The gradient magnitude reflects the intensity of pixel change and can be used to guide the corner point towards the true boundary. The averaging operation smooths local mutations and avoids excessive offset of the corner point.

[0071] Those of ordinary skill in the art will realize that the embodiments described herein are for helping the reader understand the principles of the present invention and should be understood that the protection scope of the present invention is not limited to such specific statements and embodiments. Those of ordinary skill in the art can make various other specific deformations and combinations without departing from the essence of the present invention based on the technical revelations disclosed in the present invention, and these deformations and combinations are still within the protection scope of the present invention.

Claims

1. A training data monitoring method based on deep learning, characterized in that: The following steps are involved: S1, collect user's training images; S2. construct a target interval according to the training feature map corresponding to the training image, and extract the training action closed area of ​​the training image; S3, using the corner points of the training action closed area to correct the training action closed area to obtain a smooth training action closed area; S4. Compare the closed area of ​​the smooth training action with the standard training action for similarity. When the similarity is lower than a set threshold, determine that the user's training action is unqualified.

2. The training data monitoring method based on deep learning according to claim 1, characterized in that: The S2 comprises the following sub-steps: S21, using the convolution kernel to slide the user's training image to obtain a training feature map; S22, constructing a target interval for the training image according to the training feature map; S23, constructing an objective function for the training image based on the target interval; S24, extracting corner points of the training image and constructing constraint conditions; S25, generating a target constraint model using the target function and constraint conditions of the training image; S26. Pixel points in the training image whose pixel values ​​are greater than the target constraint model are used as closed areas for the training actions.

3. The training data monitoring method based on deep learning according to claim 2, characterized in that: In S22, the mean of all elements in the training feature map is used as the target weight, the product of the target weight and the maximum pixel value in the training image is used as the right endpoint of the target interval, and the product of the target weight and the minimum pixel value in the training image is used as the left endpoint of the target interval.

4. The training data monitoring method based on deep learning according to claim 2, characterized in that: In S23, the objective function The expression is: ； ； In the formula, Indicates that the target interval is greater than the training image The number of elements of the pixel value of each pixel, Indicates The deviation between the pixel point and the target interval, represents the right endpoint of the target interval, represents the left endpoint of the target interval, Indicates the training image The Euclidean distance between the pixel point and the pixel point with the maximum curvature in the training image, represents the pixel with the maximum curvature in the training image, Indicates the training image The pixel value of a pixel.

5. The training data monitoring method based on deep learning according to claim 2, characterized in that: In S24, the constraint condition The expression is ; In the formula, Indicates that the target interval is greater than the training image The number of elements of the pixel value of each pixel, Indicates The deviation between the pixel point and the target interval.

6. The training data monitoring method based on deep learning according to claim 2, characterized in that: In S25, the result of multiplying the constraint condition by the Lagrange multiplier is added to the partial derivative of the objective function to serve as the objective constraint model of the training image.

7. The training data monitoring method based on deep learning according to claim 1, characterized in that: The S3 comprises the following sub-steps: S31, extracting all corner points contained in the closed area of ​​the training action; S32, correcting the corner points whose curvature is greater than the set curvature threshold to obtain a closed area of ​​the smooth training action.

8. The training data monitoring method based on deep learning according to claim 7, characterized in that: In S32, the coordinate position of the corrected corner point is ; In the formula, The horizontal coordinate of the original coordinate of the corner point, The ordinate represents the original coordinate of the corner point. Indicates the gradient size of the first four neighboring pixels near the corner point. Indicates the gradient size of the second four neighboring pixels near the corner point. Indicates the gradient size of the third four-neighborhood pixel near the corner point. Indicates the gradient magnitude of the fourth four-neighborhood pixel near the corner point.

Images