A high leg raising test counting method, device and medium based on visual technology

Abstract

The present invention provides a high-leg raising test counting method, device and medium based on visual technology, the method comprising: judging whether a tester meets the preparation action standard according to an acquired preparation picture, if so, starting the test counting and entering the next step; if not, giving a prompt; acquiring all pictures in chronological order, and judging the action state type in each picture and the retention time of the action state, if the retention time of the action state is less than a set threshold, deleting the picture, otherwise, entering the next step; judging whether the previous and next pictures meet the requirements of completing a high-leg raising, if both meet, adding 1 to the count; otherwise, not counting, so that the test value of the high-leg raising is more accurate.

Description

Technical Field

[0001] The invention relates to the field of computer technology, and in particular to a high leg raising test counting method, device and medium based on visual technology. Background Art

[0002] With the development of society and economy, people pay more and more attention to physical exercise. High leg raising exercise can not only exercise the leg muscle groups well, but also exercise the waist and abdominal muscles. Regular high leg raising exercise can strengthen the strength and elasticity of the rectus abdominis muscle, help burn abdominal fat and maintain a healthy body shape. At present, the existing high leg raising test counting method is mostly manual counting.

[0003] Manual counting is time-consuming and labor-intensive, prone to errors, and the counting standards are related to the subjective judgment of the measurement personnel, which can easily lead to inconsistency in standards. Manual counting is also inconvenient for athletes to conduct self-testing and training. Therefore, people's demand for intelligent counting methods and devices is becoming more and more urgent. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a high leg raising test counting method, device and medium based on visual technology, so that the test results are more accurate and the tester's movements are more standard.

[0005] In a first aspect, the present invention provides a high leg raising test counting method based on visual technology, comprising:

[0006] Step 1: Based on the acquired preparation picture, determine whether the tester meets the preparation action standard. If yes, start the test counting and go to step 2; if not, give a prompt;

[0007] Step 2: Obtain all pictures in chronological order, and determine the action state type in each picture and the duration of the action state. If the duration of the action state is less than the set threshold, delete the picture; otherwise, proceed to step 3.

[0008] Step 3: Determine whether the before and after pictures are consistent with completing a high leg lift. If they are consistent, then add 1 to the count; if not, then do not count;

[0009] Step 4: Repeat steps 2 and 3 until the test is completed, and then display the results;

[0010] The preparatory action standards in step 1 include:

[0011] The judgment basis of the lateral state of the human body is: if the coordinates of the left eye node and the right eye node in the X-axis direction are both smaller or larger than the coordinates of the left ear node and the right ear node in the X-axis direction, the human body is in the lateral state; otherwise, the human body is not in the lateral state;

[0012] The judgment basis of the double-leg straightening state is: when the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold, the double-leg straightening state is reached; otherwise, the double-leg not straightening state is reached;

[0013] The judgment basis of the trunk straightening state is: when the angle between the connection line of the left ear node and the left shoulder node and the connection line of the left shoulder node and the left hip node is greater than the second set threshold, and the angle between the connection line of the right ear node and the right shoulder node and the connection line of the right shoulder node and the right hip node is greater than the second set threshold, the trunk is in the straightening state; otherwise, the trunk is in the unstraightening state;

[0014] The standard of the preparatory action is to achieve the sideways position of the human body, straight legs and straight torso.

[0015] Furthermore, the action state types in step 2 include: S0, S1, S2, S3, S4 and unknown action state, and the actions represented by each action state are as follows:

[0016] S0: the state of legs being lowered and the trunk being straight; the state of legs being lowered is: the distance from the shoulder node to the hip node is Delta, when the height difference between the right knee joint node and the left knee joint node is less than Delta / 4, and the height difference between the left ankle node and the right ankle node is less than Delta / 4, then the legs are lowered, otherwise, then the legs are not lowered;

[0017] S1: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the third set threshold and less than the first set threshold;

[0018] S2: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than the third set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold;

[0019] S3: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the third set threshold and less than the first set threshold;

[0020] S4: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than the third set threshold, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold;

[0021] States that do not belong to S0, S1, S2, S3, and S4 are all unknown action states.

[0022] Furthermore, the duration of maintaining the action state in step 2 is specifically:

[0023] Action standard abnormality counter: when the trunk is not straightened, the action standard abnormality counter is increased by 1;

[0024] Action standard abnormality 2 counter: when in S2, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than or equal to the first set threshold, the action standard abnormality 2 counter is incremented by 1;

[0025] Action standard abnormality three counter: when in S4, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than or equal to the first set threshold, the action standard abnormality three counter is incremented by 1;

[0026] State counter Count: indicates the current action state. It is the number of times collected when this state occurs, and is used to calculate the duration of this state.

[0027] Unknown state counter Cnone: indicates that the current action state is unknown. The number of unknown actions collected when this state occurs is used to calculate the duration of this state.

[0028] Furthermore, the step 3 is further specifically as follows:

[0029] Get the continuous pictures of completing a high leg raise.

[0030] a. If the order of the pictures is S1, S2, S1, S0, or S3, S4, S3, S0: it means the leg-lifting data is valid, and go to g;

[0031] b. If the order of the pictures is S1, S0, S1, S0, it means that the left leg is not raised high enough, and the voice broadcasts "The left leg is not raised high enough";

[0032] c. If the order of the pictures is S3, S0, S3, S0, it means that the right leg is not raised high enough, and the voice broadcasts "right leg is not raised high enough";

[0033] d. If in S0, S1, S2, S3, S4, the value of the action standard abnormality counter is greater than or equal to the set threshold value, the voice broadcasts "trunk is not straightened";

[0034] e. If in S2, the value of the action standard abnormality counter 2 is greater than or equal to the set threshold 2, the voice broadcasts "right leg is not straightened";

[0035] f. If in S4, the value of the action standard abnormality counter 3 is greater than or equal to the set threshold 3, the voice broadcasts "left leg is not straightened";

[0036] g. If the order of the pictures is S1, S2, S1, S0, S1, S2, it means raising the left leg twice in a row, and the voice will play "raising the legs without crossing";

[0037] h. If the order of the pictures is S3, S4, S3, S0, S3, S4: it means raising the right leg twice in a row, and the voice will play "raising the legs without crossing";

[0038] i. If the above exceptions b, c, d, e, f, g, and h do not occur, it means that the data is valid, the counter increases by 1, and the number after the increase is broadcast.

[0039] In a second aspect, the present invention provides a high leg raising test counting device based on visual technology, comprising:

[0040] The preparation test module determines whether the tester meets the preparation action standards based on the obtained preparation pictures. If yes, the test count starts and the test module begins. If not, a prompt is given.

[0041] Start the test module, obtain all pictures in chronological order, and determine the action state type in each picture and the duration of the action state. If the duration of the action state is less than the set threshold, delete the picture. Otherwise, enter the test counting module.

[0042] Test the counting module to determine whether the previous and next pictures meet the requirement of completing a high leg lift. If both meet the requirement, the count is increased by 1; otherwise, the count is not performed.

[0043] After the test module is completed, the start test module and the test count module are repeated until the test is completed, and then the result is displayed;

[0044] The preparation action standards in the preparation test module include:

[0045] The judgment basis of the lateral state of the human body is: if the coordinates of the left eye node and the right eye node in the X-axis direction are both smaller or larger than the coordinates of the left ear node and the right ear node in the X-axis direction, the human body is in the lateral state; otherwise, the human body is not in the lateral state;

[0046] The judgment basis of the double-leg straightening state is: when the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold, the double-leg straightening state is reached; otherwise, the double-leg not straightening state is reached;

[0047] The judgment basis of the trunk straightening state is: when the angle between the connection line of the left ear node and the left shoulder node and the connection line of the left shoulder node and the left hip node is greater than the second set threshold, and the angle between the connection line of the right ear node and the right shoulder node and the connection line of the right shoulder node and the right hip node is greater than the second set threshold, the trunk is in the straightening state; otherwise, the trunk is in the unstraightening state;

[0048] The standard of the preparatory action is to achieve the sideways position of the human body, straight legs and straight torso.

[0049] Furthermore, the action state types in the start test module include: S0, S1, S2, S3, S4 and unknown action state, and the actions represented by each action state are as follows:

[0050] S0: the state of legs being lowered and the trunk being straight; the state of legs being lowered is: the distance from the shoulder node to the hip node is Delta, when the height difference between the right knee joint node and the left knee joint node is less than Delta / 4, and the height difference between the left ankle node and the right ankle node is less than Delta / 4, then the legs are lowered, otherwise, then the legs are not lowered;

[0051] S1: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the third set threshold and less than the first set threshold;

[0052] S2: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than the third set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold;

[0053] S3: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the third set threshold and less than the first set threshold;

[0054] S4: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than the third set threshold, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold;

[0055] States that do not belong to S0, S1, S2, S3, and S4 are all unknown action states.

[0056] Furthermore, the duration of maintaining the action state in the start test module is specifically:

[0057] Action standard abnormality counter: when the trunk is not straightened, the action standard abnormality counter is increased by 1;

[0058] Action standard abnormality 2 counter: when in S2, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than or equal to the first set threshold, the action standard abnormality 2 counter is incremented by 1;

[0059] Action standard abnormality three counter: when in S4, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than or equal to the first set threshold, the action standard abnormality three counter is incremented by 1;

[0060] State counter Count: indicates the current action state. It is the number of times collected when this state occurs, and is used to calculate the duration of this state.

[0061] Unknown state counter Cnone: indicates that the current action state is unknown. The number of unknown actions collected when this state occurs is used to calculate the duration of this state.

[0062] Furthermore, the test counting module is further specifically:

[0063] Get the continuous pictures of completing a high leg raise.

[0064] a. If the order of the pictures is S1, S2, S1, S0, or S3, S4, S3, S0: it means the leg-lifting data is valid, and go to g;

[0065] b. If the order of the pictures is S1, S0, S1, S0, it means that the left leg is not raised high enough, and the voice broadcasts "The left leg is not raised high enough";

[0066] c. If the order of the pictures is S3, S0, S3, S0, it means that the right leg is not raised high enough, and the voice broadcasts "right leg is not raised high enough";

[0067] d. If in S0, S1, S2, S3, S4, the value of the action standard abnormality counter is greater than or equal to the set threshold value, the voice broadcasts "trunk is not straightened";

[0068] e. If in S2, the value of the action standard abnormality counter 2 is greater than or equal to the set threshold 2, the voice broadcasts "right leg is not straightened";

[0069] f. If in S4, the value of the action standard abnormality counter 3 is greater than or equal to the set threshold 3, the voice broadcasts "left leg is not straightened";

[0070] g. If the order of the pictures is S1, S2, S1, S0, S1, S2, it means raising the left leg twice in a row, and the voice will play "raising the legs without crossing";

[0071] h. If the order of the pictures is S3, S4, S3, S0, S3, S4: it means raising the right leg twice in a row, and the voice will play "raising the legs without crossing";

[0072] i. If the above exceptions b, c, d, e, f, g, and h do not occur, it means that the data is valid, the counter increases by 1, and the number after the increase is broadcast.

[0073] In a third aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described in the first aspect.

[0074] One or more technical solutions provided in the embodiments of the present invention have at least the following technical effects or advantages:

[0075] The embodiments of the present application provide a method, device and medium for counting high leg raising test based on visual technology. The present invention digitizes time and action, can effectively realize the judgment and counting of high leg raising action, and realizes voice prompts for non-standard actions;

[0076] If the standard judgment is directly made based on the latest acquired posture image, it is easy to make a misjudgment; because there is a sudden position deviation phenomenon of "key joints of the human body" when computer vision technology recognizes posture images, the present invention can effectively solve this problem by filtering the acquired action data and removing invalid data.

[0077] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] The present invention will be further described below in conjunction with embodiments with reference to the accompanying drawings.

[0079] Figure 1 is a flow chart of the method of the present invention;

[0080] Figure 2 It is a schematic diagram of human body nodes in the present invention;

[0081] Figure 3 This is a schematic diagram of the FIFO data storage queue of the present invention;

[0082] Figure 4 A schematic diagram of a data storage queue of the present invention;

[0083] Figure 5 This is a schematic diagram of a data storage unit of the present invention;

[0084] Figure 6 This is a schematic diagram of data collection in the present invention;

[0085] Figure 7 This is a flow chart of action standard determination of the present invention. DETAILED DESCRIPTION

[0086] The embodiments of the present application provide a high-leg raising test counting method, device and medium based on visual technology, which digitizes time and action, can effectively realize the judgment and counting of high-leg raising actions, and provide voice prompts for non-standard actions.

[0087] The technical solution in the embodiment of the present application has the following general idea:

[0088] The present invention proposes a new method for realizing high leg raising test counting by recognizing posture images through computer vision technology and digitizing actions and time;

[0089] When computer vision technology is used to identify posture images, there is a sudden position deviation of the "key joints of the human body". After the test data is collected, the unreasonable deviated data is removed according to the actual situation of the action, and the "floating" abnormal action data (the data collected in a short time does not conform to the actual movement) is removed. The problem of position drift of the "key joints of the human body" is solved by filtering the unreasonable abnormal action data; Figure 1 As shown, specifically including:

[0090] Test preparation:

[0091] The voice prompts the tester to prepare for the test according to the high-leg raising action standard; the action preparation state is judged by judging the angle of the key joints of the human body. The preparation actions for high-leg raising are: "body leaning to the right", "legs straight", "torso straight". If this preparation action is not met, voice prompts such as "please stand to the right", "legs not straight", "torso not straight" will be given. If the preparation action standards are met, "high-leg raising test starts" will be reported.

[0092] Test data collection:

[0093] The high leg raise action is decomposed, and the number of times collected is recorded for each action. The actions and the number of times are added to the FIFO ring buffer in sequence, and the actions and time are digitized. In this way, according to the camera image processing speed (fps) and the number of times of a certain action, the duration of the corresponding action can be known, thereby achieving the standardization of the action and realizing the high leg raise counting function.

[0094] Action data acquisition filtering:

[0095] When computer vision technology is used to identify posture images, there is a sudden deviation of the position of "key joints of the human body". After the test data is collected, the unreasonable deviated data is removed according to the actual situation of the action, and the "floating" abnormal action data (the data collected in a short time does not conform to the actual movement) is removed.

[0096] Action standard judgment:

[0097] Determine whether the action data obtained after filtering the "floating" data meets the standard. If it does not meet the standard, it will not be counted and a corresponding voice prompt will be given without counting (such as: voice announcement "trunk is not straightened", "left leg is not straightened", "right leg is not straightened", "left leg is not raised high enough", "right leg is not raised high enough", "legs are not crossed", etc.). If it meets the standard, the counter will be added by 1 and the number after the addition will be announced by voice.

[0098] The details include:

[0099] 1. Description of key joints of the human body:

[0100] like Figure 2 As shown, firstly, the posture image is recognized by computer vision technology to identify the key joints of the human body, and the 18 points of the "key joints of the human body" are: nose 0, neck 1, right shoulder 2, right elbow 3, right wrist 4, left shoulder 5, left elbow 6, left wrist 7, right hip 8, right knee 9, right ankle 10, left hip 11, left knee 12, left ankle 13, right eye 14, left eye 15, right ear 16, left ear 17;

[0101] 2. Test preparation:

[0102] The voice prompts the tester to prepare for the test according to the high-leg raising action standard; the action preparation state is judged by judging the angle of the key joints of the human body. The preparation actions for high-leg raising are: "body leaning to the right", "legs straight", "torso straight". If this preparation action is not met, voice prompts such as "please stand to the right", "legs not straight", "torso not straight" will be given. If the preparation action standards are met, "high-leg raising test starts" will be reported.

[0103] a. Human body is facing right: the judgment basis is: take 4 position points (A left eye, B right eye, C left ear, D right ear), when the x coordinates of points AB are greater than the x coordinate of point CD, it means that the human body is facing right;

[0104] b. Straighten your legs: The judgment is based on: taking three points (A: hip, B: knee joint, C: ankle joint). When the angle between these three points ABC is greater than 160 degrees (the ideal straightening is 180 degrees, but the actual points taken are unlikely to be 180 degrees), it indicates that the legs are straightened;

[0105] c. Trunk straightening: The judgment basis is: take 3 position points (A: ear node, B: shoulder node, C: hip node), when the angle between these three points ABC is greater than 160 degrees, it indicates that the trunk is straight;

[0106] 3. Test data collection:

[0107] Data preservation: When saving data, use the FIFO ring buffer to enter the queue in sequence, and when fetching data for analysis, fetch data from the end of the queue in sequence;

[0108] The high leg raise action is decomposed, and the number of times collected is recorded for each action. The actions and the number of times are added to the FIFO ring buffer in sequence, and the actions and time are digitized. In this way, according to the camera image processing speed (fps) and the number of times of a certain action, the duration of the corresponding action can be known, thereby achieving the standardization of the action and realizing the high leg raise counting function.

[0109] like Figure 3 As shown, the data FIFO ring buffer includes data storage unit 1, data storage unit 2, data storage unit 3, data storage unit 4, data storage unit 5, data storage unit 6, and data storage unit n;

[0110] 3.1 Data storage queue description (FIFO ring buffer and queue entry action):

[0111] When the application is initialized, a circular queue buffer of size n is allocated; each time a new data storage unit enters the queue, if the queue is not full, it is directly queued; if the queue is full, the earliest queued data in the existing buffer is replaced;

[0112] like Figure 4As shown, the camera image is input, the key nodes of the human body are counted and processed, and the state type Sn (or position state Snone) of this image is obtained; the "state type Sm" in the current data storage unit is compared; if Sm is the same as Sn or Sn is an unknown action specification, the current action is directly calculated into Sm; if Sn is different from Sm, it means that a new action has occurred, Sm is stored in a circular queue, and a new data storage unit is created to save Sn and subsequent data;

[0113] The action of entering the data storage unit into the queue is triggered: each time the image obtained by the camera is processed by visual technology, and the key joints of the human body are processed according to the action specifications of high leg raising; if the obtained "action state type" has not changed / or is an unknown action, statistical calculation is directly performed in the current data storage unit; if the obtained "action state type" changes (such as: from S0 to non-S0), the existing data storage unit is placed in the fifo ring queue, and a new data storage unit is created to save the currently obtained action and subsequent actions;

[0114] 3.2 Data storage unit and data collection instructions (digitalization of actions and time):

[0115] like Figure 5 and Figure 6 As shown, including the following:

[0116] a. Action standard abnormality 1 count: the trunk is not straightened. If each data collection does not meet the following conditions: (take 3 position points (A: shoulder, B: hip, C: knee joint), when the angle between the three points ABC is > 160 degrees), it means that the trunk is not straightened, and this abnormality counter is increased by 1;

[0117] b. Abnormal Movement 2 count: If the right leg is not straightened and the right leg lifting angle does not meet the requirement of >160° in S2, the Abnormal Movement 2 count will be increased by 1;

[0118] c. Abnormal Movement Standard 3 Counts: If the left leg is not straightened, and the left leg lifting angle does not meet the requirement of >160° at S4, then the Abnormal Movement Standard 3 Counts will be increased by 1;

[0119] d. Action state type: S0 / S1 / S2. The actions represented by each action state are as follows:

[0120] S0: (high-legged state with legs lowered), the state with legs lowered and torso straight;

[0121] S1: (high leg raising with the left leg half raised), the left leg raised at an angle <140 and the trunk straight;

[0122] S2: (high leg raising with left leg raised), the left leg raised angle is <100, the right leg raised angle is >160 and the trunk is straight;

[0123] S3: (high leg raise with the right leg half raised), with the right leg raised <140 and the trunk straight;

[0124] S4: (high leg raising with the right leg raised), the right leg is raised <100, the left leg is raised >160 and the trunk is straight;

[0125] The judgment rules are as follows:

[0126] Legs down: The judgment basis is to obtain the distance Delta from the shoulder to the hip, take 4 position points (A right knee joint, B right ankle, C left knee joint, D left ankle), when the height difference of AC and BD are both less than Delta / 4, it is judged that the person's legs are down (it can also be judged by the angle of the legs);

[0127] Trunk straightening: The judgment basis is: take 3 position points (A: ear node, B: shoulder node, C: hip node), when the angle between these three points ABC is >160 degrees, it indicates that the trunk is straight;

[0128] Left leg lifting angle: The judgment basis is: take 3 position points (A: left hip, B: left knee joint, C: just below the left knee joint), the angle between the angles ABC represents the left leg lifting angle;

[0129] Right leg lifting angle: The judgment basis is: take 3 position points (A: right hip, B: right knee joint, C: right below the right knee joint), the angle between the angles ABC represents the right leg lifting angle;

[0130] e. State counter Count: indicates the current action state, the number of times (duration) collected when this state occurs;

[0131] f. Unknown state counter: Cnone: indicates the current action state, the number of unknown actions collected when this state occurs (used to calculate the duration);

[0132] If the camera collects data at a rate of 30fps (in actual use, a high-speed mode such as 60fps is generally used), then 30 data states should be saved per second. If the data we need to obtain is the data in the last 4 seconds, then 120 data states are required. The data storage units are retrieved from the end of the current fifo queue in sequence, and the sum of the Count and Cnone values ​​in each unit reaches 120, which represents the action data that occurred in the last 4 seconds.

[0133] 4. Action data acquisition and filtering (to solve the "floating" problem):

[0134] When computer vision technology is used to identify posture images, there is a sudden deviation of the position of "key joints of the human body". After the test data is collected, the unreasonable deviated data is removed according to the actual situation of the action, and the "floating" abnormal action data (the data collected in a short time does not conform to the actual movement) is removed.

[0135] Specifically, (an example in actual use), in the data collection part of step 3, in the S1 state during high leg raising, even if the action remains in the S1 state for 1 second (due to interference introduced by hands or other reasons), the data actually collected at a rate of 30fps may be: S1 action 10 times -> S0 action 2 times -> S2 action 1 time -> S1 action 7 times -> S0 action 2 times -> S1 action 8 times. What this step achieves is: filtering out the S0 / S2 data in this data state by time, and only retaining the valid S1 state data;

[0136] The implementation method is: if a state action is maintained for less than 100ms, the corresponding action is filtered out; according to the 30fps sampling rate, 100ms is more than 3 times, so filtering out the data with Count times <= 3 in the data buffer area can solve the problem of abnormal action "floating";

[0137] 5. Action standard judgment:

[0138] like Figure 7 As shown, it is determined whether the action data obtained after filtering the "floating" data meets the standard. If it does not meet the standard, it will not be counted and a corresponding voice prompt will be given without counting (such as: voice announcement "trunk is not straightened", "left leg is not straightened", "right leg is not straightened", "left leg is not raised high enough", "right leg is not raised high enough", "legs are not crossed", etc.), if it meets the standard, the counter is added by 1 and the number after the addition is announced by voice;

[0139] If everything is moving normally, starting from S0, the forward queue entry order should be as follows:

[0140] Lift your left leg first: S0S1S2S1S0S3S4S3S0S1S2S1S0S3S4S3S0...

[0141] Lift your right leg first: S0S3S4S3S0S1S2S1S0S3S4S3S0S1S2S1S0...

[0142] When fetching data for analysis, data is retrieved from the end of the queue in sequence. Each analysis count is performed when the current S0 action state is 100ms (Count is 3). The historical data from the end to the beginning of the time excluding this S0 is as follows:

[0143] a. If the historical data from back to front meets S1S2S1S0, or S3S4S3S0: it means that the leg-lifting data is valid (left / right leg-lifting), and go to g;

[0144] b. If the historical data from back to front is: S1S0S1S0: it means that the left leg is not raised high enough, and the voice broadcasts "the left leg is not raised high enough";

[0145] c. If the historical data from back to front is: S3S0S3S0:, it means that the right leg is not raised high enough, and the voice broadcasts "right leg is not raised high enough";

[0146] d. If in S0 / S1 / S2 / S3 / S4, "Action Standard Abnormal 1 Count" >= 1 / 3 of the corresponding Count, the voice broadcasts "Trunk is not straightened";

[0147] e. If in S2, "Action Standard Abnormal 2 Count" >= 1 / 3 of the corresponding Count, the voice broadcasts "right leg is not straightened";

[0148] f. If in S4, "Action Standard Abnormal 3 Count" > = 1 / 3 of the corresponding Count, the voice broadcast "Left leg is not straightened";

[0149] g. If the historical data from back to front meets S1S2S1S0S1S2: it means the left leg is raised twice in a row, and the voice broadcast is "uncrossed leg raise";

[0150] h. If the historical data from back to front meets S3S4S3S0S3S4: it means the right leg is raised twice in a row, and the voice broadcast is "uncrossed leg raised";

[0151] i. If none of the above exceptions b, c, d, e, f, g, h occurs, it indicates that the data is valid, the counter is +1 and the number after addition is broadcast.

[0152] The nodes mentioned above are all connected by the left or right nodes.

[0153] Embodiment 1

[0154] This embodiment provides a high leg raising test counting method based on visual technology, including:

[0155] Step 1: Based on the acquired preparation picture, determine whether the tester meets the preparation action standard. If yes, start the test counting and go to step 2; if not, give a prompt;

[0156] Step 2: Obtain all pictures in chronological order, and determine the action state type in each picture and the duration of the action state. If the duration of the action state is less than the set threshold, delete the picture; otherwise, proceed to step 3.

[0157] Step 3: Determine whether the before and after pictures are consistent with completing a high leg lift. If they are consistent, then add 1 to the count; if not, then do not count;

[0158] Step 4: Repeat steps 2 and 3 until the test is completed, and then display the results;

[0159] The preparatory action standards in step 1 include:

[0160] The judgment basis of the lateral state of the human body is: if the coordinates of the left eye node and the right eye node in the X-axis direction are both smaller or larger than the coordinates of the left ear node and the right ear node in the X-axis direction, the human body is in the lateral state; otherwise, the human body is not in the lateral state;

[0161] The judgment basis of the double-leg straightening state is: when the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold, the double-leg straightening state is reached; otherwise, the double-leg not straightening state is reached;

[0162] The judgment basis of the trunk straightening state is: when the angle between the connection line of the left ear node and the left shoulder node and the connection line of the left shoulder node and the left hip node is greater than the second set threshold, and the angle between the connection line of the right ear node and the right shoulder node and the connection line of the right shoulder node and the right hip node is greater than the second set threshold, the trunk is in the straightening state; otherwise, the trunk is in the unstraightening state;

[0163] The standard of the preparatory action is to achieve the sideways position of the human body, straight legs and straight torso.

[0164] In another preferred embodiment, the action state types in step 2 include: S0, S1, S2, S3, S4 and unknown action state, and the actions represented by each action state are as follows:

[0165] S0: the state of legs being lowered and the trunk being straight; the state of legs being lowered is: the distance from the shoulder node to the hip node is Delta, when the height difference between the right knee joint node and the left knee joint node is less than Delta / 4, and the height difference between the left ankle node and the right ankle node is less than Delta / 4, then the legs are lowered, otherwise, then the legs are not lowered;

[0166] S1: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the third set threshold and less than the first set threshold;

[0167] S2: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than the third set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold;

[0168] S3: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the third set threshold and less than the first set threshold;

[0169] S4: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than the third set threshold, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold;

[0170] States that do not belong to S0, S1, S2, S3, and S4 are all unknown action states.

[0171] In another preferred embodiment, the duration of maintaining the action state in step 2 is specifically:

[0172] Action standard abnormality counter: when the trunk is not straightened, the action standard abnormality counter is increased by 1;

[0173] Action standard abnormality 2 counter: when in S2, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than or equal to the first set threshold, the action standard abnormality 2 counter is incremented by 1;

[0174] Action standard abnormality three counter: when in S4, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than or equal to the first set threshold, the action standard abnormality three counter is incremented by 1;

[0175] State counter Count: indicates the current action state. It is the number of times collected when this state occurs, and is used to calculate the duration of this state.

[0176] Unknown state counter Cnone: indicates that the current action state is unknown. The number of unknown actions collected when this state occurs is used to calculate the duration of this state.

[0177] In another preferred embodiment, the step 3 is further specifically as follows:

[0178] Get the continuous pictures of completing a high leg raise.

[0179] a. If the order of the pictures is S1, S2, S1, S0, or S3, S4, S3, S0: it means the leg-lifting data is valid, and go to g;

[0180] b. If the order of the pictures is S1, S0, S1, S0, it means that the left leg is not raised high enough, and the voice broadcasts "The left leg is not raised high enough";

[0181] c. If the order of the pictures is S3, S0, S3, S0, it means that the right leg is not raised high enough, and the voice broadcasts "right leg is not raised high enough";

[0182] d. If in S0, S1, S2, S3, S4, the value of the action standard abnormality counter is greater than or equal to the set threshold value, the voice broadcasts "trunk is not straightened";

[0183] e. If in S2, the value of the action standard abnormality counter 2 is greater than or equal to the set threshold 2, the voice broadcasts "right leg is not straightened";

[0184] f. If in S4, the value of the action standard abnormality counter 3 is greater than or equal to the set threshold 3, the voice broadcasts "left leg is not straightened";

[0185] g. If the order of the pictures is S1, S2, S1, S0, S1, S2, it means raising the left leg twice in a row, and the voice will play "raising the legs without crossing";

[0186] h. If the order of the pictures is S3, S4, S3, S0, S3, S4: it means raising the right leg twice in a row, and the voice will play "raising the legs without crossing";

[0187] i. If the above exceptions b, c, d, e, f, g, and h do not occur, it means that the data is valid, the counter increases by 1, and the number after the increase is broadcast.

[0188] Based on the same inventive concept, the present application also provides a device corresponding to the method in Example 1, see Example 2 for details.

[0189] Embodiment 2

[0190] In this embodiment, a high leg raising test counting device based on visual technology is provided, comprising:

[0191] The preparation test module determines whether the tester meets the preparation action standards based on the obtained preparation pictures. If yes, the test count starts and the test module begins. If not, a prompt is given.

[0192] Start the test module, obtain all pictures in chronological order, and determine the action state type in each picture and the duration of the action state. If the duration of the action state is less than the set threshold, delete the picture. Otherwise, enter the test counting module.

[0193] Test the counting module to determine whether the previous and next pictures meet the requirement of completing a high leg lift. If both meet the requirement, the count is increased by 1; otherwise, the count is not performed.

[0194] After the test module is completed, the start test module and the test count module are repeated until the test is completed, and then the result is displayed;

[0195] The preparation action standards in the preparation test module include:

[0196] The judgment basis of the lateral state of the human body is: if the coordinates of the left eye node and the right eye node in the X-axis direction are both smaller or larger than the coordinates of the left ear node and the right ear node in the X-axis direction, the human body is in the lateral state; otherwise, the human body is not in the lateral state;

[0197] The judgment basis of the double-leg straightening state is: when the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold, the double-leg straightening state is reached; otherwise, the double-leg not straightening state is reached;

[0198] The judgment basis of the trunk straightening state is: when the angle between the connection line of the left ear node and the left shoulder node and the connection line of the left shoulder node and the left hip node is greater than the second set threshold, and the angle between the connection line of the right ear node and the right shoulder node and the connection line of the right shoulder node and the right hip node is greater than the second set threshold, the trunk is in the straightening state; otherwise, the trunk is in the unstraightening state;

[0199] The standard of the preparatory action is to achieve the sideways position of the human body, straight legs and straight torso.

[0200] In another preferred embodiment, the action state types in the start test module include: S0, S1, S2, S3, S4 and unknown action state, and the actions represented by each action state are as follows:

[0201] S0: the state of legs being lowered and the trunk being straight; the state of legs being lowered is: the distance from the shoulder node to the hip node is Delta, when the height difference between the right knee joint node and the left knee joint node is less than Delta / 4, and the height difference between the left ankle node and the right ankle node is less than Delta / 4, then the legs are lowered, otherwise, then the legs are not lowered;

[0202] S1: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the third set threshold and less than the first set threshold;

[0203] S2: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than the third set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold;

[0204] S3: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the third set threshold and less than the first set threshold;

[0205] S4: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than the third set threshold, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold;

[0206] States that do not belong to S0, S1, S2, S3, and S4 are all unknown action states.

[0207] In another preferred embodiment, the duration of maintaining the action state in the start test module is specifically:

[0208] Action standard abnormality counter: when the trunk is not straightened, the action standard abnormality counter is increased by 1;

[0209] Action standard abnormality 2 counter: when in S2, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than or equal to the first set threshold, the action standard abnormality 2 counter is incremented by 1;

[0210] Action standard abnormality three counter: when in S4, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than or equal to the first set threshold, the action standard abnormality three counter is incremented by 1;

[0211] State counter Count: indicates the current action state. It is the number of times collected when this state occurs, and is used to calculate the duration of this state.

[0212] Unknown state counter Cnone: indicates that the current action state is unknown. The number of unknown actions collected when this state occurs is used to calculate the duration of this state.

[0213] In another preferred embodiment, the test counting module is further specifically:

[0214] Get the continuous pictures of completing a high leg raise.

[0215] a. If the order of the pictures is S1, S2, S1, S0, or S3, S4, S3, S0: it means the leg-lifting data is valid, and go to g;

[0216] b. If the order of the pictures is S1, S0, S1, S0, it means that the left leg is not raised high enough, and the voice broadcasts "The left leg is not raised high enough";

[0217] c. If the order of the pictures is S3, S0, S3, S0, it means that the right leg is not raised high enough, and the voice broadcasts "right leg is not raised high enough";

[0218] d. If in S0, S1, S2, S3, S4, the value of the action standard abnormality counter is greater than or equal to the set threshold value, the voice broadcasts "trunk is not straightened";

[0219] e. If in S2, the value of the action standard abnormality counter 2 is greater than or equal to the set threshold 2, the voice broadcasts "right leg is not straightened";

[0220] f. If in S4, the value of the action standard abnormality counter 3 is greater than or equal to the set threshold 3, the voice broadcasts "left leg is not straightened";

[0221] g. If the order of the pictures is S1, S2, S1, S0, S1, S2, it means raising the left leg twice in a row, and the voice will play "raising the legs without crossing";

[0222] h. If the order of the pictures is S3, S4, S3, S0, S3, S4: it means raising the right leg twice in a row, and the voice will play "raising the legs without crossing";

[0223] i. If the above exceptions b, c, d, e, f, g, and h do not occur, it means that the data is valid, the counter increases by 1, and the number after the increase is broadcast.

[0224] Since the device introduced in the second embodiment of the present invention is a device used to implement the method of the first embodiment of the present invention, those skilled in the art can understand the specific structure and deformation of the device based on the method introduced in the first embodiment of the present invention, so it is not described here in detail. All devices used in the method of the first embodiment of the present invention belong to the scope of protection of the present invention.

[0225] Based on the same inventive concept, the present application provides a storage medium corresponding to the first embodiment, see the fourth embodiment for details.

[0226] Embodiment 3

[0227] This embodiment provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, any implementation method in the first embodiment can be implemented.

[0228] The technical solution provided in the embodiments of the present application has at least the following technical effects or advantages: the embodiments of the present application provide a high leg raising test counting method, device and medium based on visual technology,

[0229] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0230] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0231] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0232] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0233] Although the specific implementation modes of the present invention are described above, those skilled in the art should understand that the specific implementation modes described are only illustrative and are not intended to limit the scope of the present invention. Equivalent modifications and changes made by those skilled in the art in accordance with the spirit of the present invention should be included in the scope of protection of the claims of the present invention.

Claims

1. A high leg raising test counting method based on visual technology, characterized in that: include: Step 1: According to the obtained preparation picture, determine whether the tester meets the preparation action standard. If yes, start the test counting and go to step 2; If it does not meet the requirements, a prompt will be given; Step 2: Obtain all pictures in chronological order, and determine the action state type in each picture and the duration of the action state. If the duration of the action state is less than the set threshold, delete the picture; otherwise, proceed to step 3. Step 3: Determine whether the previous and next pictures are consistent with completing a high leg lift. If both are consistent, add 1 to the count; If not, it will not be counted; Step 4: Repeat steps 2 and 3 until the test is completed, and then display the results; The action state types in step 2 include: S0, S1, S2, S3, S4 and unknown action state. The actions represented by each action state are as follows: S0: the state of legs being lowered and the trunk being straight; the state of legs being lowered is: the distance from the shoulder node to the hip node is Delta, when the height difference between the right knee joint node and the left knee joint node is less than Delta / 4, and the height difference between the left ankle node and the right ankle node is less than Delta / 4, then the legs are lowered, otherwise, then the legs are not lowered; S1: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the third set threshold and less than the first set threshold; S2: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than the third set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold; S3: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the third set threshold and less than the first set threshold; S4: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than the third set threshold, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold; States that do not belong to S0, S1, S2, S3, and S4 are all unknown action states; The step 3 is further specifically as follows: Get the continuous pictures of completing a high leg raise. a. If the order of the pictures is S1, S2, S1, S0, or S3, S4, S3, S0: it means the leg-lifting data is valid, and go to g; b. If the order of the pictures is S1, S0, S1, S0, it means that the left leg is not raised high enough, and the voice broadcasts "The left leg is not raised high enough"; c. If the order of the pictures is S3, S0, S3, S0, it means that the right leg is not raised high enough, and the voice broadcasts "right leg is not raised high enough"; d. If in S0, S1, S2, S3, S4, the value of the action standard abnormality counter is greater than or equal to the set threshold value, the voice broadcasts "trunk is not straightened"; e. If in S2, the value of the action standard abnormality counter 2 is greater than or equal to the set threshold 2, the voice broadcast "right leg is not straightened"; f. If in S4, the value of the action standard abnormality counter 3 is greater than or equal to the set threshold 3, the voice broadcasts "left leg is not straightened"; g. If the order of the pictures is S1, S2, S1, S0, S1, S2, it means the left leg is raised twice in a row, and the voice broadcast is "uncrossed leg raise"; h. If the order of the pictures is S3, S4, S3, S0, S3, S4: it means raising the right leg twice in a row, and the voice will play "raising the legs without crossing"; i. If the above exceptions b, c, d, e, f, g, and h do not occur, it means that the data is valid, the counter increases by 1, and the number after the increase is broadcast.

2. The high leg raising test counting method based on vision technology according to claim 1 is characterized in that: The preparatory action standards in step 1 include: The judgment basis of the lateral state of the human body is: if the coordinates of the left eye node and the right eye node in the X-axis direction are both smaller or larger than the coordinates of the left ear node and the right ear node in the X-axis direction, the human body is in the lateral state; otherwise, the human body is not in the lateral state; The judgment basis of the double-leg straightening state is: when the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold, the double-leg straightening state is reached; otherwise, the double-leg not straightening state is reached; The judgment basis of the trunk straightening state is: when the angle between the connection line of the left ear node and the left shoulder node and the connection line of the left shoulder node and the left hip node is greater than the second set threshold, and the angle between the connection line of the right ear node and the right shoulder node and the connection line of the right shoulder node and the right hip node is greater than the second set threshold, the trunk is in the straightening state; otherwise, the trunk is in the unstraightening state; The standard of the preparatory action is to achieve the sideways position of the human body, straight legs and straight torso.

3. The high leg raising test counting method based on vision technology according to claim 1 is characterized in that: The duration of maintaining the action state in step 2 is specifically: Action standard abnormality counter: when the trunk is not straightened, the action standard abnormality counter is increased by 1; Action standard abnormality 2 counter: when in S2, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than or equal to the first set threshold, the action standard abnormality 2 counter is incremented by 1; Action standard abnormality three counter: when in S4, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than or equal to the first set threshold, the action standard abnormality three counter is incremented by 1; State counter Count: indicates the current action state. It is the number of times collected when this state occurs, and is used to calculate the duration of this state. Unknown state counter Cnone: indicates that the current action state is unknown. The number of unknown actions collected when this state occurs is used to calculate the duration of this state.

4. A high leg raising test counting device based on visual technology, characterized in that: include: The preparation test module determines whether the tester meets the preparation action standards based on the obtained preparation pictures. If yes, the test counting starts and the test starts. If it does not meet the requirements, a prompt will be given; Start the test module, obtain all pictures in chronological order, and determine the action state type in each picture and the duration of the action state. If the duration of the action state is less than the set threshold, delete the picture. Otherwise, enter the test counting module. Test the counting module to determine whether the previous and next pictures meet the requirement of completing a high leg raise. If both meet the requirement, the count will be increased by 1. If not, it will not be counted; After the test module is completed, the start test module and the test count module are repeated until the test is completed, and then the result is displayed; The action state types in the start test module include: S0, S1, S2, S3, S4 and unknown action state. The actions represented by each action state are as follows: S0: the state of legs being lowered and the trunk being straight; the state of legs being lowered is: the distance from the shoulder node to the hip node is Delta, when the height difference between the right knee joint node and the left knee joint node is less than Delta / 4, and the height difference between the left ankle node and the right ankle node is less than Delta / 4, then the legs are lowered, otherwise, then the legs are not lowered; S1: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the third set threshold and less than the first set threshold; S2: the trunk is in a straight state, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than the third set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold; S3: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the third set threshold and less than the first set threshold; S4: the trunk is in a straight state, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than the third set threshold, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold; States that do not belong to S0, S1, S2, S3, and S4 are all unknown action states; The test counting module is specifically: Get the continuous pictures of completing a high leg raise. a. If the order of the pictures is S1, S2, S1, S0, or S3, S4, S3, S0: it means the leg-lifting data is valid, and go to g; b. If the order of the pictures is S1, S0, S1, S0, it means that the left leg is not raised high enough, and the voice broadcasts "The left leg is not raised high enough"; c. If the order of the pictures is S3, S0, S3, S0, it means that the right leg is not raised high enough, and the voice broadcasts "right leg is not raised high enough"; d. If in S0, S1, S2, S3, S4, the value of the action standard abnormality counter is greater than or equal to the set threshold value, the voice broadcasts "trunk is not straightened"; e. If in S2, the value of the action standard abnormality counter 2 is greater than or equal to the set threshold 2, the voice broadcast "right leg is not straightened"; f. If in S4, the value of the action standard abnormality counter 3 is greater than or equal to the set threshold 3, the voice broadcasts "left leg is not straightened"; g. If the order of the pictures is S1, S2, S1, S0, S1, S2, it means the left leg is raised twice in a row, and the voice broadcast is "uncrossed leg raise"; h. If the order of the pictures is S3, S4, S3, S0, S3, S4: it means raising the right leg twice in a row, and the voice will play "raising the legs without crossing"; i. If the above exceptions b, c, d, e, f, g, and h do not occur, it means that the data is valid, the counter increases by 1, and the number after the increase is broadcast.

5. The high leg raising test counting device based on vision technology according to claim 4 is characterized in that: The preparation action standards in the preparation test module include: The judgment basis of the lateral state of the human body is: if the coordinates of the left eye node and the right eye node in the X-axis direction are both smaller or larger than the coordinates of the left ear node and the right ear node in the X-axis direction, the human body is in the lateral state; otherwise, the human body is not in the lateral state; The judgment basis of the double-leg straightening state is: when the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is greater than the first set threshold, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is greater than the first set threshold, the double-leg straightening state is reached; otherwise, the double-leg not straightening state is reached; The judgment basis of the trunk straightening state is: when the angle between the connection line of the left ear node and the left shoulder node and the connection line of the left shoulder node and the left hip node is greater than the second set threshold, and the angle between the connection line of the right ear node and the right shoulder node and the connection line of the right shoulder node and the right hip node is greater than the second set threshold, the trunk is in the straightening state; otherwise, the trunk is in the unstraightening state; The standard of the preparatory action is to achieve the sideways position of the human body, straight legs and straight torso.

6. The high leg raising test counting device based on vision technology according to claim 4 is characterized in that: The duration of maintaining the action state in the start test module is specifically: Action standard abnormality counter: when the trunk is not straightened, the action standard abnormality counter is increased by 1; Action standard abnormality 2 counter: when in S2, and the angle between the line connecting the right hip node and the right knee joint node and the line connecting the right knee joint node and the right ankle joint node is less than or equal to the first set threshold, the action standard abnormality 2 counter is incremented by 1; Action standard abnormality three counter: when in S4, and the angle between the line connecting the left hip node and the left knee joint node and the line connecting the left knee joint node and the left ankle joint node is less than or equal to the first set threshold, the action standard abnormality three counter is incremented by 1; State counter Count: indicates the current action state. It is the number of times collected when this state occurs, and is used to calculate the duration of this state. Unknown state counter Cnone: indicates that the current action state is unknown. The number of unknown actions collected when this state occurs is used to calculate the duration of this state.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 3 is implemented.

Images