Motion state recognition method, device, electronic device and storage medium

Abstract

The present application discloses a motion state recognition method, device, electronic device and storage medium, belonging to the field of communication technology. It includes: when the acceleration of the electronic device is greater than a first preset threshold, determining that the electronic device is in a motion state; obtaining N first accelerations of the electronic device in the motion state, each of which includes: a first sub-acceleration and a second sub-acceleration, the first sub-acceleration and the second sub-acceleration are perpendicular to each other, and N is a positive integer; when the change amount of the first sub-acceleration of the first acceleration is greater than the second preset threshold, the change amount of the second sub-acceleration of the first acceleration is greater than the third preset threshold, and there is a target first-order difference in the first-order difference of each second sub-acceleration, identifying the motion state as hitting the ball; wherein the target first-order difference is a first-order difference greater than a fourth preset threshold.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to a motion state recognition method, device, electronic device and storage medium. Background Art

[0002] As people pay more and more attention to health, they begin to increase the frequency of physical exercise and also hope to use electronic devices to record exercise parameters.

[0003] In the related art, the method of identifying the batting motion is often to set an acceleration sensor in the batting target of the batting motion to determine whether the user is performing the batting motion. However, this method often requires the use of specific equipment to perform the motion, and in the batting motion state, the batting target equipped with the acceleration sensor is also easily damaged.

[0004] Therefore, how to better judge whether the user is performing a batting sport has become a problem that needs to be solved urgently in the industry. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a motion state recognition method, device, electronic device and storage medium, which can solve the problem of how to better determine whether the user is performing a batting motion.

[0006] In a first aspect, an embodiment of the present application provides a motion state recognition method, the method comprising:

[0007] When the acceleration of the electronic device is greater than a first preset threshold, determining that the electronic device is in motion;

[0008] Acquire N first accelerations of the electronic device in the motion state, each of the first accelerations includes: a first sub-acceleration and a second sub-acceleration, the first sub-acceleration and the second sub-acceleration are perpendicular to each other in a three-dimensional space, and N is a positive integer;

[0009] In the case where the change in the first sub-acceleration of the first acceleration is greater than a second preset threshold, the change in the second sub-acceleration of the first acceleration is greater than a third preset threshold, and there is a target first-order difference in each first-order difference of the second sub-acceleration, the motion state is identified as hitting the ball; wherein the target first-order difference is a first-order difference greater than a fourth preset threshold. In a second aspect, an embodiment of the present application provides a motion state identification device, comprising:

[0010] A first determination module, configured to determine that the electronic device is in motion when the acceleration of the electronic device is greater than a first preset threshold;

[0011] A first acquisition module is used to acquire N first accelerations of the electronic device in the motion state, each of the first accelerations includes: a first sub-acceleration and a second sub-acceleration, the first sub-acceleration and the second sub-acceleration are perpendicular to each other, and N is a positive integer;

[0012] An identification module is used to identify the motion state as a hit when the change in the first sub-acceleration of the first acceleration is greater than a second preset threshold, the change in the second sub-acceleration of the first acceleration is greater than a third preset threshold, and there is a target first-order difference in each first-order difference of the second sub-acceleration; wherein the target first-order difference is a first-order difference greater than a fourth preset threshold.

[0013] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0015] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0016] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0017] In an embodiment of the present application, when the acceleration of the electronic device is greater than a first preset threshold and it is recognized that the user may be in a motion state, the first acceleration in the motion state is further acquired, thereby determining whether the user is hitting the ball based on the first sub-acceleration and the second sub-acceleration of the first acceleration, thereby effectively ensuring the convenience and accuracy of motion state recognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A schematic diagram of a motion state recognition method provided in an embodiment of the present application;

[0019] Figure 2 A second acceleration schematic diagram provided in an embodiment of the present application;

[0020] Figure 3 One of the acceleration change schematic diagrams provided in the embodiment of the present application;

[0021] Figure 4 The second schematic diagram of acceleration change provided in the embodiment of the present application;

[0022] Figure 5 A schematic diagram of the structure of a motion state recognition device provided in an embodiment of the present application;

[0023] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0024] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0026] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0027] The motion state recognition method, device, electronic device and storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0028] Figure 1 A flow chart of a motion state recognition method provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, including:

[0029] Step 110, when the acceleration of the electronic device is greater than a first preset threshold, determining that the electronic device is in motion;

[0030] Specifically, the electronic device described in the embodiment of the present application is an electronic device with an acceleration detection function, which can be an electronic device provided with an acceleration sensor, and during the motion state recognition process, the electronic device needs to be carried by the user, and the electronic device often needs to be worn on the user's arm or wrist when hitting the ball, that is, the electronic device will generate acceleration variables accordingly as the user's arm moves.

[0031] It can be understood that the electronic device described in the embodiments of the present application can specifically be a smart portable device such as a smart bracelet, a smart watch, etc. with an acceleration sensor, or it can be a bracelet or other wearable device connected to a smart device and only has an acceleration detection function.

[0032] In addition, the electronic device can also be a mobile phone with an acceleration sensor, which can be fixed to the user's body with the help of a sports bag that fixes the user's arm or other parts of the user's body. When the user is in motion, the mobile phone can also detect the acceleration variables generated by the user's motion.

[0033] The acceleration described in the embodiments of the present application may specifically be the acceleration information detected by the electronic device during operation before determining that the user has entered a motion state, and the acceleration information detected after determining that the user has entered a motion state is used as the first acceleration.

[0034] The first preset threshold described in the embodiment of the present application may be a preset threshold. For example, the first preset threshold may be 10 m / s. 2 When the acceleration of the electronic device does not exceed the first preset threshold, the user carrying the electronic device is likely not in motion and is not performing a batting motion. Correspondingly, when the acceleration of the electronic device exceeds the first preset threshold, the user carrying the electronic device is likely to be in motion and is not performing a batting motion. In this case, further analysis of the acceleration of the motion state is required.

[0035] Step 120, obtaining N first accelerations of the electronic device in the motion state, each of the first accelerations comprising: a first sub-acceleration and a second sub-acceleration, the first sub-acceleration and the second sub-acceleration are perpendicular to each other, and N is a positive integer;

[0036] Specifically, the N first accelerations of the electronic device in the motion state refer to that the acceleration information obtained when the electronic device is in the motion state is all the first acceleration, that is, the acceleration obtained in the time period from determining that the electronic device enters the motion state to determining that the electronic device ends the motion state.

[0037] Specifically, the first acceleration described in the embodiment of the present application may include three acceleration components in a three-dimensional space, which are a first sub-acceleration and a second sub-acceleration, and may also include a third sub-acceleration, and the first sub-acceleration, the second sub-acceleration and the third sub-acceleration are all in a perpendicular relationship with each other in a three-dimensional space.

[0038] For example, when the electronic device is a smart watch worn by a user, the smart watch detects a first acceleration, Figure 2 A first acceleration diagram provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the first acceleration can be decomposed into the X-axis along the direction of the arm, the Y-axis perpendicular to the direction of the arm, and the Z-axis perpendicular to both the X-axis and the Y-axis, that is, the first acceleration will have a first sub-acceleration on the Z-axis, the first acceleration will have a second sub-acceleration on the X-axis, and the first acceleration will have a third sub-acceleration on the Y-axis.

[0039] Step 130, when the first sub-acceleration change of the first acceleration is greater than the second preset threshold, the second sub-acceleration change of the first acceleration is greater than the third preset threshold, and there is a target first-order difference in each first-order difference of the second sub-acceleration, identify the motion state as a hit; wherein the target first-order difference is a first-order difference greater than a fourth preset threshold.

[0040] Specifically, the second preset threshold, the third preset threshold and the fourth preset threshold described in the embodiments of the present application are all numerical values ​​that can be pre-set.

[0041] If the motion state in the embodiment of the present application is hitting the ball, there may be two stages in the hitting process, one stage is the stage of swinging the racket to accelerate, and the other stage may be the stage of hitting the ball.

[0042] During the swing acceleration process, the arm swings forward to hit the ball, and the arm will exert a force on the first sub-acceleration direction of the electronic device. The first sub-acceleration direction can be the above Figure 2 The Z-axis direction in the embodiment is specifically manifested in that the first sub-acceleration decreases from near zero to a preset negative value, such as -20 m / s 2， That is, at this time, the first sub-acceleration change of the first acceleration is greater than the second preset threshold.

[0043] At the same time, during the swing acceleration process, the electronic device tends to fly outward along the arm, causing the skin of the wrist to exert a static friction force on the electronic device along the direction of the second sub-acceleration to prevent the relative movement of the electronic device and the arm. This static friction force causes the second sub-acceleration to increase significantly, with an increase of about 15m / s 2The above is specifically positively correlated with the strength of the swing, that is, at this time, the variable of the second sub-acceleration is greater than the third preset threshold, and when it is swung to a certain extent, the change of the adjacent second sub-acceleration will exceed the fourth preset threshold, that is, there will be at least one target first-order difference in the first-order differences of each of the second sub-accelerations, then the user's movement state is identified as hitting the ball.

[0044] The batting described in the embodiments of the present application may specifically refer to badminton batting or tennis batting, or may be other batting that satisfies the above-mentioned acceleration variation law.

[0045] In an embodiment of the present application, by using the acceleration of the electronic device carried by the user during exercise, it is recognized that the user may be in a state of motion, and the first acceleration in the state of motion is further obtained, so as to determine whether the user is hitting the ball based on the characteristics of the first acceleration. This can be achieved only with the help of the electronic device carried by the user during exercise, and there is no need to add additional equipment to the hitting target, thereby improving the convenience of detection.

[0046] Optionally, after identifying the motion state as hitting the ball, the method further includes:

[0047] In a first preset time period, after the first sub-acceleration is updated from a first value to a second value, and then updated from the second value to a third value, it is determined that the ball is hit during the motion state, wherein the second value is greater than the first value and the third value;

[0048] Or, when the first sub-accelerations are all smaller than a fifth preset threshold, it is determined that the shot has missed during the motion state.

[0049] Specifically, the first preset time period described in the embodiment of the present application may specifically refer to a preset continuous time period. The first value, second value and third value described in the embodiment of the present application may all be pre-set values, and the second value is greater than the first value and the third value.

[0050] Specifically, during the hitting process, before the ball is hit, the wrist will apply thrust to the negative direction of the first sub-acceleration of the electronic device. The first value described in the embodiment of the present application may specifically be the value of the first sub-acceleration before the ball is hit, which is usually a negative value. The first value may specifically be the minimum value of the first sub-acceleration before the ball is hit.

[0051] During the batting process, when the ball is hit, in the brief moment of contact, the reaction force of the ball on the racket will cause the racket to have a reaction force on the arm, which will further cause the electronic device worn on the arm to have a brief impact force in the positive direction of the first sub-acceleration, which will be reflected in the first sub-acceleration as the first sub-acceleration increases from a first value to a second value, which is the acceleration corresponding to the impact force and the thrust exerted by the wrist on the electronic device in the direction of the first acceleration.

[0052] After hitting the ball, the short-lived impact force disappears, at which point the first sub-acceleration of the electronic device returns to a negative value. At this point, the third value is the first sub-acceleration after the impact force disappears, and the third value is smaller than the second value.

[0053] Since the change in the first sub-acceleration caused by a hit occurs in a very short period of time, a hit in motion is determined only when it is detected that the first sub-acceleration is updated from the first value to the second value and then from the second value to the third value within the first preset time period.

[0054] More specifically, when the user's arm wearing the electronic device swings the racket to hit the ball but misses, the ball will not generate any reaction force on the racket and the arm, the first sub-acceleration will not show an obvious sudden increase trend, and within the second preset time period of a swing, the electronic device will not detect that the first sub-acceleration suddenly increases to a certain value, and when the ball misses, within the second preset time period, the value of the first acceleration should be less than the fifth preset threshold.

[0055] In the embodiment of the present application, by analyzing the Z-axis acceleration and the X-axis acceleration obtained after determining that the first motion is a hitting motion, it is further determined whether the hitting is successful in the hitting motion, thereby achieving effective statistics of the hitting situation through the electronic device.

[0056] In the embodiment of the present application, after determining that the motion state is hitting the ball, the first sub-acceleration and the second sub-acceleration are analyzed to further determine whether the ball is hit after determining that the motion state is hitting the ball, thereby achieving effective statistics of the hitting situation through the electronic device.

[0057] Optionally, after determining that the ball is hit during the motion state, the method further includes:

[0058] Obtain P first accelerations within a target period, wherein the target period is a period between a first moment and a second moment, the first moment is a moment when the motion state is identified as hitting the ball, the second moment is a moment when the first acceleration is first detected to be greater than the first preset threshold after the motion state is identified as hitting the ball, and P is a positive integer;

[0059] Based on the P first accelerations, determining a first acceleration waveform diagram;

[0060] According to the first peak whose peak similarity information is greater than the first similarity threshold in the first acceleration waveform graph, a second acceleration waveform graph is obtained, wherein the peak similarity information is determined based on the first peak and Q second peaks in the first acceleration waveform graph, the second peak is a peak adjacent to the first peak, and Q is a positive integer;

[0061] The first movement step number is determined based on the number of wave peaks per second of the second acceleration waveform.

[0062] Specifically, during the batting motion, the user's step counting characteristics are very different from those during normal walking, especially in the period from after the ball is hit to before the next swing. At this time, the user does not bend over to pick up the ball, and may need to quickly adjust his position to prepare for the next batting. Therefore, the user may walk and run randomly back and forth, left and right, resulting in poor periodic similarity between adjacent steps. It is difficult to achieve accurate step counting using conventional step counting methods. Therefore, in the embodiment of the present application, it is necessary to further perform step counting analysis on the P first accelerations.

[0063] Specifically, the target time period described in the embodiment of the present application may specifically refer to the interval from when the user is in motion, after determining that the ball is hit, to when he starts to swing the racket again. Correspondingly, if there are multiple hits in the motion state of hitting the ball, there may be multiple target time periods in the motion state of hitting the ball. If there is no hit in the motion state, there will be no target time period.

[0064] In the embodiment of the present application, the first moment is the moment when the motion state is identified as hitting the ball, and the second moment is the moment when the first acceleration is first detected to be greater than the first preset threshold after the motion state is identified as hitting the ball, that is, the second moment is the moment after the first moment when it is first detected that the user may be performing a swinging action.

[0065] In the embodiment of the present application, P first accelerations within the target time period will be further analyzed to achieve pedometer data analysis within the target time period. Specifically, after obtaining the P first accelerations, they can be filtered through a low-pass filter with a cutoff frequency of 4 Hz to generate a first acceleration waveform diagram, and the peak similarity information of each first peak in the first acceleration waveform diagram and the Q second peaks adjacent to the first peak is further analyzed. Specifically, the similarity of the first peak and each corresponding second peak is compared to finally obtain the overall peak similarity information. For example, the periodic similarity of each first peak with 4 or 5 second peaks adjacent to the first peak can be determined, and the number of Q can be set in advance.

[0066] The second wave peaks corresponding to the first wave peaks described in the embodiments of the present application may refer only to the wave peaks adjacent to the left or right of the first wave peak in the first acceleration waveform diagram.

[0067] In order to ensure the accuracy of step count statistics, the embodiment of the present application will further screen whether there may be abnormal data in each first peak through the peak similarity information of each first peak. The specific method may be to compare the peak similarity information of each first peak with the first similarity threshold. The first peak whose peak similarity information is greater than the first similarity threshold is considered to have a high similarity with the surrounding peaks and is normal data, while the peak whose peak similarity information is lower than the first similarity threshold is considered to have a low similarity with the surrounding peaks and may be abnormal data, which is not convenient to continue to retain. Therefore, in the embodiment of the present application, only the first peak whose peak similarity information is greater than the first similarity threshold in the first acceleration waveform graph is retained to obtain the second acceleration waveform graph.

[0068] The first similarity threshold described in the embodiment of the present application can be a pre-set value. The first similarity threshold can be set smaller than the threshold in the conventional pedometer algorithm, so that the data screening criteria can be relaxed and steps with poor period similarity during rapid movement can also be counted in the total number of steps.

[0069] More specifically, after determining the second acceleration waveform, the number of steps can be calculated based on the number of obvious peaks in the second acceleration waveform per second. For example, in an embodiment of the present application, if three obvious peaks are detected within one second, it is considered that the user has taken three steps in this second. Finally, the number of first movement steps within the target time period is determined based on this method.

[0070] Optionally, in the motion state of batting, if it is determined that the shot misses, the user has a short period of time to bend down to pick up the ball and remain still from the current time to the next swing, and then the user moves to the target position by normal walking to continue moving. At this time, the steps can be counted by the conventional pedometer method to determine the second motion step number from the time when the shot misses to the time when the shot is swung again.

[0071] In an embodiment of the present application, by analyzing the acceleration waveform composed of P first accelerations in the target segment, the number of steps of the user from the time of hitting the ball to the time of the next swing is determined, and the number of steps of the user can be accurately counted according to the motion characteristics of the hit.

[0072] Optionally, after identifying the motion state as hitting the ball, the method further includes:

[0073] When it is detected that M consecutive first accelerations are all smaller than a sixth preset threshold, it is determined that the motion state ends, where M is a positive integer.

[0074] Specifically, in the embodiment of the present application, in order to avoid the influence of the special pedometer in the batting motion state on the normal pedometer, and the statistical accuracy of calorie consumption in the batting motion state, it is necessary to further effectively judge when the batting motion state ends.

[0075] In the embodiment of the present application, at the stage when the motion state of hitting the ball ends, the first acceleration drops rapidly and approaches zero. Therefore, when it is detected that M consecutive first accelerations are all less than the sixth preset threshold, it is determined that the motion state ends.

[0076] After determining the motion state of the ball hitting, the embodiment of the present application will immediately restart detecting the acceleration of the electronic device. If the acceleration of the electronic device is detected again to exceed the first preset threshold, it is considered that the electronic device has re-entered the motion state.

[0077] In the embodiment of the present application, after determining that the motion state is a hit, it is further determined whether the motion state is ended based on the first acceleration, thereby effectively starting to detect subsequent motion states, effectively distinguishing data of different motion states, and avoiding recognition errors.

[0078] Optionally, in the embodiment of the present application, the number of times the ball is continuously judged to be hit in the motion state may also be recorded;

[0079] When the motion state is determined as a missed shot, the number of times is stopped from being recorded, and the number of consecutive hits in the motion state is obtained.

[0080] Specifically, for batting sports, such as badminton or tennis, users tend to be more concerned about the number of consecutive hits. This parameter can better reflect the user's batting level. Therefore, the embodiment of the present application will further record the number of times the motion state is continuously judged as a batting hit.

[0081] The number of times a shot is judged to be a hit in the motion state described in the embodiment of the present application may specifically mean that in the motion state, each shot is judged to be a hit, that is, in the motion state, no shot is judged to be a miss.

[0082] Accordingly, if a shot is judged as a miss during the motion state, stop recording the number of consecutive hits, record a miss, obtain the number of consecutive hits for the current shot motion, and restart recording the number of consecutive hits.

[0083] In the embodiment of the present application, by recording the number of consecutive hits in the batting motion state, the number of consecutive hits in the batting motion can be effectively counted, which is convenient for users to understand their motion status.

[0084] Optionally, in another embodiment, taking the case where the user wears the electronic device on the right wrist and swings the racket with the right hand to perform a ball hitting motion as an example, the direction along the user's arm is set as the X-axis, the direction perpendicular to the user's arm is set as the Y-axis, and the Z-axis is perpendicular to both the X-axis and the Y-axis, that is, the first acceleration will have a first sub-acceleration on the Z-axis, a second sub-acceleration on the X-axis, and a third sub-acceleration on the Y-axis. For details, please refer to Figure 2 The coordinate direction in Figure 3 This is one of the acceleration change schematic diagrams provided in the embodiment of the present application, such as Figure 3 As shown, the lines with rectangular symbols correspond to the first sub-acceleration, the lines with triangle symbols correspond to the second sub-acceleration, the lines with circle symbols correspond to the third sub-acceleration, and the lines with pentagon symbols correspond to the first acceleration. In order to avoid confusion caused by overlapping lines, the lines corresponding to the first acceleration are shifted upward by 5 units based on the true value. The motion state of the entire hitting ball can be roughly divided into the following five stages:

[0085] Stage 1 310, the right hand wearing the electronic device holds the racket, the arm and the racket hang down normally, the second sub-acceleration is in the positive direction of the X-axis upward, about 9.8, the electronic device is slightly tilted upward, and the first sub-acceleration of the z-axis is slightly greater than zero;

[0086] In stage 2 320, the user starts to prepare to hit the ball. The user lifts the racket with his right hand and lifts it from a drooping state to a horizontal state. At this time, the second sub-acceleration of the x-axis gradually decreases from about 9 to about zero. At the same time, the first sub-acceleration of the z-axis gradually increases from slightly greater than zero to about 9.

[0087] In stage three 330, the right hand lifts the racket with force, and the racket continues to be lifted from the horizontal posture to the posture with the racket head facing the sky; the corresponding positive direction of the x-axis changes from horizontal to pointing to the ground, that is, the second sub-acceleration of the x-axis decreases from near zero to near -9; at the same time, the positive direction of the z-axis gradually changes from pointing to the sky to the horizontal direction, that is, the first sub-acceleration of the z-axis gradually decreases from near 9 to near zero;

[0088] Stage 4 340, start hitting the ball, swing the racket forward with the right hand, and the wrist exerts a force on the negative z-axis direction of the watch, which is specifically manifested in the first sub-acceleration of the z-axis decreasing from near zero to near -20, and the specific value varies with different swinging strengths; at the same time, because the watch tends to fly outward along the arm when swinging, the skin of the wrist exerts a static friction force on the watch along the positive x-axis to prevent the relative movement of the watch and the arm. This static friction force causes the second sub-acceleration of the x-axis to increase significantly, and the increase is about 30 or more, which is positively correlated with the swinging strength;

[0089] Stage five 350, in the case of a hit, when the racket hits the badminton, because the racket has an impact force on the badminton, the badminton exerts a reaction force on the racket, and then the racket exerts a reaction force on the wrist, causing the wrist to exert an impact force on the watch along the positive direction of the z-axis, and the z-axis acceleration increases sharply instantly. At this time, the first sub-acceleration is updated from the first value to the second value, because the reaction force of the badminton on the racket only exists at the moment of contact and lasts for a very short time. As shown in the figure, it lasts for about four sampling intervals. The specific contact time is related to the material of the badminton and the racket and the force of swinging the racket to hit the ball. If the toughness of the material is stronger, the contact time is shorter, and the reaction force of the badminton on the racket is greater; if the force of swinging the racket to hit the ball is greater, the contact time is longer, and the reaction force of the badminton on the racket is greater. After the reaction force disappears, the first sub-acceleration will be updated from the second value to the third value.

[0090] At the same time, similar to stage 4, because stage 5 is still in the swinging action, the wrist drives the watch to do a circular motion around the shoulder, and the watch tends to fly out along the arm, causing the skin of the wrist to exert static friction on the watch along the positive direction of the x-axis (similar to the centripetal force of circular motion) to prevent the relative movement of the watch and the arm. This static friction causes the second acceleration of the x-axis to increase significantly, with an increase of about 30m / s2 (the specific amount is positively correlated with the strength of the swing), and the value of the x-axis acceleration is greater than zero in stage 5.

[0091] Optionally, in some embodiments, the user may miss the shot during the shot phase. Figure 4 The second schematic diagram of acceleration change provided in the embodiment of the present application is as follows: Figure 4 As shown, including:

[0092] Stage six 410 may specifically be the stage where the user misses the shot. If the user swings the racket to hit the badminton but misses it, because there is no reaction force of the badminton on the racket, the first sub-acceleration of the electronic device's z-axis does not increase significantly, and during the entire process of stage six, the first sub-acceleration of the z-axis is less than zero and its mean is less than -10, while the x-axis is greater than zero and its mean is greater than 10.

[0093] The motion state recognition method provided in the embodiment of the present application can be executed by a motion state recognition device. In the embodiment of the present application, the motion state recognition method performed by the motion state recognition device is taken as an example to illustrate the motion state recognition device provided in the embodiment of the present application.

[0094] Figure 5 A schematic diagram of the structure of the motion state recognition device provided in the embodiment of the present application is shown in FIG. Figure 5 As shown, it includes: a first determination module 510, a first acquisition module 520 and an identification module 530;

[0095] The first determination module 510 is used to determine that the electronic device is in motion when the acceleration of the electronic device is greater than a first preset threshold;

[0096] The first acquisition module 520 is used to acquire N first accelerations of the electronic device in the motion state, each of the first accelerations includes: a first sub-acceleration and a second sub-acceleration, the first sub-acceleration and the second sub-acceleration are perpendicular to each other, and N is a positive integer;

[0097] Among them, the identification module 530 is used to identify the motion state as hitting the ball when the change in the first sub-acceleration of the first acceleration is greater than the second preset threshold, the change in the second sub-acceleration of the first acceleration is greater than the third preset threshold, and there is a target first-order difference in each first-order difference of the second sub-acceleration; wherein the target first-order difference is a first-order difference greater than the fourth preset threshold.

[0098] Optionally, the device further comprises:

[0099] A first determination module is configured to determine that the ball is hit during the motion state when the first sub-acceleration is updated from a first value to a second value and then from the second value to a third value within a first preset time period, wherein the second value is greater than the first value and the third value;

[0100] Or, when the first sub-accelerations are all less than a fifth preset threshold, it is determined that the shot has not hit the target during the motion state.

[0101] The device also includes:

[0102] a second acquisition module, configured to acquire P first accelerations within a target period, wherein the target period is a period between a first moment and a second moment, wherein the first moment is a moment when the motion state is identified as hitting the ball, and the second moment is a moment when the first acceleration is first detected to be greater than the first preset threshold after the motion state is identified as hitting the ball, and P is a positive integer;

[0103] A second determination module, configured to determine a first acceleration waveform diagram based on the P first accelerations;

[0104] an analysis module, configured to obtain a second acceleration waveform graph according to a first peak whose peak similarity information is greater than a first similarity threshold in the first acceleration waveform graph, wherein the peak similarity information is determined based on a first peak and Q second peaks in the first acceleration waveform graph, the second peak is a peak adjacent to the first peak, and Q is a positive integer;

[0105] The third determination module is used to determine the first movement step number based on the number of peaks per second of the second acceleration waveform.

[0106] Optionally, the device further comprises:

[0107] The second determination module is used to determine that the motion state ends when it is detected that M consecutive first accelerations are all less than a sixth preset threshold, where M is a positive integer.

[0108] In an embodiment of the present application, by using the acceleration of the electronic device carried by the user during exercise, it is recognized that the user may be in a state of motion, and the first acceleration in the state of motion is further obtained, so as to determine whether the user is hitting the ball based on the characteristics of the first acceleration. This can be achieved only with the help of the electronic device carried by the user during exercise, and there is no need to add additional equipment to the hitting target, thereby improving the convenience of detection.

[0109] The motion state recognition device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0110] The motion state recognition device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0111] The motion state recognition device provided in the embodiment of the present application can achieve Figure 1 to Figure 2 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0112] Optionally, Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application, such as Figure 6 As shown, an embodiment of the present application also provides an electronic device 600, including a processor 601 and a memory 602, wherein the memory 602 stores programs or instructions that can be executed on the processor 601, and when the program or instructions are executed by the processor 601, the various steps of the above-mentioned motion state recognition method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

[0113] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0114] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0115] The electronic device 700 includes but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710.

[0116] Those skilled in the art will appreciate that the electronic device 700 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 710 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 7 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0117] The processor 710 is configured to determine that the electronic device is in motion when the acceleration of the electronic device is greater than a first preset threshold;

[0118] The sensor 705 is used to obtain N first accelerations of the electronic device in the motion state, each of the first accelerations includes: a first sub-acceleration and a second sub-acceleration, the first sub-acceleration and the second sub-acceleration are perpendicular to each other, and N is a positive integer;

[0119] Processor 710 is used to identify the motion state as a hit when the change in the first sub-acceleration of the first acceleration is greater than a second preset threshold, the change in the second sub-acceleration of the first acceleration is greater than a third preset threshold, and there is a target first-order difference in each first-order difference of the second sub-acceleration; wherein the target first-order difference is a first-order difference greater than a fourth preset threshold.

[0120] Optionally, the processor 710 is configured to determine that the ball is hit during the motion state when the first sub-acceleration is updated from a first value to a second value and then from the second value to a third value within a first preset time period, wherein the second value is greater than the first value and the third value;

[0121] Or, when the first sub-accelerations are all smaller than a fifth preset threshold, it is determined that the shot has missed during the motion state.

[0122] Optionally, the sensor 705 is used to obtain P first accelerations within a target period, wherein the target period is a period between a first moment and a second moment, the first moment is a moment when the motion state is identified as hitting the ball, the second moment is a moment when the first acceleration is first detected to be greater than the first preset threshold after the motion state is identified as hitting the ball, and P is a positive integer;

[0123] The processor 710 is configured to determine a first acceleration waveform diagram based on the P first accelerations;

[0124] The processor 710 is configured to obtain a second acceleration waveform graph according to a first peak whose peak similarity information is greater than a first similarity threshold in the first acceleration waveform graph, wherein the peak similarity information is determined based on a first peak and Q second peaks in the first acceleration waveform graph, the second peak is a peak adjacent to the first peak, and Q is a positive integer;

[0125] The processor 710 is configured to determine the first movement step number based on the number of peaks per second of the second acceleration waveform.

[0126] Optionally, the processor 710 is configured to determine that the motion state ends when it is detected that M consecutive first accelerations are all less than a sixth preset threshold, where M is a positive integer.

[0127] In an embodiment of the present application, by using the acceleration of the electronic device carried by the user during exercise, it is recognized that the user may be in a state of motion, and the first acceleration during the motion is further obtained, so as to determine whether the user is hitting the ball based on the characteristics of the first acceleration. This can be achieved only with the help of the electronic device carried by the user during exercise, and there is no need to add additional equipment to the hitting target, thereby improving the convenience of detection.

[0128] It should be understood that in the embodiment of the present application, the input unit 704 may include a graphics processor (Graphics Processing Unit, GPU) 7041 and a microphone 7042, and the graphics processor 7041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 707 includes a touch panel 7071 and at least one of other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0129] The memory 709 can be used to store software programs and various data. The memory 709 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 709 may include a volatile memory or a non-volatile memory, or the memory 709 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0130] The processor 710 may include one or more processing units; optionally, the processor 710 integrates an application processor and a modem processor, wherein the application processor mainly processes operations involving an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the above-mentioned modem processor may not be integrated into the processor 710. The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by the processor, each process of the above-mentioned motion state recognition method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0131] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0132] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned motion state recognition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0133] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0134] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned motion state recognition method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0135] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0136] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0137] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A motion state recognition method, characterized in that: include: When the acceleration of the electronic device is greater than a first preset threshold, determining that the electronic device is in motion; Obtaining N first accelerations of the electronic device in the motion state, wherein the first acceleration is decomposed into an X-axis along the direction of the arm, a Y-axis perpendicular to the direction of the arm, and a Z-axis perpendicular to both the X-axis and the Y-axis, and each of the first accelerations includes: a first sub-acceleration and a second sub-acceleration, wherein the first sub-acceleration is a component of the first acceleration on the Z-axis, and the second sub-acceleration is a component of the first acceleration on the X-axis, and the first sub-acceleration and the second sub-acceleration are perpendicular to each other, and N is a positive integer; When the first sub-acceleration change of the first acceleration is greater than the second preset threshold, the second sub-acceleration change of the first acceleration is greater than the third preset threshold, and there is a target first-order difference in each first-order difference of the second sub-acceleration, the motion state is identified as a hit; wherein the target first-order difference is a first-order difference greater than a fourth preset threshold.

2. The motion state recognition method according to claim 1, characterized in that: After identifying the motion state as hitting the ball, the method further includes: In a first preset time period, after the first sub-acceleration is updated from a first value to a second value, and then updated from the second value to a third value, it is determined that the ball is hit during the motion state, wherein the second value is greater than the first value and the third value; Or, when the first sub-accelerations are all smaller than a fifth preset threshold, it is determined that the shot has missed during the motion state.

3. The motion state recognition method according to claim 2, characterized in that: After determining that the ball is hit during the motion state, the method further includes: Obtain P first accelerations within a target period, wherein the target period is a period between a first moment and a second moment, the first moment is a moment when the motion state is identified as hitting the ball, the second moment is a moment when the first acceleration is first detected to be greater than the first preset threshold after the motion state is identified as hitting the ball, and P is a positive integer; Based on the P first accelerations, determining a first acceleration waveform diagram; According to the first peak whose peak similarity information is greater than the first similarity threshold in the first acceleration waveform graph, a second acceleration waveform graph is obtained, wherein the peak similarity information is determined based on the first peak and Q second peaks in the first acceleration waveform graph, the second peak is a peak adjacent to the first peak, and Q is a positive integer; The first movement step number is determined based on the number of wave peaks per second of the second acceleration waveform.

4. The motion state recognition method according to claim 2, characterized in that: After identifying that the motion state is hitting the ball, the method further includes: When it is detected that M consecutive first accelerations are all smaller than a sixth preset threshold, it is determined that the motion state ends, where M is a positive integer.

5. A motion state recognition device, characterized in that: include: A first determination module, configured to determine that the electronic device is in motion when the acceleration of the electronic device is greater than a first preset threshold; a first acquisition module, configured to acquire N first accelerations of the electronic device in the motion state, wherein the first acceleration is decomposed into an X-axis along the direction of the arm, a Y-axis perpendicular to the direction of the arm, and a Z-axis perpendicular to both the X-axis and the Y-axis, and each of the first accelerations includes: a first sub-acceleration and a second sub-acceleration, wherein the first sub-acceleration is a component of the first acceleration on the Z-axis, and the second sub-acceleration is a component of the first acceleration on the X-axis, and the first sub-acceleration and the second sub-acceleration are perpendicular to each other, and N is a positive integer; An identification module is used to identify the motion state as a hit when the change in the first sub-acceleration of the first acceleration is greater than a second preset threshold, the change in the second sub-acceleration of the first acceleration is greater than a third preset threshold, and there is a target first-order difference in each first-order difference of the second sub-acceleration; wherein the target first-order difference is a first-order difference greater than a fourth preset threshold.

6. The motion state recognition device according to claim 5, characterized in that: The device also includes: A first determination module is configured to determine that the ball is hit during the motion state when the first sub-acceleration is updated from a first value to a second value and then from the second value to a third value within a first preset time period, wherein the second value is greater than the first value and the third value; Or, when the first sub-accelerations are all smaller than a fifth preset threshold, it is determined that the shot has missed during the motion state.

7. The motion state recognition device according to claim 6, characterized in that: The device also includes: a second acquisition module, configured to acquire P first accelerations within a target period, wherein the target period is a period between a first moment and a second moment, wherein the first moment is a moment when the motion state is identified as hitting the ball, and the second moment is a moment when the first acceleration is first detected to be greater than the first preset threshold after the motion state is identified as hitting the ball, and P is a positive integer; A second determination module, configured to determine a first acceleration waveform diagram based on the P first accelerations; an analysis module, configured to obtain a second acceleration waveform graph according to a first peak whose peak similarity information is greater than a first similarity threshold in the first acceleration waveform graph, wherein the peak similarity information is determined based on a first peak and Q second peaks in the first acceleration waveform graph, the second peak is a peak adjacent to the first peak, and Q is a positive integer; The third determination module is used to determine the first movement step number based on the number of peaks per second of the second acceleration waveform.

8. The motion state recognition device according to claim 6, characterized in that: The device also includes: The second determination module is used to determine that the motion state ends when it is detected that M consecutive first accelerations are all less than a sixth preset threshold, where M is a positive integer.

9. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the motion state recognition method as described in any one of claims 1 to 4 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the motion state recognition method as described in any one of claims 1-4 are implemented.

Images