A method, apparatus, device and medium for continuous skipping behavior detection counting
By identifying the status of personnel and obtaining key coordinates within the detection area, and using formulas to calculate the number of rope jumps, the problem of low efficiency in manual counting is solved, and efficient and accurate automatic detection of rope jump counts is achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- GUANGDONG PROPHET BIG DATA CO LTD
- Filing Date
- 2024-03-18
- Publication Date
- 2026-06-26
AI Technical Summary
Current rope skipping assessments rely on manual counting, which is inefficient and costly. There is a need for an efficient and accurate method to detect the number of rope skips.
By identifying the detection status score of the person within the detection area, the coordinates of the hip, knee and ankle are obtained, and the start judgment score and jump rope interpretation score are calculated using formulas, and the number of jump ropes is automatically counted.
It enables efficient and accurate automatic detection of jump rope counts, reducing labor costs and improving assessment efficiency.
Smart Images
Figure CN117994860B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of rope skipping counting technology, and in particular to a method, apparatus, device and medium for detecting and counting continuous rope skipping behavior. Background Technology
[0002] Currently, rope skipping assessments rely heavily on manual counting by staff, which is inefficient and labor-intensive. Therefore, a continuous rope skipping behavior detection and counting method based on vision technology and related equipment are needed to help assessment staff efficiently and accurately obtain the number of rope skips performed by participants. Summary of the Invention
[0003] In view of the above problems, this application provides a method, apparatus, device and medium for detecting and counting continuous rope skipping behavior.
[0004] In a first aspect, embodiments of the present invention provide a method for detecting and counting continuous rope skipping behavior, comprising:
[0005] Set up a detection area within the scene. When the detection function is enabled, identify the people entering the detection area and obtain the detection status score for each frame.
[0006] When a person enters the detection area and the number of frames after the person enters is greater than the preset frame number threshold, the person's stagnation state score for each frame is determined based on the detection state score of each frame. The stagnation state score is used to determine whether the person is in the rope skipping detection preparation state, and the number of frames i1 when the person first enters the rope skipping detection state is recorded.
[0007] When a person is in the jump rope test preparation state, obtain the coordinates of the person's two hip bones, two knees, and two ankles;
[0008] The first start-up judgment score is determined based on the coordinates of the two hip bones and the coordinates of the two ankles; the second start-up judgment score is determined based on the coordinates of the two hip bones, the coordinates of the two knees, and the coordinates of the two ankles.
[0009] The person's start score is determined based on the first start judgment score and the second start judgment score. The person's start score is used to determine whether the person has started jumping rope. The number of frames i2 when the person starts jumping rope is recorded.
[0010] Set the number of frames corresponding to continuous rope skipping to n1. Determine the center position score of each frame from frame i2+1 to frame i2+n1 based on the coordinates of the two hip bones. Determine the movement position score based on the coordinates of the two hip bones and the coordinates of the two ankles.
[0011] The first jump rope interpretation score is determined based on the score of the center position, the second jump rope interpretation score is determined based on the score of the moving position, and the jump rope interpretation score is determined based on the first jump rope interpretation score and the second jump rope interpretation score.
[0012] The number of rope skips for each person is determined by the score of rope skipping in each frame from frame i2+1 to frame i2+n1.
[0013] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the score for the person's stagnant state in each frame is determined based on the detection state score of each frame, using the following formula:
[0014]
[0015] in, The initial detection state score is the frame number corresponding to the image. When there are people in the detection area, the detection status score is calculated. , Indicates the preset frame rate threshold;
[0016] Determining whether a person is in a jump rope test preparation state based on the stagnation state score is done by judging the relationship between the stagnation state score and a set first judgment threshold.
[0017] When personnel are in a stagnant state, a score is awarded. hour, The first judgment threshold is set, and the judge is in the jump rope detection preparation state.
[0018] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the first initiation judgment score is determined based on the coordinates of the two hip bones and the two ankles; the second initiation judgment score is determined based on the coordinates of the two hip bones, the coordinates of the two knees, and the coordinates of the two ankles, using the following formula:
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025] in, The number of frames corresponding to the image. The score is determined by the first initiation judgment. The score is determined by the distance. The score is for the second start judgment. To dynamically determine sub-scores These are the first dynamic score and the second dynamic score, respectively. The second judgment threshold is set. The coordinates of the two hip bones are set as the third judgment threshold. , The coordinates of the two knees are , The coordinates of the two ankles are , .
[0026] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the person's initiation score is determined based on the first initiation judgment score and the second initiation judgment score. The determination of whether the person has started skipping rope is based on the person's initiation score is made using the following formula:
[0027]
[0028] in, The number of frames corresponding to the image. The score is determined by the first initiation judgment. The score is for the second start judgment. Scoring is given to personnel upon activation;
[0029] When personnel start scoring At that time, the judges begin the rope-jumping motion.
[0030] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the center position score for each frame from frame i2+1 to frame i2+n1 is determined based on the coordinates of the two hip bones, and the movement position score is determined based on the coordinates of the two hip bones and the coordinates of the two ankles, using the following formula:
[0031]
[0032]
[0033] in, The first correction constant is obtained by training on historical data to reduce the impact of personnel translation on rope skipping motion detection. The score for moving positions is, To score the center position, the coordinates of the two hip bones are: , The coordinates of the two ankles are , , This represents the frame number corresponding to the image.
[0034] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the first rope skipping sub-score is determined based on the center position score, the second rope skipping sub-score is determined based on the movement position score, and the rope skipping interpretation score is determined based on the first and second rope skipping sub-scores using the following formula:
[0035]
[0036]
[0037]
[0038] in, The number of frames corresponding to the image. The score is awarded to the first jump rope reader. The score is awarded to the second jump rope reader. Scoring is determined based on the number of people jumping rope. The score for moving positions is, Score for the center position. The fourth judgment threshold is set. The fifth judgment threshold is set. The sixth judgment threshold is set. The seventh judgment threshold is set. The eighth judgment threshold is set.
[0039] Furthermore, in the above-mentioned method for detecting and counting continuous rope skipping behavior, the number of rope skips by the person is determined based on the rope skipping judgment score of each frame from frame i2+1 to frame i2+n1, which is determined through the following steps:
[0040] Initial starting frame End frame Number of jump ropes The window score is determined using the following formula:
[0041]
[0042] in, The number of frames corresponding to the image. To set the number of frames corresponding to the set time length, Scoring participants for rope skipping;
[0043] When the window scores At that time, the number of jump ropes Add 1 to the initial frame. Equal to the end frame End frame add Conversely, when the window scores... At that time, let the initial frame add End frame add ;
[0044] Repeat the above operation until the end frame. Record the number of jump ropes at this time. The value represents the number of times a person jumps rope;
[0045] in, This is the set ninth judgment threshold.
[0046] Secondly, embodiments of the present invention provide a continuous rope skipping behavior detection and counting device, comprising:
[0047] First acquisition module: used to set a detection area in the scene, and when the detection function is turned on, to identify the person entering the detection area and obtain the detection status score for each frame;
[0048] First determination module: When a person enters the detection area and the number of frames after the person enters is greater than the preset frame number threshold, it determines the person's stagnation state score for each frame based on the detection state score of each frame, determines whether the person is in the rope skipping detection preparation state based on the stagnation state score, and records the first frame number i1 when the person is in the rope skipping detection state.
[0049] The second acquisition module is used to acquire the coordinates of the person's two hip bones, two knees, and two ankles when the person is in the jump rope detection preparation state.
[0050] The second determining module is used to determine the first starting judgment score based on the coordinates of the two hip bones and the two ankles; and to determine the second starting judgment score based on the coordinates of the two hip bones, the two knees, and the two ankles.
[0051] The third determining module is used to determine the person's starting score based on the first starting judgment score and the second starting judgment score, determine whether the person has started the rope skipping action based on the person's starting score, and record the number of frames i2 when the rope skipping begins.
[0052] The fourth determination module is used to set the number of frames corresponding to continuous rope skipping as n1, determine the center position score of each frame from frame i2+1 to frame i2+n1 based on the coordinates of the two hip bones, and determine the movement position score based on the coordinates of the two hip bones and the coordinates of the two ankles.
[0053] The fifth determining module is used to determine the first jump rope interpretation sub-score based on the center position score, the second jump rope interpretation sub-score based on the moving position score, and the jump rope interpretation score based on the first jump rope interpretation sub-score and the second jump rope interpretation score.
[0054] The sixth determining module is used to determine the number of rope skips for each person based on the rope skipping score in each frame from frame i2+1 to frame i2+n1.
[0055] Thirdly, embodiments of the present invention also provide an electronic device, including: a processor and a memory;
[0056] The processor executes a continuous rope skipping behavior detection and counting method as described above by calling the program or instructions stored in the memory.
[0057] Fourthly, embodiments of the present invention also provide a deterministic machine-readable storage medium storing a program or instructions that cause the deterministic machine to execute a continuous rope skipping behavior detection and counting method as described in any of the above claims.
[0058] The advantages of this application embodiment are as follows: This application sets a detection area in the scene. When the detection function is turned on, it identifies the person entering the detection area and obtains the detection state score for each frame. When a person enters the detection area and the number of frames after the person enters is greater than a preset frame number threshold, the person's stagnation state score for each frame is determined based on the detection state score for each frame. The stagnation state score is used to determine whether the person is in the jump rope detection preparation state, and the frame number i1 when the person first enters the jump rope detection state is recorded. When the person is in the jump rope detection preparation state, the coordinates of the person's two hip bones, two knees, and two ankles are obtained. The first start judgment score is determined based on the coordinates of the two hip bones and the coordinates of the two ankles. The first start judgment score is determined based on the coordinates of the two hip bones, the two knees, and the two ankles. The coordinates of the ankles determine the second start judgment score; based on the first and second start judgment scores, the person's start score is determined, and the person's start-up action is determined based on the person's start-up score, recording the frame number i2 at which the rope skipping begins; the frame number corresponding to continuous rope skipping is set as n1, and the center position score for each frame from frame i2+1 to i2+n1 is determined based on the coordinates of the two hip bones, and the movement position score is determined based on the coordinates of the two hip bones and the coordinates of the two ankles; the first rope skipping sub-score is determined based on the center position score, the second rope skipping sub-score is determined based on the movement position score, and the rope skipping interpretation score is determined based on the first and second rope skipping sub-scores; the number of rope skips by the person is determined based on the rope skipping judgment score for each frame from frame i2+1 to i2+n1. This application determines the number of rope skips by a person through the above method, thereby helping assessment staff to efficiently and accurately obtain the number of rope skips in the rope skipping assessment. Attached Figure Description
[0059] To more clearly illustrate the technical solutions in the embodiments of this application or the conventional technology, the drawings used in the description of the embodiments or the conventional technology will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0060] Figure 1 This is a schematic diagram of a continuous rope skipping behavior detection and counting method provided in an embodiment of this application;
[0061] Figure 2 A schematic diagram of a continuous rope skipping behavior detection and counting device provided in an embodiment of this application;
[0062] Figure 3 This is a schematic block diagram of an electronic device provided in an embodiment of this disclosure. Detailed Implementation
[0063] To make the above-mentioned objectives, features, and advantages of this application more apparent and understandable, the specific embodiments of this application are described in detail below with reference to the accompanying drawings. Many specific details are set forth in the following description to provide a thorough understanding of this application. However, this application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar modifications without departing from the spirit of this application. Therefore, this application is not limited to the specific embodiments disclosed below.
[0064] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the specification of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.
[0065] Figure 1 This is a schematic diagram of a continuous rope skipping behavior detection and counting method provided in an embodiment of this application.
[0066] In a first aspect, embodiments of the present invention provide a method for detecting and counting continuous rope skipping behavior, combined with Figure 1 It includes eight steps, S101 to S108:
[0067] S101: Set up a detection area within the scene. When the detection function is enabled, identify the people entering the detection area and obtain the detection status score for each frame.
[0068] Specifically, the scenario in this application embodiment can be a school gymnasium or playground. A detection area is set up within the scene. When the detection function is enabled, people entering the detection area are identified, and a detection status score is obtained for each frame. Where i is the frame number corresponding to the image, initially When there are people in the detection area, order .
[0069] S102: When a person enters the detection area and the number of frames after the person enters is greater than the preset frame number threshold, determine the person's stagnation state score for each frame based on the detection state score of each frame, determine whether the person is in the rope skipping detection preparation state based on the stagnation state score, and record the number of frames i1 when the person first enters the rope skipping detection state.
[0070] Specifically, in this embodiment of the application, when a person enters the detection area and the number of frames after the person enters exceeds a preset frame number threshold... At that time, the detection state score is based on each frame. Determine the score for the stationary state of the personnel in each frame. Score based on stagnant state The method for determining whether a person is ready for rope skipping testing is described in detail below.
[0071] S103: When the person is in the jump rope detection preparation state, obtain the coordinates of the person's two hip bones, two knees and two ankles.
[0072] Specifically, in this embodiment of the application, when determining whether a person is in the jump rope detection preparation state based on the stagnation state score, the coordinates of the person's two hip bones are obtained. , Coordinates of the two knees , and the coordinates of the two ankles , .
[0073] S104: Determine the first starting judgment score based on the coordinates of the two hip bones and the two ankles; determine the second starting judgment score based on the coordinates of the two hip bones, the two knees, and the two ankles.
[0074] Specifically, in this embodiment of the application, based on the coordinates of the two hip bones... , and the coordinates of the two ankles , Determine the score of the first start judgment. Based on the coordinates of the two hip bones , Coordinates of the two knees , and the coordinates of the two ankles , Determine the score for the second start judgment. The method will be described in detail below.
[0075] S105: Determine the person's start score based on the first start judgment score and the second start judgment score, determine whether the person has started the rope skipping action based on the person's start score, and record the frame number i2 of the start rope skipping.
[0076] Specifically, in this embodiment of the application, the score is determined based on the first startup judgment. Second start judgment score Determine personnel start score Based on the personnel activation score The method for determining whether a person has started jumping rope is described in detail below.
[0077] S106: Set the number of frames corresponding to continuous rope skipping to n1. Determine the center position score of each frame from frame i2+1 to frame i2+n1 based on the coordinates of the two hip bones. Determine the movement position score based on the coordinates of the two hip bones and the coordinates of the two ankles.
[0078] Specifically, in this embodiment of the application, based on the coordinates of the two hip bones... , Determine the center position score for each frame from frame i2+1 to frame i2+n1. Based on the coordinates of the two hip bones , and the coordinates of the two ankles , Determine the score for moving position The method will be described in detail below.
[0079] S107: Determine the first jump rope interpretation score based on the center position score, determine the second jump rope interpretation score based on the moving position score, and determine the jump rope interpretation score based on the first jump rope interpretation score and the second jump rope interpretation score.
[0080] Specifically, in this embodiment of the application, the score is based on the center position. Determine the score of the first jump rope reader. Score based on movement position Determine the score of the second jump rope reading. The score is determined based on the first jump rope reading. Second jump rope score Determine the score for jump rope The method will be described in detail below.
[0081] S108: Determine the number of rope skips for each person based on the rope skipping score in each frame from frame i2+1 to frame i2+n1.
[0082] Specifically, in this embodiment, the score is determined based on the rope skipping in each frame from frame i2+1 to frame i2+n1. The method for determining the number of jump rope attempts for each person is detailed below.
[0083] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the score for the person's stagnant state in each frame is determined based on the detection state score of each frame, using the following formula:
[0084]
[0085] in, The initial detection state score is the frame number corresponding to the image. When there are people in the detection area, the detection status score is calculated. , Indicates the preset frame rate threshold;
[0086] Determining whether a person is in a jump rope test preparation state based on the stagnation state score is done by judging the relationship between the stagnation state score and a set first judgment threshold.
[0087] When personnel are in a stagnant state, a score is awarded. hour, The first judgment threshold is set, and the judge is in the jump rope detection preparation state.
[0088] Specifically, in the embodiments of this application, a first judgment threshold is set. The size can be flexibly set according to the actual situation.
[0089] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the first initiation judgment score is determined based on the coordinates of the two hip bones and the two ankles; the second initiation judgment score is determined based on the coordinates of the two hip bones, the coordinates of the two knees, and the coordinates of the two ankles, using the following formula:
[0090]
[0091]
[0092]
[0093]
[0094]
[0095]
[0096] in, The number of frames corresponding to the image. The score is determined by the first initiation judgment. The score is determined by the distance. The score is for the second start judgment. To dynamically determine sub-scores These are the first dynamic score and the second dynamic score, respectively. The second judgment threshold is set. The coordinates of the two hip bones are set as the third judgment threshold. , The coordinates of the two knees are , The coordinates of the two ankles are , .
[0097] Specifically, in the embodiments of this application, the second judgment threshold is set. The set third judgment threshold The size can be flexibly set according to the actual situation.
[0098] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the person's initiation score is determined based on the first initiation judgment score and the second initiation judgment score. The determination of whether the person has started skipping rope is based on the person's initiation score is made using the following formula:
[0099]
[0100] in, The number of frames corresponding to the image. The score is the first score for the initial judgment. The score for the second start judgment. Scoring is given to personnel upon activation;
[0101] When personnel start scoring At that time, the person in charge begins to jump rope.
[0102] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the center position score for each frame from frame i2+1 to frame i2+n1 is determined based on the coordinates of the two hip bones, and the movement position score is determined based on the coordinates of the two hip bones and the coordinates of the two ankles, using the following formula:
[0103]
[0104]
[0105] in, The first correction constant is obtained by training on historical data to reduce the impact of personnel translation on rope skipping motion detection. To score points for moving positions, The score for the central position is given, and the coordinates of the two hip bones are given. , The coordinates of the two ankles are , , This represents the frame number corresponding to the image.
[0106] Furthermore, in the aforementioned method for detecting and counting continuous rope skipping behavior, the first rope skipping sub-score is determined based on the center position score, the second rope skipping sub-score is determined based on the movement position score, and the rope skipping interpretation score is determined based on the first and second rope skipping sub-scores using the following formula:
[0107]
[0108]
[0109]
[0110] in, The number of frames corresponding to the image. The score is awarded to the first jump rope reader. The score is awarded to the second jump rope reader. Scoring is determined based on the number of people jumping rope. The score for moving positions is, Score for the center position. The fourth judgment threshold is set. The fifth judgment threshold is set. The sixth judgment threshold is set. The seventh judgment threshold is set. The eighth judgment threshold is set.
[0111] Specifically, in the embodiments of this application, a fourth judgment threshold is set. The fifth judgment threshold is set. The set sixth judgment threshold The set seventh judgment threshold and the set eighth judgment threshold The size can be flexibly set according to the actual situation.
[0112] Furthermore, in the above-mentioned method for detecting and counting continuous rope skipping behavior, the number of rope skips by the person is determined based on the rope skipping judgment score of each frame from frame i2+1 to frame i2+n1, which is determined through the following steps:
[0113] Initial starting frame End frame Number of jump ropes The window score is determined using the following formula:
[0114]
[0115] in, The number of frames corresponding to the image. To set the number of frames corresponding to the set time length, Scoring participants for rope skipping;
[0116] When the window scores At that time, the number of jump ropes Add 1 to the initial frame. Equal to the end frame End frame add Conversely, when the window scores... At that time, let the initial frame add End frame add ;
[0117] Repeat the above operation until the end frame. Record the number of jump ropes at this time. The value represents the number of times a person jumps rope;
[0118] in, This is the set ninth judgment threshold.
[0119] Specifically, in the embodiments of this application, a ninth judgment threshold is set. The size can be flexibly set according to the actual situation.
[0120] Figure 2 This is a schematic diagram of a continuous rope skipping behavior detection and counting device provided in an embodiment of this application.
[0121] Secondly, embodiments of the present invention provide a continuous rope skipping behavior detection and counting device, combined with Figure 2 ,include:
[0122] First acquisition module 201: used to set a detection area in the scene, and when the detection function is turned on, to identify the person entering the detection area and acquire the detection status score of each frame;
[0123] First determining module 202: When a person enters the detection area and the number of frames after the person enters is greater than a preset frame number threshold, it determines the person's stagnation state score for each frame based on the detection state score of each frame, determines whether the person is in the rope skipping detection preparation state based on the stagnation state score, and records the number of frames i1 when the person first enters the rope skipping detection state.
[0124] The second acquisition module 203 is used to acquire the coordinates of the person's two hip bones, two knees, and two ankles when the person is in the jump rope detection preparation state.
[0125] The second determining module 204 is used to determine the first starting judgment score based on the coordinates of the two hip bones and the two ankles; and to determine the second starting judgment score based on the coordinates of the two hip bones, the two knees, and the two ankles.
[0126] The third determining module 205 is used to determine the person's starting score based on the first starting judgment score and the second starting judgment score, determine whether the person has started jumping rope based on the person's starting score, and record the number of frames i2 when the person starts jumping rope.
[0127] The fourth determining module 206 is used to set the number of frames corresponding to continuous rope skipping as n1, determine the center position score of each frame from frame i2+1 to frame i2+n1 based on the coordinates of the two hip bones, and determine the movement position score based on the coordinates of the two hip bones and the coordinates of the two ankles.
[0128] The fifth determining module 207 is used to determine the first jump rope interpretation sub-score based on the center position score, determine the second jump rope interpretation sub-score based on the moving position score, and determine the jump rope interpretation score based on the first jump rope interpretation sub-score and the second jump rope interpretation score.
[0129] The sixth determining module 208 is used to determine the number of rope skips for a person based on the rope skipping score in each frame from frame i2+1 to frame i2+n1.
[0130] Thirdly, embodiments of the present invention also provide an electronic device, including: a processor and a memory;
[0131] The processor executes a continuous rope skipping behavior detection and counting method as described above by calling the program or instructions stored in the memory.
[0132] Fourthly, embodiments of the present invention also provide a deterministic machine-readable storage medium storing a program or instructions that cause the deterministic machine to execute a continuous rope skipping behavior detection and counting method as described in any of the above claims.
[0133] Figure 3 This is a schematic block diagram of an electronic device provided in an embodiment of this disclosure.
[0134] like Figure 3As shown, the electronic device includes at least one processor 301, at least one memory 302, and at least one communication interface 303. The various components of the electronic device are coupled together via a bus system 304. The communication interface 303 is used for information transmission with external devices. It is understood that the bus system 304 is used to implement communication between these components. In addition to a data bus, the bus system 304 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 3 The general designated all buses as Bus System 304.
[0135] It is understood that the memory 302 in this embodiment may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory.
[0136] In some implementations, memory 302 stores elements such as executable units or data structures, or subsets thereof, or extended sets thereof: operating systems and applications.
[0137] The operating system includes various system programs, such as the framework layer, core library layer, and driver layer, used to implement various basic business functions and handle hardware-based tasks. The application programs include various applications, such as media players and browsers, used to implement various application functions. A program implementing any method in the continuous rope skipping behavior detection and counting method provided in this application embodiment can be included in the application programs.
[0138] In this embodiment, the processor 301 executes the steps of various embodiments of the continuous rope skipping behavior detection and counting method provided in this application by calling the program or instructions stored in the memory 302, specifically, the program or instructions stored in the application.
[0139] Set up a detection area within the scene. When the detection function is enabled, identify the people entering the detection area and obtain the detection status score for each frame.
[0140] When a person enters the detection area and the number of frames after the person enters is greater than the preset frame number threshold, the person's stagnation state score for each frame is determined based on the detection state score of each frame. The stagnation state score is used to determine whether the person is in the rope skipping detection preparation state, and the number of frames i1 when the person first enters the rope skipping detection state is recorded.
[0141] When a person is in the jump rope test preparation state, obtain the coordinates of the person's two hip bones, two knees, and two ankles;
[0142] The first start-up judgment score is determined based on the coordinates of the two hip bones and the coordinates of the two ankles; the second start-up judgment score is determined based on the coordinates of the two hip bones, the coordinates of the two knees, and the coordinates of the two ankles.
[0143] The person's start score is determined based on the first start judgment score and the second start judgment score. The person's start score is used to determine whether the person has started jumping rope. The number of frames i2 when the person starts jumping rope is recorded.
[0144] Set the number of frames corresponding to continuous rope skipping to n1. Determine the center position score of each frame from frame i2+1 to frame i2+n1 based on the coordinates of the two hip bones. Determine the movement position score based on the coordinates of the two hip bones and the coordinates of the two ankles.
[0145] The first jump rope interpretation score is determined based on the score of the center position, the second jump rope interpretation score is determined based on the score of the moving position, and the jump rope interpretation score is determined based on the first jump rope interpretation score and the second jump rope interpretation score.
[0146] The number of rope skips for each person is determined by the score of rope skipping in each frame from frame i2+1 to frame i2+n1.
[0147] Any of the methods in the continuous rope skipping behavior detection and counting method provided in this application embodiment can be applied to, or implemented by, the processor 301. The processor 301 can be an integrated circuit chip with signal capabilities. During implementation, each step of the above method can be completed by the integrated logic circuits in the hardware of the processor 301 or by instructions in software form. The processor 301 can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The general-purpose processor can be a microprocessor or any conventional device.
[0148] The steps of any method in the continuous rope skipping behavior detection and counting method provided in this application embodiment can be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software units in the decoding processor. The software units can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory 302. The processor 301 reads the information in memory 302 and, in conjunction with its hardware, completes the steps of the continuous rope skipping behavior detection and counting method.
[0149] Those skilled in the art will understand that although some embodiments described herein include certain features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of this application and form different embodiments.
[0150] Those skilled in the art will understand that the descriptions of the various embodiments have different focuses, and for parts not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0151] The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.
Claims
1. A method for detecting and counting continuous rope skipping behavior, characterized in that, include: A detection area is set up within the scene. When the detection function is enabled, the person entering the detection area is identified, and the detection status score for each frame is obtained. When a person enters the detection area and the number of frames after the person enters is greater than the preset frame number threshold, the person's stagnation state score for each frame is determined based on the detection state score of each frame, and the person's stagnation state score is determined based on the stagnation state score. The number of frames i1 in which the person first enters the rope skipping detection state is recorded. When a person is in the jump rope test preparation state, obtain the coordinates of the person's two hip bones, two knees, and two ankles; The first initiation judgment score is determined based on the coordinates of the two hip bones and the coordinates of the two ankles; The second start-up judgment score is determined based on the coordinates of the two hip bones, the two knees, and the two ankles. The person's start score is determined based on the first start judgment score and the second start judgment score. The person's start score is used to determine whether the person has started jumping rope. The number of frames i2 when the person starts jumping rope is recorded. Set the number of frames corresponding to continuous rope skipping to n1. Determine the center position score of each frame from frame i2+1 to frame i2+n1 based on the coordinates of the two hip bones. Determine the movement position score based on the coordinates of the two hip bones and the coordinates of the two ankles. The first jump rope judgment sub-score is determined based on the center position score, the second jump rope judgment sub-score is determined based on the movement position score, and the jump rope judgment score is determined based on the first jump rope judgment score and the second jump rope judgment score. The number of rope skips for each person is determined by the score of rope skipping in each frame from frame i2+1 to frame i2+n1.
2. The method for detecting and counting continuous rope skipping behavior according to claim 1, characterized in that, The personnel stagnation state score for each frame is determined based on the detection state score of each frame, using the following formula: in, The initial detection state score is the frame number corresponding to the image. When there are people in the detection area, the detection status score is calculated. , Indicates the preset frame rate threshold; Determining whether a person is in a jump rope detection preparation state based on the stagnation state score is done by judging the relationship between the stagnation state score and a set first judgment threshold. When personnel are in a stagnant state, a score is awarded. hour, The first judgment threshold is set, and the judge is in the jump rope detection preparation state.
3. The method for detecting and counting continuous rope skipping behavior according to claim 1, characterized in that, The first initiation judgment score is determined based on the coordinates of the two hip bones and the two ankles; the second initiation judgment score is determined based on the coordinates of the two hip bones, the two knees, and the two ankles, using the following formula: in, The number of frames corresponding to the image. The score is determined by the first initiation judgment. The score is determined by the distance. The score is for the second start judgment. To dynamically determine sub-scores These are the first dynamic score and the second dynamic score, respectively. The second judgment threshold is set. The coordinates of the two hip bones are set as the third judgment threshold. , The coordinates of the two knees are , The coordinates of the two ankles are , , This indicates the frame number corresponding to the first time a person is in the rope skipping detection state.
4. The method for detecting and counting continuous rope skipping behavior according to claim 1, characterized in that, The starting score is determined based on the first starting judgment score and the second starting judgment score. Whether a person should begin jumping rope is then determined based on the starting score using the following formula: in, The number of frames corresponding to the image. The score is determined by the first initiation judgment. The score is for the second start judgment. Scoring is given to personnel upon activation; When personnel start scoring At that time, the judges begin the rope-jumping motion.
5. The method for detecting and counting continuous rope skipping behavior according to claim 1, characterized in that, The center position score for each frame from frame i2+1 to frame i2+n1 is determined based on the coordinates of the two hip bones, and the movement position score is determined based on the coordinates of the two hip bones and the coordinates of the two ankles, using the following formula: in, The first correction constant is obtained by training on historical data to reduce the impact of personnel translation on rope skipping motion detection. To score points for moving positions, The score for the central position is given, and the coordinates of the two hip bones are given. , The coordinates of the two ankles are , , The number of frames corresponding to the image. This indicates the frame number corresponding to the first time a person is in the rope skipping detection state. This indicates the frame number corresponding to when the person begins the rope-jumping action.
6. The method for detecting and counting continuous rope skipping behavior according to claim 1, characterized in that, The first jump rope judgment sub-score is determined based on the center position score, and the second jump rope judgment sub-score is determined based on the movement position score. The jump rope judgment score is determined by the following formula: in, The number of frames corresponding to the image. The score is determined by the first jump rope jumper. The score is determined by the second jump rope. Scoring is determined based on the number of people jumping rope. The score for moving positions is, Score for center position The fourth judgment threshold is set. The fifth judgment threshold is set. The sixth judgment threshold is set. The seventh judgment threshold is set. The eighth judgment threshold is set.
7. The method for detecting and counting continuous rope skipping behavior according to claim 1, characterized in that, The number of rope skips for each person is determined based on the score of rope skipping in each frame from frame i2+1 to frame i2+n1, through the following steps: Initial starting frame End frame Number of jump ropes The window score is determined using the following formula: in, The number of frames corresponding to the image. To set the number of frames corresponding to the set time length, Scoring participants for rope skipping; When the window scores At that time, the number of jump ropes Add 1 to the initial frame. Equal to the end frame End frame add Conversely, when the window scores... At that time, let the initial frame add End frame add ; Repeat the above operation until the end frame. Record the number of jump ropes at this time. The value represents the number of times a person jumps rope; in, This is the set ninth judgment threshold.
8. A continuous rope skipping behavior detection and counting device, characterized in that, include: First acquisition module: used to set a detection area in the scene, and when the detection function is turned on, to identify the person entering the detection area and obtain the detection status score for each frame; First determining module: When a person enters the detection area and the number of frames after the person enters is greater than a preset frame number threshold, it determines the person's stagnation state score for each frame based on the detection state score of each frame, determines whether the person is in the rope skipping detection preparation state based on the stagnation state score, and records the first frame number i1 when the person is in the rope skipping detection state. The second acquisition module is used to acquire the coordinates of the person's two hip bones, two knees, and two ankles when the person is in the jump rope detection preparation state. The second determining module is used to determine the first starting judgment score based on the coordinates of the two hip bones and the coordinates of the two ankles. The second start-up judgment score is determined based on the coordinates of the two hip bones, the two knees, and the two ankles. The third determining module is used to determine the person's starting score based on the first starting judgment score and the second starting judgment score, determine whether the person has started jumping rope based on the person's starting score, and record the number of frames i2 when the person starts jumping rope. The fourth determining module is used to set the number of frames corresponding to continuous rope skipping as n1, determine the center position score of each frame from frame i2+1 to frame i2+n1 based on the coordinates of the two hip bones, and determine the movement position score based on the coordinates of the two hip bones and the coordinates of the two ankles. The fifth determining module is used to determine the first jump rope judgment sub-score based on the center position score, determine the second jump rope judgment sub-score based on the movement position score, and determine the jump rope judgment score based on the first jump rope judgment sub-score and the second jump rope judgment score. The sixth determining module is used to determine the number of rope skips for each person based on the rope skipping score in each frame from frame i2+1 to frame i2+n1.
9. An electronic device, characterized in that, include: Processor and memory; The processor executes a continuous rope skipping behavior detection and counting method as described in any one of claims 1 to 7 by calling the program or instructions stored in the memory.
10. A deterministic machine-readable storage medium, characterized in that, The machine-readable storage medium stores a program or instructions that cause the machine to perform a continuous rope skipping behavior detection and counting method as described in any one of claims 1 to 7.