A standing long jump measuring method and device
By obtaining the perspective transformation matrix from the calibrated standing long jump mat image, recognizing facial and skeletal data, and judging the take-off and landing, the problems of accuracy and violation identification in standing long jump measurement were solved, achieving high-precision standing long jump measurement.
Patent Information
- Application Number
- CN202211507388.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-29
- Publication Date
- 2026-01-02
- Estimated Expiration
- 2042-11-29
AI Technical Summary
Existing standing long jump measurement methods suffer from poor measurement accuracy, inability to identify some violations, high equipment installation requirements, and poor environmental adaptability.
By receiving images of the standing long jump mat, calibrating and obtaining the perspective transformation matrix between the original plane and the new visual plane coordinate system, recognizing the test subject's facial information, sending a take-off preparation prompt, converting the test subject's skeletal data image in real time, judging whether the test subject stepped on/crossed the take-off line, the take-off situation and the landing situation, identifying violations, and calculating the long jump distance.
It enables accurate identification of violations, improves the accuracy of standing long jump measurement, simplifies equipment installation, and enhances environmental adaptability.
Smart Images

Figure CN115837155B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application belongs to the technical field of sports testing, and particularly relates to a standing long jump measuring method and device. BACKGROUND
[0002] With the increasing strength of the country, the public pays more and more attention to sports and invests more and more in sports. At the same time, the departments of various regions also increase the guidance of the public's attention to sports and increase the investment, such as the education department taking sports examination as a compulsory subject of the high school entrance examination. Standing long jump is a test required for all junior high school and university students according to the National Students' Physical Health Standard, and detailed motion specifications and illegal actions are specified.
[0003] At present, the standing long jump test still adopts a relatively traditional manual measurement method. However, the traditional manual measurement method has heavy work tasks and subjective reading errors. In addition, in large-scale testing, the testing standards are not unified, resulting in unfair test results. In addition, in manual measurement, it is impossible to see the illegal actions such as stepping on the starting line. The standing long jump measurement method based on computer vision is proposed in the industry. However, the existing standing long jump measurement method based on computer vision in the market has poor measurement accuracy and cannot identify some illegal actions. In addition, the existing standing long jump measurement method based on computer vision has many devices, high installation requirements, needs to be installed by professional personnel, and has a long installation time. In addition, most of the devices need to be connected to an external power supply and network, and have poor environmental adaptability. SUMMARY
[0004] Therefore, the present application provides a standing long jump measurement method and device, which solves the problems of poor measurement accuracy and inability to identify some illegal actions in the existing standing long jump measurement method.
[0005] The present application provides a standing long jump measurement method, which comprises:
[0006] receiving a standing long jump mat image, calibrating the standing long jump mat image and obtaining a perspective conversion matrix of an original plane coordinate system and a new view plane coordinate system, wherein the horizontal axis of the new view plane coordinate system corresponds to the long side of the standing long jump mat, and the vertical axis corresponds to the short side of the standing long jump mat;
[0007] identifying the face information of the tester, comparing the face information with the pre-stored information, and sending a starting preparation prompt information after the face information is consistent with the pre-stored information; subsequently, converting the original plane image including the tester's bone data into a new view plane image through the perspective conversion matrix;
[0008] In the new view plane image, receiving a first image of the tester in the standing long jump mat starting area, and determining whether the tester steps / crosses the starting line;
[0009] If the tester steps / crosses the take-off line, a step / cross take-off line prompt signal is sent; if the tester does not step / cross the take-off line, a take-off instruction signal is sent, then the tester's take-off situation is detected, and after determining that the tester takes off, the tester's landing image is detected;
[0010] The tester's jump distance is obtained based on the landing image if there is no foul; if there is a foul, a foul prompt signal is sent.
[0011] Further, the standing long jump mat image is calibrated and a conversion matrix of the original plane coordinate system and the new view plane coordinate system is obtained, comprising:
[0012] The landmark points in the standing long jump mat image are calibrated to obtain original plane coordinates of the landmark point image in the original plane coordinate system; the landmark points include 4 vertices of a first rectangular frame set on the standing long jump mat;
[0013] The landmark points correspond to 4 vertices of a second rectangular frame in the new view plane coordinate system, the vertex coordinates of the 4 vertices of the second rectangular frame in the new view plane coordinate system are set, and perspective conversion is performed on the 4 vertex coordinates of the first rectangular frame to the 4 vertex coordinates of the second rectangular frame to obtain a perspective conversion matrix of the original plane coordinate system and the new view plane coordinate system.
[0014] Further, the first image of the tester in the take-off area is received to determine whether the tester steps / crosses the take-off line, comprising:
[0015] The standing long jump mat take-off area includes a take-off line, and the tester's skeletal data includes tester's ankle joint coordinates;
[0016] First, the take-off line coordinates and the tester's ankle joint coordinates in the first image are extracted;
[0017] The take-off line coordinates and the tester's ankle joint coordinates are compared, and in the horizontal axis direction of the new view plane coordinate system, if the tester's ankle joint coordinates do not cross the take-off line coordinates, it is determined that the tester does not cross the take-off line; otherwise, it is determined that the tester crosses the take-off line and a cross take-off line prompt signal is sent;
[0018] Then, after it is determined that the tester does not cross the take-off line, the edge image of the take-off line is extracted, if the obtained edge image of the take-off line is complete, it is determined that the tester does not step the take-off line; if the obtained edge image of the take-off line is incomplete, it is determined that the tester steps the take-off line and a step take-off line prompt signal is sent.
[0019] Further, the tester's take-off situation is detected, comprising:
[0020] acquiring a second image of the tester in a take-off area of the standing long jump mat from the moment when the take-off instruction signal is sent;
[0021] extracting ankle joint coordinates of the tester in the second image in sequence, determining variable slopes between the ankle joint coordinates of the tester in a previous frame and the ankle joint coordinates of the tester in a next frame, the variable slope being a ratio of a vertical axis coordinate change amount to a horizontal axis coordinate change amount of the ankle joint coordinates of the tester in a new view plane coordinate system;
[0022] if the variable slopes between the ankle joint coordinates of the tester in a previous frame and the ankle joint coordinates of the tester in a next frame in the first n consecutive frames of the second image are all greater than a preset variable slope threshold, and the horizontal axis coordinate change amounts are all greater than a first preset change threshold, it is determined that the tester has taken off at the first frame of the n consecutive frames; wherein n is a positive integer.
[0023] Further, after determining that the tester has taken off, the image of the tester landing is acquired, comprising:
[0024] after detecting that the tester has taken off, a third image of the tester in a test area of the standing long jump mat is acquired;
[0025] extracting ankle joint coordinates of the tester in the third image in sequence, and if the vertical axis coordinate change amount and the horizontal axis coordinate change amount of the ankle joint of the tester in a previous frame and the ankle joint of the tester in a next frame are both less than or equal to a second preset change threshold, the image of the next frame is determined as the landing image.
[0026] Further, the determination of whether the tester violates the rules based on the landing image comprises:
[0027] determining whether the tester falls backward based on the landing image;
[0028] if the tester falls backward, sending a tester falls backward prompt information; if the tester does not fall backward, detecting the take-off image and determining whether the tester has taken-off line stepping;
[0029] if the tester has taken-off line stepping, sending a take-off line stepping prompt information; if the tester does not have taken-off line stepping, determining whether the tester has a step jump based on the take-off image;
[0030] if the tester has a step jump, sending a step jump prompt information; if the tester does not have a step jump, obtaining a long jump distance of the tester based on the landing image.
[0031] Further, the determination of whether the tester falls backward based on the landing image comprises:
[0032] after detecting that the tester has landed, c frames of fourth images of the tester in a test area of the standing long jump mat after landing are acquired; the tester bone data further comprises wrist joint coordinates and hip joint coordinates;
[0033] extracting the wrist joint coordinate, the hip joint coordinate and the ankle joint coordinate in the four images of each frame in sequence;
[0034] If in the first m frames, the wrist joint horizontal axis coordinate lags behind the hip joint horizontal axis coordinate, the hip joint horizontal axis coordinate lags behind the ankle joint horizontal axis coordinate, and the distance between the wrist joint vertical axis coordinate and the ankle joint vertical axis coordinate is less than or equal to a third preset change threshold in the new visual plane coordinate system, it is determined that the tester is falling backward; otherwise, it is determined that the tester is not falling backward; wherein m < c, and c and m are positive integers.
[0035] Further, the detection of the take-off image and the determination of whether the tester exists take-off line stepping include:
[0036] First, the second image is extracted in sequence, and if the vertical axis coordinate change and the horizontal axis coordinate change between the tester ankle joint coordinate of the previous frame and the tester ankle joint coordinate of the adjacent next frame are less than or equal to a fourth preset change threshold, it is determined that the adjacent next frame image is the tester take-off image; otherwise, the tester take-off image is continuously detected;
[0037] Then, the edge image of the take-off line in the take-off image and the second image of the previous frame thereof is extracted respectively, and if the obtained edge image of the take-off line is complete, it is determined that the tester does not step the line when taking off; otherwise, it is determined that the tester steps the line when taking off.
[0038] The determination of whether the tester exists step jump based on the take-off image includes:
[0039] The second image of the previous p frames is extracted from the take-off image as a starting point, and if the vertical axis coordinate of the tester ankle joint of the previous frame is less than the vertical axis coordinate of the tester ankle joint of the adjacent next frame, and the horizontal axis coordinate change between the tester ankle joint of the adjacent next frame and the tester ankle joint of the previous frame is less than or equal to a fifth preset change threshold in the s frames of the p frames, it is determined that the tester exists step jump; otherwise, it is determined that the tester does not exist step jump; wherein s < p, and s and p are positive integers.
[0040] Further, the determination of the tester long jump distance based on the landing image includes:
[0041] The tester ankle joint coordinates in the landing image and the adjacent previous frame third image are extracted respectively, and the tester heel recognition area is cut out on the second rectangular frame in the direction of the take-off line with a preset length from the tester ankle joint horizontal axis coordinate as a starting position;
[0042] respectively, the tester's two heel edge images in the tester's heel recognition area are extracted from the landing image and its adjacent third image, and the first distance and the second distance between the take-off line and the nearest heel edge are measured;
[0043] The first distance and the second distance are combined to obtain the tester's long jump distance.
[0044] The application further provides a standing long jump measuring device, which comprises:
[0045] A calibration module is configured to receive a standing long jump mat image, calibrate the standing long jump mat image, and obtain a perspective conversion matrix between an original plane coordinate system and a new view plane coordinate system, wherein the horizontal axis of the new view plane coordinate system corresponds to the long side of the standing long jump mat, and the vertical axis corresponds to the short side of the standing long jump mat.
[0046] An identification module is configured to identify the tester's face information, compare the face information with pre-stored information, and send a take-off preparation prompt information after the face information is consistent with the pre-stored information.
[0047] A perspective conversion module is configured to convert an original plane image including tester's skeletal data, which is obtained in real time, into a new view plane image through the perspective conversion matrix after the identification module sends the take-off preparation prompt information.
[0048] A first detection module is configured to receive a first image of the tester in a take-off area of the standing long jump mat in the new view plane image, and determine whether the tester steps / crosses the take-off line; if the tester steps / crosses the take-off line, a take-off line stepping / crossing prompt signal is sent; if the tester does not step / cross the take-off line, a take-off instruction signal is sent.
[0049] A second detection module is configured to detect the tester's take-off condition after the first detection module sends the take-off instruction signal.
[0050] A third detection module is configured to detect the tester's landing image after the second detection module determines that the tester takes off.
[0051] A measuring module is configured to determine whether the tester commits a foul through the landing image; if no foul is committed, the tester's long jump distance is obtained based on the landing image; if a foul is committed, a foul prompt signal is sent.
[0052] The application provides a standing long jump measurement method, which comprises the following steps: receiving a standing long jump mat image, calibrating the standing long jump mat image and obtaining a perspective conversion matrix of an original plane coordinate system and a new view plane coordinate system; sending a take-off preparation prompt information after recognizing face information; converting an original plane image including tester bone data, which is obtained in real time, into a new view plane image through the perspective conversion matrix; judging whether a testertreads / crosses a take-off line in a first image of a standing long jump mat take-off area in the new view plane image, if the tester does not tread / cross the take-off line, a take-off instruction signal is sent, then the take-off situation of the tester is detected, and after determining that the tester takes off, a landing image of the tester is detected; judging whether there is a rule violation in the landing image, if there is no rule violation, the distance between the landing position of the tester in the landing image and the starting line is obtained, and then the long jump distance of the tester is obtained. The application can accurately identify the rule violation of the tester in the standing long jump process, and improve the measurement accuracy of the standing long jump. BRIEF DESCRIPTION OF DRAWINGS
[0053] In order to more clearly illustrate the technical solutions in the embodiments of the application, the following will briefly introduce the drawings needed to be used in the embodiments. Obviously, the drawings in the following description only some embodiments of the application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.
[0054] Figure 1 A flowchart of a standing long jump measurement method provided by the embodiment of the application;
[0055] Figure 2 A schematic diagram of a standing long jump test scene provided by the embodiment of the application;
[0056] Figure 3 A flowchart of obtaining a perspective conversion matrix from a standing long jump mat image provided by the embodiment of the application;
[0057] Figure 4 A flowchart of determining whether a tester treads / crosses a take-off line provided by the embodiment of the application;
[0058] Figure 5 A block diagram of a standing long jump measurement device provided by the embodiment of the application.
[0059] In the figure, 1 is an intelligent screen, 2 is a camera, 3 is a standing long jump mat, 4 is a support, 5 is a take-off line, and 6 is a solid circle. DETAILED DESCRIPTION
[0060] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used in the description herein is for describing particular embodiments only and is not intended to be limiting of the application; the use herein of terms such as "comprise", "have" and "include" or variations such as "comprises", "comprising", "includes" and "including" will be understood to enable, without excluding, other additions or modifications. The use herein of terms such as "first", "second" and "other" or variations such as "firstly", "secondly" and "thirdly" will be understood to enable, without implying a particular order.
[0061] Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase that in various places in the specification are not necessarily all referring to the same embodiment, nor are they necessarily mutually exclusive of one another. As will be apparent to those of ordinary skill in the art upon reading this description, the embodiments described herein are merely examples of implementations and are not intended to limit the scope of the application in any way.
[0062] For the purpose of clarity, technical solutions and advantages of the present application, further detailed description will be made to the present application in combination with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and not to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application.
[0063] In the following description, the suffixes such as "module", "part" or "unit" used for an element are merely intended for facilitating explanation of the present application, and are not intended to have the specific meaning by themselves.
[0064] Embodiment 1
[0065] As shown in FIG. 1, a flowchart of a standing long jump measurement method provided by an embodiment of the present application is shown, and the method comprises: Figure 1
[0066] Step S1: receiving a standing long jump mat image, calibrating the standing long jump mat image and obtaining a perspective conversion matrix of an original plane coordinate system and a new view plane coordinate system, wherein the horizontal axis of the new view plane coordinate system corresponds to the long side of the standing long jump mat, and the vertical axis corresponds to the short side of the standing long jump mat;
[0067] Step S2: identifying the face information of the tester, comparing the face information with the pre-stored information, and sending a take-off preparation prompt information after the face information is consistent with the pre-stored information; subsequently, the original plane image including the tester's bone data obtained in real time is converted into a new view plane image through the perspective conversion matrix;
[0068] Step S3: in the new view plane image, receiving the first image of the tester in the standing long jump take-off area, determining whether the tester steps / crosses the take-off line;
[0069] Step S4: if the tester steps / crosses the take-off line, a signal of stepping / crossing the take-off line is sent; if the tester does not step / cross the take-off line, a take-off instruction signal is sent, then the take-off of the tester is detected, and after determining that the tester takes off, the landing image of the tester is detected;
[0070] Step S5: determining whether the tester commits a foul through the landing image; if not, the long jump distance of the tester is obtained based on the landing image; if so, a signal of committing a foul is sent.
[0071] Specifically, in the embodiment of the present application, as shown in Figure 2 the schematic diagram of a standing long jump test scene provided by the embodiment of the present application, the instruments used in the standing long jump test include an intelligent screen 1, a camera 2, a standing long jump mat 3 and a support 4. Before the test, the instruments are installed first, the support 4 is placed in the test site, the intelligent screen 1 is installed on the support 4, the camera 2 is also installed on the support 4 and above the intelligent screen 1, and the standing long jump mat 3 is placed on the horizontal ground within the shooting range of the camera 2, and the long side is parallel to the plane of the intelligent screen 1 for the best. The intelligent screen 1 provides data processing function and interactive interface during measurement, and the interactive interface includes the real-time measurement image captured by the camera 2, and the image converted by the perspective conversion matrix from the real-time measurement image.
[0072] After the instrument is installed, the camera 2 acquires the standing long jump mat image, and the intelligent screen 1 acquires the perspective conversion matrix of the original plane coordinate system and the new visual plane coordinate system according to the acquired standing long jump mat 3 image. The original plane coordinate system is equivalent to selecting a mark point on the standing long jump mat 3 as the origin in the image shot by the intelligent screen 1, with the horizontal axis in the horizontal direction and the vertical axis in the vertical direction. According to the perspective principle, when a rectangular standing long jump mat 3 is shot by the camera 2, it is actually displayed as a trapezoid on the image displayed by the intelligent screen 1, so it is necessary to convert the actually shot standing long jump mat 3 image through the perspective conversion matrix, so that the actually shot standing long jump mat image is restored to the original rectangular shape in a new visual plane coordinate system after conversion, that is, the standing long jump mat 3 image displayed by the intelligent screen 1 is “stood up”, so that a rectangular plane is seen, thereby facilitating the data processing of the tester's standing long jump. The new visual plane coordinate system can have the same origin as the original plane coordinate system, with the horizontal axis corresponding to the long side of the standing long jump mat 3 and the vertical axis corresponding to the short side of the standing long jump mat 3. The intelligent screen 1 then converts the original plane image including the tester's skeletal data acquired by the camera 2 in real time into a new visual plane image through the perspective conversion matrix, and then performs related data processing.
[0073] Then the tester's identity is verified, and after the verification is passed, a take-off preparation prompt information is sent, which can be in various forms, such as voice playing, text prompt, etc. After the tester receives the take-off preparation prompt information, he moves to the take-off area on the standing long jump mat 3, and the intelligent screen 1 acquires the first image of the take-off area through the perspective conversion matrix and extracts the take-off line 5 and the tester's body image in the first image. If the tester's foot is not on the take-off line 5, the tester does not step on the take-off line 5, and if the tester's heel does not exceed the take-off line 5, the tester does not cross the take-off line 5. If the tester steps / crosses the take-off line 5, a prompt information is sent, such as playing the step line and the cross line. If the tester does not step / cross the take-off line 5, a take-off indication signal is sent, and then the tester's take-off situation is detected, and after the tester's take-off is determined, the tester's landing image is detected, and the landing image is used to judge the violation. If there is a violation, the test fails, and if not, the body image and the take-off line 5 are extracted from the landing image to obtain the distance between the tester and the take-off line 5 when landing, and then the tester's long jump distance is obtained. The processing of the aforementioned body image can be further processing of the tester's skeletal data, which specifically includes extracting the tester's ankle joint, wrist joint, hip joint, etc. in the new visual plane coordinate system, and judging by combining the coordinates of the joints in the new visual plane coordinate system.
[0074] The method for measuring standing long jump provided in the embodiment of the application comprises the following steps: receiving a standing long jump mat image, calibrating the standing long jump mat image and obtaining a perspective conversion matrix of an original plane coordinate system and a new view plane coordinate system; sending a take-off preparation prompt information after recognizing face information; subsequently, converting an original plane image including tester bone data, which is obtained in real time, into a new view plane image through the perspective conversion matrix; receiving a first image of a take-off area of the standing long jump mat of the tester in the new view plane image to determine whether the tester steps / crosses a take-off line, sending a take-off instruction signal if the tester does not step / cross the take-off line, subsequently detecting a take-off condition of the tester, and detecting a landing image of the tester after determining that the tester takes off; determining whether there is a rule violation in landing through the landing image, obtaining a distance between a landing position of the tester in the landing image and a starting line, and further obtaining a long jump distance of the tester if there is no rule violation; and sending a rule violation prompt signal if there is a rule violation. The method can accurately identify rule violation actions of the tester in the standing long jump process and improves the measurement accuracy of the standing long jump.
[0075] In some embodiments, as shown in FIG. 1, a flowchart for obtaining a perspective conversion matrix from a standing long jump mat image is provided, and the step S1 comprises the following steps: Figure 3
[0076] Step S11: calibrating a mark point in the standing long jump mat image and obtaining an original plane coordinate of the mark point image in an original plane coordinate system; the mark point comprises four vertices of a first rectangular frame arranged on the standing long jump mat;
[0077] Step S12: the mark point corresponds to four vertices of a second rectangular frame in a new view plane coordinate system, setting vertex coordinates of the four vertices of the second rectangular frame in the new view plane coordinate system, and performing perspective conversion on the four vertex coordinates of the first rectangular frame to the four vertex coordinates of the second rectangular frame to obtain a perspective conversion matrix of the original plane coordinate system and the new view plane coordinate system.
[0078] Specifically, to facilitate the marking of marker points in the standing long jump mat image, the rectangular test area on the standing long jump mat 3 is considered as the first rectangular frame, and solid circles 6 are set as marker points at the four vertices of the first rectangular frame. The original image of the standing long jump mat is displayed on the smart screen, and the original plane coordinates of the centers of these four marker points in the original plane coordinate system are obtained. Then, in the new visual plane coordinate system, four marker points corresponding to the first rectangular frame are set as the second rectangular frame. These four marker points are located at the four vertices of the second rectangular frame, and their centers are set to correspond to the coordinates of the new visual plane coordinate system. Based on the correspondence between the marker points at the vertices of the first and second rectangular frames, a perspective transformation is performed from the original plane coordinate system to the corresponding new visual plane coordinate system to obtain the perspective transformation matrix between the original image and the new visual plane image. This facilitates the subsequent conversion of the captured original image into the target canvas image using the transformation matrix, simplifying later data processing.
[0079] In some embodiments, such as Figure 4 The diagram illustrates a process for determining whether a test subject has stepped on / crossed the starting line, according to an embodiment of the present invention. Step S3 includes:
[0080] Step S31: The standing long jump mat take-off area includes the take-off line, and the test subject's skeletal data includes the test subject's ankle joint coordinates;
[0081] Step S32: First, extract the take-off line coordinates and the test subject's ankle joint coordinates from the first image. Compare the take-off line coordinates and the test subject's ankle joint coordinates. In the horizontal direction of the new visual plane coordinate system, if the test subject's ankle joint coordinates do not cross the take-off line coordinates, it is determined that the test subject has not crossed the take-off line; otherwise, it is determined that the test subject has crossed the take-off line and a cross-take-off line prompt signal is sent.
[0082] Step S33: Then, after determining that the test subject has not crossed the starting line, extract the edge image of the starting line. If the obtained edge image of the starting line is complete, it is determined that the test subject has not stepped on the starting line; if the obtained edge image of the starting line is incomplete, it is determined that the test subject has stepped on the starting line and a stepping on the starting line prompt signal is sent.
[0083] Specifically, in the test preparation stage, in the first image of the tester received in the take-off area, the take-off line 5 coordinates and the tester ankle joint coordinates are extracted, and in the horizontal axis direction of the new visual plane coordinate system, if the tester ankle joint coordinates do not cross the take-off line 5 coordinates, it is determined that the tester does not cross the take-off line; otherwise, it is determined that the tester crosses the take-off line 5 and sends a cross-take-off line prompt signal. Then, after determining that the tester does not cross the take-off line 5, the edge image of the take-off line 5 is extracted, and if the obtained edge image of the take-off line 5 is complete, it is determined that the tester does not step on the take-off line 5; if the obtained edge image of the take-off line 5 is not complete, it is determined that the tester steps on the take-off line 5 and sends a step-take-off line prompt signal. The embodiment can accurately detect the preparation action of the tester when taking off.
[0084] In some embodiments, the detection of the tester's take-off situation comprises:
[0085] Starting from sending the take-off indication signal, a second image of the tester in the standing jump mat take-off area is obtained;
[0086] The tester ankle joint coordinates in the second image are extracted in sequence, and the variable slope between the tester ankle joint coordinates of the previous frame and the adjacent next frame is determined, the variable slope being the ratio of the vertical axis coordinate change amount to the horizontal axis coordinate change amount of the tester ankle joint coordinates in the new visual plane coordinate system;
[0087] If the variable slopes between the tester ankle joint coordinates of the previous frame and the adjacent next frame in the first n consecutive frames (n is a positive integer) of the second image are all greater than a preset variable slope threshold, and the horizontal coordinate change amounts are all greater than a first preset change threshold, it is determined that the tester has taken off at the first frame of the n consecutive frames. Wherein n is a positive integer.
[0088] Specifically, let the tester ankle joint coordinates of the i-th frame in the second image be (x i ,y i ), then the variable slope of the tester ankle joint of the i+1-th frame and the i-th frame is:
[0089] k (i+1,i) =Δy / Δx=(y i+1 -y i ) / (x i+1 -x i )
[0090] If n=5 is set, if the variable slopes k (i+1,i) of the tester ankle joint in the consecutive 5 frames of the second image are all greater than a preset variable slope threshold k min (such as k min =0.6), and Δx is all greater than a first preset change threshold Δx min (such as Δxmin If the first frame of the 5 frames is determined to be the take-off frame, the tester has taken off at the first frame of the 5 frames.
[0091] In some embodiments, after determining that the tester has taken off, the landing image of the tester is detected, including:
[0092] After detecting that the tester has taken off, a third image of the tester in the standing long jump pad test area is acquired;
[0093] The ankle joint coordinates of the tester in the third image are extracted in sequence, and if the vertical axis coordinate change and the horizontal axis coordinate change of the ankle joint of the tester in the first previous frame and the ankle joint of the tester in the adjacent next frame are both less than or equal to a second preset change threshold, the image of the adjacent next frame is determined as the landing image.
[0094] Specifically, after the tester takes off, the process of falling from the highest point is free fall motion, and when landing, the ankle joint enters a transient stationary state. It is assumed that if the position changes in the current and the previous two frames, i.e., the vertical axis coordinate change and the horizontal axis coordinate change are both less than or equal to a second preset change threshold (such as T max = 3), it is determined to be landing, and the judgment condition is:
[0095]
[0096] When the landing frame is detected, the landing image frame f0 and the previous frame image f1 adjacent to the landing image are recorded.
[0097] In some embodiments, the determination of whether the tester has committed a foul based on the landing image includes:
[0098] Based on the landing image, it is determined whether the tester has fallen backward.
[0099] If the tester has fallen backward, a tester backward falling prompt message is sent; if the tester has not fallen backward, the take-off image is detected and it is determined whether the tester has taken off on the line.
[0100] Further, the determination of whether the tester has fallen backward based on the landing image includes:
[0101] After detecting that the tester has landed, a fourth image of the tester in c frames after landing in the standing long jump pad test area is acquired; the tester skeletal data further includes wrist joint coordinates and hip joint coordinates of the tester;
[0102] The wrist joint coordinates, the hip joint coordinates, and the ankle joint coordinates in each frame of the fourth image are extracted in sequence;
[0103] If the wrist joint horizontal axis coordinate lags behind the hip joint horizontal axis coordinate and the hip joint horizontal axis coordinate lags behind the ankle joint horizontal axis coordinate, and the distance between the wrist joint vertical axis coordinate and the ankle joint vertical axis coordinate is less than or equal to a third preset change threshold in the new visual plane coordinate system in the first m frames (m is a positive integer), the tester is determined to land backwardly; otherwise, the tester is determined not to land backwardly.
[0104] Specifically, if c=30 and m=5, when the landing image is detected, 30 frames of fourth images of the tester after landing on the standing long jump pad test area are acquired for detection, the wrist joint coordinates (x wrist ,y wrist ), the hip joint coordinates (x hip ,y hip ) and the ankle joint coordinates (x ankle ,y ankle ) in each frame of the fourth images are extracted in sequence, and the third preset change threshold is D max (For example, D max =10). The judgment condition for detecting landing backwardly is as follows:
[0105]
[0106] If the first five frames of the fourth images after landing satisfy the landing judgment condition, it is determined that the tester lands backwardly, and the test is invalid. If no backward landing is determined, the take-off image is continuously detected to determine whether the tester exists take-off line stepping. If the take-off line stepping exists, the take-off line stepping prompt information is sent; if the take-off line stepping does not exist, whether the tester exists pad step jump is determined based on the take-off image.
[0107] Further, the determination of whether the tester exists take-off line stepping based on the take-off image comprises:
[0108] Firstly, the second images are extracted in sequence, and if the vertical axis change and the horizontal axis coordinate change between the tester ankle joint coordinates of the first previous frame and the adjacent next frame are both less than or equal to a fourth preset change threshold, the adjacent next frame image is determined as the tester take-off image; otherwise, the tester take-off image is continuously detected.
[0109] Then, the edge images of the take-off line in the take-off image and the second image of the previous frame are extracted respectively, and if the obtained edge images of the take-off line are all complete, it is determined that the tester does not take-off line stepping; otherwise, it is determined that the tester takes-off line stepping.
[0110] Specifically, the second images are extracted in sequence, and if the vertical axis change and the horizontal axis coordinate change between the tester ankle joint coordinates of the first previous frame and the adjacent next frame are both less than or equal to a fourth preset change threshold Tmax (As T max = 3), that is, the adjacent next image is determined as the tester take-off image if the following condition is met; otherwise, the tester take-off image is continuously detected.
[0111]
[0112] Then, the edge images of the take-off line in the take-off image and the second image of the previous frame are extracted respectively. If the obtained edge images of the take-off line are complete, it is determined that the tester does not step on the line when taking off, and whether the tester has a step jump is further determined based on the take-off image. If the obtained edge images of the take-off line are not complete, it is determined that the tester steps on the line when taking off, and a take-off line stepping prompt information is sent.
[0113] Further, the determination of whether the tester has a step jump based on the take-off image includes:
[0114] The second images of the previous P frames (P is a positive integer) are extracted from the take-off image as a starting point. If there are s frames (s is a positive integer smaller than P) in the P frames of images in which the vertical axis coordinate of the tester's ankle joint in the previous frame is less than the vertical axis coordinate of the tester's ankle joint in the adjacent next frame, and the change in the horizontal axis coordinate between the tester's ankle joint in the adjacent next frame and the tester's ankle joint in the previous frame is less than or equal to a fifth preset change threshold, it is determined that the tester has a step jump; otherwise, it is determined that the tester does not have a step jump.
[0115] Specifically, the second images of the previous 30 frames (such as P = 30) are extracted from the take-off image as a starting point. If 5 frames (such as s = 5) of images are detected in the 30 frames of images, which satisfy the following condition, and the preset fifth change threshold is X thres (As X thres = 5), it is determined that the tester has a step jump; otherwise, it is determined that the tester does not have a step jump.
[0116]
[0117] In some embodiments, the determination of the tester's long jump distance based on the landing image includes:
[0118] The tester's ankle joint coordinates in the landing image and the third image of the adjacent previous frame are extracted respectively, and the tester's heel recognition area is cut out on the second rectangular frame in the direction of the take-off line with a preset length from the horizontal axis coordinate of the tester's ankle joint as a starting point.
[0119] respectively, in the heel recognition region of the tester, extract two heel edge images of the tester, and measure a second distance between the take-off line and the nearest heel edge.
[0120] Combine the first distance and the second distance to obtain the jumping distance of the tester.
[0121] Specifically, in the recorded landing image frame f0 and the adjacent third image frame f1, the method for determining the jumping distance of the tester in the two frames according to the ankle joint (x, y) is as follows: taking the horizontal axis coordinate of the ankle joint (x, y) as the starting position, a tester heel recognition region is cut on the second rectangular frame in the direction of the take-off line according to a self-set parameter value width (for example, width = 100), and the rectangular region is ensured to contain two heels of the tester (considering that the two heels may be in front of and behind each other), the heel edge is extracted in the rectangular region, the position of the nearest heel edge to the take-off line is found, and the distance from the position to the take-off line is the measurement distance. According to this, the distance calculated in the landing image frame f0 is d0, the distance calculated in the adjacent third image frame f1 is d1, and the final test distance is:
[0122] d = (d0 + d1) / 2
[0123] Finally, the measurement distance value obtained above is displayed on the smart screen and saved; if the measurement distance value cannot be obtained, the related violation reason is displayed on the smart screen and saved. After the tester finishes the test, the smart screen can transmit the test result to the network server based on the network, so as to facilitate the personal test data statistics and analysis in the later period, and even can be used for macroscopic mass data analysis.
[0124] Embodiment 2
[0125] Based on the above standing long jump measurement method, as shown in the figure, a block diagram of a standing long jump measurement device provided by the embodiment of the application is shown, the device comprises: Figure 5 The calibration module 401 is configured to receive a standing long jump mat image, calibrate the standing long jump mat image, and obtain a conversion matrix of an original plane coordinate system and a new view plane coordinate system, wherein the horizontal axis of the new view plane coordinate system is parallel to the long side of the standing long jump mat, and the vertical axis is parallel to the short side of the standing long jump mat.
[0126] The identification module 402 is configured to identify the face information of the tester, compare the face information with the pre-stored information, and send a take-off preparation prompt information after the face information is consistent with the pre-stored information.
[0127]
[0128] The perspective conversion module 403 is configured to convert the original planar image including the tester's bone data acquired in real time into a new view planar image through the perspective conversion matrix after the identification module sends the take-off preparation prompt information.
[0129] The first detection module 404 is configured to receive the first image of the tester in the take-off area of the standing long jump pad in the new view planar image, determine whether the tester steps / crosses the take-off line, send a step / cross take-off line prompt signal if the tester steps / crosses the take-off line, and send a take-off instruction signal if the tester does not step / cross the take-off line.
[0130] The second detection module 405 is configured to detect the take-off situation of the tester after the first detection module sends the take-off instruction signal.
[0131] The third detection module 406 is configured to acquire the landing image of the tester after the second detection module determines that the tester takes off.
[0132] The measurement module 407 is configured to determine whether the tester commits a foul through the landing image, obtain the long jump distance of the tester based on the landing image if no foul is committed, and send a foul prompt signal if a foul is committed.
[0133] For other details of the implementation of the above technical solutions by the modules in the standing long jump measuring device, refer to the description of the standing long jump measuring method provided in the above embodiments.
[0134] The above provides a detailed description of the technical solutions of the present application. The principles and implementation manners of the present application are described by using specific examples. The above examples are only used to help understand the method and core idea of the present application. Meanwhile, for those skilled in the art, the specific implementation manners and application range can be changed according to the idea of the present application. In summary, the content of the present application should not be understood as a limitation.
Claims
1. A method for measuring standing long jump, characterized in that, The method includes: Receive a standing long jump mat image, calibrate the standing long jump mat image and obtain the perspective transformation matrix between the original plane coordinate system and the new visual plane coordinate system, wherein the horizontal axis of the new visual plane coordinate system corresponds to the long side of the standing long jump mat and the vertical axis corresponds to the short side of the standing long jump mat. The test subject's facial information is identified and compared with pre-stored information. If the facial information matches the pre-stored information, a jump preparation prompt is sent. Subsequently, the original planar image, which includes the test subject's skeletal data, is converted into a new visual plane image in real time using the perspective transformation matrix. In the new visual plane image, a first image of the test subject in the standing long jump mat take-off area is received to determine whether the test subject has stepped on / crossed the take-off line. This determination includes: the standing long jump mat take-off area includes the take-off line; the test subject's skeletal data includes the test subject's ankle joint coordinates. First, the take-off line coordinates and the test subject's ankle joint coordinates are extracted from the first image. The take-off line coordinates and the test subject's ankle joint coordinates are compared. In the horizontal direction of the new visual plane coordinate system, if the test subject's ankle joint coordinates do not cross the take-off line coordinates, it is determined that the test subject has not crossed the take-off line; otherwise, it is determined that the test subject has crossed the take-off line and a take-off line crossing warning signal is sent. Then, after determining that the test subject has not crossed the take-off line, the edge image of the take-off line is extracted. If the obtained edge image of the take-off line is complete, it is determined that the test subject has not stepped on the take-off line; if the obtained edge image of the take-off line is incomplete, it is determined that the test subject has stepped on the take-off line and a take-off line crossing warning signal is sent. If the test subject steps on / crosses the starting line, a prompt signal for stepping on / crossing the starting line is sent; if the test subject does not step on / cross the starting line, a start signal is sent, and then the test subject's start status is detected. After confirming that the test subject has started, the landing image of the test subject is detected. The landing image is used to determine whether the test subject has committed a foul; if no foul is committed, the test subject's long jump distance is obtained based on the landing image; if a foul is committed, a foul warning signal is sent.
2. The standing long jump measurement method according to claim 1, characterized in that, The process of calibrating the standing long jump mat image and obtaining the perspective transformation matrix between the original plane coordinate system and the new view plane coordinate system includes: The marker points in the standing long jump mat image are calibrated, and the original plane coordinates of the marker point image in the original plane coordinate system are obtained; the marker points include the four vertices of the first rectangular frame set on the standing long jump mat; The marker points correspond to the four vertices of the second rectangle in the new view plane coordinate system. The vertex coordinates of the four vertices of the second rectangle in the new view plane coordinate system are set. A perspective transformation is performed on the four vertex coordinates of the first rectangle to the four vertex coordinates of the second rectangle to obtain the perspective transformation matrix between the original plane coordinate system and the new view plane coordinate system.
3. The standing long jump measurement method according to claim 2, characterized in that, The detection of the test subject's jump includes: Starting from the moment the take-off signal is sent, a second image of the test subject in the take-off area of the standing long jump mat is acquired. The ankle joint coordinates of the test subject are extracted sequentially from the second image. The slope of the variable between the ankle joint coordinates of the test subject in the previous frame and the ankle joint coordinates of the test subject in the adjacent next frame is determined. The slope of the variable is the ratio of the change in the vertical axis coordinate to the change in the horizontal axis coordinate of the test subject's ankle joint coordinates in the new visual plane coordinate system. If the first consecutive n In the second image frame, if the slope of the variable between the ankle joint coordinates of the test subject in the previous frame and the ankle joint coordinates of the test subject in the adjacent next frame is greater than a preset variable slope threshold, and the change in the horizontal axis coordinate is greater than a first preset change threshold, then it is determined that in the continuous... n The test subject had already jumped in the first frame; among them n It is a positive integer.
4. The standing long jump measurement method according to claim 3, characterized in that, The step of detecting the landing image of the test subject after determining the jump includes: After the test subject takes off, a third image of the test subject in the standing long jump mat test area is obtained; The ankle joint coordinates of the test subject are extracted sequentially from the third image. If the change in the vertical axis coordinate and the change in the horizontal axis coordinate of the test subject's ankle joint in the first previous frame and the next adjacent frame are both less than or equal to the second preset change threshold, then the image of the next adjacent frame is determined as the landing image.
5. The standing long jump measurement method according to claim 4, characterized in that, The step of determining whether the test subject has committed a foul based on the landing image includes: Based on the landing image, determine whether the test subject fell backward; if so, send a test backward fall prompt message; if not, detect the take-off image and determine whether the test subject stepped on the take-off line. If the jump line is stepped on, a jump line prompt message is sent; if the jump line is not stepped on, it is determined whether the test subject has taken a preparatory step jump based on the jump image. If a budding jump is possible, a budding jump prompt message is sent; if no budding jump is possible, the test subject's long jump distance is obtained based on the landing image.
6. The standing long jump measurement method according to claim 5, characterized in that, The step of determining whether the test subject fell backward based on the landing image includes: After the test subject lands, the fourth image of the c-frame after the test subject lands in the standing long jump mat test area is acquired; the test subject skeletal data also includes the test subject's wrist joint coordinates and hip joint coordinates; The wrist joint coordinates, hip joint coordinates, and ankle joint coordinates are extracted sequentially from each frame of the fourth image. If the first consecutive m In each frame, in the new visual plane coordinate system, if the horizontal axis coordinate of the wrist joint lags behind the horizontal axis coordinate of the hip joint, the horizontal axis coordinate of the hip joint lags behind the horizontal axis coordinate of the ankle joint, and the distance between the vertical axis coordinates of the wrist joint and the vertical axis coordinates of the ankle joint is less than or equal to a third preset change threshold, then the test subject is determined to have fallen backward; otherwise, it is determined that the test subject has not fallen backward. m < c ,and c , m All are positive integers.
7. The standing long jump measurement method according to claim 5, characterized in that, The process of detecting the takeoff image and determining whether the test subject stepped on the takeoff line includes: First, the second image is extracted sequentially. If the change in vertical and horizontal coordinates between the ankle joint coordinates of the test subject in the previous frame and the ankle joint coordinates of the test subject in the next frame is less than or equal to the fourth preset change threshold, then the next frame image is determined to be the test subject's jump image; otherwise, the test subject's jump image is detected. Then, the edge images of the take-off line are extracted from the take-off image and the second image of the previous frame, respectively. If the obtained edge images of the take-off line are all complete, it is determined that the test subject did not step on the line during the jump; otherwise, it is determined that the test subject stepped on the line during the jump. The step of determining whether the test subject has taken a preparatory step jump based on the jump image includes: Starting from the aforementioned take-off image, extract its preceding... p The second image is a continuous frame, if the p Continuous in frame image s If the vertical coordinate of the test subject's ankle joint in the previous frame is less than the vertical coordinate of the test subject's ankle joint in the adjacent next frame, and the change in the horizontal coordinate between the test subject's ankle joint in the adjacent next frame and the test subject's ankle joint in the previous frame is less than or equal to a fifth preset change threshold, then it is determined that the test subject is performing a stepping jump; otherwise, it is determined that the test subject is not performing a stepping jump. s < p ,and s p and p are both positive integers.
8. The standing long jump measurement method according to claim 5, characterized in that, The process of obtaining the test subject's long jump distance based on the landing image includes: Extract the ankle coordinates of the test subject from the landing image and the adjacent previous frame of the third image respectively. Using the horizontal axis coordinates of the test subject's ankle joint as the starting position, extract the test subject's heel recognition area from the second rectangle with a preset length in the direction of the take-off line in the image. For the landing image and the adjacent previous frame third image, extract the edge images of the tester's two heels in the tester's heel recognition area, and measure the distance between the take-off line and the nearest heel edge as the first distance and the second distance. By combining the first distance and the second distance, the test subject's long jump distance is obtained.
9. A standing long jump measuring device, characterized in that, The device includes: The calibration module is used to receive the image of the standing long jump mat, calibrate the image of the standing long jump mat, and obtain the perspective transformation matrix between the original plane coordinate system and the new view plane coordinate system, wherein the horizontal axis of the new view plane coordinate system corresponds to the long side of the standing long jump mat, and the vertical axis corresponds to the short side of the standing long jump mat. The recognition module is used to recognize the test subject's facial information, compare the facial information with pre-stored information, and send a jump preparation prompt message after the facial information matches the pre-stored information. The perspective conversion module is used to convert the original planar image, which includes the test subject's skeletal data, into a new visual plane image after the recognition module sends the jump preparation prompt information, through the perspective conversion matrix. The first detection module is used to receive a first image of the test subject in the standing long jump mat take-off area in the new visual plane image, and determine whether the test subject has stepped on / crossed the take-off line; if the test subject has stepped on / crossed the take-off line, a take-off line prompt signal is sent; if the test subject has not stepped on / crossed the take-off line, a take-off indication signal is sent; the step of receiving the first image of the test subject in the standing long jump mat take-off area and determining whether the test subject has stepped on / crossed the take-off line includes, wherein the standing long jump mat take-off area includes a take-off line, and the test subject's skeletal data includes the test subject's ankle joint coordinates; firstly, the take-off line coordinates and the test subject's ankle joint coordinates are extracted from the first image. The system compares the take-off line coordinates with the test subject's ankle joint coordinates. In the horizontal direction of the new visual plane coordinate system, if the test subject's ankle joint coordinates do not cross the take-off line coordinates, it is determined that the test subject has not crossed the take-off line; otherwise, it is determined that the test subject has crossed the take-off line and a take-off line crossing warning signal is sent. Then, after determining that the test subject has not crossed the take-off line, the edge image of the take-off line is extracted. If the obtained edge image of the take-off line is complete, it is determined that the test subject has not stepped on the take-off line; if the obtained edge image of the take-off line is incomplete, it is determined that the test subject has stepped on the take-off line and a take-off line stepping warning signal is sent. The second detection module is used to detect the jump status of the test subject after the first detection module sends the jump indication signal; The third detection module is used to detect the landing image of the test subject after the second detection module determines that the test subject has taken off. The measurement module is used to determine whether the tester has committed a foul based on the landing image; if no foul is committed, the tester's long jump distance is obtained based on the landing image; if a foul is committed, a foul warning signal is sent.
Citation Information
Patent Citations
Free standing long jump testing method and device
CN110624203A
Intelligent distance measuring method and system for standing long jump based on computer vision
CN114712769A