A swimming competition video arbitration system

Abstract

The present invention relates to the field of intelligent arbitration technology, and in particular to a swimming competition video arbitration system, which includes a video acquisition module for acquiring video images; a video processing module for preprocessing video images; an identification module for identifying the similarity of swimming movements; a tracking module for generating a first swimming trajectory; a capture module for generating a second swimming trajectory and capturing a standard band according to the second swimming trajectory and adjusting the standard band to obtain a real-time standard band; a first judgment module for judging whether the first swimming trajectory meets the requirements; a second judgment module for judging the continuity of the swimming action; and an arbitration module for performing a primary arbitration and a secondary arbitration. The present invention improves the accuracy of the arbitration result by identifying the similarity of the swimming action and performing a primary arbitration on the judgment result of the first swimming trajectory, and performing a secondary arbitration based on the primary arbitration result combined with the judgment result of the second swimming trajectory.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent arbitration, and in particular to a swimming competition video arbitration system. Background Art

[0002] With the continuous development of intelligent technology in the field of sports competitions, more and more electronic referee systems have gradually emerged. In the process of swimming competitions, athletes' movements include swimming movements above water and swimming movements underwater. It is particularly important to accurately arbitrate the dynamic process of athletes' swimming in swimming competitions.

[0003] The patent document with publication number CN204745600U discloses an electronic referee system for swimming competitions, including a swimming pool, an electronic starting gun, a pressure sensor, a sound sensor, a timer, a microprocessor, a display and an electronic timing touch pad, wherein the electronic starting gun is installed near the starting platform of the swimming pool, the pressure sensors are respectively installed under the starting platform of each lane, and the pressure sensors respectively sense the pressure value of the starting platform of each lane, the probe of the sound sensor is located near the starting platform, the electronic starting gun, the pressure sensor, the sound sensor and the timer are respectively communicated with the microprocessor, the display is installed near the swimming pool through a bracket, the display is communicated with the microprocessor, the electronic timing touch pads are respectively fixedly installed on the wall at the end point of each lane of the swimming pool, and the electronic timing touch pads are respectively communicated with the microprocessor through switch input modules.

[0004] However, the arbitration conditions in the swimming competition process in the prior art are single, resulting in low accuracy of the arbitration results. Summary of the invention

[0005] To this end, the present invention provides a swimming competition video arbitration system, which performs a primary arbitration by identifying the similarity of swimming movements and the judgment result of a first swimming trajectory, and performs a secondary arbitration based on the primary arbitration result combined with the judgment result of a second swimming trajectory, so as to solve the problem of low accuracy of arbitration results in the prior art.

[0006] To achieve the above object, the present invention provides a swimming competition video arbitration system, which includes:

[0007] An acquisition module, used to acquire basic information of a target to be arbitrated, where the target to be arbitrated is a contestant in a swimming competition;

[0008] A video acquisition module, connected to the acquisition module, for acquiring video images of the target to be arbitrated, wherein the video images include a first video image and a second video image;

[0009] A video processing module, connected to the video acquisition module, for preprocessing the video image of the target to be arbitrated to obtain a corrected video image of the target to be arbitrated;

[0010] A recognition module connected to the video processing module, for determining a recognition result according to the similarity between the swimming action of the target to be arbitrated and the standard swimming action;

[0011] A tracking module, connected to the recognition module, for fitting and generating a first swimming trajectory of the target to be arbitrated in a three-dimensional coordinate system according to the three-dimensional coordinate values ​​of the video image of the corrected target to be arbitrated;

[0012] a capture module connected to the tracking module, for fusing the second image with the first swimming trajectory in time sequence to obtain a second swimming trajectory, and for capturing a standard band according to the second swimming trajectory and adjusting the standard band according to a band adjustment coefficient to obtain a real-time standard band;

[0013] a first judging module, connected to the capturing module, for comparing the first swimming track with a preset standard track range and judging whether the first swimming track meets the requirements to obtain a first judging result;

[0014] A second judgment module, connected to the first judgment module, is used to compare the real-time swimming action set on the real-time band with the standard swimming action set on the real-time standard band frame by frame in time sequence and judge the continuity of the swimming action to obtain a second judgment result;

[0015] The arbitration module is connected to the second judgment module, and is used to obtain a first arbitration result according to the recognition result and the first judgment result, and to obtain a second arbitration result according to the first arbitration result and the second judgment result.

[0016] Furthermore, the video acquisition module includes an above-water video acquisition unit and an underwater video acquisition unit, wherein the above-water video acquisition unit is arranged above the water surface to obtain a first video image of the target to be arbitrated, and the underwater video acquisition unit is arranged below the water surface to obtain a second video image of the target to be arbitrated, the first video image is a video image of the target to be arbitrated above the water surface, and the second video image is a video image of the target to be arbitrated below the water surface.

[0017] Furthermore, the video processing module includes a grid division unit, a first extraction unit and a correction unit, wherein the grid division unit is used to grid the video image to obtain a plurality of grid areas; the first extraction unit is used to extract the first image of the target to be arbitrated according to the difference between the image grayscale value of the grid area in the video image and the average grayscale value of the image of the water area; the correction unit is used to increase the grayscale value of the first image of the target to be arbitrated and reduce the image grayscale value of the water area according to the image grayscale value adjustment coefficient to obtain a corrected video image of the target to be arbitrated, and the corrected video image of the target to be arbitrated includes a corrected first video image and a corrected second video image.

[0018] Furthermore, the identification module includes a second extraction unit and an identification unit, wherein:

[0019] The second extraction unit is used to extract the second image of the target to be arbitrated from the modified video image of the target to be arbitrated,

[0020] The recognition unit is used to compare the second image of the target to be arbitrated with the preset standard swimming action image frame by frame and obtain a comparison result, wherein the comparison result is the similarity between the swimming action in the second image of the target to be arbitrated and the standard swimming action;

[0021] When the similarity is greater than or equal to a preset standard swimming action similarity, the recognition module determines that the recognition result is that the swimming action of the target to be arbitrated meets the requirements; when the similarity is less than the preset standard swimming action similarity, the recognition module determines that the recognition result is that the swimming action of the target to be arbitrated does not meet the requirements.

[0022] Furthermore, the tracking module includes a setting unit, an acquisition unit and a generation unit, wherein:

[0023] The setting unit is used to set the center point of the target to be arbitrated and to set the starting point of the target to be arbitrated in the swimming lane as the origin of the three-dimensional coordinate system; in the preparatory stage of the swimming competition, the center point coincides with the origin;

[0024] The acquisition unit is used to acquire continuous three-dimensional coordinate values ​​of the center point according to the corrected first video image and the corrected second video image; the three-dimensional coordinate values ​​include values ​​in the x-axis direction, values ​​in the y-axis direction, and values ​​in the z-axis direction, wherein the x-axis direction is a direction parallel to the starting line of the swimming lane of the center point of the target to be arbitrated, the y-axis direction is a forward direction of the center point of the target to be arbitrated, and the z-axis direction is a vertical direction of the center point of the target to be arbitrated relative to the water surface, and the water surface height of the swimming lane is a water level height of 0;

[0025] The generating unit is used for performing trajectory fitting on the continuous three-dimensional coordinate values ​​to generate a trajectory of the center point in a three-dimensional coordinate system, where the trajectory of the center point is a first swimming trajectory of the target to be arbitrated.

[0026] Furthermore, the capture module includes a fusion unit, a capture unit and an adjustment unit, wherein:

[0027] The fusion unit is used to fuse the second image with the first swimming trajectory in time sequence to obtain a second swimming trajectory of the target to be arbitrated; the second swimming trajectory is a swimming dynamic process of the target to be arbitrated, including the first swimming trajectory and the swimming action corresponding to each time point on the first swimming trajectory;

[0028] The capture unit is used to determine the standard band of the swimming action of the target to be arbitrated according to the matching degree between the set of swimming actions at the continuous time points of the second swimming trajectory and the set of swimming actions corresponding to the preset standard swimming posture, wherein the standard band includes the standard distance, the standard start time, the standard end time and the set of swimming actions corresponding to the standard swimming posture on the standard band;

[0029] The adjustment unit is used to adjust the standard band according to the band adjustment coefficient to obtain a real-time standard band, wherein the band adjustment coefficient is positively correlated with the real-time swimming speed of the target to be arbitrated, and the real-time standard band includes a real-time distance, a real-time start time, a real-time end time and a set of swimming movements corresponding to the standard swimming style on the real-time standard band; the real-time swimming speed is the ratio of the real-time distance to the time difference between the real-time end time and the real-time start time.

[0030] Further, the first judgment module includes a first comparison unit and a first judgment unit, wherein the first comparison unit is used to compare the first swimming trajectory with a preset standard trajectory range and obtain a comparison result, and the first judgment unit is used to judge whether the first swimming trajectory meets the requirements according to the comparison result;

[0031] A standard trajectory range in the x-axis direction is preset, and when the value in the x-axis direction is within the preset standard trajectory range in the x-axis direction, the first judgment unit determines that the first swimming trajectory meets the requirements in the x-axis direction; when the value in the x-axis direction is less than a minimum value in the preset standard trajectory range in the x-axis direction or greater than a maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit determines that the first swimming trajectory does not meet the requirements in the x-axis direction;

[0032] A standard trajectory range in the y-axis direction is preset, and when the value in the y-axis direction is within the preset standard trajectory range in the y-axis direction, the first judgment unit determines that the first swimming trajectory meets the requirements in the y-axis direction; when the value in the y-axis direction is less than a minimum value in the preset standard trajectory range in the y-axis direction or greater than a maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit determines that the first swimming trajectory does not meet the requirements in the y-axis direction;

[0033] A standard trajectory range is preset in the z-axis direction. When the value in the z-axis direction is within the preset standard trajectory range in the z-axis direction, the first judgment unit determines that the first swimming trajectory meets the requirements in the z-axis direction; when the value in the z-axis direction is less than the minimum value in the preset standard trajectory range in the z-axis direction or is greater than the maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit determines that the first swimming trajectory does not meet the requirements in the z-axis direction.

[0034] Furthermore, the second judgment module includes a determination unit, a second comparison unit and a second judgment unit, wherein:

[0035] The determining unit is used to determine the real-time band of the swimming action of the target to be arbitrated according to the real-time distance, the real-time start time and the real-time end time on the real-time standard band;

[0036] The second comparison unit is used to compare the real-time swimming action set on the real-time band with the standard swimming action set on the real-time standard band frame by frame in time sequence to obtain a band overlap;

[0037] The second judgment unit is used to judge the continuity of the swimming action of the target to be arbitrated in the real-time band according to the band overlap. When the band overlap is greater than or equal to a preset standard overlap, the second judgment unit judges that the second judgment result obtained is that the continuity meets the requirements; when the band overlap is less than the preset standard overlap, the second judgment unit judges that the second judgment result obtained is that the continuity does not meet the requirements.

[0038] Furthermore, the arbitration module includes a first arbitration unit and a second arbitration unit, wherein:

[0039] The first arbitration unit is used to obtain a first arbitration result according to the recognition result and the first judgment result;

[0040] The second arbitration unit is used to obtain a second arbitration result according to the first arbitration result and the second judgment result.

[0041] Furthermore, it also includes a timing module, which is used to start timing by receiving a command signal and end timing by receiving a touch signal from the lane terminal.

[0042] Compared with the prior art, the beneficial effects of the present invention are that the first video image and the second video image are acquired by the video acquisition module, so as to realize multi-angle video acquisition, which is helpful for multi-view collaborative arbitration; the video image of the target to be arbitrated is preprocessed by the video processing module to obtain the corrected video image of the target to be arbitrated, so as to realize the preprocessing of the video image, improve the clarity of the video image of the target to be arbitrated, and help improve the accuracy of the arbitration result; the recognition result is determined according to the similarity between the swimming action of the target to be arbitrated and the standard swimming action by the recognition module, so as to realize the separate comparison between the swimming action and the standard swimming action; the first swimming trajectory of the target to be arbitrated is fitted and generated in the three-dimensional coordinate system according to the three-dimensional coordinate value of the video image of the corrected target to be arbitrated by the tracking module, so as to realize the establishment of the real-time swimming trajectory in the three-dimensional coordinate system during the swimming process; the second image is merged with the first swimming trajectory in time sequence by the capture module to obtain the second swimming trajectory, so as to realize the establishment of the swimming dynamic process in the three-dimensional coordinate system; the standard band is captured according to the second swimming trajectory, so as to realize the determination of different standard bands for different contestants; the standard band is adjusted according to the band adjustment coefficient The real-time standard band is obtained by extracting the standard band from the real-time standard band, so that in the dynamic process of swimming, although the swimming speeds of the contestants are different at different stages, the real-time standard band of the contestants in the stage can be accurately captured, and the standard band can be adaptively adjusted in real time; the first swimming trajectory is compared with the preset standard trajectory range and the first swimming trajectory is judged to meet the requirements to obtain the first judgment result, so that a separate comparison within the range of the motion space is realized; the real-time swimming action set on the real-time band is compared with the standard swimming action set on the real-time standard band frame by frame in time sequence through the second judgment module, and the continuity of the swimming action is judged to obtain the second judgment result, so that the continuity of the swimming action in the band can be accurately judged on the real-time band at different stages, and the accuracy of the judgment of the continuity of the swimming action is improved; the first arbitration result is obtained according to the recognition result and the first judgment result, so that the first arbitration of the swimming action and the swimming trajectory is realized, and the second arbitration result is obtained according to the first arbitration result and the second judgment result, so that the second arbitration is performed on the basis of the first arbitration result combined with the judgment of the continuity of the swimming action in the dynamic process of swimming, and the accuracy of the arbitration result is improved.

[0043] In particular, the first video image and the second video image are acquired through the video acquisition module, thereby realizing multi-angle video acquisition, which is helpful for collaborative arbitration from the above-water perspective and the underwater perspective.

[0044] In particular, the video image of the target to be arbitrated is gridded by the video processing module, the granularity of the video image preprocessing is refined, and the accuracy of the preprocessing is improved; the grayscale values ​​of different grid areas are adjusted by the correction unit, so that the grayscale value of the first image of the target to be arbitrated is increased and the grayscale value of the image of the water area is reduced, thereby enhancing the contrast between the grayscale of the first image of the target to be arbitrated and the image of the water area, improving the clarity of the video image of the target to be arbitrated, and helping to improve the accuracy of the arbitration result.

[0045] In particular, the recognition module determines the recognition result according to the similarity between the swimming action of the target to be arbitrated and the standard swimming action, thereby realizing a separate comparison between the swimming action and the standard swimming action.

[0046] In particular, the tracking module generates a first swimming trajectory of the target to be arbitrated by fitting in the three-dimensional coordinate system according to the corrected three-dimensional coordinate values ​​of the video image of the target to be arbitrated, thereby realizing the establishment of a real-time swimming trajectory in the three-dimensional coordinate system during swimming.

[0047] In particular, the second swimming trajectory is obtained by fusing the second image with the first swimming trajectory in chronological order through the capture module, thereby realizing the establishment of the swimming dynamic process in a three-dimensional coordinate system; by capturing the standard band according to the second swimming trajectory, different standard bands are determined for different contestants; the standard band is adjusted according to the band adjustment coefficient to obtain the real-time standard band, thereby realizing that in the swimming dynamic process, although the contestants have different swimming speeds at different stages, the real-time standard bands of the contestants in that stage can be accurately captured, thereby realizing adaptive real-time adjustment of the standard band.

[0048] In particular, the first judgment module compares the first swimming trajectory with a preset standard trajectory range and judges whether the first swimming trajectory meets the requirements to obtain a first judgment result, thereby achieving a separate comparison within the range of the motion space.

[0049] In particular, the second judgment module compares the real-time swimming action set on the real-time band with the standard swimming action set on the real-time standard band frame by frame in chronological order and judges the continuity of the swimming action to obtain the second judgment result, thereby realizing accurate judgment of the continuity of the swimming action in the real-time band at different stages, and improving the accuracy of the judgment of the continuity of the swimming action.

[0050] In particular, by obtaining a first arbitration result based on the recognition result and the first judgment result, a primary arbitration of the swimming action and the swimming trajectory is achieved. By obtaining a second arbitration result based on the first arbitration result and the second judgment result, a secondary arbitration is achieved based on the primary arbitration result combined with the judgment of the continuity of the swimming action in the swimming dynamic process, thereby improving the accuracy of the arbitration result. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 This is a schematic diagram of the structure of a swimming competition video arbitration system in an embodiment of the present invention;

[0052] Figure 2 This is a schematic diagram of the structure of a video acquisition module in an embodiment of the present invention;

[0053] Figure 3 A schematic diagram of the structure of a video processing module in an embodiment of the present invention;

[0054] Figure 4 This is a schematic diagram of the structure of the identification module in an embodiment of the present invention;

[0055] Figure 5 This is a schematic diagram of the tracking module structure in an embodiment of the present invention;

[0056] Figure 6 This is a schematic diagram of the structure of a capture module in an embodiment of the present invention;

[0057] Figure 7 This is a schematic diagram of the structure of the first judgment module in an embodiment of the present invention;

[0058] Figure 8 This is a schematic diagram of the structure of the second judgment module in an embodiment of the present invention;

[0059] Fig. 9 This is a schematic diagram of the structure of an arbitration module in an embodiment of the present invention;

[0060] Attached figure mark: 1, acquisition module; 2, video acquisition module; 3, video processing module; 4, recognition module; 5, tracking module; 6, capture module; 7, first judgment module; 8, second judgment module; 9, arbitration module; 10, timing module; 201, above-water video acquisition unit; 202, underwater video acquisition unit; 301, grid division unit; 302, first extraction unit; 303, correction unit; 401, second extraction unit; 402, recognition unit; 501, setting unit; 502, acquisition unit; 503, generation unit; 701, first comparison unit; 702, first judgment unit; 801, second comparison unit; 802, second judgment unit; 901, first arbitration unit; 902, second arbitration unit. DETAILED DESCRIPTION

[0061] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0062] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0063] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0064] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0065] A swimming competition video arbitration system, see Figure 1-9 As shown, it can be implemented as follows: Figure 1 As shown, a schematic diagram of the structure of a swimming competition video arbitration system is shown, the system comprises: an acquisition module 1, used to acquire basic information of a target to be arbitrated, the target to be arbitrated is a contestant of a swimming competition;

[0066] A video acquisition module 2, connected to the acquisition module, for acquiring video images of the target to be arbitrated, the video images including a first video image and a second video image;

[0067] The video processing module 3 is connected to the video acquisition module and is used to pre-process the video image of the target to be arbitrated to obtain a corrected video image of the target to be arbitrated;

[0068] The recognition module 4 is connected to the video processing module and is used to determine the recognition result according to the similarity between the swimming action of the target to be arbitrated and the standard swimming action;

[0069] A tracking module 5, connected to the recognition module, is used to fit and generate a first swimming trajectory of the target to be arbitrated in a three-dimensional coordinate system according to the corrected three-dimensional coordinate values ​​of the video image of the target to be arbitrated;

[0070] A capture module 6, connected to the tracking module, is used to fuse the second image with the first swimming trajectory in time sequence to obtain a second swimming trajectory, and to capture a standard band according to the second swimming trajectory and adjust the standard band according to the band adjustment coefficient to obtain a real-time standard band;

[0071] A first judgment module 7, connected to the capture module, is used to compare the first swimming trajectory with a preset standard trajectory range and determine whether the first swimming trajectory meets the requirements to obtain a first judgment result;

[0072] The second judgment module 8 is connected to the first judgment module, and is used to compare the real-time swimming action set on the real-time band with the standard swimming action set on the real-time standard band frame by frame in time sequence and judge the continuity of the swimming action to obtain a second judgment result;

[0073] The arbitration module 9 is connected to the second judgment module, and is used to obtain a first arbitration result according to the recognition result and the first judgment result, and to obtain a second arbitration result according to the first arbitration result and the second judgment result.

[0074] Specifically, it also includes a timing module 10, which is used to start timing by receiving a command signal, and to end timing by receiving a touch signal from the swimming lane terminal. The timing module receives the signal of the sound of a starting gun as a command signal through a sound sensor, and receives the signal of the pressure of the target to be arbitrated on the touch pad as a touch signal through a pressure sensor arranged under the touch pad of the swimming lane terminal.

[0075] The first video image and the second video image are acquired by the video acquisition module, so as to realize multi-angle video acquisition, which is helpful for multi-view collaborative arbitration; the video image of the target to be arbitrated is pre-processed by the video processing module to obtain the corrected video image of the target to be arbitrated, so as to realize the pre-processing of the video image, improve the clarity of the video image of the target to be arbitrated, and help improve the accuracy of the arbitration result; the recognition result is determined according to the similarity between the swimming action of the target to be arbitrated and the standard swimming action by the recognition module, so as to realize the separate comparison between the swimming action and the standard swimming action; the first swimming trajectory of the target to be arbitrated is generated by fitting in the three-dimensional coordinate system according to the three-dimensional coordinate value of the corrected video image of the target to be arbitrated by the tracking module, so as to realize the establishment of the real-time swimming trajectory in the three-dimensional coordinate system during the swimming process; the second image is merged with the first swimming trajectory in time sequence by the capture module to obtain the second swimming trajectory, so as to realize the establishment of the dynamic process of swimming in the three-dimensional coordinate system; the standard band is captured according to the second swimming trajectory, so as to realize the determination of different standard bands for different contestants; the standard band is adjusted according to the band adjustment coefficient to obtain the real-time swimming trajectory; The standard band realizes that in the dynamic process of swimming, although the swimming speeds of the contestants are different at different stages, the real-time standard band of the contestants in the stage can be accurately captured, and the standard band is adaptively adjusted in real time; the first swimming trajectory is compared with the preset standard trajectory range and the first swimming trajectory is judged to meet the requirements to obtain the first judgment result, and the separate comparison within the motion space is realized; the real-time swimming action set on the real-time band is compared with the standard swimming action set on the real-time standard band frame by frame in time sequence through the second judgment module, and the continuity of the swimming action is judged to obtain the second judgment result, and the continuity of the swimming action in the band is accurately judged on the real-time band at different stages, and the accuracy of the judgment of the continuity of the swimming action is improved; the first arbitration result is obtained according to the recognition result and the first judgment result, and the first arbitration of the swimming action and the swimming trajectory is realized; the second arbitration result is obtained according to the first arbitration result and the second judgment result, and the second arbitration result is realized on the basis of the first arbitration result combined with the judgment of the continuity of the swimming action in the dynamic process of swimming.

[0076] Specifically, if Figure 2 As shown, a schematic diagram of the structure of the video acquisition module is shown, where the video acquisition module 2 includes an above-water video acquisition unit 201 and an underwater video acquisition unit 202, wherein the above-water video acquisition unit is arranged above the water surface to obtain a first video image of the target to be arbitrated, and the underwater video acquisition unit is arranged below the water surface to obtain a second video image of the target to be arbitrated, the first video image is a video image of the target to be arbitrated above the water surface, and the second video image is a video image of the target to be arbitrated below the water surface.

[0077] The first video image and the second video image are acquired through the video acquisition module, thereby realizing multi-angle video acquisition, which is helpful for collaborative arbitration from above-water perspectives and underwater perspectives.

[0078] Specifically, if Figure 3 As shown in the figure, the schematic diagram of the structure of the video processing module is shown, the video processing module 3 includes a grid division unit 301, a first extraction unit 302 and a correction unit 303, wherein the grid division unit is used to grid the video image to obtain a plurality of grid areas, each grid area corresponds to an image gray value; the first extraction unit is used to extract the first image of the target to be arbitrated according to the difference between the image gray value of the grid area in the video image and the image average gray value of the water area, specifically, the image average gray value of the water area is calculated according to the image gray value of the grid area, the image average gray value is set to Gv, and the gray value G of the continuous grids in the water area is equal to the image average gray value. When the grayscale value difference Gv is greater than the preset standard grayscale value difference and G is greater than Gv, the continuous grid is determined to be the grid area where the target to be arbitrated is located; a correction unit is used to increase the first image grayscale value of the target to be arbitrated and reduce the image grayscale value of the water area according to the image grayscale value adjustment coefficient to obtain a corrected video image of the target to be arbitrated, and the corrected video image of the target to be arbitrated includes a corrected first video image and a corrected second video image. Specifically, the grayscale value adjustment coefficient is set to α, then the grayscale value of the first image of the target to be arbitrated is adjusted to G×(1+α), and the average grayscale value of the grid area of ​​the water area is adjusted to Gv×(1-α), wherein 0<α<1.

[0079] The video image of the target to be arbitrated is grid-divided through the video processing module, which refines the granularity of the video image preprocessing and improves the accuracy of the preprocessing; the grayscale values ​​of different grid areas are adjusted by the correction unit, so that the grayscale value of the first image of the target to be arbitrated is increased and the grayscale value of the image of the water area is reduced, thereby enhancing the contrast between the grayscale of the first image of the target to be arbitrated and the image of the water area, improving the clarity of the video image of the target to be arbitrated, and helping to improve the accuracy of the arbitration result.

[0080] Specifically, if Figure 4 As shown, the structural diagram of the recognition module, the recognition module 4, includes a second extraction unit 401 and a recognition unit 402, wherein,

[0081] A second extraction unit is used to extract a second image of the target to be arbitrated from the modified video image of the target to be arbitrated,

[0082] an identification unit, for comparing the second image of the target to be arbitrated with a preset standard swimming action image frame by frame and obtaining a comparison result, wherein the comparison result is the similarity between the swimming action in the second image of the target to be arbitrated and the standard swimming action; specifically, each swimming style corresponds to a standard swimming action, and the preset standard swimming action image is a standard swimming action image corresponding to the swimming style performed by the target to be arbitrated;

[0083] When the similarity is greater than or equal to the preset standard swimming action similarity, the recognition module determines that the recognition result is that the swimming action of the target to be arbitrated meets the requirements, and when the similarity is less than the preset standard swimming action similarity, the recognition module determines that the recognition result is that the swimming action of the target to be arbitrated does not meet the requirements. Specifically, in this embodiment, the standard swimming action similarity is set to 0.8, and when the similarity recognized by the recognition unit is less than 0.8, it is determined that the swimming action of the target to be arbitrated does not meet the requirements.

[0084] The recognition module determines the recognition result according to the similarity between the swimming action of the target to be arbitrated and the standard swimming action, thereby realizing the separate comparison between the swimming action and the standard swimming action.

[0085] Specifically, if Figure 5 As shown in the schematic diagram of the tracking module structure, the tracking module 5 includes a setting unit 501, an acquisition unit 502 and a generation unit 503, wherein:

[0086] A setting unit, used to set the center point of the target to be arbitrated and to set the starting position of the target to be arbitrated in the swimming lane as the origin of the three-dimensional coordinate system; in the preparatory stage of the swimming competition, the center point coincides with the origin;

[0087] an acquisition unit, for acquiring continuous three-dimensional coordinate values ​​of the center point according to the corrected first video image and the corrected second video image; the three-dimensional coordinate values ​​include values ​​in the x-axis direction, values ​​in the y-axis direction, and values ​​in the z-axis direction, wherein the x-axis direction is a direction parallel to the starting line of the swimming lane of the center point of the target to be arbitrated, the y-axis direction is a forward direction of the center point of the target to be arbitrated, and the z-axis direction is a vertical direction of the center point of the target to be arbitrated relative to the water surface, and the water surface height of the swimming lane is a water level height of 0;

[0088] The generating unit is used for performing trajectory fitting on the continuous three-dimensional coordinate values ​​to generate a trajectory of a center point in a three-dimensional coordinate system, where the trajectory of the center point is a first swimming trajectory of the target to be arbitrated.

[0089] The tracking module generates a first swimming trajectory of the target to be arbitrated by fitting in the three-dimensional coordinate system according to the corrected three-dimensional coordinate values ​​of the video image of the target to be arbitrated, thereby realizing the establishment of a real-time swimming trajectory in the three-dimensional coordinate system during swimming.

[0090] Specifically, if Figure 6 As shown, the schematic diagram of the capture module structure, the capture module 6, includes a fusion unit 601, a capture unit 602 and an adjustment unit 603, wherein,

[0091] a fusion unit, used to fuse the second image with the first swimming trajectory in time sequence to obtain a second swimming trajectory of the target to be arbitrated; the second swimming trajectory is a swimming dynamic process of the target to be arbitrated, including the first swimming trajectory and the swimming action corresponding to each time point on the first swimming trajectory;

[0092] A capture unit is used to determine a standard band of the swimming action of the target to be arbitrated according to a matching degree between a set of swimming actions at continuous time points of the second swimming trajectory and a set of swimming actions corresponding to a preset standard swimming style, wherein the standard band includes a standard distance, a standard start time, a standard end time, and a set of swimming actions corresponding to the standard swimming style in the standard band; specifically, the swimming speed in the standard band is Vb, the standard distance is L0, the standard start time is T01, and the standard end time is T02, then Vb=L0 / (T02-T01);

[0093] The adjustment unit is used to adjust the standard band according to the band adjustment coefficient to obtain the real-time standard band, wherein the band adjustment coefficient is positively correlated with the real-time swimming speed of the target to be arbitrated, and the real-time standard band includes the real-time distance, real-time start time, real-time end time and the set of swimming movements corresponding to the standard swimming style on the real-time standard band; the real-time swimming speed is the ratio of the real-time distance to the time difference between the real-time end time and the real-time start time. Specifically, the band adjustment coefficient is set to β, and the value of β is calculated from the real-time distance, real-time start time and real-time end time on the real-time standard band, and the real-time distance is Ls, the real-time start time is Ts1, the real-time end time is Ts2, and the swimming speed on the real-time standard band is Vs, then Vs=Ls / (Ts2-Ts1), β=Vs / Vb.

[0094] The second swimming trajectory is obtained by fusing the second image with the first swimming trajectory in chronological order through the capture module, thereby realizing the establishment of the swimming dynamic process in a three-dimensional coordinate system; by capturing the standard band according to the second swimming trajectory, different standard bands are determined for different contestants; the standard band is adjusted according to the band adjustment coefficient to obtain the real-time standard band, thereby realizing that in the swimming dynamic process, although the contestants have different swimming speeds at different stages, the real-time standard bands of the contestants in that stage can be accurately captured, thereby realizing adaptive real-time adjustment of the standard band.

[0095] Specifically, if Figure 7As shown, a schematic diagram of the structure of the first judgment module, the first judgment module 7, includes a first comparison unit 701 and a first judgment unit 702, wherein the first comparison unit is used to compare the first swimming trajectory with a preset standard trajectory range and obtain a comparison result, and the first judgment unit is used to judge whether the first swimming trajectory meets the requirements according to the comparison result;

[0096] A standard trajectory range in the x-axis direction is preset, and when the value in the x-axis direction is within the preset standard trajectory range in the x-axis direction, the first judgment unit judges that the first swimming trajectory meets the requirements in the x-axis direction; when the value in the x-axis direction is less than a minimum value in the preset standard trajectory range in the x-axis direction or greater than a maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit judges that the first swimming trajectory does not meet the requirements in the x-axis direction;

[0097] A standard trajectory range in the y-axis direction is preset. When the value in the y-axis direction is within the preset standard trajectory range in the y-axis direction, the first judgment unit determines that the first swimming trajectory meets the requirements in the y-axis direction; when the value in the y-axis direction is less than a minimum value in the preset standard trajectory range in the y-axis direction or is greater than a maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit determines that the first swimming trajectory does not meet the requirements in the y-axis direction.

[0098] A standard trajectory range is preset in the z-axis direction. When the value in the z-axis direction is within the preset standard trajectory range in the z-axis direction, the first judgment unit determines that the first swimming trajectory meets the requirements in the z-axis direction; when the value in the z-axis direction is less than the minimum value in the preset standard trajectory range in the z-axis direction or is greater than the maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit determines that the first swimming trajectory does not meet the requirements in the z-axis direction.

[0099] The first judgment module compares the first swimming trajectory with a preset standard trajectory range and judges whether the first swimming trajectory meets the requirements to obtain a first judgment result, thereby achieving a separate comparison within the range of the motion space.

[0100] Specifically, if Figure 8 As shown in the structural diagram of the second judgment module, the second judgment module 8 includes a determination unit 801, a second comparison unit 802 and a second judgment unit 803, wherein:

[0101] A determination unit is used to determine the real-time band of the swimming action of the target to be arbitrated according to the real-time distance, the real-time start time and the real-time end time on the real-time standard band; specifically, the real-time distance of the real-time band is adaptively adjusted according to the calculated band adjustment coefficient, and the difference between the real-time standard band and the real-time band lies in the standard swimming action set and the real-time swimming action set;

[0102] The second comparison unit is used to compare the real-time swimming action set on the real-time band with the standard swimming action set on the real-time standard band frame by frame in time sequence to obtain the band overlap; specifically, the real-time swimming action set on the real-time band is compared with the standard swimming action set on the real-time standard band frame by frame in time sequence, and the comparison result obtained by comparing the real-time swimming action set on the real-time band is more accurate than that obtained by comparing the individual swimming actions, and the band overlap obtained by comparison can better reflect the continuity of the swimming action;

[0103] The second judgment unit is used to judge the continuity of the swimming action of the target to be arbitrated on the real-time band according to the band overlap. When the band overlap is greater than or equal to the preset standard overlap, the second judgment unit judges that the second judgment result is that the continuity meets the requirements; when the band overlap is less than the preset standard overlap, the second judgment unit judges that the second judgment result is that the continuity does not meet the requirements.

[0104] Through the second judgment module, the real-time swimming action set on the real-time band is compared frame by frame with the standard swimming action set on the real-time standard band in chronological order, and the continuity of the swimming action is judged to obtain the second judgment result, thereby realizing accurate judgment of the continuity of the swimming action in the real-time band at different stages, and improving the accuracy of the judgment of the continuity of the swimming action.

[0105] Specifically, if Fig. 9 As shown in the schematic diagram of the arbitration module structure, the arbitration module 9 includes a first arbitration unit 901 and a second arbitration unit 902, wherein:

[0106] A first arbitration unit, used to obtain a first arbitration result according to the recognition result and the first judgment result;

[0107] The second arbitration unit is used to obtain a second arbitration result according to the first arbitration result and the second judgment result.

[0108] By obtaining a first arbitration result based on the recognition result and the first judgment result, a primary arbitration of the swimming action and the swimming trajectory is achieved. By obtaining a second arbitration result based on the first arbitration result and the second judgment result, a secondary arbitration is achieved based on the primary arbitration result and combined with the judgment of the continuity of the swimming action in the swimming dynamic process, thereby improving the accuracy of the arbitration result.

[0109] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0110] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A swimming competition video arbitration system, characterized in that: include: An acquisition module, used to acquire basic information of a target to be arbitrated, where the target to be arbitrated is a contestant in a swimming competition; A video acquisition module, connected to the acquisition module, for acquiring video images of the target to be arbitrated, wherein the video images include a first video image and a second video image; A video processing module, connected to the video acquisition module, for preprocessing the video image of the target to be arbitrated to obtain a corrected video image of the target to be arbitrated; A recognition module connected to the video processing module, for determining a recognition result according to the similarity between the swimming action of the target to be arbitrated and the standard swimming action; A tracking module, connected to the recognition module, for fitting and generating a first swimming trajectory of the target to be arbitrated in a three-dimensional coordinate system according to the three-dimensional coordinate values ​​of the video image of the corrected target to be arbitrated; a capture module connected to the tracking module, for fusing the second image with the first swimming trajectory in time sequence to obtain a second swimming trajectory, and for capturing a standard band according to the second swimming trajectory and adjusting the standard band according to a band adjustment coefficient to obtain a real-time standard band; a first judging module, connected to the capturing module, for comparing the first swimming track with a preset standard track range and judging whether the first swimming track meets the requirements to obtain a first judging result; A second judgment module, connected to the first judgment module, is used to compare the real-time swimming action set on the real-time band with the standard swimming action set on the real-time standard band frame by frame in time sequence and judge the continuity of the swimming action to obtain a second judgment result; an arbitration module, connected to the second judgment module, configured to obtain a first arbitration result according to the recognition result and the first judgment result, and to obtain a second arbitration result according to the first arbitration result and the second judgment result; The capture module includes a fusion unit, a capture unit and an adjustment unit, wherein: The fusion unit is used to fuse the second image with the first swimming trajectory in time sequence to obtain a second swimming trajectory of the target to be arbitrated; the second swimming trajectory is a swimming dynamic process of the target to be arbitrated, including the first swimming trajectory and the swimming action corresponding to each time point on the first swimming trajectory; The capture unit is used to determine the standard band of the swimming action of the target to be arbitrated according to the matching degree between the set of swimming actions at the continuous time points of the second swimming trajectory and the set of swimming actions corresponding to the preset standard swimming posture, wherein the standard band includes the standard distance, the standard start time, the standard end time and the set of swimming actions corresponding to the standard swimming posture on the standard band; The adjustment unit is used to adjust the standard band according to the band adjustment coefficient to obtain a real-time standard band, wherein the band adjustment coefficient is positively correlated with the real-time swimming speed of the target to be arbitrated, and the real-time standard band includes a real-time distance, a real-time start time, a real-time end time and a set of swimming movements corresponding to the standard swimming style on the real-time standard band; the real-time swimming speed is a ratio of the real-time distance to the time difference between the real-time end time and the real-time start time; The first judgment module includes a first comparison unit and a first judgment unit, wherein the first comparison unit is used to compare the first swimming trajectory with a preset standard trajectory range and obtain a comparison result, and the first judgment unit is used to judge whether the first swimming trajectory meets the requirements according to the comparison result; A standard trajectory range in the x-axis direction is preset, and when the value in the x-axis direction is within the preset standard trajectory range in the x-axis direction, the first judgment unit determines that the first swimming trajectory meets the requirements in the x-axis direction; when the value in the x-axis direction is less than a minimum value in the preset standard trajectory range in the x-axis direction or greater than a maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit determines that the first swimming trajectory does not meet the requirements in the x-axis direction; A standard trajectory range in the y-axis direction is preset, and when the value in the y-axis direction is within the preset standard trajectory range in the y-axis direction, the first judgment unit determines that the first swimming trajectory meets the requirements in the y-axis direction; when the value in the y-axis direction is less than a minimum value in the preset standard trajectory range in the y-axis direction or greater than a maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit determines that the first swimming trajectory does not meet the requirements in the y-axis direction; A standard trajectory range in the z-axis direction is preset, and when the value in the z-axis direction is within the preset standard trajectory range in the z-axis direction, the first judgment unit determines that the first swimming trajectory meets the requirements in the z-axis direction; when the value in the z-axis direction is less than a minimum value in the preset standard trajectory range in the z-axis direction or greater than a maximum value in the preset standard trajectory range in the horizontal direction, the first judgment unit determines that the first swimming trajectory does not meet the requirements in the z-axis direction; The second judgment module includes a determination unit, a second comparison unit and a second judgment unit, wherein: The determining unit is used to determine the real-time band of the swimming action of the target to be arbitrated according to the real-time distance, the real-time start time and the real-time end time on the real-time standard band; The second comparison unit is used to compare the real-time swimming action set on the real-time band with the standard swimming action set on the real-time standard band frame by frame in time sequence to obtain a band overlap; The second judgment unit is used to judge the continuity of the swimming action of the target to be arbitrated in the real-time band according to the band overlap. When the band overlap is greater than or equal to a preset standard overlap, the second judgment unit judges that the second judgment result obtained is that the continuity meets the requirements; when the band overlap is less than the preset standard overlap, the second judgment unit judges that the second judgment result obtained is that the continuity does not meet the requirements.

2. The swimming competition video arbitration system according to claim 1, characterized in that: The video acquisition module includes an above-water video acquisition unit and an underwater video acquisition unit, wherein the above-water video acquisition unit is arranged above the water surface to obtain a first video image of the target to be arbitrated, and the underwater video acquisition unit is arranged below the water surface to obtain a second video image of the target to be arbitrated, the first video image is a video image of the target to be arbitrated above the water surface, and the second video image is a video image of the target to be arbitrated below the water surface.

3. The swimming competition video arbitration system according to claim 2, characterized in that: The video processing module includes a grid division unit, a first extraction unit and a correction unit, wherein the grid division unit is used to grid the video image to obtain a plurality of grid areas; the first extraction unit is used to extract the first image of the target to be arbitrated according to the difference between the image grayscale value of the grid area in the video image and the image average grayscale value of the water area; the correction unit is used to increase the grayscale value of the first image of the target to be arbitrated and reduce the image grayscale value of the water area according to the image grayscale value adjustment coefficient to obtain a corrected video image of the target to be arbitrated, and the corrected video image of the target to be arbitrated includes a corrected first video image and a corrected second video image.

4. The swimming competition video arbitration system according to claim 3, characterized in that: The recognition module includes a second extraction unit and a recognition unit, wherein: The second extraction unit is used to extract the second image of the target to be arbitrated from the modified video image of the target to be arbitrated, The recognition unit is used to compare the second image of the target to be arbitrated with the preset standard swimming action image frame by frame and obtain a comparison result, wherein the comparison result is the similarity between the swimming action in the second image of the target to be arbitrated and the standard swimming action; When the similarity is greater than or equal to a preset standard swimming action similarity, the recognition module determines that the recognition result is that the swimming action of the target to be arbitrated meets the requirements; when the similarity is less than the preset standard swimming action similarity, the recognition module determines that the recognition result is that the swimming action of the target to be arbitrated does not meet the requirements.

5. The swimming competition video arbitration system according to claim 4, characterized in that: The tracking module includes a setting unit, an acquisition unit and a generation unit, wherein: The setting unit is used to set the center point of the target to be arbitrated and to set the starting point of the target to be arbitrated in the swimming lane as the origin of the three-dimensional coordinate system; in the preparatory stage of the swimming competition, the center point coincides with the origin; The acquisition unit is used to acquire continuous three-dimensional coordinate values ​​of the center point according to the corrected first video image and the corrected second video image; the three-dimensional coordinate values ​​include values ​​in the x-axis direction, values ​​in the y-axis direction, and values ​​in the z-axis direction, wherein the x-axis direction is a direction parallel to the starting line of the swimming lane of the center point of the target to be arbitrated, the y-axis direction is a forward direction of the center point of the target to be arbitrated, and the z-axis direction is a vertical direction of the center point of the target to be arbitrated relative to the water surface, and the water surface height of the swimming lane is a water level height of 0; The generating unit is used for performing trajectory fitting on the continuous three-dimensional coordinate values ​​to generate a trajectory of the center point in a three-dimensional coordinate system, where the trajectory of the center point is a first swimming trajectory of the target to be arbitrated.

6. The swimming competition video arbitration system according to claim 5, characterized in that: The arbitration module includes a first arbitration unit and a second arbitration unit, wherein: The first arbitration unit is used to obtain a first arbitration result according to the recognition result and the first judgment result; The second arbitration unit is used to obtain a second arbitration result according to the first arbitration result and the second judgment result.

7. The swimming competition video arbitration system according to claim 6, characterized in that: It also includes a timing module, which is used to start timing by receiving a command signal, and to end timing by receiving a touch signal from a lane terminal.

Images