Sports event arbitration video processing method and system

Abstract

The invention provides a sports event arbitration video processing method and system. The system comprises a cloud management platform, a camera and a timing chip reading device. The cloud management platform is configured to determine the score validity of the participant passing through each clock-in point based on the collected image data and time data of the participant and the identification information pre-collected by each participant; determining the competition score validity of each participant according to the competition score validity evaluation rule; and splicing the image data of each clock-in point corresponding to the participant with the effective competition score to obtain a competition arbitration video of the participant with the effective score, so that comprehensive score verification of the participant is realized by combining face recognition, number cloth recognition and timing chip verification; in the whole competition process, the videos of all the clock-in points are edited and spliced in real time, video editing and real-time processing of the participants are finally achieved, and the efficiency and reliability of sporting event arbitration are improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of data processing, and particularly relates to a method and system for processing arbitration videos of sports events. Background Art

[0002] At present, the timing systems of most mass sports events such as marathons, triathlons, cycling, cross-country, and ultramarathons mostly use active or passive RFID chips to read and record the time. When an abnormal result occurs at a certain punching point, the monitoring video recorded at that punching point is replayed, and the referee's result is obtained after repeated manual verification. This process is very cumbersome and time-consuming, resulting in at least one week for the verification of the final results of a competition, and there are still cases of missed inspections.

[0003] In addition, in recent years, with the popularization of short video applications, the shooting of short videos of sports event activities has increased day by day. There are follow-up editing videos corresponding to specific individuals and highlight editing videos of individual contestants during the competition. However, generally, such short videos require professional shooting teams for shooting and post-production editing and music production, which takes a long time and is not suitable for shooting and producing individual videos for a large number of contestants.

[0004] Therefore, the existing technology urgently needs a technical solution that can solve at least one of the above problems. Summary of the Invention

[0005] Aiming at the above problems of the existing technology, the purpose of the present invention is to provide a method and system for processing arbitration videos of sports events, which improves the efficiency and reliability of sports event arbitration.

[0006] To solve the above technical problems, the specific technical solutions of the present invention are as follows:

[0007] On the one hand, the present invention provides a system for processing arbitration videos of sports events, which includes a cloud management platform and punching point collection devices set at the positions of each punching point. The contestants wear timing chips with number identifiers.

[0008] The punching point collection device includes a camera and a timing chip reading device. The camera is used to collect the image data of the contestants passing through the corresponding punching point, and the timing chip reading device is used to collect the time data of the timing chips passing through the corresponding punching point.

[0009] The cloud management platform is configured to:

[0010] Based on the image data and time data of the contestants collected by each punching point collection device, and the identification information collected in advance for each contestant, determine the validity of the results of the contestants passing through each punching point.

[0011] Determine the event result validity of each participant according to the result validity of the participants passing through each punching point and the event result validity evaluation rules;

[0012] Stitch the image data of each punching point corresponding to the participants with valid event results to obtain the arbitration video of the competition for the participants with valid results.

[0013] Furthermore, the identification information collected in advance for each participant includes the number identification and image identification corresponding to the participant;

[0014] Based on the image data and time data of the participants collected by the acquisition device at each punching point, and the identification information collected in advance for each participant, determine the result validity of the participants passing through each punching point, including:

[0015] According to the time data of each timing chip passing through the punching point, determine the identification information and timestamp information of the timing chip;

[0016] Determine the image data corresponding to the timestamp information, and establish the corresponding relationship between the image data and the time data. The image data includes the facial feature image and bib image of the participant;

[0017] When the competition information of the participant determined through the corresponding relationship is completely consistent with the identification information collected in advance by the participant, it is determined that the result of the participant at the current punching point is valid.

[0018] Furthermore, when the competition information of the participant determined through the corresponding relationship is completely consistent with the identification information collected in advance by the participant, it is determined that the result of the participant at the current punching point is valid, including:

[0019] When all of the following conditions are met, it is determined that the result of the participant at the current punching point is valid:

[0020] The number information recognized through the bib image is consistent with the number identification collected in advance by the participant;

[0021] The facial feature image of the participant collected at the punching point is consistent with the image identification collected in advance by the participant;

[0022] The number design rule recognized through the bib image is consistent with the bib design rule of this event;

[0023] Calculate the pace of the current stage according to the distance between this punching point and the previous punching point and the time difference between passing through two adjacent punching points, and the pace is within the preset range.

[0024] Furthermore, determining the image data corresponding to the timestamp information includes:

[0025] Collect the images in a preset time period before and after the timestamp information as the image data.

[0026] Further, according to the performance validity of the contestants passing through each punching point and the competition performance validity evaluation rules, determine the competition performance validity of each contestant, including:

[0027] For each contestant, when all of the following conditions are met, it is determined that the competition performance of the contestant is valid:

[0028] The timestamp information at all punching points is within the preset time range;

[0029] The contestant entity corresponding to the same timing chip at each punching point is consistent;

[0030] The competition results at all punching points are valid.

[0031] Further, splice the image data of each punching point corresponding to the contestants with valid competition results to obtain the competition arbitration video of the contestants with valid results, including:

[0032] Splice the image data of the contestants with valid competition results at each punching point according to the time sequence of each punching point to obtain the competition arbitration video of the contestants with valid results.

[0033] Further, it also includes multiple edge processing devices, and the multiple edge processing devices correspond to the punching points one by one, and are used to determine the performance validity of the contestants passing through the corresponding punching point based on the image data and time data of the contestants collected by the corresponding punching point collection device, and the identification information collected in advance for each contestant, and send the performance validity of the contestants at the punching point to the remote management platform.

[0034] Further, the cloud management platform is also configured to:

[0035] Obtain the results of each contestant with valid results at each punching point, and load the results into a preset result table template to obtain the competition result table of each contestant with valid results;

[0036] Establish an association relationship between the competition result table and the competition arbitration video.

[0037] Further, the cloud management platform is also configured to:

[0038] Obtain the image data of each contestant with valid results at each punching point, and the short video preference parameters of the contestant;

[0039] Process and fuse the video data of the contestant at each check-in point according to the short video preference parameters to obtain the short video of the contestant's event.

[0040] On the other hand, the present invention also provides a method for processing sports event arbitration videos, which is applied to the above-mentioned sports event arbitration video processing system. The system includes a cloud management platform and check-in point collection devices set at the positions of each check-in point. The contestants wear timing chips with number identifiers.

[0041] The method includes:

[0042] Based on the video data and time data of the contestants collected by each check-in point collection device, and the identification information collected in advance for each contestant, determine the validity of the results of the contestants passing through each check-in point.

[0043] According to the validity of the results of the contestants passing through each check-in point and the event result validity evaluation rules, determine the validity of the event results of each contestant.

[0044] Perform splicing processing on the video data of each check-in point corresponding to the contestants with valid event results to obtain the competition arbitration video of the contestants with valid results.

[0045] Adopting the above technical solutions, for a method and system for processing sports event arbitration videos according to the present invention, the system includes a cloud management platform and check-in point collection devices set at the positions of each check-in point. The contestants wear timing chips with number identifiers. The check-in point collection device includes a camera and a timing chip reading device. The camera is used to collect the video data of the contestants passing through the corresponding check-in point, and the timing chip reading device is used to collect the time data of the timing chips passing through the corresponding check-in point. The cloud management platform is configured to: based on the video data and time data of the contestants collected by each check-in point collection device, and the identification information collected in advance for each contestant, determine the validity of the results of the contestants passing through each check-in point; according to the validity of the results of the contestants passing through each check-in point and the event result validity evaluation rules, determine the validity of the event results of each contestant; perform splicing processing on the video data of each check-in point corresponding to the contestants with valid event results to obtain the competition arbitration video of the contestants with valid results. The present invention realizes all-round verification of the results of the participating personnel and screening of video segments by combining face recognition, number cloth recognition, and timing chip verification; during the entire competition process, the videos of each check-in point are edited and spliced in real time, and after receiving the video of the last check-in point, the entire video is synthesized. Finally, it realizes the massive video editing and real-time processing of a large number of participating personnel, improving the efficiency and reliability of sports event arbitration.

[0046] In order to make the above and other objects, features, and advantages of the present invention more apparent and understandable, the following provides preferred embodiments in conjunction with the accompanying drawings and describes them in detail as follows. Brief Description of the Drawings

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0048] Figure 1 Shows a schematic framework diagram of a sports event arbitration video processing system provided by an embodiment of the present invention;

[0049] Figure 2 Shows an example schematic diagram of a system provided by an embodiment of the present invention;

[0050] Figure 3 Shows an example schematic diagram of a system provided by an embodiment of the present invention;

[0051] Figure 4 Shows a schematic diagram of the steps of a sports event arbitration video processing method provided by an embodiment of the present invention;

[0052] Figure 5 Shows a schematic diagram of the structure of a computer device provided by an embodiment of the present invention.

[0053] Description of the Reference Signs in the Drawings:

[0054] 10, Cloud management platform; 20, Check-in point acquisition device; 21, Camera; 22, Timing chip reading device; 30, Check-in point; 40, Contestant; 50, Counter. Detailed Embodiments

[0055] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present invention.

[0056] It should be noted that the terms "first", "second", etc. in the description, claims and the above-mentioned drawings of the present invention are used to distinguish similar objects, and do not necessarily need to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present invention described here can be implemented in an order other than those illustrated or described here. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product or equipment comprising a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or equipment.

[0057] The technical terms appearing in the text are explained as follows:

[0058] The timing chip uses an active or passive RFID chip with 900Mhz to achieve directional reading of the information in the encrypted chip within a range of 1-2 meters, so as to realize the signing-in and timing of participants at specific check-in points. At present, the vast majority of marathon races use bibs integrated with passive RFID chips.

[0059] The bib generally integrates a 900Mhz passive RFID chip, and the race number is printed on the front with a specific color matching and coding rule. Participants must wear the bib on the chest throughout the race and there should be no smudging or obstruction.

[0060] The event timing system specifically refers to the timing systems for events such as marathon races, cross-country races, triathlon races, and cycling races. At present, such events in China are required to use timing systems certified by the Chinese Athletics Association.

[0061] According to the regulations of the Chinese Athletics Association, timing points must be set at the start and end of the race, and a timing point must be set every 5Km along the way, and a timing point must be set at the farthest end of the turning point.

[0062] In the prior art, the timing systems for some mass sports events such as marathons, triathlons, cycling, cross-country, and ultra-marathons mostly use active or passive RFID chips for punching and timing. When an abnormal result occurs at a certain punching point, the monitoring video recorded at that punching point is replayed, and the referee result is obtained after repeated manual verification. This process is very cumbersome and time-consuming, resulting in at least one week for the verification of the final results of a race, and there are still missed inspections.

[0063] To solve the above problems, the embodiments of the present invention provide a sports event arbitration processing system, which can improve the efficiency and reliability of sports event arbitration. Specifically, as Figures 1 - 3As shown in the figure, it is a schematic diagram of the basic framework of the system. The system includes a cloud management platform 10 and a punching point collection device 20 set at the position of each punching point 30. The contestants 40 wear timing chips with number identifiers. The punching point collection device 20 includes a camera 21 and a timing chip reading device 22. The camera 21 is used to collect the image data of the contestants passing through the corresponding punching point, and the timing chip reading device 22 is used to collect the time data of the timing chips passing through the corresponding punching point. Of course, a counter 50 can also be set at the starting position of the competition to obtain the competition duration of the entire event.

[0064] It can be understood that in long-distance competitions (such as marathons, cycling, cross-country, etc.), in order to ensure the reliability and fairness of the entire competition, the long-distance competition can be divided into multiple segments, and punching points 30 are set at the transition positions of each segment to record the time when the contestants 40 pass through the punching point 30. In this way, the competition situation of the contestants 40 at all punching points 30 or segments can be determined, avoiding relying only on both ends of the entire competition as the basis for statistics and arbitration of the competition, and improving the reliability and fairness of the competition.

[0065] In the embodiments of this specification, the cloud management platform is configured as follows:

[0066] Based on the image data and time data of the contestants collected by each punching point collection device, as well as the identification information collected in advance for each contestant, determine the validity of the scores of the contestants passing through each punching point;

[0067] According to the validity of the scores of the contestants passing through each punching point and the competition score validity evaluation rules, determine the validity of the competition scores of each contestant;

[0068] Perform splicing processing on the image data of each punching point corresponding to the contestants with valid competition scores to obtain the competition arbitration video of the contestants with valid scores.

[0069] It can be understood that the cloud management platform analyzes the data collected by the punching point collection devices set at the punching points to determine whether the scores of the contestants in each punching card are valid. In this way, the invalid contestants can be removed first, reducing the amount of data to be statistically analyzed when calculating the overall valid scores later and improving the arbitration efficiency. Then, based on the pre-set competition score validity evaluation rules and combined with the scores of the valid contestants at each punching point, determine the contestants with valid overall competition scores, thus realizing the arbitration of the entire competition.

[0070] Finally, in order to perform arbitration and management better and more intuitively, the competition videos of the contestants with valid scores at each punching point can be spliced to obtain the competition video of the entire event, which is convenient for subsequent timely and rapid arbitration and evaluation.

[0071] In the embodiments of this specification, the identification information pre-collected by each contestant includes the number identification and image identification corresponding to the contestant. Before the official competition of the contestant, data such as their own facial features can be collected in advance according to the requirements of the organizer and bound to the contestant's identity information (such as name, ID number, etc.). Then, each contestant will be assigned a bib with a timing chip to calculate the competition results of the event. The bib can have certain design rules, and each bib corresponds to a unique number, which is written into the timing chip. In this way, the timing chip reading device at the punching point location can determine the number identification and timestamp information of the bib passing through the punching point by reading the information of the timing chip inside the bib passing through the punching point.

[0072] Furthermore, based on the image data and time data of the contestants collected by each punching point collection device, and the identification information pre-collected by each contestant, determining the validity of the results of the contestants passing through each punching point includes:

[0073] Determine the identification information and timestamp information of the timing chip according to the time data of each timing chip passing through the punching point;

[0074] Determine the image data corresponding to the timestamp information and establish the corresponding relationship between the image data and the time data. The image data includes the facial feature image and bib image of the contestant;

[0075] When the competition information of the contestant determined through the corresponding relationship is completely consistent with the identification information pre-collected by the contestant, it is determined that the result of the contestant at the current punching point is valid.

[0076] It can be understood that in order to avoid substitutes in the competition, it is necessary to make the collection information of the contestant at each punching point completely consistent with the pre-collected or assigned information. Otherwise, there may be substitutes (such as pacemakers). For example, the collected images and bib information of the contestant passing through the punching point must be completely consistent with the pre-determined images and bibs to indicate that the current contestant is the real contestant. Specifically, since the camera for collecting images and the timing chip reading device are two independent collection devices, the timestamp obtained by the timing chip reading device can be used as the basis for establishing an association with the camera. Therefore, the data at the same time point is bound, and thus the bib information (i.e., the identification information of the timing chip) and image data of the contestant passing through the current punching point can be obtained.

[0077] Then, due to the obtained identification information of the contestants, such as the facial feature images of the contestants recorded in advance and the bib numbers assigned to the contestants, all the features can be compared. Only when all the comparisons are successful does it indicate that the contestant is a genuine one, and then the result at this checkpoint is a valid result.

[0078] Furthermore, when all the following conditions are met, it is determined that the result of the contestant at the current checkpoint is valid:

[0079] The number information recognized from the bib number image is consistent with the number identification pre-collected by the contestant;

[0080] The facial feature image of the contestant collected at the checkpoint is consistent with the image identification pre-collected by the contestant;

[0081] The number design rule recognized from the bib number image is consistent with the bib number design rule of this event;

[0082] Based on the distance between this checkpoint and the previous checkpoint and the time difference between passing through two adjacent checkpoints, the pace of the current stage is calculated, and the pace is within the preset range.

[0083] It can be understood that in the embodiments of this specification, the evaluation is carried out from three aspects: matching the facial features of the contestants, whether the bib number is the one issued by the event, and whether the result of the current stage meets the requirements. When all are satisfied, it is determined that the result of the contestant at this checkpoint or the stage corresponding to this checkpoint is valid.

[0084] Among them, the pace within the preset range can be the normal pace range, and the corresponding preset range is set based on the competition records corresponding to the current event.

[0085] In the embodiments of this specification, determining the video data corresponding to the timestamp information includes:

[0086] Collecting the videos within a preset time period before and after the timestamp information as the video data.

[0087] That is to say, in order to ensure the reliability and accuracy of the entire arbitration video, it is necessary to collect videos of a certain time length at each checkpoint, which is convenient for subsequent analysis and integration, so that the contestants can obtain arbitration videos with better quality.

[0088] According to the validity of the results of the contestants passing through each checkpoint and the event result validity evaluation rules, determining the validity of the event results of each contestant includes:

[0089] For each contestant, when all the following conditions are met, it is determined that the event result of the contestant is valid:

[0090] The timestamp information of all punching points is within a preset time range;

[0091] The competitor entity corresponding to the same timing chip at each punching point is consistent;

[0092] The competition results of all punching points are valid.

[0093] It can be understood that for the validity of the competition results of the entire event, it is necessary to ensure the validity of the results at each punching point, and the competitor himself / herself must complete the entire event, and the times at all punching points throughout the process meet the requirements, so as to determine that the competitor's results in this event are valid.

[0094] Correspondingly, corresponding to valid results, there must be situations of invalid results. For example, the reasons for invalid results include but are not limited to:

[0095] Competing under someone else's name;

[0096] Wearing a bib other than the one for this competition;

[0097] Wearing someone else's bib;

[0098] Wearing a forged bib;

[0099] Carrying the bibs and chips of multiple people;

[0100] False start;

[0101] Starting across regions;

[0102] Missing punching point results.

[0103] In the embodiments of this specification, the image data of each punching point corresponding to a competitor with valid event results is spliced to obtain the competition arbitration video of the competitor with valid results, including:

[0104] Splice the image data of the competitor with valid event results at each punching point according to the time sequence of each punching point to obtain the competition arbitration video of the competitor with valid results.

[0105] It can be understood that in order to obtain the complete arbitration video of the entire event, the captured videos of each punching point can be spliced. After each competitor completes the competition, the videos of each punching point are merged in sequence according to the order of the punching points.

[0106] In some other embodiments, for some contestants who did not complete the race or whose results are invalid, it is also possible to facilitate subsequent tracking and verification by producing race arbitration videos. Therefore, for missing or incomplete checkpoint videos, specific videos are used for replacement, such as all-black or all-white blank videos, and the checkpoint number and the reason for the absence (the contestant's video was not recognized or not collected) are displayed in subtitle text with high contrast colors, and the race arbitration video for this contestant is generated immediately.

[0107] In some other embodiments, when the event is a large-scale event (such as tens of thousands of people), the computing load of the cloud management platform will be relatively large. Therefore, through the method of distributed computing, the computing process of each checkpoint is distributed to that checkpoint. Specifically, it further includes multiple edge processing devices, and the multiple edge processing devices correspond to the checkpoints one by one, and are used to determine the validity of the results of the contestants passing through the checkpoint based on the image data and time data of the contestants collected by the corresponding checkpoint collection device, as well as the identification information collected in advance for each contestant, and send the validity of the results of the contestants at the checkpoint to the remote management platform. That is to say, by configuring edge computing devices at each checkpoint, the computing pressure on the cloud management platform can be reduced. The remote management platform is only responsible for integrating and outputting the race arbitration videos, reducing the processing process of the data collected at the checkpoint, thus ensuring the efficiency and reliability of the statistics and output of the results of the entire event.

[0108] In the embodiments of this specification, the cloud management platform is further configured to:

[0109] Obtain the results of each contestant with valid results at each checkpoint, and load the results into a pre-set result table template to obtain the event result table for each contestant with valid results;

[0110] Establish an association relationship between the event result table and the race arbitration video.

[0111] It can be understood that it is also necessary to output the final result table, as well as results such as result rankings, to the contestants. Exemplarily, the preliminary judgment results of the results at each checkpoint are output to the result report form and marked in the video segment. The marking method can be stored using the SEI information encoded by H.264 / H.265, or can be stored in the subtitle stream using the MKV encapsulation method. Finally, the cloud event management platform generates the personnel result report and statistical analysis report for this race, as well as the corresponding arbitration video list, facilitating the race referees to view the arbitration videos and finally confirm the results.

[0112] In some embodiments of this specification, the cloud management platform is further configured to:

[0113] Obtaining the image data of each contestant with valid scores at each check-in point, as well as the short video preference parameters of the contestant;

[0114] According to the short video preference parameters, the image data of the contestant at each check-in point is processed and fused to obtain a short video of the contestant's event.

[0115] It can be understood that the official event can also assist the contestants to output the corresponding short video of the competition for the contestants to keep or share to other media platforms. Specifically, the end event platform arranges the videos of each contestant passing through each check-in point in the order of the check-in points, and adds the opening video, the ending video, and the transition effects of each lens switching according to the pre-set video template, and merges them into a short video; then, the cloud event platform automatically optimizes and adjusts the color saturation, contrast, hue and exposure of the video screen, and synthesizes the event name, event LOGO, competition time, contestant name, results, ranking and other subtitles and animation effects related to the event into the video, and finally encodes and generates each contestant's competition short video file. Finally, the cloud event platform generates a short URL link and video thumbnail for each short video, and sends the link and video thumbnail together with the contestant's results, event poster pictures, etc. to the contestant's mobile phone in the form of a 5G message.

[0116] In some embodiments of the present specification, a sports event arbitration video processing system is also provided, which includes a cloud event management platform, a check-in point timing device that includes a camera and a timing chip reader, and can be used to assist in judging the results of various popular sports events such as marathons, triathlons, cycling, cross-country, and super marathons, and can also be used for editing, producing, and distributing short videos of competitions.

[0117] The cloud-based event management platform is used to edit the race videos of the check-in points in real time, and uses AI algorithms to make comprehensive judgments based on the list of participants, participant facial feature data, bib number design rules, timing chip data, general or special models for bib number recognition, timing point check-in data, check-in point video clips, and other comprehensive data to generate the results of each check-in point and supporting video clips (including video clips automatically filled in by the cloud-based platform due to missing videos of the check-in point);

[0118] Then, these video clips of each contestant are stitched together in the order of the check-in points to form the arbitration video of the contestant's entire game. The entire game process is comprehensively judged through AI algorithms or pre-configured judgment logic, and a performance report and statistical analysis report for all players in the game and a corresponding arbitration video list are generated in real time, making it convenient for the referee to review the arbitration video and finally confirm the results.

[0119] As a by-product of the competition arbitration video, the AI algorithm is used to eliminate the video clips with poor shooting effects, and then the short competition videos of each contestant are generated in real time by adding a title, an end credit, relevant video transition effects, subtitles, animations, background music, etc., and are immediately pushed to the contestant's mobile phone in the form of a 5G message after each contestant crosses the finish line.

[0120] The specific implementation method is as follows:

[0121] 1) Before the competition starts, the list of participants, the face feature data of the contestants, the number cloth design rules, the timing chip data, the general model and the special model for number cloth recognition on the cloud competition platform are encrypted and transmitted to each timing device at the check-in points. Each timing device at the check-in points is synchronized with the main timing clock of the competition through the network;

[0122] 2) When a participant wears a number cloth and passes by a timing device at a check-in point, the number cloth information of the contestant is read by the timing chip reading device, and the read number cloth information and data such as the timestamp are packed and uploaded to the cloud competition management platform;

[0123] At the same time, the camera deployed at this check-in point also uploads the real-time video of this check-in point to the cloud competition platform;

[0124] 3) The cloud competition management platform clips the real-time video according to the received number cloth information and timestamp, clips the video of a specific duration before and after the timestamp into segments, and associates them with the competition number in the number cloth information;

[0125] 4) Then, the cloud competition management platform analyzes and processes the video obtained in step 3). When all the following conditions are met, the result of this check-in point is valid:

[0126] Compare the number recognized from the video with the number information of the contestant to confirm that it is uniquely corresponding;

[0127] Collect the face information from the image of the contestant in the video and compare it with the personnel feature data collected during the collection of items to confirm that it is the contestant himself;

[0128] Collect the number cloth image from the image of the contestant in the video and compare it with the number cloth design rules of this competition to confirm that it is a legal number cloth for this competition;

[0129] Calculate the pace of this stage according to the distance between this check-in point and the previous check-in point and the time difference between passing through two adjacent check-in points, and the pace is within a reasonable range;

[0130] 5) Finally, the cloud competition management platform analyzes and processes the videos and timing data of each contestant passing through each check-in point in turn. When all the following conditions are met, the competition result is valid:

[0131] After the start of the competition in this division, there is a starting record, and the starting time is after the start time of the competition, or the starting time is within the permitted range;

[0132] The results of each subsequent punching point are valid;

[0133] The participant entity at each punching point is the same.

[0134] Otherwise, the results of the participating athlete are invalid. The reasons for invalid results include but are not limited to:

[0135] Not participating in the competition by oneself;

[0136] Wearing a bib other than the one for this competition;

[0137] Wearing a bib that does not belong to oneself;

[0138] Wearing a forged bib;

[0139] Carrying the bibs and chips of multiple people;

[0140] False start;

[0141] Starting across regions;

[0142] Missing punching point results.

[0143] 6) After each participating athlete completes the competition, the videos of each punching point are merged in the order of the punching points; for the missing punching point videos, they are replaced with specific videos, such as all-black or all-white blank videos, and the punching point number and the reason for the missing (the video of the participating personnel was not recognized or not collected) are displayed in high-contrast subtitle text, and the arbitration video of the athlete's competition is generated immediately.

[0144] 7) At the same time, the preliminary judgment results of the scores of each punching point are output to the score report and marked in the video clip. The marking method can be stored using the SEI information encoded by H.264 / H.265, or can be marked and stored in the subtitle stream using the MKV encapsulation method.

[0145] 8) Finally, the cloud event management platform generates the personnel score report and statistical analysis report of this competition and the corresponding arbitration video list, which is convenient for the event referee to view the arbitration video and finally confirm the score.

[0146] 9) In addition, the cloud event platform classifies the uploaded video clips in combination with the face feature data of the participants, the bib numbers recognized by the video, the read timing chip data, etc., and eliminates the video clips with poor shooting effects (the faces of the participants were not recognized or the bib numbers were not recognized) in the first few punching points;

[0147] 10) Then, the cloud competition platform arranges the videos of each participant passing through each check-in point in the order of the check-in points, and adds the opening video, the ending video, and the transition effects of each shot switching according to the pre-set video template, and merges them into a short video;

[0148] 11) Then, the cloud-based competition platform automatically optimizes and adjusts the color saturation, contrast, hue and exposure of the video, and synthesizes the event name, event logo, competition time, contestant name, results, ranking and other subtitles and animation effects related to the event into the video, and finally encodes and generates a short video file of each contestant's competition.

[0149] 12) Finally, the cloud-based competition platform generates a short URL link and video thumbnail for each short video, and sends the link and video thumbnail together with the contestant's score, competition poster image, etc. to the contestant's mobile phone in the form of a 5G message.

[0150] The sports event arbitration video processing system provided in the embodiment of the present specification is configured by setting up a cloud management platform and a check-in point acquisition device set at each check-in point. Participants wear timing chips with number identification; the check-in point acquisition device includes a camera and a timing chip reading device; the camera is used to collect image data of participants passing through the corresponding check-in point, and the timing chip reading device is used to collect time data of the timing chip passing through the corresponding check-in point; the cloud management platform is configured to: determine the image data and time data of the participants collected by each check-in point acquisition device, and the identification information collected in advance by each participant, The validity of the scores of the contestants at each check-in point is determined; the validity of the scores of each contestant is determined according to the validity of the scores of the contestants who pass each check-in point and the rules for evaluating the validity of the scores of the competition; the image data of each check-in point corresponding to the contestants with valid scores are spliced ​​to obtain the competition arbitration video of the contestants with valid scores. The present invention realizes the comprehensive verification of the scores of the contestants and the screening of video clips by combining face recognition and number cloth recognition, as well as timing chip verification; during the entire competition process, the videos of each check-in point are edited and spliced ​​in real time, and after receiving the video of the last check-in point, the whole video is synthesized. Finally, the massive video editing and real-time processing of a large number of contestants are realized, the efficiency and reliability of sports event arbitration are improved, the speed of refereeing the scores of various mass sports events such as marathons, triathlons, bicycles, cross-country, and super marathons can be improved, and the referee's repeated retrieval and verification of each contestant's competition video is greatly reduced. After each contestant completes the competition, the edited and encoded competition short video can be output in real time, and the entire shooting and editing process does not require manual intervention.

[0151] Based on the above-provided sports event arbitration video processing system, the present invention further provides a method for processing sports event arbitration videos, which can improve the efficiency and reliability of sports event arbitration. Figure 4 It is a schematic diagram of the steps of a method for processing sports event arbitration videos provided by an embodiment of the present invention. This specification provides the method operation steps as described in the embodiment or flowchart, but based on routine or non-creative labor, it may include more or fewer operation steps. The step order listed in the embodiment is only one way among the execution orders of numerous steps and does not represent the only execution order. When the actual system or device product executes, it can be executed in the order of the method shown in the embodiment or the drawings, or executed in parallel. Specifically, as Figure 4 shown, the method may include:

[0152] The method is applied to the above-mentioned sports event arbitration video processing system, which includes a cloud management platform and checkpoint acquisition devices set at each checkpoint location. The contestants wear timing chips with number identifiers.

[0153] The method includes:

[0154] S401: Based on the image data and time data of the contestants collected by each checkpoint acquisition device, and the identification information collected in advance for each contestant, determine the validity of the scores of the contestants passing through each checkpoint.

[0155] S402: According to the validity of the scores of the contestants passing through each checkpoint and the event score validity evaluation rules, determine the validity of the event scores of each contestant.

[0156] S403: Stitch the image data of each checkpoint corresponding to the contestants with valid event scores to obtain the competition arbitration video of the contestants with valid scores.

[0157] This embodiment provides a computer device, and its internal structure diagram can be as Figure 5 shown. The computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection.

[0158] Those skilled in the art can understand, Figure 5The structure shown is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0159] In one embodiment, a computer device is provided, including a memory and a processor. A computer program is stored in the memory, and when the processor executes the computer program, the steps in the above method embodiments are implemented.

[0160] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0161] In one embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0162] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory can include Read-Only Memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, etc., without limitation.

[0163] It should also be understood that in the embodiments of the present invention, the term "and / or" is merely a description of the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in the present invention generally represents an "or" relationship between the associated objects before and after.

[0164] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed in the present invention can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0165] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0166] In several embodiments provided by the present invention, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed couplings, direct couplings, or communication connections to each other can be indirect couplings or communication connections through some interfaces, devices, or units, and can also be electrical, mechanical, or other forms of connection.

[0167] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place, or can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiments of the present invention.

[0168] In the present invention, specific embodiments are used to elaborate on the principles and implementation manners of the present invention. The descriptions of the above embodiments are only used to help understand the method and its core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to the present invention.

Claims

1. A sports event arbitration video processing system, characterized in that: The system includes a cloud management platform and a check-in point collection device set up at each check-in point. Participants wear timing chips with number identification; The punch-in point collection equipment includes a camera and a timing chip reading device; The camera is used to collect image data of the contestants passing through the corresponding check-in point, and the timing chip reading device is used to collect time data of the timing chip passing through the corresponding check-in point; The cloud management platform is configured as follows: Determine the validity of the scores of the contestants who pass through each check-in point based on the image data and time data of the contestants collected by the collection device at each check-in point, as well as the identification information collected in advance by each contestant; Determine the validity of each participant's race results based on the validity of the participants' scores at each check-in point and the race results validity evaluation rules; The image data of each check-in point corresponding to the contestants with valid competition results are stitched together to obtain the competition arbitration video of the contestants with valid results.

2. The system according to claim 1, characterized in that The identification information collected in advance by each contestant includes the number identification and image identification corresponding to the contestant; Based on the image data and time data of the contestants collected by the collection equipment at each check-in point, as well as the identification information collected in advance by each contestant, the validity of the scores of the contestants who passed through each check-in point is determined, including: Determine identification information and timestamp information of each timing chip according to time data of each timing chip passing through the clock-in point; Determine the image data corresponding to the timestamp information, and establish a corresponding relationship between the image data and the time data, the image data including the facial feature image and the bib number image of the contestant; When the contestant's competition information determined by the corresponding relationship is completely consistent with the identification information collected in advance by the contestant, it is determined that the contestant's score at the current check-in point is valid.

3. The system according to claim 2, characterized in that When the contestant's competition information determined by the corresponding relationship is completely consistent with the identification information collected in advance by the contestant, it is determined that the contestant's score at the current check-in point is valid, including: If all of the following conditions are met, the participant's score at the current check-in point will be deemed valid: The number information identified by the bib image is consistent with the number identification collected in advance by the contestant; The facial feature image of the contestant collected at the check-in point is consistent with the image identification collected in advance by the contestant; The number design rules identified by the bib image are consistent with the bib design rules of the event; The pace of the current stage is calculated based on the distance between this check-in point and the previous check-in point and the time difference between the two adjacent check-in points, and the pace is within the preset range.

4. The system according to claim 3, characterized in that Determining the image data corresponding to the timestamp information includes: The images in a preset time period before and after the timestamp information are collected as the image data.

5. The system according to claim 1, characterized in that The validity of each participant's race results is determined based on the validity of the results of each participant who passes through each check-in point and the race results validity evaluation rules, including: For each participant, the results of the competition will be deemed valid if all of the following conditions are met: The timestamp information of all check-in points is within the preset time range; The same timing chip corresponds to the same number of participants at each check-in point; The competition results of all check-in points are valid.

6. The system according to claim 1, characterized in that The image data of each check-in point corresponding to the contestants with valid results are stitched together to obtain the competition arbitration video of the contestants with valid results, including: The image data of the contestants with valid race results at each check-in point are spliced ​​according to the time sequence of each check-in point to obtain the race arbitration video of the contestants with valid results.

7. The system according to claim 1, characterized in that It also includes multiple edge processing devices, which correspond one to one with the check-in points, and are used to determine the validity of the scores of the contestants who pass the check-in points based on the image data and time data of the contestants collected by the corresponding check-in point collection devices, and the identification information collected in advance by each contestant, and send the validity of the scores of the contestants at the check-in points to the remote management platform.

8. The system according to claim 1, characterized in that The cloud management platform is also configured to: Obtain the score of each valid contestant at each check-in point, and load the score into a preset score sheet template to obtain a competition score sheet for each valid contestant; Establishing an association relationship between the competition score sheet and the competition arbitration video.

9. The system according to claim 1, characterized in that The cloud management platform is also configured to: Obtaining the image data of each contestant with valid scores at each check-in point, as well as the short video preference parameters of the contestant; According to the short video preference parameters, the image data of the contestant at each check-in point is processed and fused to obtain a short video of the contestant's event.

10. A sports event arbitration video processing method, characterized in that: The sports event arbitration video processing system applied to any one of claims 1 to 9, the system comprising a cloud management platform and a check-in point acquisition device arranged at each check-in point, and the contestants wear timing chips with number identification; The method comprises: Determine the validity of the scores of the contestants who pass through each check-in point based on the image data and time data of the contestants collected by the collection device at each check-in point, as well as the identification information collected in advance by each contestant; Determine the validity of each participant's race results based on the validity of the participants' scores at each check-in point and the race results validity evaluation rules; The image data of each check-in point corresponding to the contestants with valid competition results are stitched together to obtain the competition arbitration video of the contestants with valid results.

Images