Intelligent referee feedback method and system

Abstract

The application discloses a kind of intelligent referee feedback method and system, comprising: obtaining ruling event and its corresponding confidence, generate corresponding event signal based on the type of ruling event;Based on the local number information and scoring information of scoring terminal, it is judged whether process event occurs, generate corresponding process signal based on the type of process event;According to event signal, generate first control instruction to scoring terminal;According to event signal and / or process signal, generate second control instruction to athlete interaction terminal.This application makes that from event identification, ruling operation, scoring operation to competition process advancement forms a complete automation closed loop, completes each round from service to score, exchanges ball right and so on automation, continuous judgment, substantially reduces the game interruption and delay caused by artificial judgment, communication and operation, ensure the compactness and continuity of game;Solve the problem that current pickle ball game professional referee is less, difficult to hold large-scale competition.

Description

Technical Field

[0001] This invention relates to the field of intelligent refereeing technology, specifically to an intelligent refereeing feedback method and system. Background Technology

[0002] Due to its low barrier to entry and high level of enjoyment, the number of people playing pickleball has surged globally in recent years, leading to a dramatic increase in the number of pickleball tournaments. According to standard pickleball rules, at least two professional referees are typically required for each match to ensure accurate officiating and maintain order. This traditional model has significant limitations: First, the training period for professional referees is long, and their numbers are limited. Their cost and availability cannot keep pace with the massive increase in both mass participation and commercial tournaments. This shortage is particularly pronounced in large tournaments with multiple matches held simultaneously, directly hindering the scale and efficiency of the events. Second, relying entirely on human judgment inevitably leads to blind spots or momentary disagreements during high-speed competition, affecting the consistency of officiating and the overall player experience.

[0003] In addition, in each match, the referee needs to use gestures and commands to inform the athletes of the scoring results and events such as the change of serve.

[0004] Therefore, overcoming the technical problems of low efficiency in the entire event and the current shortage of professional referees in pickleball competitions, making it difficult to hold large-scale competitions, has become a challenge that those skilled in the art need to address. Summary of the Invention

[0005] To address the shortcomings of existing technologies, this application provides an intelligent referee feedback method and system. This application acquires adjudication events and their confidence levels. When the confidence level exceeds a threshold, automatic adjudication and corresponding scoring operations are implemented, and the adjudication results are fed back to the athletes. Furthermore, based on the game count and scoring information from the scoring terminal, it determines whether a process event has occurred and feeds back the corresponding process event to the athletes. This creates a complete automated closed loop from event identification, adjudication, scoring operations to the progression of the match, automating and continuously judging each rally from serve to score and exchange of possession. This significantly reduces match interruptions and delays caused by manual judgment, communication, and operation, ensuring the compactness and continuity of the match. It solves the current problem of a shortage of professional referees in pickleball matches and the difficulty in organizing large-scale competitions.

[0006] To address the above problems, the present invention provides the following technical solution: In a first aspect, embodiments of this application provide an intelligent referee feedback method, applied to a system including a control terminal, an athlete interaction terminal, and a scoring terminal. The intelligent referee feedback method is executed by the control terminal and includes: Obtain the adjudication event and its corresponding confidence level. The adjudication event includes at least one of the following: score, violation, and out of bounds. If the confidence level of the adjudication event is greater than or equal to a first threshold, generate a corresponding event signal based on the type of the adjudication event. Based on the game number information and scoring information of the scoring terminal, it is determined whether a process event has occurred. The process event includes at least one of changing the court and changing the right to serve. A corresponding process signal is generated based on the type of the process event. A first control instruction is generated based on the event signal and sent to the scoring terminal, and the scoring terminal performs the corresponding scoring operation; a second control instruction is generated based on the event signal and / or the process signal and sent to the athlete interaction terminal, and the athlete interaction terminal displays and / or broadcasts the type of event via voice.

[0007] Secondly, embodiments of this application provide an intelligent referee feedback system, including: a control terminal and an athlete interaction terminal and a scoring terminal connected thereto; The control terminal is used to acquire adjudication events and their corresponding confidence levels in real time; the adjudication events include at least one of scoring, violation, and out-of-bounds; if the confidence level of the adjudication event is greater than or equal to a second threshold but less than a first threshold, a corresponding event signal is generated based on the type of the adjudication event; based on the set number information and scoring information of the scoring terminal, it is determined whether a process event has occurred, the process event includes at least one of changing sides and changing the right to serve, and a corresponding process signal is generated based on the type of the process event; a first control command is generated to the scoring terminal according to the event signal, and a second control command is generated to the athlete interaction terminal according to the event signal and / or the process signal; The athlete interactive terminal is used to display and / or voice announce the type of event; The scoring terminal is used to perform the corresponding scoring operations.

[0008] The beneficial effects of this application are as follows: This application provides an intelligent referee feedback method and system that can acquire adjudication events (scores, violations, out-of-bounds) and their confidence levels. When the confidence level exceeds a threshold, automatic adjudication and corresponding scoring operations can be achieved, and the adjudication results can be fed back to the athletes. Furthermore, based on the game number information and scoring information of the scoring terminal, it determines whether a process event (change of possession, change of court) has occurred and feeds back the corresponding process event to the athletes. This creates a complete automated closed loop from event recognition, adjudication operations, scoring operations to the progression of the game, completing automated and continuous adjudication for each rally from serve to score and change of possession. This significantly reduces game interruptions and delays caused by manual judgment, communication, and operation, ensuring the compactness and continuity of the game. Compared to the current requirement of two referees for each pickleball match, using the intelligent referee feedback method of this application can effectively reduce the number of referees needed to hold pickleball matches, which is beneficial to the promotion of pickleball. Attached Figure Description

[0009] Figure 1 This is a flowchart illustrating the intelligent referee feedback method provided in the embodiments of this application.

[0010] Figure 2 This is a structural block diagram of the intelligent referee feedback system provided in the embodiments of this application.

[0011] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0012] Figure 4 This is a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. Detailed Implementation

[0013] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0014] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0015] The intelligent referee feedback method for pickleball using this application can provide feedback on pickleball matches remotely. For example, this intelligent referee feedback method for pickleball can provide feedback on pickleball matches remotely through an Internet platform. The electronic device can be a server in a cloud computing center. Therefore, this application also relates to the fields of Internet and cloud computing, and big data services.

[0016] The intelligent referee feedback method provided in this application will be described in detail below with reference to the accompanying drawings. Please refer to... Figure 1 , Figure 1 This is a flowchart illustrating the intelligent referee feedback method 100 provided in an embodiment of this application. Figure 1 As shown, the intelligent referee feedback method 100 is applied to a system including a control terminal, an athlete interaction terminal, a referee interaction terminal, and a scoring terminal. The method includes steps S100 to S800.

[0017] Step S100: Obtain a live video of the pickle game.

[0018] In some methods, a control terminal is connected to a camera component, which is placed at the edge of the playing field to capture live video of the pickle game. The live video includes the trajectory of the ball, the actions of the athletes, and the location where the ball lands. The control terminal receives the live video of the pickle game sent by the camera component.

[0019] Step S200: Determine whether an adjudication event has occurred based on the live video, and output the confidence level corresponding to the adjudication event; the adjudication event includes at least one of scoring, violation, and going out of bounds; if the confidence level of the adjudication event is greater than or equal to the first threshold, generate the corresponding event signal based on the type of the adjudication event.

[0020] In some implementations, the control terminal captures the trajectory of the ball and the actions of the athletes based on the live video, and analyzes whether the ball enters the valid area and triggers a score, whether the athlete's behavior violates the rules of the game, or whether the ball exceeds the valid boundary of the game. If any of these occur, a ruling event is determined to have occurred and the confidence level corresponding to the ruling event is output. If the confidence level of the ruling event is greater than or equal to a first threshold, an event signal is generated. The event signal includes a score signal, a violation signal, and an out-of-bounds signal. The confidence level is the probability that the control terminal determines that this ruling event is true.

[0021] In some implementations, for example, the first confidence threshold is set to 90%. If the confidence level is greater than or equal to 90%, the control terminal determines that no manual intervention is required and directly determines to generate the event, and generates the corresponding event signal based on the type of the adjudication event.

[0022] Specifically, step S200 includes the following steps: Step S210: Obtain the first monitoring data and referee record data before the start of the current round.

[0023] If the current rally is the first rally of the first game in the current match, the referee's record data will be empty. Otherwise, the referee's record data includes the game number of the current rally, the current score, the serving side of the current rally, and the match format.

[0024] Step S220: Determine the match situation information based on the first monitoring data and referee record data. In some embodiments, step S220 includes steps S221 to S223.

[0025] Step S221: Determine the field type and ball type based on the first monitoring data.

[0026] In some implementations, the first monitoring data includes first image data.

[0027] Optionally, the first monitoring data is obtained by camera components positioned at multiple angles within the competition venue. Optionally, the first monitoring data also includes first acoustic data.

[0028] In some implementations, a pre-trained classification model is used to identify the playing field and ball based on the first monitoring data, thereby determining the field type and ball type.

[0029] Step S222: Determine the game number, current score, serving side, and match format based on the referee's record data.

[0030] The referee's record data includes the number of games in the previous round, the current score, the serving side in the current round, and the match format.

[0031] Step S223: Determine the match information based on the court type, ball type, number of games, current score, serving side, and match format.

[0032] Step S230: Determine the referee rule set for the current round based on the match information and the preset match rules.

[0033] The referee's rule set includes at least one of the following: scoring rules, service rules, non-volley zone rules, and double bounce rules.

[0034] Optionally, the scoring rules include a serve-based scoring system and a direct scoring system.

[0035] In some implementations, step S230 includes steps S231 to S233.

[0036] Step S231: Determine the basic referee rule set that is compatible with the match information based on the preset match rules.

[0037] Step S232: Determine the round type of the current round based on the number of games and the current score in the match information.

[0038] Step S233: Select at least one referee rule from the basic referee rule set based on the round type, and determine the referee rule set for the current round based on all selected referee rules.

[0039] Step S240: Obtain the second monitoring data in the current round.

[0040] Optionally, the second monitoring data includes second image data.

[0041] Optionally, the second monitoring data also includes second acoustic data, which is collected by a distributed microphone array. Optionally, the second monitoring data also includes wind speed data of the competition venue area.

[0042] Step S250: Based on the second monitoring data and the competition information, determine the competition venue area, ball movement characteristics, and athlete's human movement characteristics.

[0043] In order to adaptively adjust the recognition algorithm according to the environment around the playing field and the type of ball, in some implementations, step S250 includes steps S251 to S254.

[0044] Step S251: Determine environmental impact parameters based on the venue type in the competition information.

[0045] Optionally, the site type includes indoor sites and outdoor sites. Because indoor and outdoor sites differ in environmental factors such as lighting and wind speed, environmental impact parameters need to be determined for accurate subsequent processing of the second image data. Optionally, the environmental impact parameters are determined based on the site type, a preset correspondence between site types and environmental impact parameters.

[0046] Step S252: Determine the ball type feature parameters based on the ball type in the match information.

[0047] Optionally, the ball type characteristic parameters include the size of the pick ball, the number of holes in the pick ball, and the size of the holes. Optionally, the ball type characteristic parameters are determined based on the ball type and the correspondence between the ball type and the ball type characteristic parameters.

[0048] Step S253: Determine the competition venue area and human movement characteristics based on the second monitoring data and environmental impact parameters.

[0049] Step S254: Determine the ball motion characteristic information based on the second monitoring data, ball type characteristic parameters, and environmental influence parameters.

[0050] Optionally, the ball's motion characteristic information includes the ball's trajectory and motion parameters. The ball's motion parameters, such as speed, acceleration, and current coordinates, can be determined through video, and the trajectory can be calculated from these motion parameters.

[0051] Step S260: Based on the referee rule set, the playing area, ball movement characteristics, and human movement characteristics, determine whether both players have violated the rules or scored in the current round, and obtain the referee record data for the current round.

[0052] In some implementations, step S260 includes steps S261 to S262.

[0053] Step S261: When the referee's rule set includes the service rule and the scoring rule, determine whether the first player serving the ball has violated the rules based on the service rule, the playing area, ball movement characteristics, and human movement characteristics.

[0054] In some implementations, athletes can serve in various ways, and different serving methods correspond to different referee conditions in the service rules. For example, athletes can serve with either a volley or a drop serve, and the referee conditions for a volley and a drop serve are different. In this case, step S261 includes steps S2611 to S2612.

[0055] Step S2611: Capture the athlete's serving posture and determine the serving method adopted by the first athlete based on the playing area, ball motion characteristics, and human motion characteristics.

[0056] In some implementations, step S2611 includes steps S26111 to S26112.

[0057] Step S26111: Based on the motion trajectory and motion parameters of the pick ball in the ball motion feature information, determine the first time point when the motion trajectory and velocity direction of the pick ball change abruptly, and based on the human motion feature information, determine the second time point when the first athlete's serving posture begins. When the difference between the first time point and the second time point is less than the preset time difference, determine that the first athlete is serving, and determine the first time point or the second time point as the first athlete's serving time point.

[0058] Step S26112: Based on the playing area, ball movement characteristics, and the first player's serving time, determine whether the ball lands in the first player's service area at least once within the first time interval, where the end time is the serving time. If the ball lands in the first player's service area at least once, determine the serving method as a landing serve; otherwise, determine the serving method as a volley serve.

[0059] The duration of the first time period is the first preset duration. The playing area includes the receiving area.

[0060] Optionally, the receiving area includes the volley zone and the non-volley zone.

[0061] Optionally, the playing area is the area defined by the sidelines, with the volley zone and non-volley zone within the receiving area demarcated by the sidelines. Optionally, according to the service rules, only the non-volley zone can be used as the service zone during a serve. Therefore, the non-volley zone of the first player in the playing area is designated as the service zone.

[0062] In some implementations, the system determines whether the ball contacts the ground within a first time period, coinciding with the end time of the serve, based on ball motion characteristic information. When it is determined that the ball contacts the ground, the coordinates of each contact point are determined based on the trajectory of the pick in the ball motion characteristic information, and it is determined whether the coordinates of each contact point are within the service area. If the coordinates of each contact point are determined to be within the service area, the serve is determined to be a landing serve; if the ball does not contact the ground, the serve is determined to be a volley serve.

[0063] Optionally, when the height of the lowest point of the peak ball's trajectory in the ball's motion characteristic information is the height of the ground in the playing area, it is determined that the ball is in contact with the ground, and the coordinates of the lowest point are determined as the coordinates when the ball contacts the ground.

[0064] Optionally, when the height of the lowest point of the peak ball's trajectory in the ball's motion characteristic information is the height of the ground in the playing area, and both the trajectory and motion parameters undergo abrupt changes, it is determined that the ball is in contact with the ground, and the coordinates of that lowest point are determined as the coordinates when the ball contacts the ground.

[0065] Step S2612: Determine the referee conditions in the service rules corresponding to the service method adopted by the first player, and judge whether the first player who serves has violated the rules based on the referee conditions corresponding to the service method, the playing area, the ball's motion characteristics, and the human body's motion characteristics.

[0066] In some implementations, regardless of the serving method, the referee's condition for the serving method includes that the first player must serve from outside the volley zone. In this case, based on the position coordinates of the first player during the duration of the serving posture in the playing area and human motion characteristic information, it is determined whether the first player is in the non-volley zone of the playing area during the duration of the serving posture. If so, the first player is judged not to have violated the rules; otherwise, the first player is judged to have violated the rules.

[0067] In some implementations, the referee conditions corresponding to the serve type also include posture referee conditions corresponding to the serve type. Optionally, posture referee conditions include arm movement restriction conditions, racket position restriction conditions at the time of serve, and hitting point height restriction conditions, etc.

[0068] For example, the posture referee conditions for a volley serve include the athlete's arm moving in an upward arc, the highest point of the racket not exceeding the horizontal line of the highest point of the wrist when hitting the ball, and the hitting point not exceeding the waist level when serving. In this case, the coordinates of all key posture points within the duration of the serving posture in the first athlete's human motion characteristic information are used to determine whether the first athlete's posture meets the posture referee conditions. If it does, the first athlete is judged not to have violated the rules; otherwise, the first athlete is judged to have violated the rules.

[0069] In some implementations, when the serve is a drop serve, the referee's conditions for a drop serve include that the ball must fall naturally before the serve is given. In this case, step S2612 includes steps S26121 to S26125.

[0070] Step S26121: Determine the referee conditions in the service rules corresponding to the first player's service method, including the requirement that the ball must fall naturally before the serve.

[0071] Step S26122: Based on the motion trajectory and motion parameters in the ball motion feature information, determine the trajectory of the ball when it first lands in the service area within the first time period when the end time point is the service time point.

[0072] The starting point of the falling trajectory is the point when the speed of the pick is 0, and the ending point of the falling trajectory is the point when the pick first lands in the service area.

[0073] Step S26123: Determine the height of the pick ball based on its coordinates at the start time of the falling trajectory. Calculate the standard trajectory and standard motion parameters of the pick ball's natural fall based on its height according to the laws of free fall.

[0074] Step S26124: Calculate the distance error and motion parameter error between a point on the standard trajectory of the pick ball and a point on the falling trajectory of the pick ball at each time point during the multiple time points in the process of the pick ball falling.

[0075] Optionally, the multiple time points can be any point in the process of the pickle falling.

[0076] Optionally, multiple time points may include the start time point and / or end time point of the descent trajectory.

[0077] Step S26125: When the sum of distance errors is greater than the preset distance error threshold, or the sum of motion parameter errors is greater than the preset motion parameter error threshold, the first athlete is judged to have violated the rules; otherwise, the first athlete is judged not to have violated the rules.

[0078] By using the above methods, the referee can automatically determine the athlete's serving method and adaptively adjust the referee rules when the athlete's serving method is different, thereby improving the accuracy of the referee.

[0079] Step S262: When it is determined that the first player has not violated the rules, based on the referee rule set, the playing field area, ball movement characteristics information and human movement characteristics information, determine whether the first player and the second player have received the ball in compliance with the rules or scored a point, and generate referee record data.

[0080] In some implementations, when the referee rule set includes non-interception zone rules, step S262 includes steps S2621 to S2624.

[0081] Step S2621: When it is determined that the first player has not violated the rules and the referee's rule set includes non-volley zone rules, determine whether the second player has received the ball based on the ball's motion characteristics and the human body's motion characteristics.

[0082] Optionally, based on the trajectory and motion parameters of the pickle in the ball motion feature information, a third time point is determined where the trajectory and velocity direction of the pickle change abruptly, and based on the human motion feature information, a fourth time point is determined where the second athlete's receiving posture begins. When the difference between the third time point and the fourth time point is less than a preset time difference, it is determined that the second athlete has received the ball.

[0083] Step S2622: When it is determined that the second athlete receives the ball, it is determined whether the second athlete is in the non-volley zone of the playing field area during the duration of the receiving posture based on the playing field area and human movement characteristic information.

[0084] Specifically, based on the position coordinates of the athlete during the duration of the receiving posture in the competition area and human motion characteristic information, it is determined whether the second athlete is in the non-volley zone of the competition area during the duration of the receiving posture.

[0085] Step S2623: When the second player is not in the non-volley zone of the playing field during the duration of the receiving posture, determine that the second player's receiving is compliant, and determine whether the ball lands on the ground of the first player's receiving area at least twice after the second player receives the ball based on the playing field area and ball movement characteristics information.

[0086] Optionally, when the lowest point of the peak's trajectory in the ball's motion characteristic information is at the same height as the ground surface of the playing area, the ball is considered to have touched the ground, and the coordinates of this lowest point are determined as the coordinates of the ball when it touches the ground. Based on the playing area and the coordinates of the ball when it touches the ground, it can be determined whether the ball lands on the ground in the first player's receiving area after the second player receives it. There can be multiple lowest points in the peak's trajectory; when it is determined that the ball lands on the ground in the first player's receiving area, the number of times the ball lands on the ground in the first player's receiving area is recorded.

[0087] In some implementations, when it is determined that the ball lands on the ground in the second player's receiving area after the second player receives the ball, the score of the first player is increased by 1, the first player is determined to be the serving player in the next round, and referee record data is generated.

[0088] Step S2624: When the scoring rule in the referee's rule set is direct scoring, and the second player's reception is compliant, and the ball lands on the ground of the first player's receiving area at least twice after the second player receives the ball, the second player's score is increased by 1, the second player is determined to be the server in the next round, and referee record data is generated; otherwise, the first player's score is increased by 1, the first player is determined to be the server in the next round, and referee record data is generated.

[0089] The referee's record data includes the scores of both players in the current rally and the serving side in the next rally. Optionally, the referee's record data also includes information on whether each player committed a foul and scored a point in the current rally.

[0090] In some implementations, when the scoring rule in the referee's rule set is a serve-and-score system, and the second player's reception is compliant, and the ball lands on the ground in the first player's receiving area at least twice after the second player receives the ball, the second player's score is not changed, the second player is determined to be the server in the next rally, and referee record data is generated; otherwise, the first player's score is increased by 1, the first player is determined to be the server in the next rally, and referee record data is generated.

[0091] In some implementations, when the referee rule set includes the double bounce rule for the pickle, step S262 includes steps S2625 to S26211.

[0092] Step S2625: When it is determined that the first athlete has not violated the rules, and the referee's rule set includes the double bounce rule corresponding to the pickle, determine whether the second athlete should catch the ball based on the ball's motion characteristic information and the human body's motion characteristic information.

[0093] Optionally, if the second athlete is judged to have a receiving posture after the first athlete serves, based on human motion characteristic information, and the trajectory and motion parameters of the pick ball change abruptly during the duration of the receiving posture, the second athlete is judged to have received the ball; otherwise, the second athlete is judged not to have received the ball.

[0094] Step S2626: When it is determined that the second player receives the ball, based on the playing field area and ball movement characteristics information, determine whether the ball landed on the ground in the second player's receiving area once before the second player receives the ball.

[0095] Optionally, when the lowest point of the peak's trajectory in the ball's motion characteristic information is at the same height as the ground surface of the playing area, the ball is considered to have touched the ground, and the coordinates of this lowest point are determined as the coordinates of the ball when it touches the ground. Based on the playing area and the coordinates of the ball when it touches the ground, it can be determined whether the ball lands on the ground in the second player's receiving area after being received. There can be multiple lowest points in the peak's trajectory; when it is determined that the ball lands on the ground in the second player's receiving area, the number of times the ball lands on the ground in the second player's receiving area is recorded.

[0096] Step S2627: When it is determined that the ball landed on the ground in the second player's receiving area once before the second player receives the ball, the second player's receiving of the ball is deemed compliant.

[0097] In some implementations, the second player is judged to have violated the receiving rules if the ball did not land on the ground in the second player's receiving area before the second player receives the ball, or if the ball lands on the ground in the second player's receiving area more than once.

[0098] Step S2628: Determine whether the first athlete has received the ball based on the ball's motion characteristics and the human body's motion characteristics.

[0099] The content of step S2628 is the same as that of step S2625.

[0100] Step S2629: When it is determined that the first player receives the ball, based on the playing field area and ball movement characteristics information, determine whether the ball landed on the ground in the first player's receiving area once before the first player receives the ball.

[0101] The content of step S2629 is the same as that of step S2626.

[0102] Step S26210: When it is determined that the ball landed on the ground in the first player's receiving area once before the first player receives the ball, the first player's receiving of the ball is deemed compliant.

[0103] In some implementations, the first player is judged to have violated the rules of receiving the ball if the ball did not land on the ground in the first player's receiving area before the first player receives the ball, or if the ball lands on the ground in the first player's receiving area more than once.

[0104] Step S26211: When it is determined that after the first player serves, the second player receives the ball in compliance with the rules and the first player receives the ball in compliance with the rules, it is determined that the double bounce rule is invalid in the subsequent process of the current round. Based on the referee rule set after the double bounce rule is invalidated, the playing field area, ball movement characteristic information and human movement characteristic information, it is determined whether the first player and the second player receive the ball in compliance with the rules or score, and referee record data is generated.

[0105] In some implementations, the referee's rule set after the double bounce rule is invalidated, the playing field area, ball movement characteristics information, and human movement characteristics information are used to determine whether the first and second players have received the ball legally or scored, and referee record data is generated, including steps (26211.1) to (26211.13). (26211.1) When the referee's rule set includes non-interception zone rules, determine whether the second player has received the ball based on ball motion characteristics and human motion characteristics.

[0106] In some implementations, a fifth time point is determined based on the trajectory and motion parameters of the pickle in the ball motion feature information, indicating a sudden change in the trajectory and velocity direction of the pickle. A sixth time point is determined based on the human motion feature information, indicating the start of the second athlete's receiving posture. When the difference between the fifth time point and the sixth time point is less than a preset time difference, it is determined that the second athlete has received the ball.

[0107] (26211.2) When it is determined that the second player did not receive the ball, determine whether the second player has scored based on the referee rule set and generate referee record data.

[0108] In some implementations, when it is determined that the second player did not receive the ball, it is determined whether the ball landed in the second player's receiving area based on the playing field area and ball movement characteristics. If it is determined that the ball landed in the second player's receiving area, the second player is determined not to score according to the scoring rules in the referee's rule set, the first player's score is incremented by 1, the first player is determined to be the serving player in the next round, and referee record data is generated. When it is determined that the ball did not land in the second player's receiving area, the second player is determined not to score according to the scoring rules in the referee's rule set, and the first player is determined whether to score, and the serving player in the next round is determined, and referee record data is generated.

[0109] (26211.3) When determining the second player to receive the ball, determine the number of times the ball lands on the ground in the second player's receiving area before the second player receives the ball, based on the information of the playing field area and the ball's movement characteristics.

[0110] (26211.4) Determine the second player's receiving method or whether a point is scored based on the number of times the ball lands on the ground in the second player's receiving area before the second player receives the ball.

[0111] The methods of receiving the ball include volleying and non-volleying. A volley is when a player receives the ball before it has landed in their own receiving area. A non-volley is when a player receives the ball after it has landed in their own receiving area at least once.

[0112] In some implementations, when the ball lands on the ground in the second player's receiving area once before the second player receives the ball, the second player's receiving method is determined to be a non-volley receiving method.

[0113] In some implementations, when the number of times the ball lands on the ground in the second player's receiving area before the second player receives the ball is 0, the second player's receiving method is determined to be a volley.

[0114] In some implementations, if the ball lands on the ground in the second player's receiving area more than once before the second player receives the ball, the second player is determined not to score. In this case, the first player's score and the serving player for the next round are determined based on the scoring rules, and referee record data is generated.

[0115] The content of step (26211.4) is the same as that of step S2626.

[0116] (26211.5) When it is determined that the second player's receiving method is a volley, the position coordinates of the second player in the receiving posture during the duration of the receiving posture in the playing field area and human motion characteristic information are used to determine whether the second player is in the non-volley zone of the second player in the playing field area during the duration of the receiving posture. If so, the second player is judged not to have violated the rules; otherwise, the second player is judged to have violated the rules.

[0117] (26211.6) When it is determined that the second player's receiving method is a non-volley receiving method, the position coordinates of the second player in the receiving posture during the duration of the receiving posture in the playing field area and human motion characteristic information are used to determine whether the second player is in the receiving area of ​​the second player in the playing field area during the duration of the receiving posture. If so, the second player is judged not to violate the rules; otherwise, the second player is judged to violate the rules.

[0118] In some implementations, when a second player is judged to have violated the rules, the referee records data are generated based on the scoring rules in the referee rule set to determine whether the second player has scored and whether the first player has scored, and to determine the serving side in the next round.

[0119] (26211.7) When it is determined that the second athlete has not violated the rules, the first athlete is judged to receive the ball based on the ball movement characteristics and human movement characteristics.

[0120] (26211.8) When it is determined that the first player did not receive the ball, the scoring rules in the referee rule set are used to determine whether the first player has scored and the referee record data is generated.

[0121] (26211.9) When determining the first player to receive the ball, determine the number of times the ball lands on the ground in the first player's receiving area before the first player receives the ball, based on the playing field area and ball movement characteristics.

[0122] (26211.10) Determine the first player's receiving method or whether a point is scored based on the number of times the ball lands on the ground in the first player's receiving area before the first player receives the ball.

[0123] (26211.11) When it is determined that the first player's receiving method is a volley, the position coordinates of the first player in the receiving posture during the duration of the receiving posture in the playing field area and human motion feature information are used to determine whether the first player is in the non-volley zone of the first player in the playing field area during the duration of the receiving posture. If so, the first player is judged not to have violated the rules; otherwise, the first player is judged to have violated the rules.

[0124] (26211.12) When it is determined that the first player's receiving method is non-volley receiving, the position coordinates of the first player in the receiving posture during the duration of the receiving posture in the playing field area and human motion feature information are used to determine whether the first player is in the receiving area of ​​the first player in the playing field area during the duration of the receiving posture. If so, the first player is judged not to violate the rules; otherwise, the first player is judged to violate the rules.

[0125] (26211.13) When it is determined that the first athlete has not violated the rules, return to step (26211.1).

[0126] The content of steps (26211.7) to (26211.13) refers to the content of steps (26211.1) to (26211.6).

[0127] By using the above methods, the applicable refereeing rules can be adjusted according to the entire round's progress, thereby improving the applicability and accuracy of the refereeing methods.

[0128] In some implementations, the method further includes step S270 after step S260.

[0129] Step S270: Determine whether the match is over based on the referee record data and referee rule set for the current round. If not, return to step S210.

[0130] In some implementations, the control terminal responds to at least one of a pause and a serve timing command; the pause and serve timing commands are also process events, which can be sent by the referee. If the pause command is received, the scoring terminal is controlled to stop scoring according to the pause command; if the serve timing command is received, the athlete's interactive terminal is controlled to display a serve countdown screen according to the serve timing command, and the serve time of the peak ball is 10 seconds.

[0131] Step S300: Based on the game number information and scoring information of the scoring terminal, determine whether a process event has occurred. The process event includes at least one of changing the court or changing the serve. Generate a corresponding process signal based on the type of the process event.

[0132] In some implementations, the change of sides for service occurs when a singles or doubles team loses the serve and passes it to their opponent. The control terminal determines the losing and serving sides based on the ruling or score. If the losing and serving sides are the same, a signal is generated to change the serving side. If the losing and serving sides are not the same, the serving side remains unchanged.

[0133] In some implementations, for different competition formats, if it is a single-game match, a switch-of-side signal is generated when the score reaches a certain point, such as when either team reaches 8 points. If it is a best-of-three match, a switch-of-side signal is generated when the score reaches a certain number of games, such as when the score reaches 6 or 8 points in the third game.

[0134] Step S400: Generate a first control command to the scoring terminal based on the event signal, and the scoring terminal performs the corresponding scoring operation; generate a second control command to the athlete interaction terminal based on the event signal and / or the process signal, and the athlete interaction terminal displays and / or broadcasts the type of the event via voice.

[0135] In some implementations, the athlete's interactive terminal displays the type of event and the team information where the event occurred, such as Team A scoring, Team B exchanging serve, etc.

[0136] Step S500: If the confidence level of the adjudication event is greater than or equal to the second threshold but less than the first threshold, it is determined that manual intervention is required, and a corresponding event signal is generated; In some implementations, when the control terminal detects an event, it generates a corresponding confidence level. If the confidence level is greater than or equal to a preset second threshold, the control terminal determines that the event is generated; otherwise, it ignores the event. If the confidence level is greater than or equal to the second threshold but less than the first threshold, the control terminal determines that manual intervention is required and generates a corresponding event signal. If the confidence level is greater than or equal to the first threshold, the control terminal determines that no manual intervention is required and generates a corresponding event signal. If the first threshold is greater than the second threshold (e.g., the second threshold is set to 55% and the first threshold to 90%), when the control terminal determines that an athlete has violated the rules and the confidence level is greater than or equal to 55%, it determines that the event is generated; if the confidence level is less than 55%, it is ignored. If the confidence level is greater than or equal to 55% but less than 90%, the control terminal determines that manual intervention is required and generates a corresponding event signal. If the confidence level is greater than or equal to 90%, the control terminal determines that no manual intervention is required and generates a corresponding event signal. This improves the accuracy of referees in scenarios where judgment is difficult, such as when the ball lands near the boundary line.

[0137] Because the Peak court is small, the ball speed is fast, and there are specific rules such as the non-volley zone, in order to accurately officiate Peak ball, it is necessary to judge: 1. The ball's landing point: whether it is out of bounds (sideline, baseline) or within the non-volley zone; 2. Player's actions: whether the serve is illegal (underhand, hitting point height), whether the player's footsteps are in the non-volley zone, whether the player touches the net, etc.; 3. The ball's trajectory: whether it touches the net (serve, return), whether the ball bounces twice, etc.

[0138] To ensure accurate officiating, at least two types of camera systems will be installed at Peak Court. Side camera systems (e.g., positioned on either side of the net) will provide a clear view of the sidelines and monitor player movements outside the volley zone. End camera systems (e.g., positioned at the front and back baselines and slightly away from the baselines) will provide a clear view of baseline out-of-bounds situations, monitor the net area (violations such as touching the net or hitting the ball over the net), serve motions, and the height of the contact point.

[0139] At this time, method 100 also includes steps S601 to S607.

[0140] Step S601: Calculate the confidence level of the adjudication event of the video captured by each camera component.

[0141] Step S602: Classify the camera components according to their installation positions, classifying them into side camera groups and end camera groups.

[0142] Step S603: Sort the camera components in each type of camera component according to their confidence level, and calculate the confidence level difference between adjacent camera components after sorting.

[0143] The sorting rule can be from largest to smallest or from smallest to largest; this application does not impose any restrictions.

[0144] Specifically, each type of camera assembly typically includes at least two camera assemblies. For example, in a side camera assembly, one camera assembly is typically located on the left side of the net, and the other on the right side of the net; in an end-face camera assembly, one camera assembly is typically located on the front baseline, and the other on the rear baseline.

[0145] Step S604: When there is a confidence difference greater than a preset difference threshold, the target camera component with the smallest confidence is determined from the two camera components used to calculate the confidence difference.

[0146] For example, if there are camera components 1 and camera component 2 in the first type of camera components, the confidence level of camera component 1 is 30%, the confidence level of camera component 2 is 50%, and the difference is 20%, which is greater than the preset difference threshold of 10%, then the target camera component is camera component 1.

[0147] Step S605: Delete the target camera component and all camera components with a confidence level lower than that of the target camera component in each type of camera component.

[0148] For example, the first type of camera components includes camera component 1, camera component 2, and camera component 3. The confidence level of camera component 1 is 25%, the confidence level of camera component 2 is 30%, and the confidence level of camera component 3 is 50%. The preset difference threshold is 10%. Then, the target camera component is camera component 2, and camera component 1 and camera component 2 are deleted.

[0149] The reason is that in a pickleball game, certain camera components are easily affected by factors such as the athlete, the audience, the environment, or the weather, which can cause their confidence level to drop abnormally, thus lowering the average confidence level. The above steps can remove such camera components and retain only the videos from reliable camera components.

[0150] Step S606: Calculate the average confidence level of all camera components in each class of camera components, and use the average confidence level as the class confidence level of that class of camera components.

[0151] Step S607: Calculate the confidence difference between classes. If the confidence difference between classes is greater than the preset difference threshold, it is determined that manual intervention is required. Generate the corresponding event signal, and extract the video of the camera component with the highest confidence in each class and send it to the referee terminal.

[0152] Specifically, since steps S601 to S605 above have eliminated abnormal camera components affected by external factors, the remaining camera components should be considered as normal. At this time, the confidence levels of different types of camera components should be consistent. If they are inconsistent, a dispute may have occurred. For example, the average confidence level of the side camera components is 40%, and the average confidence level of the end camera components is 70%. This may be because the ball grazed the net with a very small gap. In this case, human intervention is introduced for refereeing.

[0153] In some implementations, a database of adjudication event types is established, and feedback from athletes is collected afterward. Based on the database, certain adjudication event types are marked as controversial events, and the confidence threshold for controversial events is increased. For example, the first threshold for non-controversial events is 90%, and the first threshold for controversial events can be increased based on this.

[0154] Step S600: Extract the video playback segment corresponding to the adjudication event from the live video, and determine at least one adjudication interaction terminal among multiple adjudication interaction terminals to send the event signal and the video playback segment, so as to control the adjudication interaction terminal to display the event to be adjudicated and the video playback segment corresponding to the adjudication event. Step S600 specifically includes steps S610 to S630: Step S610: If the determination is yes, extract the video playback segment corresponding to the adjudication event from the live video.

[0155] In some embodiments, if the control terminal determines that the event signal requires manual intervention based on the confidence level, it uses the event signal reception event as a timestamp, extracts the live video of the corresponding time window based on the timestamp, generates a video playback segment, and sends it to the referee interaction terminal.

[0156] In some implementations, there are multiple camera components, which are set up in different locations on the field. The control terminal receives the live video from the multiple camera components and generates multiple video playback segments, which are then sent to the referee interaction terminal.

[0157] Step S620: Among the multiple referee interaction terminals, at least one referee interaction terminal is determined to send an event signal and a video playback segment. Specifically, step S620 includes the following steps: Step S621: Each referee is bound to a referee interaction terminal, and each referee interaction terminal includes a unique ID.

[0158] Step S622: Select the appropriate referee interaction terminal allocation method according to the different needs of the referees in the competition.

[0159] Specifically, the referee requirements for different events can be divided into three categories: The first scenario: When only one judge needs to make a ruling on the same event, and there is only one judge and one bound judge interaction terminal, the allocation method is as follows: The event signal corresponding to the adjudication event is sent to the adjudicator's interactive terminal for adjudication.

[0160] The second method is used when only one referee needs to adjudicate the same event, and there are at least two referees and their associated referee interaction terminals. For example, when holding a group stage of a large-scale peak ball competition, with a large number of participating teams and several matches to be held simultaneously, the allocation method is as follows: Step S6221: The control terminal, based on the event type of the adjudication event to be decided and the preset referee classification rules, divides the referees into chief referees and assistant referees, and associates different types of events with referees of different levels. Each referee corresponds to a referee interaction terminal. The control terminal selects a set of referee interaction terminals that meet the conditions from all referee interaction terminals according to the event type.

[0161] In some implementations, the types of events for adjudication include violations, out-of-bounds events, and scoring events. Specific violations include timing violations and action violations. Timing violations include failing to serve within the time limit, while action violations include improper serving or hitting motions. In peak ball, the server's arm must move in an upward arc during the hit, the highest point of the racket cannot exceed the horizontal line of the highest point of the wrist, and the point of contact cannot exceed waist level. Referees are divided into a head referee and assistant referees. Action violations are marked as difficult events, while scoring and out-of-bounds events are marked as general events. Difficult events are assigned only to the head referee, while general events can be assigned to all referees.

[0162] In step S6221, a set of referee interaction terminals that meet the conditions is initially selected based on the event type. The set of referee interaction terminals includes at least one referee interaction terminal.

[0163] Step S6222: Based on the total number of pending events and processed tasks in the set of referee interaction terminals, perform a second filtering to obtain the remaining set of referee interaction terminals.

[0164] The control terminal monitors the number of pending tasks and processed tasks for each referee interaction terminal. When a new ruling event occurs, it is preferentially assigned to the referee interaction terminal with the fewest pending tasks. If multiple referee interaction terminals have the same number of pending events, the new event is preferentially assigned to the referee interaction terminal with the fewest processed tasks.

[0165] Step S6223: Based on the judge profile formed by the historical ruling accuracy rate of each candidate judge, select the judge interaction terminal corresponding to the judge with the high historical ruling accuracy rate from the remaining set of judge interaction terminals as the target judge interaction terminal.

[0166] Action violations are categorized into different phases, including service violations, double bounce violations, hitting violations during the game, and violations outside the volley zone, among others. Based on these types of violations, the historical accuracy rate of each referee for different violations is statistically analyzed. Each referee corresponds to one referee interaction terminal. Depending on the type of the current violation, the referee interaction terminal with the highest historical ruling accuracy rate is selected from the remaining set of referee interaction terminals as the target referee interaction terminal.

[0167] Step S6224: Assign the adjudication event to the target referee's interactive terminal.

[0168] The second method of allocating referee interaction terminals allows a small number of referees to serve multiple matches played simultaneously, thus solving the problem of insufficient referee numbers.

[0169] The third type: When multiple referees are needed to adjudicate the same event, such as in the final or semi-final of peakball, the accuracy of the referees' decisions is required, and the number of matches is small, usually only one match is played at a time. Therefore, a single event requires multiple referees.

[0170] The specific allocation method is as follows: The event signal corresponding to the adjudication event is simultaneously sent to multiple referee interaction terminals for joint adjudication.

[0171] Step S630: Control the referee's interactive terminal to display the event to be adjudicated and the corresponding video replay clip.

[0172] In some implementations, the referee interaction terminal includes a display device with multiple sub-windows, the number of which is the same as the number of camera components, for playing multiple video playback clips from different perspectives, and each sub-window can be enlarged and played individually.

[0173] In some implementations, the referee interaction terminal also includes a wearable contact device separate from the display device, and the control terminal controls the wearable contact device to trigger tactile feedback to the referee to remind the referee.

[0174] The control terminal locates the video based on the timestamp, extracts a few seconds before and after the event (e.g., 2 seconds before and 8 seconds after the event), and transcodes or encapsulates it. This process requires computing resources and consumes computation time. After generating the event signal, the control terminal sends the event signal and the video playback segment to the referee's interactive terminal. The control terminal needs to extract the video playback segment before sending it to the referee's interactive terminal, so there is a delay of a few seconds between the control terminal sending the video playback segment and the time signal. Furthermore, the referee's interactive terminal then sends it to its display device, which needs to decode and buffer it before playback, and decoding and buffering also require some time. When the control terminal sends the event signal to the referee's interactive terminal, the referee's interactive terminal sends a vibration command to the wearable contact device. The vibration of the referee's interactive terminal occurs before the video plays, effectively reminding the referee to look at the display device on the referee's interactive terminal in advance, preventing the referee from missing the playback video segment.

[0175] In this embodiment, the tactile feedback and display device of the referee interaction terminal work together, and the two are precisely linked in time. First, the tactile feedback reminds the referee to focus and ensures that the referee obtains complete decision support in the shortest possible time.

[0176] Step S700: Receive voting instructions from the referee interaction terminal; In some implementations, voting instructions include instructions to approve, instructions to disapprove, and instructions to extend the deliberation time.

[0177] In some implementations, voting can be done via physical buttons on a wearable contact device or via virtual buttons on a display device.

[0178] Step S800: Make a decision based on the voting instruction and generate a first control instruction to send to the scoring terminal to execute the corresponding scoring operation; For the first and second methods of allocating the referee interaction terminal, if only one referee makes a ruling on the same ruling event, then the first control command is generated directly according to the ruling of that referee and sent to the scoring terminal, and the scoring terminal executes the corresponding scoring operation.

[0179] In some implementations, if the referee selects the "agree" instruction, for violations, the player is deemed to have violated the rules, and scoring is performed according to the pickleball scoring rules; for out-of-bounds incidents, if the player is deemed to have gone out of bounds, scoring is performed accordingly. If the referee selects the "disagree" instruction, the scoring terminal remains inactive. If the referee selects the "extend deliberation time" instruction, the referee's interactive terminal re-enters the voting page, and the referee continues voting.

[0180] For the third scenario, where the number of referees exceeds the number of matches played simultaneously, and multiple referees are required to adjudicate the same event, the following adjudication method shall apply: First, determine if there are any signals indicating an extension of the review process; If there is a signal to extend the deliberation period, a re-voting instruction will be sent to all judge interaction terminals, at which point the voting input module of all judge interaction terminals will be restarted. If there is no signal to extend the deliberation period, the total number of voting signals is compared with the total number of judge interaction terminals. If the total number of voting signals is not equal to the total number of judge interaction terminals, it indicates that there is a problem with the judge interaction terminal or that a judge has not voted. In this case, a re-voting instruction can be sent to the judge interaction terminal that has not voted or the judge interaction terminal that has a problem, and the voting input module of that judge interaction terminal will be restarted. Determine if the number of "yes" signals and the number of "no" signals are the same. If they are the same, send a re-voting instruction to all judge interaction terminals. At this time, the voting input modules of all judge interaction terminals will be restarted. If the number of "yes" signals and the number of "no" signals are not equal, the control terminal sends a normal playback command to the referee interaction terminal located in the referee area. At this time, the referee interaction terminal ends the replay and continues to play the game content in real time.

[0181] The adjudication module in this embodiment employs a hierarchical judgment logic. First, it responds to the highest priority extended deliberation, giving the on-site judges an opportunity for collective deliberation and ensuring the accuracy of the judgment. Second, it provides a revote opportunity to individual terminals that did not vote, saving power. Finally, it checks whether the number of "yes" and "no" signals are equal, because if there are collective deliberation signals and some judges did not vote, then evaluating the existing number of "yes" and "no" signals is invalid. Through this design, the efficiency of judge deliberation can be improved, and while ensuring the accuracy of the judgment, the system achieves the fastest response speed and energy savings.

[0182] In some implementations, when multiple judges hold differing opinions and it is difficult to change the original decision, the voting results of human judges and the confidence scores generated by the control terminal can be merged to generate a final decision confidence score. This saves judges' deliberation time and avoids situations where judges argue endlessly or their votes remain the same. If the final decision confidence score is greater than the fourth threshold, the event is considered to have occurred. The formula for calculating the final decision confidence score is as follows:

[0183] in, For the confidence level of the final ruling, To control the terminal trust index, To control the confidence level generated by the terminal, The voting results are as follows: 100% in favor and 0% against. As the weight of the referee.

[0184] The control terminal trust index is related to the type of event. For example, the current peakball competition is a major event, and the control terminal trust index... Set to 0.3 if the pickleball tournament is an amateur event. The value is set to 0.8, meaning that human decision-making is given priority for major events.

[0185] Assuming the confidence level generated by the control terminal is 80%, that is The value is 0.8. Assuming the human referee team consists of one head referee and three assistant referees, we can assume the head referee's weight is 2, and the two assistant referees' weights are each 1. In this embodiment, if the referee inputs a "yes" command, the percentage is 100%; if they input a "no" command, the percentage is 0%. The percentages for "yes" and "no" commands can be adjusted as needed. If one head coach and one assistant coach agree, and the other two assistant coaches disagree, then... %=66%, resulting in a final confidence level of 66%. The fourth threshold for the final decision confidence level can be set to 60%, thus determining the final decision confidence level. If the percentage is greater than 60%, then the event is determined to have occurred.

[0186] Please see Figure 2 , Figure 2 This is a structural block diagram of an intelligent referee feedback system provided in an embodiment of this application. In a second aspect, this application provides an intelligent referee feedback system, which includes: a control terminal and connected to it an athlete interaction terminal, a referee interaction terminal, and a scoring terminal. The control terminal is used to connect to the camera component, which is used to acquire real-time video of the pickle's movement; the camera component is used to collect real-time video including information on the athlete's movements, the ball's trajectory, and the ball's landing point. The control terminal receives live video and determines whether a ruling event has occurred based on the live video. When a ruling event is determined to have occurred, a corresponding event signal is generated based on the type of the ruling event, and the confidence level corresponding to the ruling event is output. The ruling event includes at least one of scoring, violation, and out-of-bounds. If the confidence level of the ruling event is greater than or equal to a first threshold, a corresponding event signal is generated based on the type of the ruling event. Based on the game count information and scoring information of the scoring terminal, it determines whether a process event has occurred. The process event includes at least one of changing sides or changing serve, and a corresponding process signal is generated based on the type of the process event. A first control command is generated according to the event signal and sent to the scoring terminal. The process signal generates a second control command to the athlete's interactive terminal; when the confidence level of the adjudication event is greater than or equal to a second threshold but less than a first threshold, the control terminal determines that manual intervention is required and generates a corresponding event signal; it extracts a video playback segment corresponding to the adjudication event from the live video, and determines that at least one of the referee's interactive terminals will send the event signal and the video playback segment; it receives a voting command from the referee's interactive terminal; it makes a ruling based on the voting command, generates a third control command and sends it to the scoring terminal, and generates a fourth control command and sends it to the athlete's interactive terminal; if the confidence level of the adjudication event is less than the second threshold, the event is ignored and no event signal is generated.

[0187] The control terminal in this embodiment includes a first main control module and connected to it a first wireless communication module, an event analysis module, a statistics module, a video storage module, a video playback segment generation module, a referee judgment module, and a priority decision module. The first main control module analyzes the live video of the pickle according to step S200, generating referee events and their corresponding confidence levels. The types of referee events include scoring, violations, out-of-bounds, and rescues. If the confidence level of a referee event is greater than or equal to a first threshold, a corresponding event signal is generated, and corresponding control commands are sent to the scoring terminal and the athlete interaction terminal respectively. If the confidence level of a referee event is less than a first threshold, the following actions are taken: If a threshold is set but greater than or equal to a second threshold, a corresponding event signal is generated, and corresponding control commands are sent to the scoring terminal and the referee interaction terminal respectively. If the confidence level of the adjudicated event is less than the second threshold, the event is ignored and no event signal is generated. Based on the game number information and scoring information of the scoring terminal, it is determined whether a process event has occurred. The process event includes at least one of changing the court or changing the serve. A corresponding process signal is generated based on the type of the process event. A corresponding control command is generated to the scoring terminal based on the event signal, and a corresponding control command is generated to the athlete interaction terminal based on the event signal and / or the process signal.

[0188] The control terminal establishes a wireless communication connection with the referee interaction terminal, athlete interaction terminal, and scoring terminal via the first wireless communication module; the video storage module receives and stores the live video from the camera components; the video playback segment generation module, when human intervention is deemed necessary, extracts relevant video playback segments from the video based on the timestamp corresponding to the event signal and sends the corresponding video playback segments to the designated referee interaction terminal via the wireless communication module; the statistics module counts the number of voting instructions; the adjudication module adjudicates based on the voting instructions and outputs the adjudication result to the first main control module, which generates corresponding control instructions for the scoring terminal and athlete interaction terminal; and the priority decision module handles the priority of different events.

[0189] The priority decision module sets rescue events as the highest priority, failures of any important equipment such as the control terminal, referee interaction terminal, and scoring terminal as the second highest priority, violations and out-of-bounds events as the third highest priority, and scoring events and process events as the lowest priority.

[0190] In some embodiments, the rescue signal can be issued by the control terminal recognizing an athlete's abnormal posture, or it can be triggered manually. When the rescue signal is issued, the control terminal directly sends a prompt to medical personnel, issues relevant prompts to the referee, and sends a stop signal to the scoring terminal, which then stops scoring. The video replay segment generation module can generate video replay segments of preset duration before and after the incident, which are sent to a display terminal for medical personnel to view, facilitating their assessment of the athlete's injury and enabling them to provide better medical services.

[0191] In some embodiments, the self-testing steps of the control terminal, athlete interaction terminal, referee interaction terminal, and scoring terminal are as follows: The control terminal monitors the existence of the processes of the first wireless communication module, event analysis module, statistics module, video storage module, video playback segment generation module, adjudication judgment module, and priority decision module to confirm that no abnormal shutdown has occurred in each module. If a module process is not present, it is determined that the module is faulty. The first main control module of the control terminal periodically sends corresponding module test commands to each module. For the event analysis module, it sends an event signal for testing, and determines whether the event analysis module is in normal working condition based on the type of event signal output by the event analysis module. For the statistics module, the first main control module sends a set of simulated voting signals for testing, and determines whether the statistics module is in normal working condition based on the quantity results output by the statistics module. For the video storage module, the first main control module periodically writes a known test data block into the free area of ​​the storage medium, reads and verifies it to check its correctness, and monitors the memory capacity and read / write speed of the video storage module in real time. For the video playback segment generation module, the first... The main control module periodically sends a known timestamp and preset rules for testing, such as 2 seconds before and 2 seconds after the timestamp. The video playback segment generation module extracts the corresponding video and generates the corresponding video playback segment. The first main control module verifies whether the video playback segment is correct. For the priority decision module, a set of virtual event signals for testing is periodically input, such as rescue signals and violation signals. The priority decision module outputs an event queue according to the priority rules, and the first main control module verifies whether the event queue is correct. If any of the above modules fails to output a result or the result is incorrect, or if the memory capacity and read / write speed of the video storage module are less than a preset threshold, the control terminal determines that one of its modules has malfunctioned.

[0192] The control terminal periodically sends test instructions with preset output expectations to the athlete interaction terminal, referee interaction terminal, and scoring terminal; it receives the results output by each terminal, and if it does not receive the result from a terminal or the result does not meet the preset expectations, the control terminal determines that the terminal is malfunctioning.

[0193] If the control terminal determines that any of its modules, the referee interaction terminal, or the scoring terminal has malfunctioned, it generates a fault signal.

[0194] The priority decision module of the control terminal is used to output an event queue in descending order of priority when at least two of the following signals are received simultaneously: rescue signal, fault signal, violation signal, out-of-bounds signal, process signal, and score signal. The control terminal then processes the event queue according to the order of priority: rescue signal, fault signal, violation signal, or out-of-bounds signal, score signal, and process signal.

[0195] In some embodiments, if the first main control module receives a rescue signal, it determines that manual intervention is required, sends a prompt to medical personnel, issues relevant prompts to the referee, and simultaneously sends a replay command to at least one referee interaction terminal. The video replay clips can also be viewed by medical personnel to facilitate analysis of the cause of the injury and provide better medical assistance.

[0196] In some implementations, when the athlete's interactive terminal receives a control command from the control terminal, it displays and / or voice-announces the type of event to inform the athlete of the ruling result, such as a violation by one side, a ball going out of bounds, and a score result, as well as the next procedural operation that the athlete needs to perform, such as changing serve and changing courts.

[0197] In some implementations, the athlete interactive terminal allows athletes to raise objections. The athlete interactive terminal is a touch screen. If an athlete does not agree with the ruling or procedure, they can input an objection command through virtual buttons on the touch screen. The control terminal responds to the objection command and returns to step S500.

[0198] Specifically, the referee interaction terminal in this embodiment includes a separately configured display device and a wearable contact device. The wearable contact device includes a haptic feedback module and a voting input module. The referee interaction terminal is used to display the event to be adjudicated and the corresponding video playback segment, and to provide haptic feedback to the referee to remind the referee.

[0199] When the referee's interactive terminal receives event signals and video playback clips, the display device is used to display the event to be adjudicated and the corresponding video playback clips. The haptic feedback module is used to receive event signals and generate perceptible haptic feedback. The voting input module is used for referees to input their voting results on the event to be adjudicated.

[0200] In some implementations, the number of referee interaction terminals is the same as the number of referees, with each referee equipped with one referee interaction terminal. Each referee interaction terminal also includes a second main control module and a second wireless communication module. The second main control module is connected to the display device, the wearable contact device, and the second wireless communication module. The second main control module receives and parses event signals, outputs corresponding level signals to the wearable contact device, and can also output PWM signals with different duty cycles to the wearable contact device. The wearable contact device outputs a start signal to the voting input module, outputs a vibration signal to the haptic feedback module, and receives voting signals output by the voting input module and performs corresponding operations. The haptic feedback module adjusts its vibration modes according to different level signals or PWM signals. The voting input module collects voting instructions input by the referees and generates corresponding voting signals to send to the second main control module. The second wireless communication module enables wireless communication connections between the display device, the wearable contact device, and the control terminal.

[0201] The second main control module includes a decoding circuit, which is used to analyze the event signal type corresponding to the event signal and the voting signal output by the voting input module, and output the corresponding level signal to the wearable contact module according to different event signals.

[0202] The wearable contact device includes a timing control module, which is connected to the haptic feedback module and the voting input module. The timing control module is used to control the duration of the continuous output of the haptic feedback module when it is started. Specifically, the output duration of the haptic feedback module is set to 3-5 seconds. After the haptic feedback module starts, the sampling window of the voting input module is started after a preset time delay, and the sampling function is automatically turned off after the sampling window expires. The wearable contact device automatically returns to a low-power mode. The sampling window time can be set to 15-20 seconds.

[0203] Optionally, the wearable contact device is a wristband with vibration function, and the wristband has at least two vibration modes with different vibration frequencies. The wristband adjusts its different vibration modes according to different level signals or PWM signals output by its second main control module. For example, a slower vibration frequency is an out-of-bounds signal, and a faster vibration frequency is an out-of-bounds signal, so that the referee can distinguish different event signals as early as possible before voting through the voting input module, so as to prepare in advance.

[0204] In this embodiment, there are at least two camera components, which are used to capture real-time video including information on the athlete's movements, the trajectory of the ball, and the ball's landing point.

[0205] The video storage module of the control terminal is used to receive and store the live video from each camera component in real time. When an event signal is generated, the control terminal obtains the timestamp of the video frame corresponding to the event signal generation. The live video includes multiple video frames, each with a timestamp. If manual intervention is required, the video playback segment generation module extracts the video data corresponding to the time window from the stored video based on the timestamp, creating a video playback segment for the event to be adjudicated. This video playback segment data is then sent to the referee interaction terminal via the first wireless communication module. The video playback segment data consists of multiple video feeds from different perspectives collected by multiple camera components.

[0206] To increase the accuracy of the judgment, the referee interactive terminal can simultaneously play video replay clips corresponding to multiple visual event signals.

[0207] The referee interaction terminal's display device includes a first display module, a second display module, and a switching module. The first display device includes multiple video acquisition modules corresponding to multiple video streams, and multiple video playback modules connected to each video acquisition module. Each video playback module includes a sub-window; the number of sub-windows is the same as the number of camera components.

[0208] The control terminal receives live video from each camera component and sends multiple video streams to the corresponding video acquisition module of the referee interaction terminal. The video acquisition module outputs multiple video streams to the corresponding video playback module, and each video playback module's corresponding sub-window plays multiple live video streams from different perspectives. The switching module receives the user's switching command to play a specific sub-window and sends the switching command to the second display module. The second display module displays the independent playback interface of the corresponding video in the sub-window according to the switching command.

[0209] When a violation or out-of-bounds incident occurs, multiple sub-windows on the referee's interactive terminal play multiple video replay clips. Referees can clearly see the video a few seconds before and after the violation or out-of-bounds incident, or they can choose to zoom in on a single sub-window for a more detailed view, thereby making an accurate judgment and voting within the voting collection window.

[0210] The judge's interactive terminal includes at least three physical or virtual buttons, such as three physical buttons on a wearable contact device or three virtual buttons on a display device. These buttons are used to input commands for approval, disapproval, and extension of deliberation time, respectively. Voting commands include approval, disapproval, and extension of deliberation time commands. The voting input module collects the voting commands input by the judges and generates corresponding voting signals for the second main control module. The second main control module then wirelessly transmits the voting signals to the control terminal.

[0211] The control terminal receives voting signals and analyzes the type of the current voting signals through its first main control module. The types of voting signals include approval signals, disapproval signals, and signals to extend the deliberation time. The statistics module is used to count the number of approval signals, disapproval signals, signals to extend the deliberation time, and the total number of voting signals. The results are sent to the decision-making module of the control terminal for judgment.

[0212] In summary, the intelligent referee feedback method and system provided in this application have the following advantages: 1. This application combines AI-powered intelligent referees and human referees. Under normal circumstances, the default working mode is human-machine collaboration: when the confidence level of the AI-powered intelligent referee in identifying an event reaches or exceeds a preset first threshold (such as 90%), the system automatically makes a ruling and executes subsequent operations. In this mode, AI undertakes most of the ruling work, which can significantly alleviate the continuous focus pressure and workload of human referees. When the confidence level is lower than the first threshold but higher than the second threshold (such as 55%), human rulings are made through the referee interaction terminal to ensure the accuracy of rulings in complex or ambiguous scenarios.

[0213] This application can be applied to training matches, low-level competitions, or application scenarios with a high tolerance for refereeing errors, such as amateur competitions. The working mode can be fully automatic, that is, it can automatically adjudicate and control the process based solely on the recognition results of AI referees and preset thresholds (such as 55%), without the need to configure a referee interaction terminal, so that the competition can continue.

[0214] Through the two working modes mentioned above, a complete automated closed loop is formed in the peakball event, from event recognition, adjudication, scoring to the progress of the game. It completes automated and continuous rulings for each round, from serving to scoring and changing possession, which greatly reduces the interruption and delay caused by human judgment, communication and operation, and ensures the compactness and continuity of the game.

[0215] 2. This application sets up an athlete interactive terminal, which informs athletes of the results and process of adjudication events through display and broadcast. It can remind athletes to change sides and change serving rights, and inform athletes which side scored and which side went out of bounds. If athletes have any objections, they can also raise objections through the athlete interactive terminal. At this time, the control terminal can directly enter step S500, which greatly improves the efficiency of the event.

[0216] 3. This application can promptly remind referees to watch the referee interactive terminal through tactile feedback, and different tactile feedbacks represent different signals, so that referees can know in advance what they need to focus on when watching the referee interactive terminal, thereby improving the overall efficiency of manual adjudication.

[0217] 4. The central processing module of this application has a self-testing step and checks whether the referee interaction terminal, referee interaction terminal and scoring terminal connected to it are in normal working condition. It can locate the fault in time and stop the game in time when a fault occurs, so as to eliminate the impact of the fault on the fairness and security of the event.

[0218] 5. Based on the different needs of referees in various competitions, this application designs a reasonable method for allocating multiple referee interaction terminals. In particular, for multiple matches where a small number of referees are serving simultaneously, the reasonable allocation of various events ensures the accuracy of the match decisions. New tasks are prioritized for referees with less free time, improving referee processing efficiency. Furthermore, specific types of violations are prioritized for referees who have historically made the most accurate judgments on such events, thereby improving the accuracy of individual decisions.

[0219] 6. This application designs a corresponding ruling method for multiple judges adjudicating the same event. First, it responds to the highest priority request for extended deliberation, giving the judges on site an opportunity for collective deliberation and ensuring the accuracy of the ruling. Second, it provides a revote opportunity for individual terminals that did not vote, saving power. Finally, it counts whether the number of "yes" and "no" signals are the same, because if there are collective deliberation signals and some judges did not vote, then evaluating the existing number of "yes" and "no" signals is invalid. Through the design of this application, the efficiency of judge deliberation can be improved, and while ensuring the accuracy of the ruling, the system can achieve the fastest response speed and save energy.

[0220] 7. This application calculates the confidence level of the final ruling. This can solve the problem of inconsistent judicial opinions and difficulty in changing the original decision, and avoid excessive time spent on deliberation.

[0221] refer to Figure 3 , Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. For example... Figure 3 As shown, the electronic device 400 includes: one or more processors 410 and a memory 420. Figure 3 Take a processor 410 as an example.

[0222] In some implementations, the processor 410 and the memory 420 may be connected via a bus or other means. Figure 3 Taking the example of a connection between China and Israel via a bus.

[0223] In some implementations, the processor 410 acquires a ruling event and its corresponding confidence level, the ruling event including at least one of scoring, violation, and out-of-bounds; if the confidence level of the ruling event is greater than or equal to a first threshold, a corresponding event signal is generated based on the type of the ruling event; based on the game number information and scoring information of the scoring terminal, it determines whether a process event has occurred, the process event including at least one of changing sides and changing the right to serve, and generates a corresponding process signal based on the type of the process event; A first control command is generated based on the event signal and sent to the scoring terminal. The scoring terminal performs the corresponding scoring operation. A second control command is generated based on the event signal and / or the process signal and sent to the athlete interaction terminal. The athlete interaction terminal displays and / or broadcasts the type of event via voice.

[0224] In some embodiments, memory 420 serves as a non-volatile computer-readable storage medium, used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules of the intelligent referee feedback method in the embodiments of this application. Processor 410 executes various functional applications and data processing of electronic device 400 by running the non-volatile software programs, instructions, and modules stored in memory 420, thereby implementing the intelligent referee feedback method of the above-described method embodiments.

[0225] In some embodiments, memory 420 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of electronic device 400, etc. Furthermore, memory 420 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 420 may optionally include memory remotely located relative to processor 410, and this remote memory may be connected to the controller via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0226] In some implementations, one or more modules are stored in memory 420 and, when executed by one or more processors 410, perform the intelligent referee feedback method in any of the above method embodiments, for example, performing the method described above. Figure 1 The method steps S100 to S800.

[0227] Please refer to Figure 4 , Figure 4 This is a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. The computer-readable storage medium 500 stores program code 510, which can be called by a processor to execute the intelligent referee feedback method described in the above method embodiments.

[0228] The computer-readable storage medium 500 may be an electronic storage device such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium includes non-volatile computer-readable media. transitory computer The computer-readable storage medium 500 has storage space for program code that performs any of the method steps of the intelligent referee feedback method described above. This program code can be read from or written to one or more computer program products. The program code can be compressed, for example, in a suitable form.

[0229] In summary, this application provides an intelligent referee feedback method and system, which obtains adjudication events and their corresponding confidence levels. The adjudication events include at least one of scoring, violation, and out-of-bounds. If the confidence level of the adjudication event is greater than or equal to a first threshold, a corresponding event signal is generated based on the type of the adjudication event. Based on the game number and scoring information from the scoring terminal, it is determined whether a process event has occurred. The process event includes at least one of the following: changing ends or changing serve. A corresponding process signal is generated based on the type of the process event. A first control command is generated and sent to the scoring terminal based on the event signal. The scoring terminal then executes the corresponding scoring operation. A second control command is generated and sent to the athlete interaction terminal based on the event signal and / or the process signal. The athlete interaction terminal displays and / or announces the type of event via voice. This application can significantly improve match efficiency and allows a small number of referees to officiate multiple picket matches, solving the current problem of a shortage of professional referees and the difficulty in organizing large-scale picket matches.

[0230] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. An intelligent referee feedback method, characterized in that, Applied to a system including a control terminal, an athlete interaction terminal, and a scoring terminal, the intelligent referee feedback method is executed by the control terminal, and the intelligent referee feedback method includes: Obtain the adjudication event and its corresponding confidence level. The adjudication event includes at least one of the following: score, violation, and out of bounds. If the confidence level of the adjudication event is greater than or equal to a first threshold, generate a corresponding event signal based on the type of the adjudication event. Based on the game number information and scoring information of the scoring terminal, it is determined whether a process event has occurred. The process event includes at least one of the following: changing the court, changing the serve, timeout, and service timing instruction. A corresponding process signal is generated based on the type of the process event. A first control instruction is generated based on the event signal and sent to the scoring terminal, and the scoring terminal performs the corresponding scoring operation. A second control instruction is generated based on the event signal and / or the process signal and sent to the athlete interaction terminal, and the athlete interaction terminal displays and / or announces the type of the event via voice. The system also includes a referee interaction terminal, and the intelligent referee feedback method further includes: Get live videos of pickleball games; If the confidence level of the adjudication event is greater than or equal to the second threshold but less than the first threshold, it is determined that manual intervention is required, and a corresponding event signal is generated. The video replay segment corresponding to the adjudication event is extracted from the live video, and at least one of the referee interaction terminals is determined to send the event signal and the video replay segment, so as to control the referee interaction terminal to display the event to be adjudicated and the video replay segment corresponding to the adjudication event; Receive voting instructions from the referee interaction terminal; The system makes a decision based on the voting instructions and generates a third control instruction which is sent to the scoring terminal to execute the corresponding scoring operation. It also generates a fourth control instruction which is sent to the athlete interaction terminal, which displays and / or broadcasts the type of event via voice.

2. The intelligent referee feedback method according to claim 1, characterized in that, The intelligent referee feedback method also includes: The control terminal responds to at least one of the pause and serve timing commands; If the pause command is received, the scoring terminal is controlled to stop scoring according to the pause command; If the serve timing command is received, the athlete's interactive terminal is controlled to display a serve countdown screen according to the serve timing command.

3. The intelligent referee feedback method according to claim 1, characterized in that, Obtain the adjudication event and its corresponding confidence level, wherein the adjudication event includes at least one of scoring, violation, and out-of-bounds, including: Get live videos of pickleball games; Based on the live video, analyze whether the ball enters the valid area and triggers a score, whether the athlete's behavior violates the rules of the game, or whether the ball exceeds the valid boundary of the game. If so, determine that the ruling event has occurred and generate the confidence level corresponding to the ruling event.

4. An intelligent referee feedback system, characterized in that, include: Control terminal and connected athlete interaction terminal, scoring terminal and referee interaction terminal; The control terminal is used to acquire adjudication events and their corresponding confidence levels in real time; the adjudication events include at least one of scoring, violation, and going out of bounds; if the confidence level of the adjudication event is greater than or equal to a first threshold, a corresponding event signal is generated based on the type of the adjudication event; Based on the game number information and scoring information of the scoring terminal, it is determined whether a process event has occurred. The process event includes at least one of the following: changing courts, changing serve, timeout, and serve timing instruction. A corresponding process signal is generated based on the type of the process event. A first control instruction is generated to the scoring terminal based on the event signal, and a second control instruction is generated to the athlete interaction terminal based on the event signal and / or the process signal. The control terminal also acquires live video of the pickle game; when the confidence level of the adjudication event is greater than or equal to a second threshold but less than a first threshold, the control terminal determines that manual intervention is required and generates a corresponding event signal; it extracts a video playback segment corresponding to the adjudication event from the live video, and determines that at least one of the referee interaction terminals sends the event signal and the video playback segment; it receives voting instructions from the referee interaction terminal; it makes an adjudication judgment based on the voting instructions, and generates a third control instruction to send to the scoring terminal; And generate a fourth control command and send it to the athlete's interactive terminal; The referee interaction terminal is used to display the event to be adjudicated and the corresponding video replay clips of the event to be adjudicated. The athlete interactive terminal is used to display and / or voice announce the type of event; The scoring terminal is used to perform the corresponding scoring operations.

5. The intelligent referee feedback system according to claim 4, characterized in that, The referee interaction terminal includes a separately configured display device and a wearable contact device, wherein the wearable contact device includes a haptic feedback module and a voting input module; When the referee interaction terminal receives the event signal and the video playback segment, the display device is used to display the event to be adjudicated and the corresponding video playback segment; the haptic feedback module is used to receive the event signal and generate perceptible haptic feedback; the voting input module is used for the referee to input the voting result for the event to be adjudicated.

6. The intelligent referee feedback system according to claim 5, characterized in that, The tactile feedback module includes multiple vibration modes, each corresponding to a different event signal. While generating perceptible tactile feedback, the tactile feedback module outputs a start signal to the voting input module, which then enters a responsive state and starts a voting window of a preset duration. After the voting window expires, the module automatically returns to a low-power mode.

7. The intelligent referee feedback system according to claim 4, characterized in that, The control terminal acquires and stores live video of the pickle's movement; The control terminal acquires the timestamp corresponding to the generation of the event signal; If it is determined that manual intervention is required, then based on the timestamp, the video data corresponding to the time window in the stored live video is extracted as the corresponding video playback segment for the event requiring adjudication. The video playback segment corresponding to the event requiring adjudication is sent to the corresponding referee interaction terminal.

8. The intelligent referee feedback system according to claim 4, characterized in that, The intelligent referee feedback system is connected to multiple camera components, each of which is placed in a different position on the field to collect multiple live videos from different perspectives. The referee interaction terminal includes a first display module, a second display module, and a switching module. The first display module includes multiple video acquisition modules corresponding to the multiple videos, and multiple video playback modules connected to each of the video acquisition modules. Each of the multiple video playback modules includes a sub-window. The control terminal receives the live video from each of the camera components and sends the multiple videos to the corresponding video acquisition modules of the referee interaction terminal. The video acquisition module outputs multiple video streams to the corresponding video playback modules, and each video playback module's corresponding sub-window plays multiple live videos from different perspectives. The switching module is used to receive a user's switching instruction for playing a specific sub-window and send the switching instruction to the second display module; The second display module is used to display the independent playback interface of the corresponding video in the corresponding sub-window according to the switching instruction.

Images