Control method of AI-based unmanned table tennis match progress system
Patent Information
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- IND ACADEMIC COOPERATION FOUND HONAM UNIV
- Filing Date
- 2024-02-05
- Publication Date
- 2026-08-03
Smart Images
Figure 112024014080519-PAT00004_ABST
Abstract
Description
Technology Field
[0001] The present invention relates to a control method for an AI-based unmanned table tennis match management system, and more specifically, to a control method for an AI-based unmanned table tennis match management system that not only enables fair and accurate table tennis matches to be conducted without a referee, but also relieves the burden of having to act as a referee when ordinary people play table tennis, allowing everyone to enjoy the game. Background Technology
[0002] Table tennis is generally one of the most popular recreational sports, serving as a simple pastime and sport that can be enjoyed with just a small space, a racket, and a ball. A large number of table tennis enthusiasts in Korea enjoy the sport at their homes, workplaces, and through private and public sports clubs, and the current number of table tennis members in Korea is estimated at approximately 5.7 million.
[0003] To enjoy table tennis, one must acquire basic skills, engage in rallies, and play matches. Table tennis matches are typically played by two or four people in singles or doubles, and a referee is required to ensure fair play.
[0004] However, when ordinary people play a table tennis match, if one person acts as the referee, that person cannot enjoy the match, so the game is usually played without a referee. In such cases, disputes over scores often occur because there is no referee.
[0005] Accordingly, a table tennis match management system capable of conducting unmanned matches without a human referee has been patented.
[0006] An example of such a table tennis match progression system is well illustrated in Korean Patent Registration No. 1579755 (hereinafter referred to as the 'prior art').
[0007] The conventional table tennis match progression system of the aforementioned prior art is configured to receive impact detection signals with the table tennis ball from impact detection sensors installed in each section of the table and on the racket, and to calculate and display the score of the table tennis match according to the input pattern of the received detection signals.
[0008] However, the prior art disclosed in the aforementioned prior art relies solely on impact detection sensors installed on the table tennis rackets of both players and on the table, and determines whether a point has been scored entirely based on impact detection signals transmitted from said sensors. In this case, judgment errors occurred during the game because incorrect impact detection signals were transmitted or impact detection signals were not transmitted at all due to minor vibrations in many instances, such as when a player bounces the ball on their racket as a preparatory action before serving, when the ball gets caught in the net during a serve and fails to cross over, or when the ball is an edge ball that lightly hits the corner of the table. Accordingly, the aforementioned conventional table tennis game progression system ultimately had the problem of failing to properly determine whether a point had been scored. Prior art literature
[0009] Korean Patent Registration No. 1579755 (Registered Dec. 17, 2015) The problem to be solved
[0010] Accordingly, the present invention has been devised to resolve the aforementioned problems and aims to provide a control method for an AI-based unmanned table tennis match management system that not only enables fair and accurate table tennis matches to proceed without a referee, but also relieves the burden of having to referee when ordinary people play table tennis, allowing everyone to enjoy the game. means of solving the problem
[0011] According to one embodiment, the present invention for achieving the above-mentioned purpose comprises: a table tennis table (10) having a first zone (11) and a second zone (12) partitioned around a net (20); a first sensing sensor (110) installed in the first zone (11) to detect an impact applied to the first zone (11); a second sensing sensor (120) installed in the second zone (12) of the table tennis table (10) to detect an impact applied to the second zone (12); a net sensor (130) installed on the net (20) to detect an impact applied to the net; and a motion sensing unit (140) installed above the table tennis table (10) to recognize and read the motions of both players participating in a table tennis match. A control method for an AI-based unmanned table tennis match progress system comprising: a control unit (150) installed on one side of the table tennis table (10) and receiving a motion detection signal transmitted from the motion detection unit (140) and an impact detection signal transmitted from the first, second, and net sensors (110)(120)(130), and determining whether both players have scored through this; and a scoreboard unit (160) installed on one side of the table tennis table (10) and visually displaying the scores of both players according to the judgment result of the control unit (150); wherein (S110) a step of reading the motion detection signal transmitted from the motion detection unit (140) to first determine whether the players have taken a motion according to the preset rules of the table tennis match; and (S120) a step of finally determining whether a point is scored by reading the impact detection signal transmitted from the first, second, and net sensors (110)(120)(130) and making a second determination of whether the table tennis ball actually contacted the first zone (11), second zone (12) or net (20) of the table tennis table according to the rules of the table tennis game; is included.
[0012] Additionally, according to one embodiment, prior to step S110, (S100) the motion detection unit further includes the step of capturing face images of players participating in a table tennis match and generating the captured face images as the ID (identification) of the corresponding player.
[0013] Additionally, according to one embodiment, after step S120, (S130) the control unit further includes the step of storing the scores of both players displayed on the scoreboard for each player's ID (identification) when the table tennis match ends.
[0014] In addition, according to one embodiment, the motion detection unit is a camera installed above the table tennis table, and the camera captures images of the table tennis table and both players in real time.
[0015] In addition, according to one embodiment, the first determination process in step S110 is characterized by automatically determining the score or subnet of both players by using an AI model that has been trained on the score and subnet video data of both players using a deep learning-based Convolutional Neural Network (CNN) technique.
[0016] In addition, according to one embodiment, the motion detection unit further includes a thermal imaging camera, wherein the thermal imaging camera is used to capture images of the exercise movements of players participating in a table tennis match, and the control unit measures the physical load for each table tennis posture through heatmap analysis of the captured images of the players' exercise movements and stores the results according to the identification of the corresponding player. Effects of the invention
[0017] The control method of the AI-based unmanned table tennis match progress system of the present invention, as described above, has the effect of enabling fair and accurate progress of a table tennis match without the need for a human referee who manually turns the scoreboard, as in the conventional method.
[0018] In addition, in terms of promoting recreational sports, it has the effect of relieving the burden of having to referee matches for the general public, allowing everyone to enjoy the game.
[0019] Furthermore, if the world's first digital unmanned scoreboard is developed and exported based on this invention, it can elevate the status of Digital Korea and significantly contribute to increasing the sales of domestic companies by exporting the system overseas. Brief explanation of the drawing
[0020] FIG. 1 is a configuration diagram of an AI-based unmanned table tennis match progress system according to the present invention. FIG. 2 is a plan view of FIG. 1 FIG. 3 is a block diagram of a scoreboard section according to the present invention. FIG. 4 is a flowchart showing a control method of the AI-based unmanned table tennis game progress system of the present invention according to one embodiment. Specific details for implementing the invention
[0021] The terms used herein are used merely to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as “comprising,” “having,” or “having” are intended to indicate the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described herein, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.
[0022] Unless otherwise defined in this specification, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains.
[0023] Terms such as those defined in commonly used dictionaries should be interpreted as having meanings consistent with their meanings in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this specification.
[0024] Hereinafter, the configuration and operational relationship of an AI-based unmanned table tennis match progress system according to an embodiment of the present invention will be examined in detail with reference to the attached drawings.
[0025] FIG. 1 is a configuration diagram of an AI-based unmanned table tennis game progress system according to the present invention, FIG. 2 is a plan view of FIG. 1, and FIG. 3 is a block configuration diagram of a scoreboard section according to the present invention.
[0026] First, referring to FIGS. 1 to 3 above, the AI-based unmanned table tennis game progress system according to the present invention is equipped with a table tennis table (10) divided into a first zone (11) and a second zone (12) centered around a net (20) in the center.
[0027] In addition, a first detection sensor (110) is provided, which is installed in the first zone (11) of the table tennis table (10) and detects an impact applied to the first zone (11).
[0028] In addition, a second detection sensor (120) is provided, which is installed in the second zone (12) of the table tennis table (10) and detects an impact applied to the second zone (12).
[0029] In addition, a net sensor (130) is provided that is installed on the net (20) to detect impact applied to the net.
[0030] According to one embodiment, the first sensing sensor (110), the second sensing sensor (120), and the net sensor (130) can detect edge balls and net balls that occur during a game, and for this purpose, they may be attached to the center of the bottom surface of the table tennis table and to one side of the net. Among these, the net sensor (130) is attached to the net to detect such net balls, as the score is invalidated and the serve is performed again when the table tennis ball touches the net (20) during a serve.
[0031] According to one embodiment, the sensors (110, 120, 130) may be designed to convert noise into a recognizable signal by applying a piezo sensor to filter and amplify the noise. The sensors (110, 120, 130) recognize an impact detection signal (vibration signal) that is in contact with a table tennis ball and transmit the impact detection signal to a control unit (150) described later via wired or wireless communication. In addition, at least one or more of the first detection sensor (110), the second detection sensor (120), and the net sensor (130) may be installed to improve the sensitivity of the sensors, and it is preferable that the installation location of these sensors be a location that can maximize the sensitivity of the sensors.
[0032] Additionally, a motion detection unit (140) is provided, which is installed above the table tennis table (10) to recognize and detect the motions of both players participating in the table tennis match. According to one embodiment, the motion detection unit (140) may be a camera installed above the table tennis table (10), and the camera generates a motion detection signal (video signal) by capturing images of the table tennis table (10) and both players in real time.
[0033] In addition, a control unit (150) is provided that is installed on one side of the table tennis table (10) and receives a motion detection signal transmitted from the motion detection unit (140) and an impact detection signal transmitted from the first, second, and net sensors (110)(120)(130), and determines whether both players score through this.
[0034] In addition, a scoreboard unit (160) is provided on one side of the table tennis table (10) to visually display the scores of both players according to the judgment result of the control unit (150).
[0035] That is, the control unit (150) receives an impact detection signal transmitted from the sensors (110, 120, 130) during a singles match, determines whether both players have scored, displays the scores of both players on the scoreboard unit (160) according to the determined result, and the scoreboard unit (160) can also visually display information such as the displayed score and output the information as voice.
[0036] According to one embodiment, the control unit (150) may be installed inside the scoreboard unit (160).
[0037] The scoreboard unit (160) serves to convey scores and match status to both players and spectators during a table tennis match. According to one embodiment, the scoreboard unit (160) may use an electronic scoreboard. The electronic scoreboard has excellent readability and displays scores by detecting the net, edge, etc., allowing for accurate match management. In particular, since a separate referee is not required in amateur matches, players can focus on the game and enhance the exercise effect.
[0039] The following are examples of pre-set table tennis rules, a scoring judgment algorithm of the control unit, and the main functions of the scoreboard unit, assuming a table tennis match is played using the AI-based unmanned table tennis match progress system of the present invention.
[0040] Pre-established table tennis rules
[0041] - Matches can be played in sets of 3, 5, or 7, with 5 sets being the standard.
[0042] - Set 1 is completed when the score reaches 11 points, and becomes juice when the score reaches 10:10.
[0043] - The right to serve is given alternately, and when the right to serve is given, each player takes turns serving twice.
[0044] - If the score reaches deuce, the players take turns serving one at a time; the match ends when the difference reaches two points.
[0046] Scoring algorithm of the control unit
[0047] - Three vibration sensors were installed: one at the bottom center of the left end of the table, one at the bottom center of the right end, and one at the center of the net referee's end.
[0048] - If no vibration is detected on the serving side after serving, a point is lost.
[0049] - After serving, if vibrations are detected alternately on both sides and no vibration is detected on the opponent's side, a point is lost.
[0050] - After serving, if vibrations are detected alternately and no vibration is detected on the serve side, a point is scored.
[0051] - Immediately after serving, if vibration is detected on the serve side and then on the net, a re-serve is performed.
[0052] The starting serve changes after the first set ends.
[0054] Main functions of the scoreboard section
[0055] - Display both sides' scores
[0056] - Displays serve and serve change (reflects deuce status)
[0057] - Provides the sub-net
[0058] - Displays set score
[0060] Meanwhile, the scoreboard unit (160) of the present invention receives impact detection signals from each sensor (110, 120, 130) installed on the table tennis table (10) and performs the function of displaying and voice notifying the progress of the game, such as the scoring situation of each player performing the table tennis game, the change of serve right, or the deuce situation.
[0061] Referring to FIG. 3, the control unit (150) and scoreboard unit (160) of the present invention may be manufactured as dedicated hardware devices as follows, and a general-purpose smart device such as a smartphone or tablet PC, which can execute an application program that performs the functions of each of the following components, may be connected to the control unit (150) and scoreboard unit (160).
[0062] For example, the control unit (150) may be formed in the form of a MICOM board on which a conventional microprocessor unit (MCU) and its peripheral circuits are mounted. Additionally, the scoreboard unit (160) may be composed of a sensor input unit (161), a display unit (162), a voice output unit (163), a communication unit (164), a power supply unit (165), and a storage unit (166).
[0063] In addition, the control unit (150) receives a motion detection signal (video signal) transmitted from the motion detection unit (140) of the system for the aforementioned single match and an impact detection signal transmitted from each sensor (110, 120, 130), determines whether each player has scored, and calculates the score of each player based on the determined result and displays it on the scoreboard unit (160).
[0064] According to one embodiment, the control unit (150) reads the motion detection signal transmitted from the motion detection unit (140) to first determine whether the players have taken motions according to the preset rules of the table tennis game, and reads the impact detection signal transmitted from the first, second, and net sensors (110)(120)(130) to secondly determine whether the table tennis ball has actually come into contact with the first zone (11), second zone (12) or net (20) of the table tennis table according to the preset rules of the table tennis game, thereby finally determining whether a point has been scored. That is, according to one embodiment, the control unit (150) applies the preset rules of the table tennis game described above to apply and display the players' point loss / score situation on the scoreboard unit (160).
[0065] According to one embodiment, a Vision AI (artificial intelligence) application may be installed in the control unit (150) to read the motion detection signal transmitted from the motion detection unit (140) and to make a preliminary determination of whether the players have taken motions according to the preset rules of the table tennis match. Accordingly, the control unit activates the installed Vision AI application to perform video analysis and observes motions related to the players' match (serve, hit) and the movement trajectory of the table tennis ball in real time to make a preliminary determination of whether normal play (serve, hit) has been performed.
[0066] For example, the first decision process of image analysis using the above Vision AI can be performed by a deep learning-based Convolutional Neural Network (CNN) technique.
[0067] That is, the above first judgment process automatically determines the score or subnet of both players by using an AI (artificial intelligence) model that has been trained on the score and subnet video data of both players using deep learning-based convolutional neural network (CNN) techniques.
[0068] More specifically, the CNN technique described above first learns the 'features' of an image in the first step, and then 'classifies' the image based on the learned features in the second step. In the first step, image features are output using Convolution and Activation Functions, and a process called Pooling is performed during this process. This is the final step in extracting features and serves to reduce the size of the Activation Map or emphasize specific parts. Image features are extracted by continuously repeating this process, and in the second step, a Flatten operation is performed to flatten the 2D matrix generated in the first step into a single column so that it can be applied to the Neural Network, and then the final classification of the image is performed using the Softmax function after passing through a fully connected network.
[0069] Subsequently, if the motion detection signal (video signal) using the Vision AI application is initially determined to be normal play as a result of the above first judgment, the control unit proceeds to a second judgment. To explain the second judgment process, the control unit (150) reads the impact detection signals transmitted from the first, second, and net sensors (110)(120)(130) and makes a second judgment on whether the table tennis ball has actually come into contact with the first zone (11), second zone (12) or net (20) of the table tennis table (10) according to the preset rules of the table tennis game, thereby making a final determination of whether a point has been scored.
[0070] At this time, the scoreboard unit (160) includes a sensor input unit (161) to integrally collect shock detection signals generated by sensors and transmit them to the control unit (150).
[0071] The sensor input unit (161) receives an impact detection signal generated by the sensors (110, 120, 130) used in the system of the present invention for single or double matches, and can amplify the current or voltage of the impact detection signal or additionally perform analog-to-digital conversion (AD converter) for signal processing.
[0072] In addition, an impact detection signal is transmitted between the sensor input unit (161) and the sensors (110, 120, 130), and the transmission of the impact detection signal can be carried out through a known wired communication method or a wireless communication method.
[0073] For example, the above communication method is preferably a wireless communication method rather than a wired communication method so as not to congest the area around the table tennis table (10), and such wireless communication methods may include wireless internet (WiFi), Bluetooth, or RFID.
[0074] In addition, the display unit (162) displays, in addition to the score display of each player, the server performing the serve, the cumulative score change status for each player, and circular or square characters or colors for distinguishing each player.
[0075] In addition, the voice output unit (163) outputs the scores of each player calculated by the control unit (150), announcements regarding the start and end of the game, announcements regarding changes in the right to serve, and whether each player has scored, etc., as voice.
[0076] In addition, the communication unit (164) communicates with the motion detection unit (140) via wired or wireless means, receives a motion detection signal (video signal) transmitted from the motion detection unit (e.g., camera), and transmits it to the control unit (150).
[0077] In addition, the power supply unit (165) applies driving power to the scoreboard unit (160) of the present invention.
[0078] Additionally, the storage unit (166) can store and manage current score information for each player in the current table tennis match, situation information for each set, or past game record information of the player based on the score information of each player.
[0079] FIG. 4 is a flowchart showing a control method of an AI-based unmanned table tennis game progress system according to one embodiment of the present invention, and the present invention can be carried out in the following steps.
[0080] Step (S100): The motion detection unit (140) captures the face images of players participating in a table tennis match and generates the captured face images as the ID (identification) of the corresponding player.
[0081] As described above, the motion detection unit (140) is a camera installed above the table tennis table (10), and the camera captures images of the table tennis table (10) and both players in real time.
[0082] Accordingly, players using the AI-based unmanned table tennis match progress system according to the present invention can easily register their face image as a face ID using the camera of the motion detection unit (140) without a separate registration process. Subsequently, when the AI-based unmanned table tennis match progress system of the present invention is used again, the control unit (150) automatically recognizes the face and attempts to automatically log in to the corresponding player's ID.
[0083] Step (S110): The motion detection signal transmitted from the motion detection unit (140) is read to determine whether the players have taken motions according to the preset rules of the table tennis match.
[0084] According to one embodiment, the first determination process in step S110 automatically determines the score or subnet of both players by using an AI model that has been trained on the score and subnet video data of both players using a deep learning-based convolutional neural network (CNN) technique.
[0085] Step (S120): The impact detection signal transmitted from the first, second, and net sensors (110)(120)(130) is read to determine whether the table tennis ball actually contacts the first zone (11), second zone (12) or net (20) of the table tennis table (10) according to the rules of the table tennis game, thereby making a final determination of whether a point is scored.
[0086] Step (S130): When the table tennis match ends, the control unit (150) stores the scores of both players displayed on the scoreboard unit (160) according to the corresponding player's ID (identification).
[0087] Meanwhile, according to one embodiment, the motion detection unit (140) further includes a thermal imaging camera (not shown). Accordingly, the thermal imaging camera is used to capture images of the exercise movements of players participating in a table tennis match, and the control unit (150) measures the physical load for each table tennis posture through heatmap analysis of the captured images of the players' exercise movements and then stores them according to the ID (identification) of the corresponding player.
[0088] For example, through the thermal image acquired by the thermal imaging camera, a confidence map is generated for each RGB image and the thermal image, respectively, by using an Open Pose API to display each point estimated as a joint location as a heatmap, and the joint location information of the corresponding player can be obtained according to the confidence map.
[0089] For reference, the heatmap mentioned above is a visualization technique widely used in data analysis, which generally represents dataset values using colors to make them easy to understand visually. The heatmap can visualize data in the form of a two-dimensional array and displays each value by assigning a color to it.
[0090] Furthermore, the control unit (150) trains an artificial intelligence neural network based on continuous motions included in the target image, and inputs the player's joint position information and body stimulation area into the trained neural network to extract the players' body stimulation area for each table tennis posture in real time.
[0091] Accordingly, the control unit (150) can extract the player's joint position information and body stimulation area through heatmap analysis of the thermal image, input this into a learned neural network to compare and analyze the correct table tennis posture and the body stimulation area, thereby determining whether the player is taking an incorrect table tennis posture or measuring the degree of physical load for each table tennis posture, and then provide feedback to the player.
[0092] Accordingly, the present invention improves upon conventional manual scoreboards in which a referee manually turns the scoreboard, and the AI-based unmanned table tennis match progression system of the present invention automatically detects and determines the players' motions and the impact detection signals (vibrations) of the table tennis ball to display the score, thereby providing the advantage of enabling fair and accurate match progression without a referee.
[0093] In addition, ordinary people can enjoy playing table tennis without the burden of having to act as a referee.
[0094] Furthermore, developing and exporting the world's first digital unmanned scoreboard can elevate the status of Digital Korea and contribute to increased corporate revenue by exporting the system overseas.
[0096] Furthermore, the present invention is not limited solely to the embodiment described above. Since the same effect can be achieved even when changing the detailed configuration, number, or arrangement structure of the device, it is hereby specified that those skilled in the art can add, delete, or modify various configurations within the scope of the technical concept of the present invention. Explanation of the symbols
[0097] 10, 11, 12: Table tennis table, Zone 1, Zone 2 110, 120: First detection sensor, second detection sensor 130 : Net sensor 140 : Motion detection unit 150 : Control unit 160 : Scoreboard Section
Claims
Claim 1 A table tennis table (10) having a first zone (11) and a second zone (12) partitioned around a net (20); a first detection sensor (110) installed in the first zone (11) to detect an impact applied to the first zone (11); a second detection sensor (120) installed in the second zone (12) of the table tennis table (10) to detect an impact applied to the second zone (12); a net sensor (130) installed on the net (20) to detect an impact applied to the net; and a motion detection unit (140) installed above the table tennis table (10) to recognize and read the motions of both players participating in a table tennis match. A control method for an AI-based unmanned table tennis match progress system comprising: a control unit (150) installed on one side of the table tennis table (10) and receiving a motion detection signal transmitted from the motion detection unit (140) and an impact detection signal transmitted from the first, second, and net sensors (110)(120)(130), and determining whether both players have scored through this; and a scoreboard unit (160) installed on one side of the table tennis table (10) and visually displaying the scores of both players according to the judgment result of the control unit (150); wherein (S100) the motion detection unit captures face images of players participating in the table tennis match and generates the captured face images as the ID (identification) of the corresponding player; (S110) the control unit reads the motion detection signal transmitted from the motion detection unit (140) and first determines whether the players have taken motions according to the preset rules of the table tennis match; and (S120) the control unit reads the impact detection signals transmitted from the first, second and net sensors (110)(120)(130) and, according to the preset rules of the table tennis game, the table tennis ball is in the first zone (11) of the table tennis table,A step of finally determining whether a point is scored by making a second determination of whether contact was actually made with the second zone (12) or the net (20) (S130); and a step in which, when the table tennis match ends, the control unit stores the scores of both players displayed on the scoreboard according to the corresponding player's ID (identification); wherein the first detection sensor (110), the second detection sensor (120), and the net sensor (130) apply a piezo sensor to filter and amplify noise to convert it into a recognizable impact detection signal, and then transmit the impact detection signal to the control unit (150) via wired or wireless communication; the motion detection unit is a camera installed above the table tennis table, and the camera captures images of the table tennis table and both players in real time; and the control unit, if one player serves and no vibration (impact detection signal) is detected from the side that served, treats the player who served as the loser of the point, and if, after one player serves and vibrations are detected alternately, vibrations from the opposing side are not detected The player who served is treated as having lost a point, and if vibration is not detected on the serving side while vibration is detected alternately after one side's player serves, the player who served is treated as having scored a point, and if a net ball (a table tennis ball touching the net (20)) is detected by the net sensor (130) immediately after one side's player serves, a re-serve is guided, and the first judgment process in step S110 above automatically determines the score or sub-net of both players by using an AI model that has been trained on the score and sub-net video data of both players using a deep learning-based Convolutional Neural Network (CNN) technique, wherein the CNN technique learns the 'features' of an image in the first step, and then 'classifies' the image based on the learned features in the second step, and in the first step, outputs the features of the image using Convolution and Activation Function.A control method for an AI-based unmanned table tennis match progress system, characterized in that, in this process, image features are extracted by continuously repeating a pooling operation, and in the second step, a flatten operation is performed to flatten the 2D matrix generated in the first step into a single column so that it can be applied to a Neural Network, and then the final classification of the image is performed using a Softmax function after passing through a fully connected network, wherein the motion detection unit further includes a thermal imaging camera and captures video of the movement of players participating in a table tennis match using the thermal imaging camera, and the control unit measures the physical load for each table tennis posture through heatmap analysis of the captured video of the players' movement and stores it according to the ID (identification) of the corresponding player. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete Claim 6 delete