Information processing methods, computer programs, and information processing devices.

Abstract

The present invention provides an information processing method, a computer program, and an information processing device that are expected to facilitate the recording of information related to sports matches and to allow the recorded information to be used for match analysis and other purposes. [Solution] The information processing method according to this embodiment involves an information processing device acquiring event information that encodes the content of an event concerning a player that occurred during a sports match, and storing the acquired event information in association with time information relating to the time when the event information was acquired. Furthermore, multiple pieces of the event information may be output in chronological order based on the stored time information. The event information may be information in the form of a string formed by encoding the player involved in the event, the location where the event occurred, the content of the event, the result of the event, the team to which the player belongs, and additional information into characters, and then concatenating multiple characters.

Description

Technical Field

[0001] The present disclosure relates to an information processing method, a computer program, and an information processing apparatus for performing information processing related to sports.

Background Art

[0002] In Patent Document 1, an input tablet is provided which is configured to output a unique signal for each input point based on contact with input points arranged vertically and horizontally on a touch panel surface. On the touch panel surface, a position designation field imitating a layout of a stadium, player designation fields located on the left and right sides sandwiching this position designation field, and a play content designation field located in front are formed, so that competition data such as soccer can be input and recorded accurately with simple operations without requiring skill. An input device has been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present disclosure provides an information processing method, a computer program, and an information processing apparatus that can be expected to facilitate recording of information related to a sports game and utilize the recorded information for game analysis and the like.

Means for Solving the Problems

[0005] An information processing method according to an embodiment includes an information processing apparatus acquiring event information encoding the content of an event related to a player that occurred during a sports game, and associating and storing the acquired event information with time information regarding the time when the event information was acquired.

Effects of the Invention

[0006] According to this disclosure, it is expected that the recording of information related to sports matches will be made easier, and the recorded information will be used for match analysis and other purposes. [Brief explanation of the drawing]

[0007] [Figure 1] This is a schematic diagram illustrating the overview of the information processing system according to this embodiment. [Figure 2] This is a schematic diagram illustrating an example of coding rules for handball matches. [Figure 3] This is a schematic diagram illustrating an example of a shoot course code. [Figure 4] This is a block diagram showing one example configuration of the information processing device according to this embodiment. [Figure 5] This is a block diagram showing one example configuration of a terminal device according to this embodiment. [Figure 6] This is a block diagram showing one example configuration of a terminal device according to this embodiment. [Figure 7] This is a schematic diagram showing an example of an event information input screen. [Figure 8] This flowchart shows an example of the procedure for recording event information performed by the information processing device according to this embodiment. [Figure 9] This is a schematic diagram illustrating an example of event information visualization. [Figure 10] This is a schematic diagram illustrating an example of event information visualization. [Figure 11] This is a schematic diagram illustrating an example of event information visualization. [Figure 12] This is a schematic diagram illustrating an example of visualization combining event information and heart rate measurement results. [Figure 13] This is a schematic diagram illustrating an example of how event information is generated using a learning model. [Modes for carrying out the invention]

[0008] Specific examples of information processing systems according to the embodiments of this disclosure will be described below with reference to the drawings. However, this disclosure is not limited to these examples, and all modifications within the meaning and scope of the claims are intended to be included.

[0009] <System Overview> Figure 1 is a schematic diagram illustrating the overview of the information processing system according to this embodiment. The information processing system according to this embodiment is a system that records information about player events that occur during a sports match in which two teams composed of multiple players, such as handball or soccer, compete, and supports the analysis of the match based on the recorded information. The information processing system according to this embodiment is composed of an information processing device 1 and terminal devices 3, 5, etc.

[0010] The illustrated example assumes a situation where two teams are playing a handball match on a handball court. In the information processing system according to this embodiment, when a handball match is being played, one or more users acting as recorders watching the match from around the court input information about events that occur during the handball match into the terminal device 3. The terminal device 3 is a portable information processing device such as a laptop computer or a tablet terminal, and in this embodiment, the terminal device 3 can accept input from recorders via keyboard operation at least.

[0011] The terminal device 3, used by the recorder to input information, can communicate via a wired or wireless network with an information processing device 1, such as a server, located away from the court where the handball match is being played. The terminal device 3 transmits information about the events entered by the recorder to the information processing device 1, and the information processing device 1 records the information received from the terminal device 3 in a database, adding a timestamp (time information).

[0012] The information processing device 1 can communicate with a terminal device 5 used by a user such as a supervisor or a coach who gives instructions to players in the vicinity of a court where a handball game is being played via a wired or wireless network. The information processing device 1 aggregates the information recorded and stored in a database, generates a table, a graph, or the like, and transmits information for displaying the generated graph to the terminal device 5. The terminal device 5 is a portable information processing device such as a notebook personal computer, a tablet-type terminal device, or a smartphone, and displays a table, a graph, or the like based on the information received from the information processing device 1. A user such as a supervisor or a coach can analyze the situation of a handball game in real time based on the table, the graph, or the like displayed on the terminal device 5.

[0013] As described above, in a system in which a user, such as a recorder, needs to input information related to a game in order to perform real-time analysis of the situation, etc., it is required that the recorder input the information as quickly and accurately as possible without delay. Therefore, in the information processing system according to the present embodiment, rules for coding (expressing in a character string of about several to about a dozen characters) events that can occur in a handball game are predetermined. The recorder memorizes the predetermined coding rules and, when an event occurs while watching the game, inputs a character string of about several to about a dozen characters using the keyboard of the terminal device 3, thereby inputting information related to the coded event (hereinafter referred to as event information) and recording it in the database of the information processing device 1.

[0014] FIG. 2 is a schematic diagram showing an example of coding rules related to a handball game. In the information processing system according to the present embodiment, one event related to a player that occurs during a handball game is recorded as event information including six types of items: "player", "location", "event content", "event result", "team", and "additional information". One item included in the event information is represented by a code of about one to several characters, and a correspondence table between the item name and the code is shown in FIG. 2.

[0015] For the "Player" item included in the event information, for example, the jersey number assigned to each player is set as a code. The jersey number can be a numerical value of about 1 to 3 digits, but it can also be a numerical value with more digits, or it may include characters, etc.

[0016] For the "Location" item included in the event information, for example, any one of the characters "l", "c", and "r" is set as a code. These three characters are respectively assigned to three regions when the handball court is divided vertically into three parts, where "l" is the left side, "c" is the center, and "r" is the right side. Note that the left and right of the court are determined based on the direction in which a predetermined team attacks.

[0017] The "Event Content" item included in the event information is an item indicating the specific content of the event that occurred to the player. In this example, three types of event contents, "Shot", "Miss", and "Penalty", are shown, but this is just an example, and various events other than these three types may be adopted. For "Shot", the character "s" is assigned as a code for a side shot, "p" for a post shot, "l" for a long shot, "c" for a cut-in shot, "f" for a fast break, and "t" for a 7m shot. For "Miss", the two characters "mt" are assigned as a code for a technical miss, and "md" for an induced miss. For "Penalty", the character "y" is assigned as a code for a yellow card, "b" for a blue card, "x" for expulsion, and "z" for disqualification.

[0018] The "Event Result" field in the event information contains the result of the event set in the "Event Details" above. However, depending on the settings of the "Event Details," there may be no "Event Result," in which case the "Event Result" code may be omitted. In this example, an "Event Result" is set for the "Shoot" in the "Event Details," but not for the other "Event Details," namely "Miss" and "Penalty." Regarding the "Event Result," the number (letter) "1" is assigned as the code if the "Shoot" goes in, the number "2" if it is saved by the GK (goalkeeper), the number "3" if it is blocked by a DF (defender), the number "4" if it goes wide, and the number "5" if a 7m shot is awarded.

[0019] The "Team" field in the event information specifies which of the two teams the player designated in the "Player" field above belongs to in the match. For "Team," the number "1" is assigned as a code to one of the predetermined teams (Team A in the diagram), and the number "2" is assigned to the other team (Team B in the diagram). Regarding the "Location" field above, the left and right sides of the court may be determined based on the team to which code "1" is assigned as the "Team."

[0020] The "additional information" item included in the event information is not a mandatory item, but is used when the recorder deems it necessary to add information as needed. In this example, "additional information" may include, for example, the "number of the opposing goalkeeper" who blocked the shot, and the "shot trajectory" if the shot was successful. Figure 3 is a schematic diagram illustrating an example of a shot trajectory code. In the information processing system according to this embodiment, the "shot trajectory" to be set in "additional information" is assumed to be nine regions obtained by dividing the handball goal into a 3x3 grid vertically and horizontally, and the codes are assigned from 1 to 9, with horizontal priority given to the upper left and lower right.

[0021] In the information processing system according to this embodiment, for each item of "player," "location," "event details," "event result," "team," and "additional information," a code of one to several characters is determined according to the event that occurs during the match. A string of six to more than ten characters is generated by concatenating the determined codes in the order of "player," "location," "event details," "event result," "team," and "additional information," and this is treated as coded event information. A recorder who has memorized the coding rules in advance inputs the event information string from the keyboard of terminal device 3 when an event occurs during the match. Terminal device 3 transmits the input event information to information processing device 1, and information processing device 1 records the received event information in the database with a timestamp.

[0022] For example, if a player with jersey number 5 scores a goal with a side shot from the right side of the court, belongs to Team A, and the shot was aimed at the right center, the recorder would input the coded event information "5rs11,6" from terminal device 3. In this embodiment, a rule is established to precede additional information with a comma. However, the rule of adding a comma is not required.

[0023] For example, if an event occurs during a handball match in which a player with jersey number 87 cuts in from the right side of the court and the goalkeeper saves it, and the player belongs to Team B and the shot was aimed towards the center, the recorder inputs the coded event information "87rc22,5" from terminal device 3.

[0024] If a recorder can input data without looking at the keyboard keys (possessing skills such as touch typing or blind typing) and has memorized the coding rules, they can be expected to input coded event information of events that occur during a handball match while watching the game, in as little as one second, or at most a few seconds. For example, if event information is input using a GUI (Graphical User Interface), the recorder would need to look at the screen of terminal device 3 to input the information, and during that time they would not be able to watch the match, potentially missing a series of events. Furthermore, input using a GUI takes more time compared to inputting data without looking at the keyboard.

[0025] <Device configuration> Figure 4 is a block diagram showing an example configuration of the information processing device 1 according to this embodiment. The information processing device 1 according to this embodiment can be realized, for example, by installing a predetermined application program on a general-purpose information processing device such as a server computer or a personal computer. The information processing device 1 according to this embodiment is configured to include a processing unit 11, a storage unit 12, a communication unit 13, etc. In this embodiment, the explanation is given assuming that processing is performed by one information processing device 1, but the processing of the information processing device 1 may be distributed among multiple devices.

[0026] The processing unit 11 is composed of a CPU (Central Processing Unit), MPU (Micro-Processing Unit), GPU (Graphics Processing Unit), or quantum processor, as well as ROM (Read Only Memory) and RAM (Random Access Memory). The processing unit 11 reads and executes the program 12a stored in the storage unit 12, thereby performing various processes such as acquiring and storing event information input by the recorder from the terminal device 3, and visualizing the stored event information.

[0027] The storage unit 12 is configured using a large-capacity storage device such as a hard disk or an SSD (Solid State Drive). The storage unit 12 stores various programs executed by the processing unit 11, and various data necessary for the processing of the processing unit 11. In this embodiment, the storage unit 12 stores the program 12a executed by the processing unit 11. The storage unit 12 is also provided with an event information storage unit 12b that stores event information acquired from the terminal device 3.

[0028] In this embodiment, the program (computer program, program product) 12a is provided in a form recorded on a recording medium 99 such as a memory card or optical disc, and the information processing device 1 reads the program 12a from the recording medium 99 and stores it in the storage unit 12. However, the program 12a may also be written to the storage unit 12 during the manufacturing stage of the information processing device 1, for example. Alternatively, the program 12a may be distributed by a remote server device or the like and acquired by the information processing device 1 via communication. For example, the program 12a may be read from the recording medium 99 by a writing device and written to the storage unit 12 of the information processing device 1. The program 12a may be provided by distribution via a network, or it may be provided in a form recorded on the recording medium 99.

[0029] The event information storage unit 12b stores the event information acquired from the recorder's terminal device 3 in association with information (timestamp) regarding the date and time this event information was acquired. The information processing device 1 may also decode the coded event information according to predetermined rules and store the coded event information and timestamp, along with the decoded information such as "player," "location," "event details," "event results," "team," and "additional information," in the event information storage unit 12b.

[0030] The communication unit 13 transmits and receives data with other devices via a network N such as the Internet or a LAN (Local Area Network). In this embodiment, the communication unit 13 receives coded event information from the recorder's terminal device 3 and provides the received event information to the processing unit 11. The communication unit 13 also receives display data such as tables or graphs generated based on the event information from the processing unit 11 and transmits the provided display data to a terminal device 5 such as a supervisor or coach.

[0031] The memory unit 12 may be an external storage device connected to the information processing device 1. The information processing device 1 may be a multicomputer comprising multiple computers, or it may be a virtual machine virtually constructed by software. Furthermore, the information processing device 1 is not limited to the above configuration and may include a display unit such as a display for displaying characters and images, and an operation unit such as a keyboard and mouse for receiving user input.

[0032] Furthermore, in the information processing device 1 according to this embodiment, the processing unit 11 reads and executes the program 12a stored in the storage unit 12, thereby realizing the event information acquisition unit 11a, the time information assignment unit 11b, the aggregation processing unit 11c, and the display information transmission processing unit 11d, etc., as software-based functional units in the processing unit 11. In this figure, the functional units of the processing unit 11 shown are those related to processing such as storing event information related to sports matches and visualizing the stored event information, while functional units related to other processing are omitted from the illustration.

[0033] The event information acquisition unit 11a communicates with the recorder's terminal device 3 via the communication unit 13 and performs processing to acquire coded event information entered by the recorder. The event information acquisition unit 11a associates the acquired event information with the time information (timestamp) added by the time information assignment unit 11b and stores it in the event information storage unit 12b. Alternatively, the event information acquisition unit 11a may decode the acquired event information into multiple pieces of information and store the event information, time information, and the decoded information in the event information storage unit 12b, associating them.

[0034] The time information assignment unit 11b determines the time (which may include the year, month, and day, etc.) at the time the event information acquisition unit 11a acquired the event information, and performs a process to assign the determination result to the event information as time information. The time information assignment unit 11b can determine the year, month, day, hour, minute, and second, etc., based, for example, on the clock function provided by the information processing device 1.

[0035] The aggregation processing unit 11c aggregates information necessary for analyzing the match, etc., based on the event information stored in the event information storage unit 12b. In this embodiment, the aggregation processing unit 11c aggregates, for example, the number of times each player performed a specific action such as a shot or a miss. The aggregation processing unit 11c may also aggregate various other pieces of information, such as the success rate of each player's shots, the distribution of each player's shot trajectory, or the success rate of goalkeepers blocking shots.

[0036] The display information transmission processing unit 11d generates display information to visualize the event information stored in the event information storage unit 12b, and transmits the generated display information to a terminal device 5 such as a supervisor or coach via the communication unit 13. In this embodiment, the display information transmission processing unit 11d generates a table as display information, for example, which lists the decoded event information in chronological order, and transmits it to the terminal device 5. The display information transmission processing unit 11d also generates a graph or the like to visualize the aggregated results of the information by the aggregation processing unit 11c, and transmits display information to the terminal device 5 for displaying this graph.

[0037] The display information transmitted by the information processing device 1 to the terminal device 5 is information necessary for the terminal device 5 to display a table or graph, etc., and may be in any data format, such as image data or structured data. The terminal device 5 can display a table or graph, etc., based on the display information received from the information processing device 1. However, the information processing device 1 may transmit stored event information to the terminal device 5, and the terminal device 5, upon receiving this information, may generate and display a table or graph based on the event information.

[0038] Figure 5 is a block diagram showing an example configuration of the terminal device 3 according to this embodiment. The terminal device 3 according to this embodiment is a device used by the recorder to input event information, and can be realized by installing a predetermined application program on a general-purpose portable information processing device such as a notebook computer, tablet terminal device, or smartphone. The terminal device 3 according to this embodiment is configured to include a processing unit 31, a storage unit 32, a communication unit 33, a display unit 34, and an operation unit 35, etc.

[0039] The processing unit 31 is composed of a processing unit such as a CPU or MPU, ROM, and the like. The processing unit 31 reads and executes the program 32a stored in the storage unit 32, and performs various processes such as receiving event information input from the recorder and transmitting the received event information to the information processing device 1.

[0040] The storage unit 32 is configured using a large-capacity storage device such as a hard disk or SSD. The storage unit 32 stores the program 32a executed by the processing unit 31. In this embodiment, the program (computer program, program product) 32a is provided in the form of being recorded on a recording medium 98 such as a memory card or optical disc, and the terminal device 3 reads the program 32a from the recording medium 98 and stores it in the storage unit 32. However, the program 32a may also be provided in the form of being distributed via a network. Furthermore, the program 32a is not a program dedicated to the information processing system according to this embodiment, but may be a general-purpose program such as a web browser.

[0041] The communication unit 33 communicates with various devices via a network N such as a LAN or the Internet. In this embodiment, the communication unit 33 communicates with the information processing device 1 via the network N. The communication unit 33 transmits data received from the processing unit 31 to other devices and provides data received from other devices to the processing unit 31.

[0042] The display unit 34 is configured using a liquid crystal display or the like, and displays various images and characters based on the processing of the processing unit 31. The operation unit 35 receives user operations and notifies the processing unit 31 of the received operations. In this embodiment, the operation unit 35 of the terminal device 3 used by the recorder receives event information input from the recorder at least via a keyboard. However, the operation unit 35 may also receive user operations via an input device such as a mouse or a touch panel provided on the surface of the display unit 34. Furthermore, for example, the input devices such as the mouse and keyboard of the operation unit 35 may be configured to be detachable from the terminal device 3.

[0043] Furthermore, in the terminal device 3 according to this embodiment, the processing unit 31 reads and executes the program 32a stored in the storage unit 32, thereby realizing the input reception unit 31a, the event information transmission processing unit 31b, the display processing unit 31c, etc., as software-based functional units in the processing unit 31. The input reception unit 31a receives coded event information related to events that occurred during a handball match by receiving user operations to the operation unit 35. The event information transmission processing unit 31b processes the event information received by the input reception unit 31a and transmits it to the information processing device 1 via the communication unit 33.

[0044] The display processing unit 31c performs processing to display various characters and images on the display unit 34. In this embodiment, the display processing unit 31c displays, for example, a screen on the display unit 34 for receiving event information input from the recorder. The display processing unit 31c may also display tables and graphs based on the input event information, and these displays may be performed based on display information generated by the information processing device 1.

[0045] Figure 6 is a block diagram showing an example configuration of the terminal device 5 according to this embodiment. The terminal device 5 according to this embodiment is a device used by a user such as a coach or manager involved in a sports match to view information, and can be realized by installing a predetermined application program on a general-purpose portable information processing device such as a notebook computer, tablet terminal, or smartphone. The terminal device 5 according to this embodiment is configured to include a processing unit 51, a storage unit 52, a communication unit 53, a display unit 54, and an operation unit 55, etc.

[0046] The processing unit 51 is configured using an arithmetic processing unit such as a CPU or MPU, ROM, etc. The processing unit 51 performs various processes, such as visualization of event information based on information provided by the information processing device 1, by reading and executing a program 52a stored in the storage unit 52. The storage unit 52 is configured using a large-capacity storage device such as a hard disk or SSD. The storage unit 52 stores the program 52a that the processing unit 51 executes. In this embodiment, the program (computer program, program product) 52a is provided in the form of being recorded on a recording medium 97 such as a memory card or optical disc, and the terminal device 5 reads the program 52a from the recording medium 97 and stores it in the storage unit 52. However, the program 52a may be provided in the form of distribution via a network. Also, the program 52a is not a program dedicated to the information processing system according to this embodiment, but may be a general-purpose program such as a web browser.

[0047] The communication unit 53 communicates with various devices via a network N such as a LAN or the Internet. In this embodiment, the communication unit 53 communicates with the information processing device 1 via the network N. The display unit 54 is configured using a liquid crystal display or the like and displays various images and characters based on the processing of the processing unit 51. In this embodiment, the display unit 54 displays tables and graphs based on display information provided by the information processing device 1. The operation unit 55 receives user operations and notifies the processing unit 51 of the received operations. The operation unit 55 receives user operations via an input device such as a keyboard, mouse, or touch panel provided on the surface of the display unit 54.

[0048] Furthermore, in the terminal device 5 according to this embodiment, the processing unit 51 reads and executes the program 52a stored in the storage unit 52, thereby realizing the display information receiving processing unit 51a and the display processing unit 51b, etc., as software-based functional units in the processing unit 51. The display information receiving processing unit 51a communicates with the information processing device 1 via the communication unit 53 and performs processing to receive display information transmitted by the information processing device 1. The display processing unit 51b performs processing to display various characters and images on the display unit 54. In this embodiment, the display processing unit 51b displays a table or graph, etc., which aggregates and visualizes event information based on the display information received by the display information receiving processing unit 51a.

[0049] <Event Information Recording Processing> Figure 7 is a schematic diagram showing an example of an event information input screen. In this embodiment, the terminal device 3 used by the recorder displays the tabular event information input screen shown in Figure 7 to accept coded event information input from the recorder. The illustrated event information input screen displays a table with items such as "Event Information," "Players," "Location," "Event Details," "Event Results," "Team," "GK (Goalkeeper)," and "Time Information."

[0050] The table in the diagram contains two pieces of event information. The first piece of "event information" is "5rs11,6", the "player" is "player a", the "location" is "right", the "event content" is "long shot", the "event result" is "goal in", the "team" is "team A", the "GK" is "player c", and the "time information" is "2023 / 10 / 15 10:33:32". The second piece of "event information" is "87rc22,5", the "player" is "player b", the "location" is "right", the "event content" is "cut-in shot", the "event result" is "GK save", the "team" is "team B", the "GK" is "player d", and the "time information" is "2023 / 10 / 15 10:34:55".

[0051] The "Event Information" column in the table on the event information input screen is for the recorder to input event information. Terminal device 3 displays the event information in the "Event Information" column in the order it was entered by the recorder, from top to bottom, and indicates that the bottom row of unentered information is in an input-receiving state by surrounding it with a thick border. The recorder uses the keyboard on the operation unit 35 of terminal device 3 to input coded event information of about 6 to 10 characters, and confirms the input by pressing, for example, the "Enter" key on the keyboard after completion.

[0052] Upon confirmation of input, terminal device 3 acquires the input event information and transmits it to information processing device 1. Information processing device 1 receives the event information from terminal device 3, acquires the date and time at the time of receipt of the information, and stores the event information and time information (timestamp) in association in the event information storage unit 12b. In this embodiment, information processing device 1 also decodes the received coded event information and stores the decoded information such as "player," "location," "event content," "event result," "team," and "additional information (in this example, the "GK" of the team that was shot at)" in association with the event information and time information in the event information storage unit 12b. Information processing device 1 transmits the "event information," "player," "location," "event content," "event result," "team," "GK," and "time information" stored in the event information storage unit 12b to terminal device 3, the source of the event information, and to terminal device 5 used by a pre-registered manager or coach.

[0053] Upon receiving information transmitted from the information processing device 1, terminal device 3 displays information such as "player," "location," "event details," "event result," "team," "goalkeeper," and "time information" corresponding to the event information recorded by the recorder, in a table on the event information input screen. After receiving the event information input from the recorder, terminal device 3 moves the bold border display to the location one position below the input field in the table and waits for the input of the next event information.

[0054] Furthermore, the terminal device 5 used by the manager or coach receives information transmitted from the information processing device 1 and displays a table on the display unit 54 similar to the event information input screen in Figure 7 based on the received information. In this embodiment, the terminal device 5 does not accept input of event information. Therefore, the terminal device 5 either displays a table with the "Event Information" column of the table shown in Figure 7 deleted, or it displays the "Event Information" column but does not display the thick border indicating that it is in input acceptance state. However, the terminal device 5 used by the manager or coach may also be configured to accept input of event information.

[0055] Figure 8 is a flowchart illustrating an example of the procedure for recording event information performed by the information processing device 1 according to this embodiment. The event information acquisition unit 11a of the processing unit 11 of the information processing device 1 according to this embodiment acquires coded event information entered by the recorder on the terminal device 3 by communicating with the terminal device 3 via the communication unit 13 (step S1). The time information assignment unit 11b of the processing unit 11 acquires the date and time information at the time the event information was received in step S1 and assigns this as time information to the event information (step S2). The processing unit 11 also decodes the coded event information received in step S1 based on predetermined rules (step S3). The processing unit 11 associates the event information to which the time information was assigned in step S2 with the information decoded in step S3 and stores it in the event information storage unit 12b (step S4). The processing unit 11 transmits the event information, the time information stored in the event information storage unit 12b, and the decoded information to the terminal device 3 that sent the event information (step S5). The processing unit 11 may also transmit this information to the terminal device 5 used by the supervisor or coach in step S5.

[0056] Next, the aggregation processing unit 11c of the processing unit 11 aggregates the multiple event information stored in the event information storage unit 12b (step S6). In this embodiment, the aggregation processing unit 11c aggregates, for example, the number of shots, the success rate of shots, and the course of shots for each player. Based on the aggregation results in step S6, the aggregation processing unit 11c generates a table or graph, etc., for visualizing these aggregation results (step S7). The display information transmission processing unit 11d of the processing unit 11c transmits the display information for displaying the table or graph, etc., generated in step S7 to a terminal device 5 used by a manager or coach, etc., which has been registered in advance (step S8), and terminates the process. The information processing device 1 performs the series of processes shown in the flowchart of Figure 8 each time the recorder inputs event information.

[0057] Figures 9 to 11 are schematic diagrams illustrating an example of event information visualization, showing an example of a table or graph displayed on the display unit 54 of the terminal device 5 based on event information. The display example shown in Figure 9 visualizes the results of aggregating the success rates of players' shots in a table and graph. The table shown in Figure 9 shows the number of successful (IN) and unsuccessful (OUT) shots for "close-range" shots, the number of successful (IN) and unsuccessful (OUT) shots for "long-range" shots, and the "success rate" of the shots aggregated from these, as numerical values ​​in the table for each player. In this example, a horizontal bar graph showing the number of shots for each player is embedded in the table, and the bar graph is color-coded according to the number of successful and unsuccessful shots (the color coding is represented by hatching in this figure).

[0058] Furthermore, the table in this example also shows the "calories consumed" for each player. The information processing device 1 has pre-stored calculation formulas, for example, for calculating calories consumed according to the number of shots, and can calculate the calories consumed for each player based on the total number of shots.

[0059] The example shown in Figure 10 visualizes the results of aggregating the shooting lanes for each player as a table. In the example shown in Figure 10, a 9x9 table showing the shooting lanes is created for each player, and the tables for 15 players a-o are displayed side by side. Each player's 9x9 table corresponds to the shooting lanes shown in Figure 3, and the success rate of shots for each shooting lane is shown in the form of a fraction "number of successes / number of shots".

[0060] The example shown in Figure 11 visualizes the results of summarizing goalkeeper save percentages in a table format. In the example in Figure 11, three values—"IN" (number of shots scored), "Save" (number of shots prevented), and "Save Percentage" (the ratio of saves to the number of shots)—are summarized separately for "long-range" and "short-range" shots, and a "Total Save Percentage" is calculated by combining long-range and short-range saves, and is shown for each goalkeeper.

[0061] The display examples shown in Figures 9 to 11 are merely examples of visualization and are not limited to these. In the information processing system according to this embodiment, aggregated results based on event information may be displayed in various other display modes. The information processing device 1 acquires and aggregates the event information entered by the recorder at the terminal device 3 each time the recorder inputs event information at the terminal device 3, and transmits display information based on the aggregated results to the terminal device 5, thereby updating the tables or graphs displayed on the terminal device 5. This allows the supervisor or coach using the terminal device 5 to check the aggregated results of events that occurred during the handball match in real time.

[0062] <Embodiment 2> The information processing system according to Embodiment 2 combines event information input by the recorder with information obtained from various sensors, etc., and aggregates the aggregated results, providing them to the supervisor or coach, etc. For example, in the information processing system according to Embodiment 2, each player participating in a handball match is fitted with a heart rate sensor. This heart rate sensor continuously measures the player's heart rate during the match and transmits the measurement results to the information processing device 1. The information processing device 1 associates the heart rate measurement result data transmitted from each player's heart rate sensor with the player's identification information and the time information of reception, etc., and stores them in the storage unit 12.

[0063] However, if real-time heart rate data for each player is not required during the match, the heart rate sensor may not transmit the measurement results to the information processing device 1 in real time. Instead, the heart rate sensor may store the measurement results associated with time information, and the information processing device 1 may acquire the stored measurement results data after the match has ended. The information processing device 1 can determine the timing of each player's heart rate and events that occurred during the match based on the time information attached to the measurement results acquired from the heart rate sensor and the time information attached to the event information stored in the event information storage unit 12b. Furthermore, the transfer of measurement result data from the heart rate sensor to the information processing device 1 may not be done through direct communication between the heart rate sensor and the information processing device 1, but may be done through other devices such as terminal devices 3 and 5.

[0064] Figure 12 is a schematic diagram illustrating an example of visualization combining event information and heart rate measurement results. In this example, terminal device 5 displays a graph with time on the horizontal axis and the player's heart rate on the vertical axis. At the bottom of this graph, the timing of successful shots, missed shots, and mis-shots is indicated by dots of different colors (in this example, color coding is represented by hatching).

[0065] The information processing device 1 according to this embodiment generates a line graph or the like showing the changes in an athlete's heart rate by arranging multiple heart rate data stored in the storage unit 12 in chronological order and graphing them, and can also show the timing of event occurrences in the graph based on the time information attached to the heart rate data and the time information attached to the event information.

[0066] In this example, a configuration was described in which heart rate measured by a heart rate sensor attached to the athlete is associated with event information, but the use of sensors is not limited to this. For example, sensors that measure various aspects of the athlete's physical condition, such as body temperature or blood pressure, could be used. Alternatively, for example, the sensor could be used to acquire the athlete's location information, and the information processing device 1 could display the location of each athlete on the terminal device 5 when an event occurs. Various sensors such as GPS (Global Positioning System) sensors, accelerometers, gyroscopes, or UWB (Ultra Wide Band) tags could be used to acquire the athlete's location information. Furthermore, the method of acquiring the athlete's location information is not limited to using sensors attached to the athlete; for example, the location of each athlete could be determined based on video footage of a handball match.

[0067] Alternatively, for example, video footage of a handball match captured by a camera may be associated with event information and used. The information processing device 1 can, for example, receive an event specification from a user based on the event information, identify the time when the specified event occurred based on the event information, extract video footage of the identified time and the time immediately before and after from the video footage stored in the storage unit 12b, and transmit the extracted video footage to the terminal device 5 for display.

[0068] Alternatively, for example, data for machine learning (so-called training data) may be generated by associating events identified based on event information with measurements from sensors or images captured by a camera. The information processing device 1 can perform machine learning processing using the generated training data to generate a learning model that predicts events occurring in a handball match based on data such as measurements from sensors or images captured by a camera.

[0069] <Embodiment 3> In the information processing system according to Embodiment 3, instead of a recorder inputting coded event information, for example, a handball match is filmed with a camera, and a pre-trained machine learning model generates event information based on the video footage obtained from the filming. Figure 13 is a schematic diagram illustrating an example of how to generate event information using a machine learning model. In this example, three types of machine learning models 201, 202, and 203 are used to generate coded event information based on video footage of the match filmed by the camera.

[0070] The first learning model 201 is a learning model that has been pre-trained to accept frame images (still images) contained in a video as input and output text that describes these images. The first learning model 201 may be a learning model that can be called by names such as img2txt or image to text. The first learning model 201 may be a learning model that has been trained for handball, or a general-purpose pre-trained learning model may be used. The information processing device 1 according to Embodiment 3 inputs frame images contained in a video captured by a camera in chronological order to the learning model 201 and obtains text (text data) output by the learning model. In the illustrated example, by inputting three frame images contained in the video into the learning model 201 in order, the information processing device 1 obtains text such as "Team A's player number 11 is waiting in the center of the court," "Team A's player number 11 is about to receive a pass in the center of the court," and "Team A's player number 11 shot from the right side."

[0071] The second learning model 202 is a learning model that has been pre-trained to accept multiple sentences as input and output a summarized version of these sentences. The second learning model 202 can be an existing learning model that handles text data, such as a so-called LLM (Large Language Model). The second learning model 202 may be one that has been trained for handball, or a general-purpose pre-trained learning model may be used. In the illustrated example, by inputting the three sentences mentioned above into the learning model 202, the information processing device 1 obtains the summarized sentence, "Summary: The player with jersey number 11 on the white team shot from the right side position, and it went in."

[0072] The third learning model 203 is a pre-trained learning model that accepts a summary text and a prompt instructing the rules for coding the event as input, and outputs coded event information. Similar to the second learning model 202, the third learning model 203 can use existing learning models such as so-called LLMs. The third learning model 203 may be machine-trained for handball, or a general-purpose pre-trained learning model may be used. In the illustrated example, by inputting the summary text mentioned above and a prompt such as, "Based on the summary text, identify the player's jersey number, position, event content, event result, team, and shot course, and generate a code according to the following rules. The identified jersey number should be written in the first position. The player's position should be written in the second position using the notation l for left side of the court, c for center, and r for right side. The event content is...", the information processing device 1 obtains coded event information "11rs11,6".

[0073] The process of converting video footage into event information using these learning models may be performed by the information processing device 1, or by another device (e.g., a camera). Furthermore, the process of converting video footage into event information may be performed in real time during a handball match, or it may be performed after the match has ended based on stored video footage.

[0074] Furthermore, the second learning model 202 and the third learning model 203 can be integrated into, for example, a single LLM learning model. In this case, the learning model accepts multiple sentences generated from multiple frame images and prompts instructing it to encode these sentences as input, and outputs encoded event information. Moreover, by using an LLM that supports multimodal input, the first learning model 201, the second learning model 202, and the third learning model 203 can be integrated into a single learning model. In this case, the learning model accepts video data and prompts instructing it to output encoded event information based on the video as input, and outputs encoded event information.

[0075] <Summary> In the information processing system according to this embodiment, the information processing device 1 acquires event information from the terminal device 3, which is an encoded representation of events related to players that occurred during a sports match such as handball. The acquired event information is then associated with time information related to the time of acquisition and stored in the event information storage unit 12b. As a result, the information processing system according to this embodiment is expected to facilitate the recording of information related to sports matches, and the stored event information and time information can be utilized for sports-related analysis and other purposes.

[0076] Furthermore, in the information processing system according to this embodiment, the information processing device 1 displays (outputs) multiple event information in chronological order on the display unit 54 of the terminal device 5 based on the time information stored in the event information storage unit 12b. As a result, the information processing system according to this embodiment is expected to allow the coach or manager to check the occurrence status of events during a handball match.

[0077] Furthermore, in the information processing system according to this embodiment, event information is information that is a string of characters formed by encoding the players involved in the event, the location where the event occurred, the content of the event, the result of the event, the team to which the players belong, and additional information into characters and combining multiple characters. As a result, the information processing system according to this embodiment is expected to facilitate the task of recording information about events that occur during a sports match.

[0078] Furthermore, in the information processing system according to this embodiment, the information processing device 1 associates the acquired event information with the players involved in the event, the location where the event occurred, the content of the event, the result of the event, the team to which the players belong, and additional information, and displays (outputs) them on the display unit 34 of the terminal device 3 or the display unit 54 of the terminal device 5. As a result, the information processing system according to this embodiment is expected to make it easier for users to understand the match situation and other information that is difficult to grasp from coded event information alone, based on the decoded information.

[0079] Furthermore, in the information processing system according to this embodiment, the information processing device 1 aggregates specific actions for each player and their success or failure based on the acquired event information, and displays (outputs) the aggregated results on the display unit 54 of the terminal device 5. For example, in sports such as handball or soccer, where players score points by shooting the ball into the goal, the information processing device 1 aggregates and outputs the location where the player shot or whether the shot was successful or not. Also, for example, the information processing device 1 aggregates and outputs whether the goalkeeper defending the goal succeeded or failed in blocking the shot. As a result, the information processing system according to this embodiment can provide various information aggregated from event information to the coach or manager, and is expected to contribute to the coach or manager's analysis of the match.

[0080] Furthermore, in the information processing system according to this embodiment, the first terminal device 3 receives event information input, the information processing device 1 acquires the event information from the first terminal device 3, and transmits display information (output information) of the aggregated event information results to the second terminal device 5, and the second terminal device 5 acquires the display information from the information processing device 1 and displays (outputs) the aggregated results on the display unit 54. As a result, in the information processing system according to this embodiment, the terminal device 3 used by the recorder who records event information and the terminal device 5 used by the manager or coach, etc., for analyzing the game, etc., can be made into separate devices, and an improvement in convenience can be expected.

[0081] Furthermore, in the information processing system according to this embodiment, the first terminal device 3 accepts event information input via keyboard input. As a result, in the information processing system according to this embodiment, it is expected that the recorder can input event information easily and quickly.

[0082] Furthermore, in the information processing system according to this embodiment, the information processing device 1 acquires information (heart rate information) measuring the heart rate of the player during the match, and displays (outputs) a graph on the display unit 54 of the terminal device 5 that correlates the changes in the player's heart rate with the timing of event occurrences based on the acquired heart rate information. As a result, the information processing system according to this embodiment is expected to support the analysis of the relationship between the heart rate of a player during a sports match and the occurrence of events by a coach or other supervisor.

[0083] Furthermore, in the information processing system according to this embodiment, the information processing device 1 acquires video footage of a sports match, inputs the acquired video footage into a learning model, and obtains event information. The learning model converts the scenes depicted in the video footage into text, and converts the text into event information based on coding rules given as prompts. As a result, the information processing system according to this embodiment is expected to automate the input of event information.

[0084] The embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of this disclosure is indicated by the claims, not in the sense described above, and all modifications within the sense and scope equivalent to the claims are intended.

[0085] The matters described in each embodiment can be combined with each other. Furthermore, the independent and dependent claims described in the claims can be combined with each other in any combination, regardless of the form of reference. In addition, the claims use a form in which claims referencing two or more other claims (multi-claim form), but are not limited to this. A form in which multi-claims referencing at least one multi-claim (multi-multi-claim) may also be used. [Explanation of Symbols]

[0086] 1. Information processing equipment (computer) 3. Terminal device (first terminal device) 5. Terminal device (second terminal device) 11 Processing Section 11a Event Information Acquisition Section 11b Time information assignment unit 11c Aggregation Processing Unit 11d Display Information Transmission Processing Unit 12 Storage section 12a Program (Computer Program) 12b Event Information Storage Unit 13 Communications Department 31 Processing Unit 31a Input reception section 31b Event Information Transmission Processing Unit 31c Display Processing Unit 32 Storage section 32a Program 33 Communications Department 34 Display section 35 Control section 51 Processing Unit 51a Display Information Reception Processing Unit 51b Display Processing Unit 52 Storage section 52a Program 53 Communications Department 54 Display section 55 Operation section 97, 98, 99 Recording media 201, 202, 203 Learning Models N Network

Claims

1. Information processing device, We obtain event information that codes the details of events related to players that occurred during a sports match. The acquired event information is stored in association with the time information relating to the time when the event information was acquired. Information processing methods.

2. Based on the stored time information, multiple event information items are output in chronological order. The information processing method according to claim 1.

3. The event information is a string of characters formed by encoding the players involved in the event, the location where the event occurred, the content of the event, the result of the event, the team to which the players belong, and additional information into characters, and then concatenating multiple characters. The information processing method according to claim 1.

4. The acquired event information is associated with the player involved in the event (decoded from the event information), the location where the event occurred, the content of the event, the result of the event, the team to which the player belongs, and additional information, and output accordingly. The information processing method according to claim 3.

5. Based on the acquired event information, the specific actions of each player and the success or failure of those actions are compiled. Output the aggregated results. The information processing method according to claim 3.

6. The aforementioned sport is one in which players score points by shooting a ball into a goal. Based on the acquired event information, the location from which the player shot towards the goal or the success or failure of the shot is tallied. Output the aggregated results. The information processing method according to claim 3.

7. The aforementioned sport is one in which players score points by shooting a ball into a goal. Based on the acquired event information, the success or failure of the goalkeeper's attempts to block the shots is tallied. Output the aggregated results. The information processing method according to claim 3.

8. The first terminal device receives the input of the event information, The information processing device acquires the event information from the first terminal device and transmits the output information for the aggregated results generated based on the acquired event information to the second terminal device. The second terminal device acquires the output information from the information processing device and outputs the aggregated results based on the acquired output information. The information processing method according to claim 5.

9. The first terminal device accepts the input of the event information via keyboard input. The information processing method according to claim 8.

10. We acquire heart rate information of players during the match. The system outputs a graph that correlates the changes in the athlete's heart rate based on the acquired heart rate information with the timing of events based on the acquired event information. The information processing method according to claim 1.

11. We obtain video footage of the aforementioned sports match, The acquired video images are input into a machine learning model. The event information output by the aforementioned learning model is acquired. The information processing method according to claim 1.

12. The aforementioned learning model, The scene captured in the aforementioned video is converted into text, Based on the given coding rules, convert the text into the event information. The information processing method according to claim 11.

13. We obtain event information that codes the details of events related to players that occurred during a sports match. The acquired event information is stored in association with the time information relating to the time when the event information was acquired. A computer program that instructs a computer to perform a process.

14. Equipped with a processing unit, The aforementioned processing unit, We obtain event information that codes the details of events related to players that occurred during a sports match. The acquired event information is stored in association with the time information relating to the time when the event information was acquired. Information processing device.

Images