Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device capable of more easily assigning a score to a score book.SOLUTION: An information processing device comprises: an input acceptance unit which accepts an input of audio information on sport competition scores; a generation unit which generates score data for registration in a score book on the basis of a learned model where audio information whose input is accepted by the input acceptance unit serves as input information, audio information on the sport competition scores serves as an input, and score data for registration in the score book serves as an output; and a transmission unit which transmits the score data generated by the generation unit to a terminal.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] It can be difficult for beginners to keep score in a scorebook for recording sports games and practice sessions. The reason for this is that the rules for scoring differ for each sport, and some teams have their own unique rules for scoring, making the rules complicated. For example, when keeping score in a youth baseball game, the parents of the players may study the rules for scoring and keep the score in the scorebook.

[0003] In response to this, several application software programs have been released as a way to make it easier to keep score in a scorebook. For example, there are services that allow you to keep score in a scorebook by speaking specific words, such as the rules of each sport or the official names of events, in a specific order.

[0004] Furthermore, a technique for generating an answer to a question input by a user using a generative model has been conventionally known (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Special Publication No. 2022-503838 Summary of the Invention [Problem to be solved by the invention]

[0006] However, in the conventional technology, there are cases where it is difficult to more easily keep score in the scorebook. For example, in the conventional technology, it is sometimes difficult to keep score in the scorebook when the spoken language is casual and does not follow the rules of saying specific words in a specific order. For this reason, there is a demand for a technology that allows even a person who does not know the rules of keeping score in the scorebook to easily keep score in the scorebook. [Means for solving the problem]

[0007] An information processing device according to one embodiment of the present invention has an input accepting unit that accepts input of audio information related to the score of a sports competition, a generating unit that generates score data to be registered in a scorebook based on a trained model that uses the audio information related to the score of a sports competition as input information and outputs score data to be registered in a scorebook, and a transmitting unit that transmits the score data generated by the generating unit to a terminal. Effect of the Invention

[0008] According to one aspect of the present invention, keeping score in a scorebook can be made easier. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of an overview of an information processing system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of an information processing device and a terminal according to the first embodiment. [Diagram 3] FIG. 3 is a diagram for explaining an example of the use of score data. [Figure 4] FIG. 4 is a diagram illustrating an example of statistical data. [Diagram 5] FIG. 5 is a diagram illustrating an example of statistical data. [Figure 6]FIG. 6 is a flowchart showing an example of a processing flow of the information processing device according to the first embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of the configuration of an information processing device and a terminal according to the second embodiment. [Figure 8] FIG. 8 is a flowchart showing an example of a process flow of the information processing device according to the second embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of the configuration of an information processing device and a terminal according to the third embodiment. [Figure 10] FIG. 10 is a flowchart showing an example of a process flow of the information processing device according to the third embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of the configuration of an information processing device and a terminal according to the fourth embodiment. [Figure 12] FIG. 12 is a flowchart showing an example of a processing flow of the information processing device according to the fourth embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of a hardware configuration of an information processing device and a terminal according to each embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, each embodiment of the present invention will be described with reference to the drawings, but the present invention is not limited to the following embodiments. In addition, in the description of the drawings, the same parts are given the same reference numerals, and duplicated explanations are omitted, and explanations of members having similar functions and similar processes are also omitted.

[0011] 1. First Embodiment (Example of summary) Fig. 1 is a diagram for explaining an example of the outline of an information processing system 1 according to a first embodiment. As illustrated in Fig. 1, when a scorer who records the progress of a game and the scores in a sports competition says "Number 4 of the opposing team adds 3 points with a 3-point shot" into a microphone of a terminal 20, the information processing device 10 accepts the scorer's words as input as voice information related to the score of the sports competition.

[0012] Next, the information processing device 10 generates score data to be registered in a scorebook based on a trained model that uses, for example, the accepted voice information as input information, voice information related to the score of a sports competition as input, and score data to be registered in a scorebook as output. As a result, the information processing device 10 converts the voice information into score data.

[0013] Next, the information processing device 10 transmits, for example, the generated score data to the terminal 20. As illustrated in Fig. 1, the terminal 20 registers the score data in application software (digital score application) for registering the score data in a scorebook, and displays the scorebook in which the score data is registered.

[0014] In this way, the information processing device 10 generates score data based on a trained model, so it can generate score data by supplementing information for registration in a scorebook even from audio information in spoken language that does not follow rules established for each sporting event or rules such as uttering specific words, such as official names, in a specific order, and transmit the score data to the terminal 20. As a result, the information processing device 10 allows even people who do not know the scoring rules to keep scores in a scorebook more easily than with conventional technology.

[0015] (An example of the configuration of an information processing device) 2 is a diagram showing an example of the configuration of an information processing device and a terminal according to the first embodiment. The information processing device 10 is realized by, for example, a server. As shown in FIG. 2, the information processing device 10 has a control unit 11, a communication unit (transmission unit) 12, and a storage unit 13.

[0016] (Control unit) The control unit 11 controls the entire information processing device 10. For example, the control unit 11 is configured with one or more processors having programs that define the flow of various processes and internal memory that stores control information, and the processor executes each process using the programs and internal memory. The control unit 11 is realized by, for example, electronic circuits such as a central processing unit (CPU), a micro processing unit (MPU), and a graphics processing unit (GPU), and integrated circuits such as an application specific integrated circuit (ASIC) and a field programmable gate array (FPGA). As illustrated in FIG. 2, the control unit 11 has a trained model generation unit 111, an input reception unit 112, and a generation unit 113.

[0017] (Trained model generation part) The trained model generation unit 111 generates a trained model based on voice information, which is input information, and score data, which is output information (correct answer information). For example, the trained model generation unit 111 may generate a trained model using the voice information, which is input information associated with speaker information indicating that the speaker is a scorer, and the score data, which is output information, as teacher data. In this way, the trained model generation unit 111 can train the trained model in advance not only on the relationship between the voice information and the score data, but also on the voice of the scorer.

[0018] Here, the audio information is not limited to information in which words are spoken according to rules established for each sport or rules such as speaking specific words in a specific order. Examples of the audio information include information containing spoken words corresponding to the official names of teams, players, shots, and points. As an example, the audio information includes spoken words such as "Number 4 of the opposing team adds 3 points with a 3-point shot" in which the words and word order are casual, and spoken words with different expressions such as "Number 4 of the opposing team makes a successful 3-point shot" and "Number 4 of the red team scores with a 3-point shot."

[0019] The sport is not particularly limited as long as the score can be kept in a scorebook, and examples include basketball, soccer, and baseball. Since the score is easily variable in basketball, when the sport is basketball, the information processing device 10 can keep the score in the scorebook particularly easily compared to manual work or conventional techniques. Also, when the sport is baseball, unlike basketball, soccer, and the like, the information processing device 10 receives input of voice information such as "the opponent's number 4 throws a strike low and on the outside corner" for each ball, not for each point, and executes each process.

[0020] The score data is not limited to the scores of each team or player, so long as it is data to be registered in a scorebook, and may include, for example, data that is the basis of stats, which are the playing results for each team or player in a game, such as the number of shots or steals for each basketball player. The scorebook is not particularly limited as long as it has the function of a record book for keeping records of sports games and practice sessions, and includes, for example, a digitized scorebook.

[0021] In addition, the trained model refers to, for example, generative AI (Artificial Intelligence), and as one example, it is realized by a sentence generation model with a dialogue function such as ChatGPT (Chat Generative Pre-trained Transformer).

[0022] (Input reception section) The input receiving unit 112 receives input of audio information related to the score of a sports event. For example, when audio information such as "Number 4 of the opposing team adds 3 points with a 3-point shot" is input to an input unit 21 such as a microphone of a terminal 20 described later, the input receiving unit 112 indirectly receives the input of audio information from the terminal 20 via the communication unit 12 and a communication unit 23 of the terminal 20 described later.

[0023] Here, the acceptance of input by the input accepting unit 112 is not limited to a configuration in which various information such as voice information is directly accepted, but also includes a configuration in which various information is indirectly accepted from various devices such as the terminal 20 via a network, for example.

[0024] (Generation part) The generation unit 113 takes the voice information accepted by the input accepting unit 112 as input information, and generates score data to be registered in a scorebook based on a trained model that takes voice information related to the score of a sports competition as input and outputs score data to be registered in a scorebook. For example, the generation unit 113 inputs the voice information to be the input information into the trained model, and generates output information output from the trained model as score data.

[0025] As an example, when the generation unit 113 receives input of audio information specifying a successful shot, such as "No. 4 of the opposing team makes a three-point shot, adding three points," the generation unit 113 generates score data indicating that the number of shots and points have been added. In addition, when the generation unit 113 receives input of audio information that does not specify whether the shot was successful, such as "No. 4 of the opposing team makes a three-point shot," or audio information that specifies a failed shot, such as "No. 4 of the opposing team misses his three-point shot," the generation unit 113 generates score data indicating that only the number of shots has been added, and no points have been added.

[0026] As another example, the generation unit 113 generates score data that adds the number of shots and points not only when it receives input of audio information that specifies the success of the shot, but also when it receives input of audio information that does not specify the success or failure of the shot.

[0027] For example, the generation unit 113 may correct the score data based on the voice information the input of which is accepted by the input acceptance unit 112. As one example, when the voice information the input of which is accepted contains the word "mistake", such as "the previous 'two-point shot, add two points' was a mistake", the generation unit 113 deletes the score data based on the previous voice information. As another example, when the voice information the input of which is accepted contains the word "correction", such as "corrected the previous 'two-point shot, add two points' to 'three-point shot, add three points'", the generation unit 113 corrects the target for the number of shots to be added from "two-point shot" to "three-point shot", and corrects the number of points to be added from "two points" to "three points".

[0028] This allows the generating unit 113 to delete or correct the score data using the audio information as a trigger, even if the content of the audio information is incorrect.

[0029] For example, the generating unit 113 may generate score data when the speaker of the voice information is a specific scorer. As an example, an example of generation by the generating unit 113 when the voice information whose input is accepted includes voice information of a specific scorer saying "opposing team number 5 shoots" and voice information of another person saying "Number 5's shot went in" will be described. In this case, the generating unit 113 identifies only the voice information of the specific scorer in which it is not specified that a shot went in, and generates score data corresponding to the voice of the specific scorer, such as score data in which only the number of shots is added by 1 out of the number of shots and points of the opposing team number 5.

[0030] This allows the generating unit 113 to generate score data only when the speaker of the audio information is a specific scorer, even if the voice of a specific scorer overlaps with the voice of another person.

[0031] The method of identifying whether the speaker of the voice information by the generation unit 113 is a scorer is not particularly limited, and may be, for example, a method using a trained model or a method using a voice authentication technology. As an example, the generation unit 113 identifies whether the speaker of the voice information is a scorer by receiving an input and inputting the voice information associated with the speaker information into a trained model that has previously trained the voice of a scorer that receives input of voice information associated with speaker information indicating that the speaker is a scorer and outputs score data. The generation unit 113 generates score data only when the speaker of the voice information is a scorer.

[0032] For example, the generating unit 113 may further generate information on advance information to be preregistered in the scorebook. As an example, the generating unit 113 generates information on advance information such as uniform numbers and positions of players who will play on that day before the match, and causes the communication unit 12 to transmit the information on advance information to the terminal 20. For example, the terminal 20 activates the voice function of the digital score app 30 minutes before the start of the match, and outputs the information on advance information from the output unit 22 described later by a voice announcement such as "We will now start preparations for registering the score. Please tell us the names, uniform numbers, and positions of players from the opposing team." When voice information including advance information is input from the scorer, the terminal 20 preregisters the advance information in the scorebook.

[0033] This allows the generation unit 113 to assist the scorer in registering the advance information in the scorebook even if the scorer is not aware of the advance information.

[0034] For example, the generation unit 113 may further generate score data for a simulation. As an example, the generation unit 113 further generates simulator information for a match based on advance information or the like, and causes the communication unit 12 to transmit the simulator information to the terminal 20. The output unit 22 of the terminal 20 displays the simulator information as, for example, an image. For example, when the input of audio information based on the simulator information by a scorer is indirectly received by the input reception unit 112 from the input unit 21 such as a microphone of the terminal 20 via the communication unit 12 and the communication unit 23 before a match, the generation unit 113 generates score data for a simulation.

[0035] This enables the generation unit 113 to allow the scorer to practice how to enter scores into the scorebook.

[0036] For example, the generating unit 113 may further generate statistical data related to the statistics of the score data based on the score data. An example of generation by the generating unit 113 will be described below with reference to Fig. 3. Fig. 3 is a diagram for explaining an example of utilization of the score data. Figs. 4 and 5 are diagrams showing examples of statistical data.

[0037] As shown in Fig. 3, the generating unit 113, for example, registers the score data, then tallys the score data by game and by season using a known tallying method, and generates standard statistical data in basketball, such as box scores and season stats, which are the results of the score data. As shown in Fig. 4, a box score generally refers to a cross-tabulation of sports performance data, and in the case of basketball, for example, refers to stats on a game-by-game basis. Season stats refer to the scores of players and teams throughout the season.

[0038] The generating unit 113 may further generate other important statistical data such as a running score and a distribution map by field goal. Here, the running score refers to a player's score recorded on a timeline for each play, as exemplified in Fig. 5. The distribution map by field goal refers to a distribution map showing the success rate of goals in each area of ​​the field for each player or team, as exemplified in Fig. 5.

[0039] Hereinafter, an example of generation of a running score by the generation unit 113 will be described. In this case, the generation unit 113 inputs audio information with time information such as a time stamp previously associated therewith, or audio information including time information such as "at 50 minutes, the opponent's No. 4 adds 3 points with a 3-point shot," which is received as input by the input receiving unit 112, into a trained model that outputs score data, and then tally up the score data output from the trained model to generate a running score.

[0040] Hereinafter, an example of the generation of a distribution map by field goals by the generation unit 113 will be described. The generation unit 113 inputs audio information including position information accepted by the input accepting unit 112 into a trained model that takes as input, for example, audio information associated with position information in advance or audio information including position information such as "No. 4 of the opposing team scores three points with a three-point shot from outside the three-point line in front of the ring" and outputs score data, and then tallys up the score data output from the trained model to generate a distribution map by field goals.

[0041] Next, the generation unit 113 causes the communication unit 12 to transmit the statistical data to the terminal 20. The communication unit 23 of the terminal 20 receives the statistical data, for example, and the output unit 22 of the terminal 20 displays the statistical data as an image, for example. This allows the generation unit 113 to utilize the score data for the team's strategy and for overcoming weaknesses through the statistical data.

[0042] As one example, the generating unit 113 can use the score data for analysis of team strategies, such as analysis of compatibility with an opposing team and strategy, by using the box score. As another example, the generating unit 113 can use the score data for players by scouts, etc., by using season stats, which are the performance (score) of players and teams throughout the season, and can use the score data for strategies, such as overall team strengths and weaknesses and analysis, by using the team data. For example, the generating unit 113 can use the score data for tournament selection by using the season stats. As another example, the generating unit 113 can use the score data for strategies, such as analysis of the difference when there is a time period when a score is scored and a time period when a score is not scored, by using the running score. As another example, the generating unit 113 can use the score data for strategies of defense and offense by using a distribution map by field goal.

[0043] (Communications Department) Returning to the description of Fig. 2, the communication unit 12 transmits the score data generated by the generation unit 113 to the terminal 20. For example, the communication unit 12 receives various information such as voice information from the communication unit 23 of the terminal 20 via a network such as the Internet, and transmits various information such as score data to the communication unit 23 of the terminal 20 in which a digital score application is installed. The communication unit 12 is realized by, for example, a NIC (Network Interface Card) or the like.

[0044] (Storage part) The storage unit 13 stores various information such as voice information, score data, statistical data, and trained models, as well as an OS (Operating System) and various programs executed by the information processing device 10. For example, the storage unit 13 stores score data in a database on the information processing device 10 side such as a server, separately from a storage unit 25 of the terminal 20 described below in which the score data is registered in a scorebook. The storage unit 13 is realized by, for example, a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or an optical disk, or a semiconductor memory capable of rewriting information such as a RAM (Random Access Memory), a flash memory, or a NVSRAM (Non Volatile Static Random Access Memory), or the like.

[0045] (Example of terminal configuration) The terminal 20 is realized by, for example, a smartphone, etc. As illustrated in FIG.

[0046] (Input / Output) The input unit 21 is realized by an input device such as a voice input unit such as a microphone or a display unit such as a touch panel, and inputs various information such as voice information in response to an input operation by a scorer. The output unit 22 is realized by an output device such as a display unit such as a touch panel or a voice output unit such as a microphone, and displays various information such as a scorebook and statistical data.

[0047] (Communications Department) The communication unit 23 transmits and receives various information to and from the information processing device 10. For example, the communication unit 23 transmits various information such as voice information to the communication unit 12 of the information processing device 10 via a network such as the Internet, and receives various information such as score data and statistical data from the communication unit 12. The communication unit 23 is realized by, for example, a NIC or the like.

[0048] (Control unit) The control unit 24 controls the entire terminal 20. For example, the control unit 24 is configured with one or more processors having programs that define the flow of various processes and internal memory that stores control information, and the processor executes each process using the programs and internal memory. The control unit 24 is realized by, for example, electronic circuits such as a CPU, MPU, GPU, or integrated circuits such as an ASIC or FPGA. As illustrated in FIG. 2, the control unit 24 has a registration unit 241.

[0049] (Registration Department) The registration unit 241 registers the score data in the scorebook. An example of registration by the registration unit 241 in a case where score data is generated based on the scorer's voice information of "opponent team No. 4 adds 3 points with a 3-point shot" will be described below with reference to FIG. 1. For example, the registration unit 241 registers the score data in the scorebook in the storage unit 25 during a match in accordance with a digital score application. As a result, 3 is added to the numerical value representing the score of team B on the scorebook screen displayed on the output unit 22 of the terminal 20 in FIG. 1.

[0050] (Storage part) The storage unit 25 stores, for example, various information such as audio information, score data, statistical data, and a scorebook, a digital score application, an OS and various programs executed by the terminal 20, etc. The storage unit 25 is realized by a storage device such as an HDD, SSD, or optical disk, or a semiconductor memory such as a RAM, flash memory, or NVSRAM that allows information to be rewritten.

[0051] (An example of processing flow) 6 is a flowchart showing an example of the flow of processing executed by an information processing device. In step S1, the input receiving unit 112 receives input of voice information related to the score of a sports competition. For example, when voice information such as "Number 4 of the opposing team adds 3 points with a 3-point shot" is input to the input unit 21 such as a microphone of the terminal 20, the input receiving unit 112 indirectly receives the input of the voice information from the terminal 20 via the communication units 12 and 23.

[0052] In step S2, the generation unit 113 takes the voice information accepted by the input accepting unit 112 as input information, and generates score data to be registered in a scorebook based on a trained model that takes voice information related to the score of a sports competition as input and outputs score data to be registered in a scorebook. For example, the generation unit 113 inputs the voice information accepted as input to the trained model, and generates output information output from the trained model as score data.

[0053] In step S3, the communication unit 12 transmits the score data generated by the generation unit 113 to the terminal 20. For example, the communication unit 12 transmits the score data to the communication unit 23 of the terminal 20 in which a digital score application is installed, via a network such as the Internet. In this case, the communication unit 23 of the terminal 20 receives the score data from the communication unit 12, for example. Then, the registration unit 241 of the terminal 20 registers the received score data in a scorebook in the storage unit 25, for example.

[0054] (Modification) In the above example, the information processing device 10 and the terminal 20 are configured separately, but may be configured integrally as a terminal, for example.

[0055] 2. Second Embodiment A case will be described in which the information processing device 10X according to the second embodiment further receives input of image information and generates score data further based on the image information. The image information refers to, for example, video information in which the play of a player related to the score is recorded or distributed in real time.

[0056] (An example of the configuration of an information processing device) Fig. 7 is a diagram showing an example of the configuration of an information processing device and a terminal according to the second embodiment. As illustrated in Fig. 7, the information processing device 10X has a control unit 11X and a communication unit 12X instead of the control unit 11 and the communication unit 12. The control unit 11X has an input reception unit 112X and a generation unit 113X instead of the input reception unit 112 and the generation unit 113.

[0057] (Input reception section) The input receiving unit 112X further receives input of image information related to the score. For example, the input receiving unit 112X receives input of video information in which the play of a player related to the score is recorded or distributed in real time, and which is synchronized (linked) with the audio information by being associated with time information such as a time stamp or containing time information.

[0058] The method by which the input receiving unit 112X receives the input of image information is not particularly limited. As an example, the communication unit 12X receives video information recorded by a recording device (not shown) different from the terminal 20 and distributed in real time from the recording device, and the input receiving unit 112X receives the input of the video information received by the communication unit 12X. As another example, the input receiving unit 112X receives the input of video information recorded by a recording unit (not shown) such as a camera of the terminal 20 via the communication unit 12X and the communication unit 23.

[0059] (Generation part) The generating unit 113X generates score data further based on the image information inputted and accepted by the input accepting unit 112X. As an example, the generating unit 113X analyzes video information in which the play of the players related to the score is recorded using an image recognition technique, extracts analysis information, and generates score data further based on the extracted analysis information.

[0060] Here, the image information can be learning data input to the trained model, similar to the score data. In this case, the image information becomes learning data linked to the score data, so that the trained model with advanced learning can output score data from the image information in a highly accurate form. Therefore, as another example, the generation unit 113X may input the image information whose input has been accepted to the trained model that has further trained the image information as learning data, and generate output information output from the trained model as score data. This allows the generation unit 113X to generate score data with higher accuracy.

[0061] The generation unit 113X may extract information that does not match between the score data based on the audio information whose input is accepted by the input accepting unit 112X and the score data based on the image information, and may further generate correction information for correcting the score data based on the audio information based on the mismatching information.

[0062] As an example, the generation unit 113X extracts the inconsistent information "2-point shot" from score data based on the audio information "The opposing team's No. 4 takes a 2-point shot" that has been accepted as input, and score data based on analysis information of recorded video information showing that the opposing team's No. 4 takes a 3-point shot, and further generates correction information to provide guidance regarding the correction, such as "The image has been identified. Would you like to change it to a 3-point shot?"

[0063] The generating unit 113X may further generate missing information that is insufficient for registration in the scorebook. For example, when the generating unit 113X receives input of voice information such as "Number 4 of the opposing team takes a three-point shot," the generating unit 113X further generates missing information regarding the success or failure of the shot, such as "Did the three-point shot succeed?", based on the voice information.

[0064] As another example, when the generation unit 113X receives input of audio information such as "Number 4 of the opposing team takes a three-point shot" and video information recording that Number 4 of the opposing team successfully makes a three-point shot, the generation unit 113X further generates missing information such as "Was the three-point shot successful?" based on the audio information and the video information.

[0065] Hereinafter, another example of generation by the generating unit 113X in a case where input of voice information to the effect that the first batter in baseball has moved to first base is received, and then input of voice information to the effect that the next batter has moved to first base is received will be described. In this case, the generating unit 113X further generates missing information regarding where the first batter has moved to, such as, for example, "Has the batter who reached first base moved to second base?"

[0066] The generating unit 113X may further generate statistical data based on the image information whose input is accepted by the input accepting unit 112X. For example, the generating unit 113X generates a distribution map by field goal by inputting video information in which the number 4 of the opposing team successfully made a three-point shot from outside the three-point line in front of the ring and audio information synchronized with the video information into a trained model and correlating and aggregating the score data output from the trained model.

[0067] (Communications Department) The communication unit 12X further transmits the correction information generated by the generation unit 113X to the terminal 20. The output unit 22 of the terminal 20 outputs the correction information transmitted from the communication unit 12X by voice or displays it, and presents a guide regarding the correction to the scorer. In this way, the communication unit 12X can urge the scorer to correct the score data even if the score data based on the voice information is incorrect.

[0068] The communication unit 12X may further transmit the missing information generated by the generation unit 113X to the terminal 20. The output unit 22 of the terminal 20 outputs the missing information transmitted from the communication unit 12X by voice or displays it, and presents the information that is missing for scoring. In this way, the communication unit 12X can assist in scoring in the scorebook, for example, by making it easier to prevent beginners from missing out on registering score data in the scorebook.

[0069] (An example of processing flow) 8 is a flowchart showing an example of the flow of processing of the information processing device according to the second embodiment. Steps S21 and S32 are similar to steps S1 and S3.

[0070] In step S22, the input receiving unit 112X further receives an input of image information related to the score. For example, the input receiving unit 112X receives an input of video information from a recording device, in which the play of a player related to the score is recorded and is synchronized with the audio information by being associated with time information such as a timestamp.

[0071] In step S23, the generating unit 113X judges whether inconsistent information is extracted between the score data based on the voice information inputted and accepted by the input accepting unit 112X and the score data based on the image information. For example, the generating unit 113X extracts inconsistent information "2-point shot" between the score data based on the voice information inputted and accepted, "The opponent's No. 4 takes a 2-point shot," and the score data based on the analysis information of the video information in which the opponent's No. 4 takes a 3-point shot.

[0072] If it is determined that inconsistent information has been extracted (Yes in step S23), in step S24, the generating unit 113X further generates correction information for correcting the score data based on the audio information based on the inconsistent information. For example, the generating unit 113X further generates correction information, "Image identification confirmed. Would you like to change it to a three-point shot?" based on the inconsistent information, "two-point shot."

[0073] In step S25, the communication unit 12X further transmits to the terminal 20 the correction information generated by the generation unit 113X.

[0074] In step S26, the input receiving unit 112X receives an input of information corresponding to the correction information. For example, the input receiving unit 112X indirectly receives an input of voice information corresponding to the correction information, such as "correct to a three-point shot," input to the input unit 21 such as a microphone of the terminal 20, via the communication unit 12X and the communication unit 23.

[0075] After step S26, or if it is determined that no mismatching information has been extracted (No in step S23), in step S27, the generation unit 113X determines whether or not there is insufficient information for registration in the scorebook. For example, when the input receiving unit 112X receives the input of voice information "Number 4 of the opposing team takes a two-point shot" and voice information corresponding to the correction information "will be corrected to a three-point shot", the generation unit 113X determines whether or not there is insufficient information regarding the success or failure of the shot based on this voice information.

[0076] If it is determined that the information is insufficient for registration in the scorebook (Yes in step S27), in step S28, the generating unit 113X further generates the missing information that is insufficient for registration in the scorebook. For example, the generating unit 113X further generates the missing information regarding the success or failure of the shot, such as "Did you succeed in the three-point shot?"

[0077] In step S29, the communication unit 12X further transmits to the terminal 20 the missing information generated by the generation unit 113X.

[0078] In step S30, the input receiving unit 112X receives an input of information corresponding to the missing information. For example, the input receiving unit 112X indirectly receives an input of voice information corresponding to the missing information, such as "The three-point shot was successful," input to the input unit 21 such as a microphone of the terminal 20, via the communication unit 12X and the communication unit 23.

[0079] After step S30, or if it is determined that there is sufficient information to register in the scorebook (No in step S27), in step S31, the generating unit 113X generates score data further based on the image information whose input is accepted by the input accepting unit 112X. For example, the generating unit 113X generates score data based on audio information such as "No. 4 of the opposing team makes a two-point shot," audio information corresponding to correction information based on the image information such as "This will be corrected to a three-point shot," and audio information corresponding to the insufficient information such as "The three-point shot was successful." In this case, the generating unit 113X generates score data indicating that, for example, No. 4 of the opposing team made a successful three-point shot and added three points to the opposing team.

[0080] (Modification) In the above example, the process of step S22 is executed after the process of step S21, and the process of steps S27 to S30 is executed after the processes of steps S23 to S26, but in this embodiment, the order of these processes is not particularly limited. In this embodiment, for example, the process of step S21 may be executed simultaneously with the process of step S22 or after step S22, and the process of steps S23 to S26 may be executed simultaneously with the process of steps S27 to S30 or after the processes of steps S27 to S30.

[0081] 3. Third embodiment In the information processing device 10Y according to the third embodiment, a case will be described in which related information is further generated based on voice information whose input has been accepted, and the generated related information is further transmitted to the terminal 20. Here, the related information refers to information associated with score data, such as sub-information of a match related to score data that is not registered in a scorebook, such as the shape of a shot.

[0082] (An example of the configuration of an information processing device) Fig. 9 is a diagram showing an example of the configuration of an information processing device and a terminal according to the third embodiment. As illustrated in Fig. 9, the information processing device 10Y has a control unit 11Y and a communication unit 12Y instead of the control unit 11 and the communication unit 12. The control unit 11Y has a generation unit 113Y instead of the generation unit 113.

[0083] (Generation part) The generating unit 113Y further generates related information associated with the score data. For example, the generating unit 113Y further generates related information on the shape of a basketball shot, such as a layup or a floater, based on the voice information whose input has been accepted. As an example, when the generating unit 113Y accepts input of voice information such as "teammate, Yamada, number 5, two-point shot, memo, layup", the generating unit 113Y further generates related information based on the word "layup" following the word "memo" in the voice information.

[0084] For example, the generating unit 113Y may generate statistical data based on related information. As an example, the generating unit 113Y collects related information such as annual score data and player characteristics such as tendencies in shot shapes, and generates season stats. In this way, the generating unit 113Y can utilize the related information to assist in understanding the characteristics and tendencies of the players.

[0085] (Communications Department) The communication unit 12Y further transmits the related information generated by the generation unit 113Y to the terminal 20. As an example, the communication unit 12Y further transmits related information based on the generated voice information of "layup" to the communication unit 23 of the terminal 20. The storage unit 25 of the terminal 20 stores the related information separately from the score data registered in the scorebook. This allows the communication unit 12Y to utilize the related information for generating statistical data such as season stats and for assisting in understanding the characteristics and tendencies of players.

[0086] (An example of processing flow) 10 is a flowchart showing an example of the flow of processing in the information processing device according to the third embodiment. Steps S41 to S43 are similar to steps S1 to S3.

[0087] In step S44, the generating unit 113Y further generates related information associated with the score data. For example, when input of voice information such as "teammate, Yamada, No. 5, 2-point shot, memo, layup" is accepted, the generating unit 113Y generates related information based on the word "layup" following the word "memo" in the voice information.

[0088] In step S45, the communication unit 12Y further transmits the related information generated by the generation unit 113Y to the terminal 20. For example, the communication unit 12Y further transmits related information based on the generated voice information of “lay-up” to the communication unit 23 of the terminal 20.

[0089] (Modification) In the above example, the processes of steps S44 and S45 are executed after the processes of steps S42 and S43, but in this embodiment, the order of these processes is not particularly limited. In this embodiment, for example, the processes of steps S42 and S43 may be executed simultaneously with the processes of steps S44 and S45 or after the processes of steps S44 and S45.

[0090] (4. Fourth embodiment) In the information processing device 10Z according to the fourth embodiment, the input of voice information of a plurality of people is accepted, and modifiable score data is generated based on score data based on each of the voice information of the plurality of people whose input has been accepted.

[0091] (An example of the configuration of an information processing device) Fig. 11 is a diagram showing an example of the configuration of an information processing device and a terminal according to the fourth embodiment. As illustrated in Fig. 11, an information processing device 10Z has a control unit 11Z and a communication unit 12Z instead of the control unit 11 and the communication unit 12. The control unit 11Z has an input receiving unit 112Z and a generation unit 113Z instead of the input receiving unit 112 and the generation unit 113.

[0092] (Input reception section) The input receiving unit 112Z receives input of voice information of a plurality of people. As an example, the input receiving unit 112Z receives input of voice information of a plurality of people input to each of the input units 21 of the plurality of terminals 20 via each of the communication units 23 of the plurality of terminals 20 and the communication unit 12.

[0093] (Generation part) The generating unit 113Z further generates modifiable score data based on the score data based on each of the voice information of the multiple people whose input is accepted by the input accepting unit 112Z.

[0094] Below, we will explain an example in which there are multiple managers and audio information is received from one manager saying "Number 4 of the opposing team makes a three-point shot, adding three points," and audio information is received from another manager saying "Number 4 of the opposing team makes a three-point shot."

[0095] In this case, the generating unit 113Z generates, for example, score data based on each of these pieces of voice information as score data to be registered in a scorebook. In addition, the generating unit 113Z further generates, for example, among the score data based on each of the voice information of the multiple people whose input is accepted by the input accepting unit 112Z, inconsistent score data based on the voice information of one manager, such as "3 points added," as correctable score data such as "3 points added, is this correct?"

[0096] As a result, the generating unit 113Z considers inconsistent score data, such as score data based on voice information from only one of the multiple people, to be valid, and allows the registering unit 241 of the terminal 20 to register the inconsistent score data in the scorebook as modifiable score data, while allowing the modifiable score data to be modified later. Furthermore, the generating unit 113Z can generate, among the score data based on the respective voice information of the multiple people, the matching score data as more accurate score data that has been substantially double-checked by the multiple people, compared to the case of generating score data based on the voice information of one person.

[0097] In the above example, the condition for generating modifiable score data by the generation unit 113Z is described as a case where there is inconsistent score data among the score data based on each of the voice information of multiple people, but this condition is not particularly limited as long as it is based on score data based on each of the voice information of multiple people.

[0098] For example, the generating unit 113Z may further generate correctable score data only when the score data based on each of a plurality of pieces of voice information, such as score data based on voice information of "three-point shot, three points added" by one manager and score data based on voice information of "two-point shot successful" by another manager, includes contradictory information. In this case, the generating unit 113Z may determine that there is no contradiction in the score data based on voice information of only one of the plurality of people, such as score data based on voice information of "three points added" by only one manager, and may not generate the score data as correctable score data. Note that this case is also merely an example, and the conditions for determining whether or not there is a contradiction and whether or not to generate specific score data as correctable score data are not limited to the above example.

[0099] This allows the generating unit 113Z to generate, as correctable score data, only score data that is likely to be inaccurate among the score data based on the voice information of the plurality of people.

[0100] (Communications Department) The communication unit 12Z further transmits the modifiable score data generated by the generation unit 113Z to the terminal 20. As one example, the communication unit 12Z transmits the modifiable score data only to the terminal 20 of the person who uttered the voice information on which the modifiable score data is based. As another example, the communication unit 12Z transmits the modifiable score data to all of the terminals 20 of the multiple people.

[0101] (An example of processing flow) 12 is a flowchart showing an example of the flow of processing by the information processing device according to the fourth embodiment. Steps S65 and S66 are similar to steps S2 and S3.

[0102] In step S61, the input receiving unit 112Z receives input of voice information of a plurality of people. For example, the input receiving unit 112Z indirectly receives input of the voice information of a plurality of people input to each of the input units 21 of the plurality of terminals 20 from each of the plurality of terminals 20 via each of the communication units 23 of the plurality of terminals 20 and the communication unit 12.

[0103] In step S62, the generating unit 113Z judges whether there is any inconsistent score data among the score data based on the voice information of the multiple players whose input has been accepted by the input accepting unit 112Z. For example, if there are multiple managers and the input of voice information from one manager saying "No. 4 of the opposing team scores three points with a three-point shot" and voice information from another manager saying "No. 4 of the opposing team scores three points with a three-point shot" is accepted, the generating unit 113Z judges that there is inconsistent score data based on the voice information that three points have been added.

[0104] If it is determined that there is inconsistent score data (Yes in step S62), in step S63, the generating unit 113Z further generates modifiable score data based on score data based on each of the voice information of the multiple people whose input is accepted by the input accepting unit 112Z. For example, the generating unit 113Z generates inconsistent score data based on voice information that three points have been added as modifiable score data. If it is determined that there is no inconsistent score data (No in step S62), the generating unit 113Z omits the processes of steps S63 and S64.

[0105] In step S64, the communication unit 12Z further transmits the modifiable score data generated by the generation unit 113Z to the terminal 20. For example, the communication unit 12Z transmits the modifiable score data only to the terminal 20 of the person who uttered the voice information on which the modifiable score data is based.

[0106] (Modification) In the above example, the processes of steps S62 to S64 are followed by the processes of steps S65 and S66, but in this embodiment, the order of these processes is not particularly limited. In this embodiment, for example, the processes of steps S62 to S64 may be performed simultaneously with the processes of steps S65 and S66 or after steps S65 and S66.

[0107] (5. Hardware Configuration) 13 is a diagram showing an example of the hardware configuration of the information processing device 10, the information processing device 10X, the information processing device 10Y, and the information processing device 10Z. A program installed in the computer 1200 functioning as the information processing device 10, the information processing device 10X, the information processing device 10Y, and the information processing device 10Z can cause the computer 1200 to function as one or more "parts" of the device according to the embodiment, or to execute an operation or one or more "parts" associated with the device, and can cause the computer 1200 to execute a process or a process step according to the embodiment. Such a program may be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks of the flowcharts and block diagrams described in this specification.

[0108] The computer 1200 according to the embodiment includes a CPU 1212, a RAM 1214, and a graphic controller 1216, which are connected to each other by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes legacy input / output units such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0109] The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into itself, and causes the image data to be displayed on the display device 1218.

[0110] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive 1226 reads programs or data from a DVD-ROM 1227 or the like and provides the programs or data to the storage device 1224. The IC card drive reads programs and data from an IC card and writes the programs and data to the IC card.

[0111] The ROM 1230 stores therein programs that depend on the hardware of the computer 1200, such as a boot program that is executed by the computer 1200 upon activation. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

[0112] The programs are provided by a computer-readable storage medium such as a DVD-ROM 1227 or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, the RAM 1214, or the ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing an operation or processing of information in accordance with the use of the computer 1200.

[0113] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded in the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in the RAM 1214, the storage device 1224, the DVD-ROM 1227, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0114] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, the DVD drive 1226 (DVD-ROM 1227), or an IC card to be read into the RAM 1214, and may perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0115] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and may undergo information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search, replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and writes back the results to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0116] The above-mentioned programs or software modules may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200. In addition, a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0117] The blocks in the flowcharts and block diagrams may represent stages of a process in which operations are performed or "parts" of apparatus responsible for performing the operations. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, or a processor provided with computer readable instructions stored on a computer readable storage medium. Dedicated circuitry may include digital or analog hardware circuitry, and may include integrated circuits (ICs) or discrete circuits. Programmable circuitry may include reconfigurable hardware circuitry including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements, such as field programmable gate arrays (FPGAs) and programmable logic arrays (PLAs).

[0118] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture that includes instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable storage media include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray disks, memory sticks, integrated circuit cards, and the like.

[0119] The computer readable instructions may include either source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, JAVA, C++, and conventional procedural programming languages, such as the "C" programming language or similar programming languages.

[0120] Computer readable instructions may be provided locally or over a local area network (LAN), a wide area network (WAN) such as the Internet, to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, such that the processor or programmable circuit executes the computer readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0121] Although one aspect of the present invention has been described above using an embodiment, the technical scope of the present invention is not limited to the scope described in the above embodiment. Various modifications or improvements can be made to the above embodiment. Furthermore, forms with such modifications or improvements can also be included in the technical scope of the present invention.

[0122] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and may be realized in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is explained using "first," "next," etc. for convenience, it does not mean that it is essential to perform the process in this order. [Explanation of symbols]

[0123] 10. Information processing device 11, 24 Control section 12, 23 Communications Department 13, 25 Storage section 20 Terminals 21 Input section 22 Output section 111 Trained model generation unit 112 Input reception section 113 Generation part 241 Registration Department

Claims

1. an input receiving unit that receives input of audio information related to the score of a sports event; a generation unit that generates score data to be registered in a scorebook based on a trained model that uses the voice information accepted by the input acceptance unit as input information, and uses voice information related to the score of a sports competition as input and outputs score data to be registered in a scorebook; a transmission unit that transmits the score data generated by the generation unit to a terminal; 13. An information processing device comprising:

2. the input receiving unit further receives input of image information related to the score, The information processing apparatus according to claim 1 , wherein the generating unit generates the score data further based on the image information inputted and accepted by the input accepting unit.

3. the generation unit extracts information that does not match between the score data based on the voice information, the input of which is accepted by the input acceptance unit, and the score data based on the image information, and further generates correction information for correcting the score data based on the voice information, based on the information that does not match; The information processing apparatus according to claim 2 , wherein the transmission unit further transmits the correction information generated by the generation unit to the terminal.

4. The generating unit further generates missing information that is not required for registration in the scorebook, 4. The information processing device according to claim 1, wherein the transmission unit further transmits the missing information generated by the generation unit to the terminal.

5. The generating unit further generates related information associated with the score data, The information processing apparatus according to claim 1 , wherein the transmission unit further transmits the related information generated by the generation unit to the terminal.

6. the input receiving unit receives input of the voice information from a plurality of people; the generating unit further generates modifiable score data based on score data based on each of the voice information of the plurality of people whose input is accepted by the input accepting unit; The information processing apparatus according to claim 1 , wherein the transmission unit further transmits the modifiable score data generated by the generation unit to the terminal.

7. An information processing method executed by an information processing device, an input receiving step of receiving input of voice information related to the score of a sports event; a generation step of generating score data to be registered in a scorebook based on a trained model in which the voice information received by the input receiving step is used as input information, and voice information regarding the score of a sports competition is used as input and score data to be registered in a scorebook is used as output; a transmission step of transmitting the score data generated by the generation step to a terminal; 13. An information processing method comprising:

8. an input receiving step of receiving input of voice information related to the score of a sports event; a generation step of generating score data to be registered in a scorebook based on a trained model in which the voice information received by the input receiving step is used as input information, and voice information regarding the score of a sports competition is used as input and score data to be registered in a scorebook is used as output; a transmission step of transmitting the score data generated by the generation step to a terminal; An information processing program characterized by causing a computer to execute the above.

Images