System, Server and Program

Abstract

To contribute to increasing the interest of game events. [Solution] The system of the present application comprises an acquisition unit that acquires audio related to the play of a computer game, an extraction unit that extracts terms related to the computer game from the audio using voice recognition processing, a selection unit that selects commentary information associated with the extracted terms from a memory unit that stores each term related to the computer game in association with commentary information related to each term, and a display control unit that controls the display of the selected commentary information.

Description

[Technical field]

[0001] The present invention relates to a system, a server, and a program. [Background technology]

[0002] Conventionally, events related to computer games (hereinafter, referred to as "game events") have been held. In recent years, among game events, so-called e-sports (electronic sports), which are competitions in which computer games are played, have been attracting attention (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-44152 A Summary of the Invention [Problem to be solved by the invention]

[0004] At game events (e.g., e-sports tournaments), it has been considered to increase the interest of the game event by providing live commentary of the play of a computer game. However, since the commentary is provided using terms related to computer games (e.g., technical terms specific to computer games), it is expected that there will be some spectators who cannot understand the content of the commentary. As a result, there is a risk that the effect of increasing the interest of the game event through the commentary will not be fully achieved.

[0005] The present disclosure provides a system, a server, and a program that contribute to improving the interest of game events. [Means for solving the problem]

[0006] The first aspect is: An acquisition unit for acquiring audio relating to playing of a computer game; an extraction unit that extracts terms related to the computer game from the voice using a voice recognition process; a selection unit that selects commentary information associated with the extracted term from a storage unit that stores each term related to the computer game in association with commentary information related to each term; a display control unit that controls display of the selected guidance information; The system is characterized by comprising:

[0007] Also, in a first aspect, the memory unit stores each of the terms in association with a situation of the computer game in which the term is used, and the display control unit can control the display of the selected commentary information based on the relationship between a first game situation, which is the situation of the computer game associated with the extracted term, and a second game situation, which is the situation of the computer game based on the play.

[0008] In addition, in a first aspect, the display control unit can distinguishably display the selected commentary information when the first game situation matches the second game situation and the selected commentary information when the first game situation does not match the second game situation.

[0009] Also, in a first aspect, each of the terms is a specific term used specifically for the computer game, or a common term used in common with other computer games different from the computer game, and the display control unit can control the display of the selected commentary information based on whether the extracted term is the specific term or the common term.

[0010] Also, in a first aspect, the memory unit stores first term information that associates the unique term with explanatory information related to the unique term, and second term information that associates the common term with explanatory information related to the common term, and the display control unit can control the display of the selected explanatory information based on whether the extracted term is included in the second term information.

[0011] Also, in a first aspect, the display control unit can control the display of the selected commentary information based on the number of times the extracted term is extracted within a predetermined period. Also, in the first aspect, the display control unit can restrict the display of the selected commentary information when the number of times the term is extracted within the predetermined period satisfies a predetermined condition. Also, in the first aspect, the display control unit can relax restrictions on the display of the selected commentary information based on a situation of the computer game based on the play and / or a time condition.

[0012] Also, in a first aspect, the storage unit stores each of the terms in association with a viewing level for each of the terms, and the display control unit can control the display of the selected commentary information based on the viewing level associated with the extracted term. Also, in the first aspect, a determination unit determines a viewing level of a user watching the play, and the display control unit can limit the display of the selected commentary information based on the determined viewing level and the viewing level associated with the extracted term.

[0013] Also, in a first aspect, the computer game includes a first part in which the play progresses and a second part other than the first part, and the display control unit can control display in the second part based on an extraction history of the extracted terms.

[0014] In addition, in a first aspect, the display control unit can display a predetermined number of the selected commentary information based on an extraction order of the extracted terms, and can limit the display of the selected commentary information exceeding the predetermined number. The display control unit can display an area requesting reference to the selected commentary information whose display is limited.

[0015] The second aspect is a server characterized by comprising an acquisition unit that acquires audio related to the play of a computer game, an extraction unit that extracts terms related to the computer game from the audio using voice recognition processing, a selection unit that selects commentary information associated with the extracted terms from a memory unit that stores each term related to the computer game in association with commentary information related to each term, and an output control unit that controls the output of the selected commentary information.

[0016] A third aspect is a program that causes a computer to perform the following operations: acquire audio related to the play of a computer game; extract terms related to the computer game from the audio using speech recognition processing; select commentary information associated with the extracted terms from a memory unit that stores each term related to the computer game in association with commentary information related to each term; and control output of the selected commentary information. Effect of the Invention

[0017] According to the present disclosure, it is possible to provide a system, a server, and a program that contribute to increasing the interest of game events. [Brief description of the drawings]

[0018] [Figure 1] FIG. 4 is a diagram showing an example of a game event according to the present embodiment. [Diagram 2] 1 is a diagram illustrating an example of an overview of an information processing system according to an embodiment of the present invention. [Diagram 3]FIG. 2 is a diagram illustrating an example of a hardware configuration of each device constituting the information processing system according to the present embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the functional configuration of each device constituting the information processing system according to the present embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of a term DB according to the embodiment. [Figure 6] 11 is a diagram showing an example of a first display control of guidance information according to the embodiment. FIG. [Figure 7] 13A to 13C are diagrams illustrating an example of a second display control of the guide information according to the embodiment. [Figure 8] 13A to 13C are diagrams illustrating an example of a third display control of the guide information according to the embodiment. [Figure 9] 13 is a diagram showing a fourth example of display control of guide information according to the embodiment. FIG. [Figure 10] 13 is a diagram showing a fifth example of display control of guidance information according to the embodiment. FIG. [Figure 11] 13 is a diagram showing a sixth example of display control of guide information according to the embodiment. FIG. [Figure 12] 13 is a diagram showing a seventh example of display control of the guide information according to the embodiment. FIG. [Figure 13] FIG. 4 is a sequence diagram showing an example of an operation of the information processing system according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] [Game event description] A game event in this embodiment is an event in which one or more players play a computer game. In the following, an e-sports tournament in which computer games are held as a competition is assumed as an example of a game event, but is not limited to this. A game event may or may not have a competitive nature. Furthermore, a computer game played in a game event may be a game in which players directly compete against each other, may be a game in which players compete over the results of playing the game individually, or may be a game in which players cooperate with each other to execute the game.

[0020] Such a game event may be held by accommodating players and spectators in a physical space such as an arena, a game facility, a cafe, etc. Also, the game event may be held without providing such a physical space, or in addition to such a physical space, for example, in a virtual space provided by a server on a network, with players and spectators connecting from different locations via predetermined terminals.

[0021] Fig. 1 is a diagram showing an example of a game event according to the present embodiment. For example, as shown in Fig. 1, a computer game played in a game event is a one-on-one competitive game. Players participating in the tournament shown in Fig. 1 make one or more player characters (corresponding to objects) active in a virtual game space, or make the player characters compete against enemy characters that are non-player characters.

[0022] For example, in the venue 60 shown in FIG. 1, players 602 and 604 are playing a competitive game. Moreover, a video related to the competitive game is displayed on a display device D installed in the venue 60. A spectator 606 in the venue 60 can enjoy the game event by the video displayed on the display device D. The display device D is, for example, a monitor, a screen, a liquid crystal panel, a projector, or the like. One or more display devices D may be installed in the venue 60. Moreover, the video related to the competitive game may be distributed to a viewing terminal (not shown). Not only the spectator 606 in the venue 60 but also the spectator 606 who is not in the venue 60 can enjoy the game event by the video distributed to the viewing terminal. The spectator 606 who is not in the venue 60 may be called a viewer, etc. Moreover, it goes without saying that the spectator 606 in the venue 60 may use the viewing terminal.

[0023] Also, in the venue 60, a commentator 608 provides commentary on the game event. For example, audio relating to the commentary (hereinafter referred to as "commentary audio") is picked up by a microphone M and output to the venue 60 by a speaker S installed in the venue 60. Such commentary audio can excite the spectators 606. On the other hand, the commentary audio includes terms related to computer games (for example, technical terms specific to computer games), and therefore some spectators 606 cannot understand the content of the commentary audio even if they hear it.

[0024] Therefore, in the information processing system according to this embodiment, commentary audio is acquired, and terms related to computer games are extracted from the commentary audio using voice recognition processing, and information explaining the extracted terms (hereinafter referred to as "explanation information") is displayed on the display device D and / or the viewing terminal. This makes it easier for the spectators 606 to understand the content of the commentary audio, improving the entertainment value of the game event.

[0025] In this way, the information processing system according to this embodiment is a system for displaying commentary information on terms extracted from commentary audio using voice recognition processing. Note that in this embodiment, the commentary audio is described as an example of "audio relating to computer game play", but the "audio relating to computer game play" is not limited to the commentary audio and may include the audio of the spectator 606 or the players 602 and 604, etc.

[0026] [Information processing system configuration] <Outline configuration> Fig. 2 is a diagram showing an example of a schematic configuration of an information processing system according to this embodiment. As shown in Fig. 2, the information processing system 1 includes a server 2, a play terminal 3, a viewing terminal 4, and a communication network 5. The server 2 may be connected to a display device D, a microphone M, and a speaker S provided in a venue 60 illustrated in Fig. 1, for example.

[0027] The server 2 outputs video relating to a computer game played using a play terminal 3 at a game event (hereinafter referred to as "play video"). For example, the server 2 may output the play video to a display device D provided at the venue 60. The server 2 may also output the play video to a viewing terminal 4 connected via a communication network 5.

[0028] The server 2 may function as a game server. A game server is a device that handles some of the functions of the game execution processing on the play terminal 3, such as managing various information related to users who play computer games and executing some of the game processing. The server 2 may be composed of one or more information processing devices, or may be a virtual server. It may be configured using a cloud server or the like.

[0029] The playing terminal 3 is a terminal used for playing a computer game, and transmits and / or receives various data related to the computer game played on the playing terminal 3 between the server 2. The viewing terminal 4 is a terminal used for viewing a computer game played at a game event, and displays gameplay footage distributed from the server 2 via a communications network 5.

[0030] In this embodiment, for convenience of explanation, the play terminal 3 and the viewing terminal 4 are described separately, but the play terminal 3 and the viewing terminal 4 are not limited to being separate terminals and may be the same terminal. For example, when a user of a terminal views the computer game, the terminal may operate as the viewing terminal 4, and when a user of the terminal plays the computer game, the terminal may operate as the play terminal 3.

[0031] The play terminal 3 and the viewing terminal 4 are, for example, computers such as mobile phones (including smartphones), tablets, personal computers, arcade game devices, consumer game devices, amusement machines, etc. The number of play terminals 3 and viewing terminals 4 is not limited to that shown in Fig. 1 and may be one or more. The play terminal 3 and the viewing terminal 4 may be referred to as a "first terminal" and a "second terminal", etc., respectively.

[0032] The communication network 5 is, for example, the Internet, an intranet, a wireless LAN, or mobile communication. The communication network 5 connects the server 2 and the play terminal 3 to each other. Note that the schematic configuration of the information processing system 1 shown in FIG. 1 is merely an example and is not limited to the one shown in the figure. For example, the server 2 may be connected to a display device D, a microphone M, and a speaker S via a predetermined device or the communication network 5. In addition, a terminal for a commentator 608 that collects live audio may be connected to the communication network 5.

[0033] <Hardware configuration> Fig. 3 is a diagram showing an example of the hardware configuration of each device constituting the information processing system according to this embodiment. As shown in Fig. 3, the server 2, the play terminal 3, and the viewing terminal 4 each have a communication interface (IF) 11, a storage device 12, a processor 13, an input device 14, and an output device 15. The communication interface 11, the storage device 12, the processor 13, the input device 14, and the output device 15 are electrically connected via a bus 16.

[0034] Note that the server 2, the play terminal 3, and the viewing terminal 4 do not need to have all of the components shown in Fig. 3, and some of the components may be omitted. For example, the server 2 may be connected to a display device D, a microphone M, and a speaker S provided outside the server 2, instead of at least some of the input device 14 and the output device 15 (e.g., a display, a microphone, a speaker, etc.).

[0035] The communication IF 11 performs wired or wireless communication. Specifically, the communication IF 11 of the server 2 and the communication IF 11 of the play terminal 3 transmit and / or receive information via the communication network 5.

[0036] The storage device 12 is composed of at least one of, for example, a hard disk drive (HDD), a random access memory (RAM), a read only memory (ROM), and a solid state drive (SSD), etc. Specifically, the storage device 12 stores various information and programs (for example, a game program, etc.).

[0037] The processor 13 is configured by a microcomputer including a CPU and a semiconductor memory. Specifically, the processor 13 performs various controls based on the information and programs stored in the storage device 12 and / or the information transmitted or received via the communication IF.

[0038] The input device 14 is configured with at least one of, for example, a keyboard, a touch panel, a mouse, a microphone, a game controller, a camera, a Web camera, etc. The input device 14 accepts an input operation from a user.

[0039] The output device 15 is composed of at least one of, for example, a display and a speaker. The output device 15 outputs information under the control of the processor 13. The output device 15 may constitute the "display unit" of the present invention.

[0040] <Functional configuration> Fig. 4 is a diagram showing an example of the functional configuration of each device constituting the information processing system 1 according to this embodiment. Note that Fig. 4 shows at least a part of the functions of each device, and the functions of each device are not limited to the functions shown in the figure.

[0041] -server- 4, the server 2 includes a control unit 21, a storage unit 22, and a transmission / reception unit 23. The control unit 21, the storage unit 22, and the transmission / reception unit 23 are respectively configured by the processor 13, the storage device 12, and the communication IF 11 of the server 2.

[0042] The control unit 21 controls various processes performed by the server 2. For example, the control unit 21 includes a video generation unit 211, an audio acquisition unit 212, an extraction unit 213, a selection unit 214, and a display control unit 215.

[0043] The video generation unit 211 generates gameplay footage based on data relating to the play of a computer game (hereinafter referred to as "play data") from the play terminal 3. The video generation unit 211 also stores the generated gameplay footage in the storage unit 22. The video generation unit 211 may also generate gameplay footage for replay based on the gameplay footage stored in the storage unit 22.

[0044] The audio acquisition unit 212 acquires live audio relating to the play of a computer game. For example, the audio acquisition unit 212 may acquire live audio picked up via a microphone M installed in the venue 60.

[0045] The extraction unit 213 extracts terms related to computer games (for example, technical terms specific to computer games) from the commentary audio acquired by the audio acquisition unit 212. Specifically, the extraction unit 213 performs a voice recognition process on the commentary audio and generates a character string corresponding to the commentary audio. The extraction unit 213 also performs natural language processing on the generated character string to extract the specific term.

[0046] Here, the voice recognition process includes, for example, acoustic analysis and recognition process using a voice recognition dictionary. In the acoustic analysis, feature quantities such as frequency components, sound intensity, intervals, and time changes of the input live voice are extracted. In the recognition process, a character string corresponding to the live voice is generated based on the feature quantities extracted by the acoustic analysis and a model (for example, an acoustic model, a pronunciation dictionary, a language model, etc.) learned by machine learning.

[0047] The natural language processing includes, for example, morphological analysis, syntactic analysis, semantic analysis, and context analysis. By performing natural language processing on the character string generated by the speech recognition processing, the character string is recognized as a sentence including words having meaning. The extraction unit 213 extracts terms related to computer games recognized by the natural language processing.

[0048] The selection unit 214 selects commentary information associated with the term extracted by the extraction unit 213 from the storage unit 22, which stores each term related to a computer game in association with commentary information related to the term. Specifically, the selection unit 214 searches a term database (DB) stored in the storage unit 22 using the term extracted by the extraction unit 213 as a search key, and selects commentary information associated with the extracted term.

[0049] 5 is a diagram showing an example of a term DB stored in the storage unit 22. The term DB is a database that at least associates each term related to a computer game with explanation information related to the term, and is also called term information or a table. The term DB may also associate each term with the viewing level of a user who is the subject of an explanation of the term, and the situation of the computer game in which the term is used (hereinafter referred to as a "game situation").

[0050] In addition, the multiple terms stored in the DB are terms commonly used in each computer game. (hereinafter referred to as "common terms") and / or terms (hereinafter referred to as "specific terms") that are used specifically in a certain computer game (for example, in FIG. 5, "Fighting V")

[0051] 5, the term DB may be divided into a term DB that associates common terms with explanatory information for the common terms (hereinafter referred to as a "common term DB") and a term DB that associates specific terms with explanatory information for the specific terms (hereinafter referred to as a "specific term DB"). The specific term DB is also called first term information or a first table, and the common term DB is also called second term information or a second table.

[0052] The common term DB may associate the common term, explanation information about the common term, the viewing level of the user who is the subject of the explanation of the common term, and the game situation in which the common term is used. The specific term DB may associate the specific term, explanation information about the specific term, the viewing level of the user who is the subject of the explanation of the specific term, and the game situation in which the specific term is used.

[0053] The common terminology DB can be used in common for multiple computer games, and therefore may be shared by multiple game companies. The common terminology DB may be provided for each game genre (e.g., fighting games, sports games, etc.), and common terms common to each game genre may be stored in association with explanatory information. On the other hand, the specific terminology DB is used specifically for a certain computer game, and therefore may be used by the game company that provides that computer game. In this way, by distinguishing between the common terminology DB and the specific terminology DB, the common terminology DB can be shared by multiple game companies, and therefore the cost of creating the DB can be reduced compared to when each game company creates its own terminology DB.

[0054] 5, the term DB is divided into a common term DB and a specific term DB, but the present invention is not limited to this, and for example, a term DB that integrates the common term DB and the specific term DB may be used. In the term DB, information indicating whether each term is a common term or a specific term (hereinafter referred to as "term classification information") may be associated with each term.

[0055] 5, a specific term DB is provided for each computer game, but this is not limiting, and for example, a specific term DB storing specific terms of multiple computer games provided by a certain game company may be used. In this case, information indicating the computer game in which each specific term is used (hereinafter referred to as "game information") may be associated with each specific term and explanation information for each specific term.

[0056] The selection unit 214 selects commentary information associated with the term extracted by the extraction unit 213 from the common term DB or the specific term DB as described above. The selection unit 214 may also search the common term DB first, and then search the specific term DB if the extracted term is not detected from the common term DB. For example, if the extraction unit 213 extracts the term "△△" from the live voice, the common term DB is searched using the extracted term "△△" as a search key. Since the common term DB shown in FIG. 5 does not include the term "△△", the selection unit 214 searches the specific term DB using the extracted term "△△" as a search key. The selection unit 214 selects commentary information "Use a middle punch to check the approach" associated with the term "△△" in the specific term DB.

[0057] The display control unit 215 controls the display of a screen on the display device D. Specifically, the display control unit 215 controls the display of the play video generated by the video generation unit 211. The display control unit 215 also controls the display of the guidance information selected by the selection unit 214. For example, the display control unit 215 controls the display of the guidance information using at least one of the first to seventh display controls. The first to seventh display controls will be described in detail with reference to FIGS. 6 to 12.

[0058] <First display control> Fig. 6 is a diagram showing an example of a first display control of commentary information according to the present embodiment. For example, Fig. 6 shows a screen D1 displayed on a display device D when a commentary voice "This is where player XX is doing △△" is acquired. In a venue 60, the commentary voice is output via a speaker S.

[0059] 6, the voice acquisition unit 212 acquires a live voice commentary by a commentator 608, "Here, player ●● is doing △△," via a microphone M, and the specific term "△△" is extracted by the extraction unit 213. The selection unit 214 selects commentary information "Deterring approach with a middle punch," associated with the specific term "△△," from the unique term DB.

[0060] For example, as shown in Fig. 6, the display control unit 215 displays the play video generated by the video generation unit 211 in an area R11 in the screen D1. The display control unit 215 displays commentary information "Containing approach with a middle punch" selected from the unique term DB using the term "△△" extracted from the live commentary of the play video as a search key in an area R12 in the screen D1. Note that, in Fig. 6, the commentary information is displayed on the screen D1 together with the play video generated by the video generation unit 211, but this is not limiting, and only the commentary information may be displayed on the screen D1.

[0061] As shown in FIG. 6, by displaying explanatory information about the term “△△” extracted from the live audio on screen D1, even a viewer 606 who is unfamiliar with the term “△△” can understand the content of the live audio through the explanatory information displayed on screen D1.

[0062] <<Second display control>> The display control unit 215 may control the display of the commentary information selected by the selection unit 214 based on the relationship between the game situation (first game situation) associated with the term extracted from the commentary audio by the extraction unit 213 and the game situation based on the play (second game situation). Here, the "game situation associated with the term extracted from the commentary audio" is, for example, the game situation associated with the extracted term in the common term DB or unique term DB in FIG. 5. On the other hand, the "game situation based on the play" is the game situation at the time when the commentary audio is acquired by the audio acquisition unit 212, and may be, for example, the game situation indicated by the play data synchronized with the timing of the commentary audio.

[0063] By considering the relationship between the game situation associated with the terms extracted from the commentary audio and the game situation based on the play (e.g., whether the two match), it is possible to distinguish whether the commentary audio relates to the game situation shown in the play footage (i.e., the current game situation) or to a game situation different from the current game situation (i.e., a hypothetical game situation).

[0064] Fig. 7 is a diagram showing an example of a second display control of commentary information according to the present embodiment. For example, Fig. 7 shows a screen D2 displayed on the display device D when a live commentary voice "This is where ●● player is doing △△. However, if the situation were □□, ▽▽ would be more effective, but ●● player's judgment of the situation is impressive." is acquired. Note that Fig. 7 will be mainly described with respect to differences from Fig. 6.

[0065] As shown in FIG. 7, the area R21 of the screen D2 displays a game video in which the game situation is "middle punch applied." Therefore, in FIG. 7, when the commentary voice "●● player is doing △△ here. However, if the situation is □□, ▽▽ would be more effective, but ●● player's situation judgment is impressive" is acquired, the game situation is "middle punch applied." Also, in FIG. 7, the terms "△△", "□□", and "▽▽" are extracted from the commentary voice by the extraction unit 213. The selection unit 214 selects the commentary information "Using a middle punch to check the approach", "xxxxxxxxxx", and "yyyyyyyyyy" associated with the extracted terms "△△", "□□", and "▽▽", respectively, from the unique term DB shown in FIG. 5, using the extracted terms "△△", "□□", and "▽▽" as search keys, respectively.

[0066] Here, in the unique term DB shown in FIG. 5, the term "△△" is associated with the game situation "middle punch activated". Meanwhile, the terms "□□" and "▽▽" are each associated with the game situation "zzz activated". As described above, the game situation "middle punch activated" associated with the term "△△" extracted from the above-mentioned live commentary audio matches the game situation "middle punch activated" at the time the live commentary audio was acquired. Meanwhile, the game situation "zzz activated" associated with the terms "□□" and "▽▽" extracted from the above-mentioned live commentary audio does not match the game situation "middle punch activated" at the time the live commentary audio was acquired.

[0067] Therefore, the display control unit 215 may display commentary information in a manner that distinguishes between a case where the game situation associated with the term extracted from the commentary audio matches the game situation when the commentary audio was acquired, and a case where the game situation associated with the term extracted from the commentary audio does not match the game situation when the commentary audio was acquired.

[0068] 7, the game situation "middle punch applied" associated with the extracted term "△△" matches the game situation "middle punch applied" when the play-by-play audio was acquired, so the display control unit 215 displays commentary information "Use a middle punch to check the approach" associated with the extracted term "△△" in the region R22 in the first display method (encircled by a solid line here). On the other hand, the game situation "zzz applied" associated with the extracted terms "□□" and "▽▽" does not match the game situation "middle punch applied" when the play-by-play audio was acquired, so the display control unit 215 displays commentary information "xxxxxxxxxx" and "yyyyyyyyy" associated with the extracted terms "□□" and "▽▽" in the regions R23 and R24 in the second display method (encircled by a dashed line here).

[0069] In Fig. 7, the types of lines (here, solid lines and dashed lines) surrounding the commentary information are different between the first display method and the second display method, but this is not limiting. For example, any display method may be used as long as it is possible to distinguish between the commentary information displayed in the first display method and the commentary information displayed in the second display method, such as using different colors between the first display method and the second display method.

[0070] In addition, in Fig. 7, commentary information when the game situation associated with the term extracted from the play-by-play sound matches the game situation when the play-by-play sound was acquired and commentary information when they do not match are displayed in different display methods, but commentary information when they do not match may not be displayed. For example, in Fig. 7, commentary information "Use a middle punch to check the approach" for the extracted term "△△" is displayed on screen D2, and commentary information "xxxxxxxxxx" and "yyyyyyyyyy" for the extracted terms "□□" and "▽▽", respectively, may not be displayed on screen D2.

[0071] <Third display control> The display control unit 215 may control the display of the guidance information selected by the selection unit 214 based on whether the term extracted from the live commentary audio by the extraction unit 213 is a unique term or a common term.

[0072] Fig. 8 is a diagram showing an example of a third display control of commentary information according to this embodiment. For example, Fig. 8 shows a screen D3 displayed on the display device D when a live commentary voice "This is where player XX is doing XX" is acquired. Figs. 6 and 8 differ in that while in Fig. 6, a unique term "△△" is extracted from the live commentary voice, in Fig. 8, a common term "〇〇" is extracted from the live commentary voice. The following mainly describes the differences from Fig. 6.

[0073] 8, the selection unit 214 searches the common term DB using the term "XX" extracted by the extraction unit 213 from the live audio as a search key, and selects the commentary information "Inflict fatal damage" associated with the specific term "XX." The display control unit 215 displays the commentary information "Inflict fatal damage" selected from the common term DB in an area R31 on the screen D3.

[0074] As shown in FIG. 8, the display control unit 215 may display the commentary information for the common term "XX" "Deal fatal damage" in a different display method from the commentary information for the specific term "△△" shown in FIG. 6 "Contain approach with a middle punch." For example, the area R31 in FIG. 8 is colored in a color other than white, whereas the area R12 in FIG. 6 is white. Note that the display method of the commentary information for the specific term and the display method of the commentary information for the common term are not limited to those shown in FIGS. 6 and 8, and it is sufficient that both are displayed in different display methods. Also, the display control unit 215 does not need to display commentary information for either the specific term or the common term.

[0075] Furthermore, the display control unit 215 may control the display of commentary information associated with a term extracted by the extraction unit 213 as described above, based on whether or not the term extracted by the extraction unit 213 is included in the common term DB. This is because the selection unit 214 first searches the common term DB using the term as a search key, and searches the specific term DB if the term is not detected in the common term DB. In general, it is considered that the commentator 608 uses common terms more frequently than specific terms, so the search time can be shortened by searching the common term DB first. Note that the search order of the term DBs is not limited to this, and it goes without saying that the specific term DB may be searched first and the common term DB may be searched afterwards.

[0076] <<Fourth display control>> The display control unit 215 may control the display of commentary information associated with a term based on the number of times the term is extracted by the extraction unit 213 (hereinafter referred to as the "extraction count"). Specifically, the display control unit 215 may restrict the display of commentary information when the number of times a term is extracted in a predetermined period of time satisfies a predetermined condition. Furthermore, the display control unit 215 may relax restrictions on the display of the commentary information based on the game situation and / or time conditions.

[0077] FIG. 9 is a diagram showing an example of a fourth display control of comment information according to this embodiment. For example, in FIG. 9, screens D41 to D43 corresponding to timings T41 to T43 are shown. The following mainly describes the differences from FIG. 6. For example, in FIG. 9, the above-mentioned predetermined period is the periods P1 and P2 from the start to the end of a certain match, but is not limited to this and may be a certain period such as one hour or 30 minutes. Also, in FIG. 9, the above-mentioned predetermined condition is the number of times n that a specific term is extracted in the period P>a predetermined number X (where X>1), but is not limited to this.

[0078] 9, at timing T41, the audio acquisition unit 212 acquires a live commentary voice saying, "It's player ●● doing △△ here," and the extraction unit 213 extracts the term "△△." The number of times n that the term "△△" is extracted at timing T41 is a predetermined number X, and n>X is not satisfied. Therefore, the display control unit 215 displays commentary information "Containing an approach with a middle punch" associated with the extracted term "△△" on the screen D41.

[0079] At timing T42, the audio acquisition unit 212 acquires the live commentary audio "★★Player is doing △△," and the extraction unit 213 extracts the term "△△." The number of times n that the term "△△" is extracted at timing T42 is a predetermined number X+1, which satisfies n>X. Therefore, the display control unit 215 restricts the display of commentary information associated with the extracted term "△△" on screen D42. For example, on screen D42, the commentary information is not displayed due to this restriction. In this way, when n>X is satisfied, even if the term "△△" is extracted, the commentary information is not displayed.

[0080] On the other hand, the display control unit 215 may relax the restriction on displaying the commentary information of the specific term "△△" based on the game situation and / or time condition. Specifically, in Fig. 9, the restriction on displaying the commentary information of the specific term "△△" is relaxed based on the game situation "end of game" or "start of game", or based on the end of period P1 or the start of period P2.

[0081] For example, in FIG. 9, when period P2 starts, the number of extractions of the term "△△" is initialized to n=0. At timing T43, the audio acquisition unit 212 acquires a live voice commentary "This is player ●●'s special move △△," and the extraction unit 213 extracts the term "△△." The number of extractions n of the specific term "△△" at timing T43 is 1, which does not satisfy n>X. Therefore, the display control unit 215 displays commentary information "Containing an approach with a middle punch" associated with the extracted term "△△" on screen D43.

[0082] 9, when the number of times the term "△△" is extracted during period P1 satisfies a predetermined condition, the display of commentary information related to the term "△△" is restricted, making it easier for the spectator 606 to concentrate on the gameplay footage. On the other hand, when the next period P2 starts, the restriction is relaxed, so that even if the spectator 606 is replaced before the start of the next game, commentary information related to the term "△△" can be presented to the new spectator 606.

[0083] <Fifth display control> The display control unit 215 may control the display of explanation information associated with a specific term in the term DB, based on a viewing level associated with the specific term.

[0084] Fig. 10 is a diagram showing an example of the fifth display control of commentary information according to the present embodiment. In Fig. 10, as in Fig. 7, a live commentary voice "This is where ●● player is doing △△. However, if the situation is □□, ▽▽ would be more effective, but ●● player's judgment of the situation is impressive." is assumed to be acquired. Note that Fig. 10 will mainly explain the differences from Fig. 7.

[0085] For example, in FIG. 10, when a main monitor and a sub-monitor are provided as the display device D in the venue 60 in FIG. 1, a screen D51 (here, a screen for intermediate level) displayed on the main monitor and a screen D52 (here, a screen for beginner level) displayed on the sub-monitor are shown. For example, a viewing level of "intermediate level" may be set on the screen D51 for the main monitor, and a viewing level of "beginner level" may be set on the screen D52 for the sub-monitor. In addition, the terms "△△", "□□", and "▽▽" extracted by the extraction unit 213 from the live audio are associated with the viewing levels of "intermediate level", "beginner level", and "beginner level", respectively, in the unique term DB shown in FIG. 5. Note that the game video may be displayed on the screen D51 for the main monitor, and commentary information of the extracted terms may be displayed on the screen D52 for the sub-monitor in a manner according to the viewing level.

[0086] When the viewing level associated with the extracted term is equal to or higher than the viewing level associated with the screen D51 or D52, the display control unit 215 may display commentary information associated with the specific term in the screen D51 or D52. For example, the viewing level "intermediate" associated with the extracted term "△△" is equal to the viewing level "intermediate" defined in the screen D51, so the display control unit 215 may display commentary information associated with the term "△△" in the area R51 in the screen D51. On the other hand, the viewing level "beginner" associated with the extracted terms "□□" and "▽▽" is lower than the viewing level "intermediate" defined in the screen D51, so the display control unit 215 does not display commentary information associated with the extracted terms "□□" and "▽▽" in the screen D51.

[0087] Furthermore, since the viewing level "beginner" associated with the extracted terms "□□" and "▽▽" is equal to the viewing level "beginner" defined on screen D52, the display control unit 215 displays commentary information associated with the extracted terms "□□" and "▽▽" in regions R53 and R54 on screen D52. Furthermore, since the viewing level "intermediate" associated with the extracted term "△△" is a higher viewing level than the viewing level "beginner" defined on screen D52, the display control unit 215 displays commentary information associated with the term "△△" in region R52 on screen D52.

[0088] As shown in FIG. 10, screens D51 and D52 corresponding to different viewing levels are displayed on multiple monitors in venue 60, and each of the multiple monitors is caused to display only commentary information that matches the viewing level, making it easier for spectators 606 to concentrate on the gameplay footage even when spectators 606 with different viewing levels are mixed in venue 60.

[0089] 10, the viewing level of the spectator 606 in the venue 60 does not have to be determined, but this is not limited thereto, and even when commentary information is displayed on the display device D of the venue 60, the viewing level of the spectator 606 may be determined. In other words, the display control unit 215 constitutes a "determination unit that determines the viewing level of the user watching the play" and may limit the display of commentary information based on the determined viewing level and the viewing level associated with the extracted term.

[0090] For example, the display control unit 215 may determine the viewing level of the spectators 606 in the venue 60 based on the ratio of viewing levels (e.g., beginner, intermediate, advanced, etc.) registered in advance by each spectator 606 entering the venue 60, and may restrict the display of commentary information on the display device D of the venue 60 based on the viewing level and the viewing level associated with the extracted term. For example, if the ratio of viewing levels is beginner:intermediate:advanced=5:4:1, the display device D may display the beginner screen D52 of FIG. 10, and if the ratio of viewing levels is beginner:intermediate:advanced=3:5:2, the display device D may display the intermediate screen D51 of FIG. 10. In addition, the display mode of the commentary information may be changed according to the ratio of viewing levels. For example, if there are few beginner viewers, the display time of the commentary information may be shortened or the commentary information may be displayed in a smaller size. Note that since beginner viewers are considered to need commentary information more than advanced viewers, the degree to which the ratio of viewing levels is reflected in the change in the display mode of the commentary information may be greater for advanced viewers. In this case, the commentary information for beginners is reliably displayed even when there are few beginner viewers, while the commentary information for advanced viewers is made less noticeable when there are few advanced viewers, thereby ensuring visibility of the commentary information for beginner viewers.

[0091] Furthermore, when the screen D51 or D52 based on the viewing level is delivered to the viewing terminal 4, the display control unit 215 may determine the viewing level of the user of the viewing terminal 4. The viewing level of the user can be determined, for example, based on the rank of the user as a player, the viewing history of the user, the viewing time of the user, etc. The display control unit 215 may determine a screen to be delivered to the viewing terminal 4 (for example, in FIG. 10, either the intermediate level screen D51 or the beginner level screen D52) based on the viewing level of the user. In this way, the display control unit 215 determines information regarding the screen to be delivered to the viewing terminal 4 based on the viewing level of the user of the viewing terminal 4 and the viewing level associated with the term extracted from the live audio. (hereinafter referred to as "screen information") may be generated.

[0092] ≪Sixth display control≫ The display control unit 215 controls the display based on the extraction history of terms from the live audio. Generally, a computer game includes a first part where the play progresses (hereinafter referred to as a "play part"), and a second part other than the play part (hereinafter referred to as a "non-play part"). The display control unit 215 may control the display based on the extraction history in the play part in the non-play part.

[0093] Here, the play part is a part in which a player character in a computer game is being operated based on the player's operation, and is a state in which a story in a virtual game space is progressing. For example, in a battle type game, the play part is when the player characters are fighting, but is not limited to this.

[0094] A non-play part is a part other than a play part, and is, for example, a state in which the story in the virtual game space is not progressing, such as while a computer game is being loaded, while a character is being set, while a stage is being set, while conditions in the virtual game space are being set, while the virtual game space is being set, etc. In the case of a fighting game, a non-play part is, for example, a preparation period from the end of the previous match to the start of the next match, etc., but is not limited to this. Note that a play part and a non-play part may be called a first scene and a second scene, etc., respectively.

[0095] Fig. 11 is a diagram showing an example of a sixth display control of comment information according to the present embodiment. For example, Fig. 11 shows screens D61 and D62 displayed on the display device D during a non-play part from the end of the previous match to the start of the next match. As shown in Fig. 11, during the non-play part, the display control unit 215 may display a replay video of a play part (e.g., the previous match) on the screen D61.

[0096] Furthermore, the display control unit 215 may display a list of term explanations on the screen D62 in non-play parts based on the extraction history of terms in play parts within a recent predetermined period. The play parts in the most recent predetermined period may be, for example, during the previous game, or during previous games on the same day. Furthermore, the list of term explanations may show explanation information on each term shown in the extraction history as a list. The list of term explanations may be displayed regardless of whether or not the replay video shown as an example in the screen D61 is displayed.

[0097] 11, the glossary may show the explanation information of the extracted terms together with the number of times the terms were extracted from the live commentary in a predetermined period (e.g., during the previous game or during the same day) in descending order of frequency of extraction. By displaying the glossary in the non-play part, the spectator 606 can review the meaning of the terms extracted from the live commentary.

[0098] <Seventh display control> Furthermore, the display control unit 215 may display a predetermined number of pieces of explanation information based on the time series in which a specific term was extracted. Furthermore, the display control unit 215 may limit the display of the explanation information exceeding the predetermined number.

[0099] Fig. 12 is a diagram showing an example of the seventh display control of the explanation information according to the present embodiment. In Figs. 6 to 10, explanation information associated with an extracted term is displayed at the timing when the term is extracted in the play part, but in Fig. 12, a predetermined number of most recent pieces of explanation information may be displayed based on the time series in which the term is extracted in the play part. That is, it differs from Figs. 6 to 10 in that a real-time list of explanations of terms is displayed in the play part. The following mainly describes the differences from Figs. 6 to 10.

[0100] 12, the term explanation list shown on screens D71 and D72 displays up to the most recent three pieces of explanation information, but the number of pieces of explanation information displayed is not limited to 3. Also, on screens D71 and D72, explanation information for more recently extracted terms is displayed at the top, but this may be based on the extraction order of the specific terms and is not limited to the display method shown in FIG.

[0101] 12, for example, it is assumed that the extraction unit 213 extracts the terms "△△", "□□", and "▽▽" from the live audio acquired at timing T71. Since the most recent three pieces of commentary information are displayed on screen D71, the display control unit 215 displays the commentary information for each of the terms "△△", "□□", and "▽▽" extracted at timing T71 on screen D71 in the order of extraction.

[0102] On the other hand, the display control unit 215 limits the display of the explanation information of the term extracted before timing T71, as shown in areas R71 and R72. For example, area R71 indicates that the specific term "△△" was extracted three times before timing T71. Also, area R72 indicates that the specific term "□□" was extracted once before timing T71.

[0103] Also, in FIG. 12, it is assumed that the extraction unit 213 extracts a specific term "XXX" from the live commentary audio acquired at timing T72. Since the most recent three pieces of commentary information are displayed on screen D72, the display control unit 215 newly displays the term "XXX" extracted from the live commentary audio on screen D72. Furthermore, on screen D72, as shown in area R73, the display control unit 215 restricts the display of commentary information for the term "△△" extracted most recently on screen D71. For example, area R73 indicates that the specific term "△△" was extracted four times before timing T72.

[0104] In FIG. 12, the real-time glossary list is displayed on screens D71 and D72 separate from the gameplay video, but the real-time glossary list may be displayed on the same screen as the gameplay video.

[0105] Furthermore, when the screens D71 and D72 showing a list of real-time term explanations are distributed to the viewing terminal 4, the display control unit 215 may configure the areas R71, R72, and R73 showing the explanation information whose display is restricted as areas that request reference to the explanation information in response to an input by the user of the viewing terminal 4, and generate information about the screen including the areas. For example, when the screen D72 in FIG. 12 is displayed on the viewing terminal 4, the display of the explanation information about the term "△△" that has been extracted four times is restricted, and the user of the viewing terminal 4 cannot recognize the meaning of the term "△△". Therefore, the user of the viewing terminal 4 may request reference to the explanation information about the term "△△" by performing a predetermined operation (e.g., tapping, etc.) on the area R73.

[0106] As described above, the display control unit 215 may control the output of the commentary information selected by the selection unit 214 using at least one of the first to seventh display controls. That is, the display control unit 215 may constitute an "output control unit that controls the output of commentary information." More specifically, the display control unit 215 may generate screen information related to a screen (e.g., FIGS. 6 to 12) controlled using at least one of the first to seventh display controls. The display control unit 215 may output the generated screen information to the display device D. In addition, the display control unit 215 may output the generated screen information to the viewing terminal 4 via the transmission / reception unit 23.

[0107] The storage unit 22 stores various information and programs. Specifically, the storage unit 22 stores a term DB. As described above, the term DB may include a common term DB and a specific term DB. The storage unit 22 may also store a video DB that stores play video for replay.

[0108] The transmitting / receiving unit 23 transmits and / or receives information between the play terminal 3 or the viewing terminal 4 via the communication network 5. The transmitting / receiving unit 23 may be called a "transmitting unit" or a "receiving unit."

[0109] Specifically, the transmitting / receiving unit 23 transmits and / or receives data related to play (hereinafter referred to as “play data”) between the playing terminal 3. In addition, the transmitting / receiving unit 23 transmits the above-mentioned screen information to the viewing terminal 4.

[0110] -Play device- 4, the playing terminal 3 includes a control unit 31 and a transmission / reception unit 32. The control unit 31 and the transmission / reception unit 32 are respectively configured by the processor 13 and communication IF 11 of the playing terminal 3. The control unit 31 controls various processes carried out by the playing terminal 3. For example, the control unit 31 has a display control unit 311, an input reception unit 312, and a game control unit 313.

[0111] The display control unit 311 controls the screen displayed on the output device 15 of the play terminal 3. The display control unit 311 controls the display of play images.

[0112] The input receiving unit 412 receives input from the operation of the input device 14 of the play terminal 3. Specifically, the input receiving unit 412 receives operations related to the player's play of the computer game. The input receiving unit 412 may receive input of a performance for the audience (for example, input of audio, video, etc.) by the player who has referred to the above-mentioned audience information.

[0113] The game control unit 313 controls the execution of the computer game in accordance with the operation of the input device 14. Specifically, the game control unit 313 controls the generation and drawing of gameplay images including characters and various objects related to the virtual game space displayed on the output device 15. The gameplay images may be in a video format, but are not limited to this.

[0114] The transmission / reception unit 42 transmits and / or receives information between the server 2 and the server 2 via the communication network 5. The transmission / reception unit 42 may be called a "transmission unit" or a "reception unit." Specifically, the transmission / reception unit 42 transmits data used to generate gameplay footage (hereinafter referred to as "play data") to the server 2.

[0115] -Viewing device- 4, the viewing terminal 4 includes a control unit 41 and a transmission / reception unit 42. The control unit 41 and the transmission / reception unit 42 are respectively configured with the processor 13 and the communication IF 11 of the viewing terminal 4. The control unit 41 controls various processes performed by the viewing terminal 4. For example, the control unit 41 includes a display control unit 411 and an input receiving unit 412.

[0116] The display control unit 411 controls the screen displayed on the output device 15 of the viewing terminal 4. The display control unit 411 controls the display of the play video. Specifically, the display control unit 411 controls the display of commentary information associated with terms extracted from the commentary audio, based on information related to the screen from the server 2. For example, the display control unit 411 may control the display of the commentary information, based on at least one of the first to seventh display controls described above.

[0117] The input receiving unit 412 receives an input by operating the input device 14 of the audio-visual terminal 4. Specifically, the input receiving unit 412 may receive an input of an instruction to use an electronic medium.

[0118] The transmission / reception unit 42 transmits and / or receives information between the server 2 and the server 2 via the communication network 5. The transmission / reception unit 42 may be called a "transmission unit" or a "reception unit." Specifically, the transmission / reception unit 42 receives gameplay footage from the server 2. The transmission / reception unit 42 receives the above-mentioned screen information from the server 2.

[0119] [Operation of information processing system] Fig. 13 is a sequence diagram showing the operation of the information processing system according to this embodiment. Some steps in Fig. 13 may be omitted, or some of the steps may be changed in order. For example, either step st107 or st108 may be omitted. In Fig. 13, the operation in the play part is described as an example.

[0120] 13, in step st101, the play terminal 3 transmits play data from that play terminal 3 to the server 2. In step st102, the server 2 generates play video based on the play data.

[0121] In step st103, the server 2 acquires the commentary audio. In step st104, the server 2 uses a voice recognition process to extract terms related to the computer game from the commentary audio. In step st105, the server 2 selects explanation information associated with the terms extracted in step st104 from the term DB.

[0122] In step st106, the server 2 controls the display of the play video generated in step st102 and the guidance information selected in step st105. The server 2 uses at least one of the above first to seventh display controls to control the display of the guidance information on a screen (e.g., FIGS. 6 to 12) and generates screen information related to the screen.

[0123] In step st107, the server 2 outputs the gameplay video and screen information to the display device D, and the display device D displays the above screen. In step st108, the server 2 outputs the gameplay video and screen information to the viewing terminal 4, and the viewing terminal 4 displays the above screen.

[0124] To summarize the above, the program of this embodiment causes the control unit 21 (computer) of the server 2 to acquire commentary audio (audio related to the play of a computer game), extract terms related to the computer game from the commentary audio using voice recognition processing, select commentary information associated with the extracted terms from the memory unit 22, which stores each term related to the computer game in association with commentary information related to each term, and control the output of the selected commentary information.

[0125] [effect] According to the information processing system 1 of this embodiment, the content of the commentary audio can be made easy to understand by acquiring the commentary audio, extracting terms related to the computer game from the audio using voice recognition processing, and displaying explanatory information related to the extracted terms on the display device D and / or the viewing terminal 4. As a result, the entertainment value of the game event can be improved.

[0126] [Other embodiments] The various control means and processing procedures described in the above embodiment are merely examples, and are not intended to limit the scope of the present invention, its applications, or its uses. The various control means and processing procedures can be appropriately modified in design without departing from the spirit of the present invention.

[0127] In the above embodiment, in addition to or instead of displaying commentary information, related information corresponding to the extracted term may be displayed. For example, when the extracted term is a specific action (a special move or combo) by the player character, information such as the amount of damage caused by the action and a correction value (increase) of the amount of damage caused by the combo may be displayed as related information corresponding to the action. In this case, the storage unit stores information such as the amount of damage caused by the action in association with the game situation in which the action has occurred. This makes it possible to display related information corresponding to the extracted term in addition to or instead of displaying commentary information.

[0128] The related information may be information about the player character or other characters, or information about the player. For example, when a term related to introducing a character or player is extracted, a list or correlation table of characters or players, a battle history, etc. may be displayed as related information.

[0129] The related information may be information related to the game situation, for example, in a sports game, statistical information of the game may be displayed. In a soccer game, statistical information such as the ball possession rate of both teams and a heat map showing the time that a player or the ball stayed at a specific position may be displayed in response to the extracted specific term. In a baseball game, information such as information on the pitcher's pitch type and pitching course, information on the batter's batting average by pitch type and pitching course, and the probability of stealing bases and success probability by runner's pitch count may be displayed in response to the extracted specific term.

[0130] The display of the related information may be controlled according to the game situation, time conditions, the viewing level of the viewer, etc. The commentary information and related information may be displayed regardless of whether or not a term has been extracted from the sound related to play, according to the game situation, time conditions, the viewing level of the viewer, etc. For example, the commentary information and related information as described above may be automatically displayed in a specific game situation or in a non-play part.

[0131] In the above embodiment, the computer game played in the game event is a battle game, but the present invention is not limited to this. The game may be of various types, such as a shooting game, a role-playing game, a simulation game, a board game, and a puzzle game.

[0132] In the above embodiment, the server 2 independently executes the program, but the present invention is not limited to this. At least some of the means of the program may be provided in one or more devices constituting the server 2.

[0133] Even when these other embodiments are adopted, the effects of the present embodiment are exhibited. In addition, the present embodiment can be appropriately combined with other embodiments, and other embodiments can be appropriately combined with each other. [Explanation of symbols]

[0134] 1. Information Processing Systems 2 Server 3. Playing device 4. Viewing device 5. Communication Network 11 Communication Interface 12 Storage device 13 Processors 14 Input Devices 15 Output Devices 16 Bus 21 Control section 22 Memory section 23 Transmitter / receiver 31 Control Unit 32 Transmitter / receiver 41 Control section 42 Transmitter / receiver 211 Image Generation Unit 212 Voice Acquisition Unit 213 Extraction part 214 Selection Section 215 Display control unit 311 Display control unit 312 Input reception section 313 Game Control Unit 411 Display control unit 412 Input reception section 60 Venues 602 Player 606 visitors 608 Commentator D Display device M Microphone S Speaker

Claims

1. Computer, An acquisition means for acquiring live audio relating to the play of a computer game; an extraction means for extracting terms relating to the computer game from the live commentary voice using a voice recognition process; a selection means for selecting commentary information associated with the extracted term from a storage unit that stores each term related to the computer game and commentary information related to each term in association with each other; a display control means for displaying the game image of the computer game and the selected commentary information in different regions on a display screen of one or more display devices installed in a venue where the computer game is played; A determination means for determining a ratio of viewing levels of a plurality of users in the venue; Functioning as a the storage unit stores each of the terms in association with a viewing level of each of the terms; The program characterized in that the display control means controls the display of the selected guide information based on the ratio of the determined viewing levels and the viewing level associated with the extracted term.

2. the one or more display devices include a first display device and a second display device; The viewing level of each of the terms includes a first viewing level and a second viewing level, the display control means causes the first display device to display commentary information of the extracted terms associated with the first viewing level, and causes the second display device to display commentary information of the extracted terms associated with the second viewing level.

2. The program according to claim 1 .

3. the display control means displays a common game image on display screens of the first display device and the second display device.

3. The program according to claim 2 .

4. Computer, An acquisition means for acquiring live audio relating to the play of a computer game; an extraction means for extracting terms relating to the computer game from the live commentary voice using a voice recognition process; a selection means for selecting commentary information associated with the extracted term from a storage unit that stores each term related to the computer game in association with commentary information related to each term; a display control means for displaying a game image of the computer game on a first display device installed in a venue where the computer game is played, and displaying the selected commentary information on a second display device installed in the venue; A determination means for determining a ratio of viewing levels of a plurality of users in the venue; Functioning as a the storage unit stores each of the terms in association with a viewing level of each of the terms; The display control means controls display of the selected guide information based on the determined ratio of viewing levels and a viewing level associated with the extracted term, the program.

5. A storage unit that stores the program according to any one of claims 1 to 4; A control unit that executes the program; A server comprising:

6. A storage unit that stores the program according to any one of claims 1 to 4; A control unit that executes the program; A system for executing the above.

Images