Systems, servers, and programs

Abstract

To contribute to an increase in fun of a game event.SOLUTION: A system includes: an acquisition section for acquiring voice regarding play of a computer game; an extraction section for extracting terminology regarding the computer game from the voice by using voice recognition processing; a selection section for selecting explanation information related to the extracted terminology from a storage section for relating each terminology regarding the computer game and explanation information regarding each terminology and storing them; and a display control section for controlling display of the selected explanation information.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to a system, a server, and a program.

Background Art

[0002] Conventionally, events related to computer games (hereinafter referred to as "game events") have been held. In recent years, among game events, so-called e-sports (electronic sports), which are competitions in which computer games are held, have attracted attention (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In game events (for example, e-sports competitions), it has been considered to improve the interest of the game event by presenting the play of computer games. However, since the presentation is made using terms related to computer games (for example, specialized terms unique to computer games), there may be viewers who cannot understand the content of the presentation. As a result, there is a risk that the effect of improving the interest of the game event by the presentation cannot be fully obtained.

[0005] The present disclosure provides a system, a server, and a program that contribute to improving the interest of game events.

Means for Solving the Problems

[0006] The first aspect is, An acquisition unit that acquires audio related to the gameplay of a computer game, Using speech recognition processing, terms related to the computer game are extracted from the audio. Extraction section, The terms related to the aforementioned computer game and the explanatory information for each term are associated and memorized. A selection unit selects explanatory information associated with the extracted term from the memory unit, A display control unit that controls the display of the selected explanatory information, This system is characterized by having the following features:

[0007] Furthermore, in the first aspect, the storage unit contains the terms and the terms in which they are used. The computer game status is stored in association with the display control unit, and the extracted usage A first game situation which is the situation of the computer game associated with the word, and the player Based on the relationship between the second game situation, which is the state of the computer game based on (i), and The display of the selected explanatory information can be controlled.

[0008] Furthermore, in the first aspect, the display control unit determines that the first game state is the second game state. The selected explanatory information when it matches the game situation, and the first game situation To distinguish between the selected explanatory information in cases that do not match the game situation described in the second section. It can be displayed.

[0009] Furthermore, in the first aspect, each of the terms used is specific to the computer game. Specific terminology used in this computer game, or terms used in common with other computer games that differ from the aforementioned computer game. is a common language used, and the display control unit controls the display of the selected explanatory information based on whether the extracted term is the proprietary term or the above common language. This is possible.

[0010] Also, in a first aspect, the storage unit stores first term information associating the proprietary term with explanatory information regarding the proprietary term, and second term information associating the common language with explanatory information regarding the common language. The display control unit can control the display of the selected explanatory information based on whether the extracted term is included in the second term information. information, and second term information associating the common language with explanatory information regarding the common language, and the display control unit can control the display of the selected explanatory information based on whether the extracted term is included in the second term information. In addition, in a first aspect, the display control unit can control the display of the selected explanatory information based on the number of times the extracted term is extracted within a predetermined period. Also, in a first aspect, the display control unit can limit the display of the selected explanatory information when the number of extractions within the predetermined period satisfies a predetermined condition. Also, in a first aspect, the display control unit can relax the restrictions regarding the display of the selected explanatory information based on the situation of the computer game based on the play and / or time conditions. This is possible.

[0011] In addition, in a first aspect, the display control unit can control the display of the selected explanatory information based on the number of times the extracted term is extracted within a predetermined period. Also, in a first aspect, the display control unit can control the display of the selected explanatory information based on the number of extractions of the extracted term within the predetermined period. Also, in a first aspect, the display control unit can limit the display of the selected explanatory information when the number of extractions within the predetermined period satisfies a predetermined condition. Also, in a first aspect, the display control unit can relax the restrictions regarding the display of the selected explanatory information based on the situation of the computer game based on the play and / or time conditions. In addition, in a first aspect, the storage unit stores the association between each term and the viewing level of each term, and the display control unit can control the display of the selected explanatory information based on the viewing level associated with the extracted term. Also, in a first aspect, a determination unit that determines the viewing level of the user who views the play, and the display control This can relax the restrictions regarding the display of the selected explanatory information.

[0012] In addition, in a first aspect, the storage unit stores the association between each term and the viewing level of each term, and the display control unit can control the display of the selected explanatory information based on the viewing level associated with the extracted term. Also, in a first aspect, the display control unit can control the display of the selected explanatory information based on the viewing level associated with the extracted term. Also, in a first aspect, a determination unit that determines the viewing level of the user who views the play, and the display control unit. The part can limit the display of the selected explanatory information based on the determined viewing level and the viewing level associated with the extracted term.

[0013] Also, in a first aspect, the computer game includes a first part where the play progresses and a second part other than the first part, and the display control unit can control the display based on the extraction history of the extracted term in the second part.

[0014] Also, in a first aspect, the display control unit displays a predetermined number of the selected explanatory information based on the extraction order of the extracted term, and can limit the display of the selected explanatory information exceeding the predetermined number. The display control unit can display a region for requesting reference to the selected explanatory information whose display is restricted.

[0015] A second aspect is characterized in that the server includes an acquisition unit that acquires voice related to the play of a computer game, an extraction unit that extracts terms related to the computer game from the voice using voice recognition processing, a selection unit that selects explanatory information associated with the extracted terms from a storage unit that stores each term related to the computer game and the explanatory information related to each term in association with each other, and an output control unit that controls the output of the selected explanatory information.

[0016] A third aspect is that the computer acquires voice related to the play of a computer game, and extracts terms related to the computer game from the voice using voice recognition processing. The purpose is to provide information on the various terms related to the aforementioned computer game and the explanatory information for each term. From the memory unit that stores the terms in sequence, select the explanatory information associated with the extracted term. The features include controlling the output of the selected explanatory information and causing it to perform the following actions. This is a program. [Effects of the Invention]

[0017] According to this disclosure, the system, server and program contribute to improving the entertainment value of game events. We can provide grams. [Brief explanation of the drawing]

[0018] [Figure 1] This figure shows an example of a game event according to this embodiment. [Figure 2] This figure shows an example of the overview of the information processing system according to this embodiment. [Figure 3] This figure shows an example of the hardware configuration of each device constituting the information processing system according to this embodiment. [Figure 4] This figure shows an example of the functional configuration of each device constituting the information processing system according to this embodiment. [Figure 5] This figure shows an example of a terminology database according to this embodiment. [Figure 6] This figure shows an example of the first display control of explanatory information according to this embodiment. [Figure 7] This figure shows an example of the second display control of the explanatory information according to this embodiment. [Figure 8] This figure shows an example of the third display control of the explanatory information according to this embodiment. [Figure 9] This figure shows an example of the fourth display control in the explanatory information according to this embodiment. [Figure 10] This figure shows an example of the fifth display control of the explanatory information according to this embodiment. [Figure 11]This figure shows an example of the sixth display control in the explanatory information according to this embodiment. [Figure 12] This figure shows an example of the seventh display control in the explanatory information according to this embodiment. [Figure 13] This sequence diagram shows an example of the operation of the information processing system according to this embodiment. [Modes for carrying out the invention]

[0019] [Game event description] In this embodiment, a game event is when one or more players play a computer game. This is an event. Below, as an example of a game event, a computer game is This primarily refers to esports tournaments held as competitive events, but is not limited to them. (Game events) It may or may not have a competitive aspect. Also, it can be played at game events. The computer games being played may be games in which players compete directly against each other, or It could be a competition where each layer plays the game individually and competes based on their results, or it could be a competition where players cooperate with each other. It may also be something that runs the game.

[0020] Such gaming events are held in physical spaces such as arenas, gaming facilities, and cafes. The event may be held with players and spectators present. Without providing a physical space, or in addition to the physical space, for example, on a network In the virtual space provided by the server, players and viewers can access the space from different locations. The event may be held by connecting via a designated terminal.

[0021] Figure 1 shows an example of a game event according to this embodiment. For example, as shown in Figure 1 Thus, computer games played at gaming events are one-on-one matches This is a battle-type game. The players participating in the tournament shown in Figure 1 are one or more players You can make Rakuta (equivalent to an object) move around in the virtual game space, or the player character This allows you to have non-playable characters, such as enemy characters, fight against each other.

[0022] For example, in venue 60 shown in Figure 1, players 602 and 604 play a competitive game. In addition, videos related to competitive games are displayed on display device D installed in venue 60. The 606 spectators in the venue 60 were able to see the game event through the video displayed on display device D. You can enjoy this. The display device D is, for example, a monitor, screen, liquid crystal panel, This includes projectors, etc. One or more display devices D may be provided within the venue 60. Also, Video related to competitive games may be distributed to a viewing device (not shown). The video footage suggests that not only were there 606 spectators inside the venue, but also 6 spectators who were not in the venue. 06 can also enjoy the game event. However, spectator 606 who is not in venue 60 will be seen They may also be called hearing persons, etc. Furthermore, the audience members 606 in venue 60 may use viewing devices. Of course.

[0023] Additionally, at venue 60, commentator 608 will provide live commentary on the game event. If so, the audio related to the commentary (hereinafter referred to as "commentary audio") will be picked up by microphone M. The audio is output to venue 60 via speaker S installed in venue 60. This will further excite the 606 spectators. On the other hand, the commentary audio will be computer game Because it includes terminology related to games (for example, specialized terminology specific to computer games), the commentary There are also 606 viewers who are unable to understand the content even after listening to the audio.

[0024] Therefore, in the information processing system according to this embodiment, live audio is acquired and speech recognition processing is performed. This method extracts computer game-related terminology from the commentary audio and interprets the extracted terminology. The explanatory information (hereinafter referred to as "explanatory information") is displayed on the display device D and / or the viewing terminal. This makes it easier for the 606 viewers to understand the content of the commentary, thus making the game event To improve the appeal of the product.

[0025] Thus, in the information processing system according to this embodiment, speech recognition processing is used to provide live commentary audio. This system displays explanatory information about terms extracted from the data. In terms of form, the above commentary audio is described as an example of "audio related to playing computer games." To clarify, "audio related to computer game gameplay" is not limited to commentary audio, but also includes audio from viewers. The audio may include sounds from person 606 or players 602 and 604, etc.

[0026] [Configuration of the Information Processing System] <Outline configuration> Figure 2 shows an example of the schematic configuration of the information processing system according to this embodiment. As shown, the information processing system 1 consists of a server 2, a play terminal 3, a viewing terminal 4, Includes a communication network 5. Also, server 2 is, for example, at venue 60 as illustrated in Figure 1. It may be connected to a display device D, a microphone M, and a speaker S provided therein.

[0027] Server 2 is where computer games played using terminal 3 during game events are played. The system outputs video related to the game (hereinafter referred to as "gameplay video"). For example, Server 2 outputs the relevant video. The gameplay footage may be output to display device D, which is set up in venue 60. Also, server 2, The gameplay video is output to the viewing terminal 4 connected via the communication network 5. That's good too.

[0028] Server 2 may also function as a game server. The game server is a computer This system manages various information about users playing the game and executes some of the game's processes. It is a device that handles some of the functions of the game execution process on the play terminal 3, such as doing the above. Server 2 may consist of one or more information processing devices, or a virtual server. It may be configured using (cloud servers, etc.).

[0029] Play terminal 3 is a terminal used to play computer games, and is connected to server 2 and During this period, various data related to the computer game played on play terminal 3 It transmits and / or receives. Viewing terminal 4 is the computer used in the game event. This is a terminal used to view the game, and it delivers content from server 2 via communication network 5. Display the gameplay footage.

[0030] In this embodiment, for the sake of explanation, the play terminal 3 and the viewing terminal 4 will be described separately. However, the playing device 3 and the viewing device 4 are not limited to separate devices; they may be the same device. For example, if a user of a device watches the above computer game, the device is for viewing. When operating as terminal 4, and the user of that terminal plays the above computer game, The terminal may operate as the play terminal 3.

[0031] Playing device 3 and viewing device 4 are, for example, mobile phones (including smartphones), etc. Bullet, personal computer, arcade game machine, or consumer game This refers to a computer for devices, amusement equipment, etc. It also includes a play terminal 3 and a viewing terminal. The number of terminals 4 is not limited to those shown in Figure 1; any number of terminals 4 is acceptable. Play terminal 3 and visual The listening terminals 4 may be referred to as "terminal 1" and "terminal 2," respectively.

[0032] The communication network 5 is, for example, the Internet, an intranet, a wireless LAN, or mobile This is a dynamic communication system. The communication network 5 interconnects the server 2 and the player terminal 3. The schematic configuration of the information processing system 1 shown in Figure 1 is merely an example and is not necessarily accurate. It is not limited to this. For example, Server 2 may display via a predetermined device or communication network 5. It may also be connected to a stationary unit D, microphone M, and speaker S. Additionally, 6 commentators will be recording the commentary audio. A terminal for 08 may be connected to communication network 5.

[0033] <Hardware Configuration> Figure 3 shows one of the hardware configurations of each device constituting the information processing system according to this embodiment. This is an example. As shown in Figure 3, Server 2, Play Terminal 3, and Viewing Terminal 4 are: These are the communication interface (IF) 11, storage device 12, processor 13, and input data respectively. It has a vice 14 and an output device 15. Communication interface 11, storage device 12, The processor 13, input device 14, and output device 15 are electrically connected via the bus 16. It is connected.

[0034] Furthermore, Server 2, Play Terminal 3, and Viewing Terminal 4 each consist of all the components shown in Figure 3. It is not necessary to have all the components, and some components may be omitted. For example, Server 2 is an input device Chair 14 and at least a portion of the output device 15 (e.g., display, microphone and...) Instead of the speaker, etc., the display device D, microphone M, and speaker S located outside server 2 are used. It may be connected.

[0035] Communication IF11 performs wired or wireless communication. Specifically, it communicates with server 2's communication IF11. Alternatively, information is transmitted via the communication network 5 to the communication IF11 of the play terminal 3. To receive / send.

[0036] The storage device 12 is, for example, an HDD (Hard Disk Drive), RAM (Ra). ndom Access Memory), ROM(Read Only Memory) ) and at least one of the following: Specifically, the storage device 12 stores various information and programs (for example, game programs). (etc.)

[0037] The processor 13 consists of a microcomputer including a CPU and semiconductor memory. Specifically, information and programs stored in the memory device 12, and / or in the communication interface. Various controls are performed based on the information transmitted or received.

[0038] The input device 14 may be, for example, a keyboard, touch panel, mouse, microphone, or game controller. It consists of at least one of the following: a controller, a camera, and a webcam. Input device 1 4 accepts input from the user.

[0039] The output device 15 consists of at least one of the following: a display and a speaker. The output device 15 outputs information according to the control of the processor 13. Chair 15 may constitute the "display unit" of the present invention.

[0040] <Functional Configuration> Figure 4 shows an example of the functional configuration of each device constituting the information processing system 1 according to this embodiment. This is a diagram. Note that Figure 4 shows at least some of the functions of each device, and the functions of each device This is not limited to the functions illustrated.

[0041] -server- As shown in Figure 4, the server 2 comprises a control unit 21, a storage unit 22, and a transmission / reception unit 23. The control unit 21, storage unit 22, and transmission / reception unit 23 are, respectively, connected to the processor 1 of the server 2. 3. It consists of a storage device 12 and a communication interface 11.

[0042] The control unit 21 controls various processes performed by the server 2. For example, the control unit 21 controls the video The image generation unit 211, sound acquisition unit 212, extraction unit 213, selection unit 214, and display control unit 215 are To possess.

[0043] The video generation unit 211 receives data related to the gameplay of the computer game from the play terminal 3. Based on the data (hereinafter referred to as "play data"), gameplay footage is generated. The video generation unit 211 stores the generated gameplay video in the memory unit 22. Based on the gameplay footage stored in the memory unit 22, it generates gameplay footage for replay. That's good too.

[0044] The audio acquisition unit 212 acquires commentary audio related to the gameplay of a computer game. The audio acquisition unit 212 then receives the commentary audio picked up via the microphone M installed in the venue 60. You may acquire it.

[0045] The extraction unit 213 extracts computer game data from the live commentary audio acquired by the audio acquisition unit 212. Extract terminology related to games (for example, specialized terminology specific to computer games). The extraction unit 213 performs speech recognition processing on the commentary audio and responds to the commentary audio. The extraction unit 213 then performs natural language processing on the generated string. Perform the following to extract the specific terms mentioned above.

[0046] Here, speech recognition processing involves, for example, acoustic analysis and recognition processing using a speech recognition dictionary. Includes. Acoustic analysis includes the frequency components, intensity, intervals, and temporal changes of the input commentary audio. Features are extracted. In recognition processing, the features extracted by acoustic analysis and machine learning are used. Based on the trained model (e.g., acoustic model, pronunciation dictionary, language model, etc.), A string corresponding to the audio is generated.

[0047] Furthermore, natural language processing includes, for example, morphological analysis, syntactic analysis, semantic analysis, and contextual analysis. , including. By performing natural language processing on the string generated by speech recognition processing, The string is recognized as a sentence containing meaningful words. The extraction unit 213 performs natural language processing. This extracts computer game-related terminology recognized through logic.

[0048] The selection unit 214 selects terms related to computer games and explanatory information related to those terms. The terms extracted by the extraction unit 213 are associated with the storage unit 22, which stores them in association. Selects the explanatory information provided. Specifically, the selection unit 214 selects the term stored in the memory unit 22. The database (DB) is searched using the terms extracted by the extraction unit 213 as search keys. Select explanatory information associated with the extracted term.

[0049] Figure 5 shows an example of a term database stored in the memory unit 22. The term database is a computer database. Each term related to the computer game and the explanatory information for each term are at least associated with each term. It is a database, also called terminology information or a table, etc. Furthermore, the terminology DB is the relevant database. The viewing level of the users to whom each term is explained, and the computer games in which each term is used. The game situation (hereinafter referred to as "game situation") may be associated with each of the terms in question.

[0050] Furthermore, multiple terms stored in the database are terms commonly used across all computer games. (Hereinafter referred to as "common terminology"), and / or a computer game (for example, in Figure 5) This may include terms used specifically for "Fighting V" (hereinafter referred to as "specific terms"). .

[0051] As shown in Figure 5, the terminology database associates common terms with explanatory information for those common terms. The term database (hereinafter referred to as the "common term database") and specific terms and their explanatory information are related. It may be distinguished from the linked terminology database (hereinafter referred to as the "specific term database"). The term database is also called the first term information or first table, etc., and the common term database is the second term This is also called word information or a second table, etc.

[0052] The Common Terminology Database contains the above-mentioned common terms, explanatory information related to those common terms, and the The viewing level of the users being explained and the game context in which the common terminology is used are related. You may add it. Also, the specific term database contains the above specific terms and explanatory information related to them. Furthermore, the viewing level of the users who are the target of the explanation of the specific term, and the game in which the specific term is used. You can associate the situation with the condition.

[0053] The Common Terminology Database can be used across multiple computer games, so it can be used across multiple games It may be shared within the company. Note that this common terminology database is used for game genres (for example, fighting games). Each game genre (such as baseball games and sports games) has its own set of terms and explanatory information common to all game genres. You can also remember them in association with each other. On the other hand, a unique term database is unique to a particular computer game. Since it is used for that purpose, it may be used by the game company that provides the computer game in question. In this way, by distinguishing between the common terminology database and the specific terminology database, multiple common terminology databases can be created. Since it can be shared among game companies, it is more efficient than if each game company were to create its own terminology database. This can reduce the cost of creating a database.

[0054] Note that in Figure 5, the terminology database is distinguished into a common terminology database and a specific terminology database. However, this is not limited to the above; for example, a terminology database that integrates the common terminology database and the specific terminology database may be used. It may be used. In the terminology database, it is determined whether each term is a common term or a specific term. The information provided (hereinafter referred to as "term classification information") may be associated with each term.

[0055] Furthermore, in Figure 5, a unique terminology database is assumed to be provided for each computer game, This is not limited to the above; for example, the unique features of multiple computer games provided by a certain game company A unique term database may be used to store the terms. In this case, each unique term is used in the context of Information relating to the computer game (hereinafter referred to as "game information"), each specific term and each specific application It may be associated with explanatory information about the word.

[0056] The selection unit 214 uses the extraction unit 213 to select from the common term DB or specific term DB as described above. Then, it selects explanatory information associated with the extracted terms. Also, the selection unit 214 is common If the term database is searched first and the extracted term is not found in the common term database, The specific term database may also be searched. For example, the extraction unit 213 may extract the term "△△" from the commentary audio. If "△△" is extracted, the extracted term "△△" is used as the search key to search the Common Terminology Database. Therefore, the term "△△" is not included in the common terminology database shown in Figure 5, so the selection unit 214 The extracted term "△△" is then used as the search key to search the specific term database. Selection section 214 In the unique term database, the explanatory information associated with the term "△△" is "to draw the enemy's attention with a medium punch." I choose to "control."

[0057] The display control unit 215 controls the display of the screen on the display device D. Specifically, the display control The control unit 215 controls the display of the gameplay video generated by the video generation unit 211. The display control unit 215 controls the display of the explanatory information selected by the selection unit 214. For example, the display control unit 215 uses at least one of the first to seventh display controls to explain the information This controls the display of information. Refer to Figures 6-12 for a detailed explanation of the first to seventh display controls. ru.

[0058] ≪First Display Control≫ Figure 6 shows an example of the first display control of explanatory information according to this embodiment. For example, Figure 6 shows the case where the commentary audio "Here, player ●● is doing △△" is acquired. Screen D1 displayed on display device D is shown. In venue 60, the commentary audio is played through speaker S. It is assumed that the output will be via [this method].

[0059] Furthermore, in Figure 6, the audio acquisition unit 212 receives the commentary sound from commentator 608 via microphone M. The voice "Here, player ●● is doing △△" is acquired, and the extraction unit 213 selects a specific term It is assumed that "△△" will be extracted. In addition, the selection unit 214 will select a specific term from the unique term DB. The explanatory information associated with the word "△△" is "to deter an approaching opponent with a medium punch." It shall be considered as such.

[0060] For example, as shown in Figure 6, the display control unit 215 displays in area R11 within screen D1. The gameplay video generated by the image generation unit 211 is displayed. The display control unit 215 controls the The term "△△" extracted from the commentary audio of the gameplay video is used as the search key in the above-mentioned unique term database. The selected explanatory information, "Use a medium punch to keep the enemy at bay," is placed in area R12 on screen D1. Display. Note that in Figure 6, the image generated by the image generation unit 211 on screen D1 is displayed. While explanatory information is displayed along with the video, it's not limited to this; the explanatory information alone is displayed on screen D1. It may be displayed.

[0061] As shown in Figure 6, explanatory information about the term "△△" extracted from the commentary audio is displayed on screen D1. By displaying it on screen D1, even viewers 606 who are unfamiliar with the term "△△" can see it. The provided explanatory information allows you to understand the content of the commentary.

[0062] ≪Second Display Control≫ The display control unit 215 associates terms extracted from the live commentary audio by the extraction unit 213. The game situation as it was (first game situation) and the game situation based on play (second game situation) Based on the relationship between ) and , the display of the explanatory information selected by the selection unit 214 is controlled. Good. Here, "game situation associated with terms extracted from commentary audio" means, for example, If, then, the terms extracted above are associated with the common terminology DB or specific terminology DB shown in Figure 5. This is the game situation. On the other hand, "game situation based on gameplay" is determined by the audio acquisition unit 212. This refers to the game situation at the time the commentary audio was acquired, for example, the timing at which the commentary was recorded. It could also be the game status shown by the synchronized play data.

[0063] Game situations associated with terms extracted from commentary audio, and game states based on gameplay. By considering the relationship between the commentary and the gameplay (for example, whether the two match or not), the commentary audio can be interpreted as follows: Does this relate to the game situation shown in the video (i.e., the current game situation), or does it relate to the current Distinguish between a game situation different from the actual game situation (i.e., a hypothetical game situation) and a hypothetical game situation. can.

[0064] Figure 7 shows an example of a second display control for explanatory information according to this embodiment. For example, In Figure 7, the commentator says, "Here, player ●● is doing △△. However, if the situation is □□..." In that situation, ▽▽ would be more effective, but player ●●'s situational judgment is truly impressive. In the case where it is obtained, the screen D2 displayed on the display device D is shown. Note that in Figure 7, This explanation will focus on the differences from version 6.

[0065] As shown in Figure 7, in area R21 of screen D2, the game situation is "medium punch activated". The gameplay footage is displayed. Therefore, in Figure 7, the above commentary audio says, "Here, player ●● does △△." That's true. However, if the situation is □□, then ▽▽ would be more effective, but ● ●The player's situational awareness is impressive. The game situation when this was acquired was "Medium Punch Activated". Yes. Also, in Figure 7, the terms "△△", "□□", and "▽▽" are extracted from the commentary audio. The terms are extracted by section 213. The selection section 214 selects the extracted terms "△△" and "□□". Using "▽▽" as the search key, the extracted terms were obtained from the unique term database shown in Figure 5. The explanatory information associated with the terms "△△", "□□", and "▽▽" is "Connect with a medium punch". Select "Keep the enemy in check", "xxxxxxxxxx", and "yyyyyyyyyy".

[0066] Here, in the unique terminology database shown in Figure 5, the term "△△" corresponds to the game situation "Medium Punch". The term "activation" is associated with it. On the other hand, the terms "□□" and "▽▽" are associated with the game situation " The phrase "zzz activation" is associated with this. As mentioned above, the term "△△" was extracted from the above commentary audio. The associated game situation "Medium Punch Activated" refers to the game situation at the time the commentary audio was acquired. This matches "medium punch activated". On the other hand, the terms "□□" and "▽" extracted from the above commentary audio are also relevant. The game status "zzz activated" associated with "▽" is the game status when the commentary audio was acquired. Furthermore, this does not match the statement "Medium punch activated".

[0067] Therefore, the display control unit 215 displays the game-like terms associated with the terms extracted from the commentary audio. The commentary information is provided when the situation matches the game situation at the time the commentary audio was acquired, and the commentary audio The game situation associated with the terms extracted from the voice is the game when the commentary audio was acquired. You may also display explanatory information that does not match the situation in a way that makes it easy to distinguish between the two.

[0068] For example, in Figure 7, the game situation "Medium punch" is associated with the extracted term "△△". The term "Movement" corresponds to the game situation "Medium punch activated" when the commentary audio was acquired, so the display method Section 215 contains the explanatory information associated with the extracted term "△△": "Approaching with a medium punch." The phrase "to deter" is displayed in area R22 using the first display method (here, enclosed by a solid line). On the other hand, the game situation "zzz activated" is associated with the extracted terms "□□" and "▽▽". This does not match the game situation "medium punch activated" when the commentary audio was acquired, therefore display control Section 215 contains explanatory information "xxxx" associated with the extracted terms "□□" and "▽▽". The area R23 and the area R23 are shown using the second display method (here, enclosed in a dashed line) for "xxxxxx" and "yyyyyyyyyy". Display on R24.

[0069] Note that in Figure 7, the type of line surrounding the explanatory information differs between the first and second display methods (here For example, the solid and dashed lines are shown as different, but this is not the only way. Using different colors in the second display method, for example, the explanatory information displayed in the first display method and the second table... Any display method is acceptable as long as it can be distinguished from the explanatory information displayed in the display method.

[0070] Furthermore, Figure 7 shows the game situation associated with terms extracted from the commentary audio. This section provides explanatory information when the voice recording matches the game situation at the time, and when it does not match. The explanatory information and the other information were displayed using different display methods, but the explanation in cases where they do not match. It is not necessary to display the information. For example, in Figure 7, the explanatory information for the extracted term "△△" is The phrase "Use a medium punch to keep the enemy at bay" is displayed on screen D2, and the extracted terms "□□" and " The explanatory information for each of the following will not be displayed on screen D2: "xxxxxxxxxx" and "yyyyyyyyyy". That's fine.

[0071] ≪Third Display Control≫ The display control unit 215 determines whether the terms extracted from the live commentary audio by the extraction unit 213 are proper terms or Based on whether it is a common term, the table of explanatory information selected by the selection unit 214 The display may be controlled.

[0072] Figure 8 shows an example of a third display control for explanatory information according to this embodiment. For example, Figure 8 shows the table when the commentary audio "Here, player XX is doing XX" is acquired. The screen D3 displayed on display device D is shown. In Figure 6, the specific term "△△" is extracted from the commentary audio. In contrast to the extraction shown in Figure 8, the common term "〇〇" is extracted from the commentary audio, Numbers 6 and 8 are different. The following explanation will focus on the differences from Figure 6.

[0073] In Figure 8, the selection unit 214 uses the audio extracted by the extraction unit 213 from the above-mentioned live commentary audio. Search the common terminology database using the word "○○" as the search key and associate it with the specific term "○○". Select the explanatory information "Inflict fatal damage". Display Control Unit 2 15 is the explanation "to inflict fatal damage" selected from the Common Terminology Database, and is used in the illustration. Display it in region R31 within surface D3.

[0074] As shown in Figure 8, the display control unit 215 displays the explanatory information for the common term "〇〇" as "fatal damage". "To give an advantage" is explained in the explanatory information for the specific term "△△" shown in Figure 6 as "to deter approaching with a medium punch." It is also acceptable to display it using a different method than "doing". For example, area R31 in Figure 8 is not white. While the other areas are colored, region R12 in Figure 6 is white. (See also: Explanation of specific terms) The methods for displaying the terms and the methods for displaying explanatory information on common terms are not limited to those shown in Figures 6 and 8. The person can be displayed using different display methods. In addition, the display control unit 215 can use specific terms or common terms. It is not necessary to display explanatory information for any of the terms.

[0075] Furthermore, the display control unit 215 determines that the terms extracted by the extraction unit 213 are included in the common terminology database. Based on whether or not it is present, the display of explanatory information associated with that term will be controlled as described above. It is also possible. The selection unit 214 first searches the common term database using the term as a search key, and This is to search the specific term database when a term is not found in the common term database. Generally, Commentator 608 is thought to use common terms more frequently than unique terms, therefore, Searching the terminology database first can shorten the search time. The search order for the terminology database is as follows: This is not the only option; of course, it is also acceptable to search the specific terminology database first and the common terminology database afterward. ru.

[0076] ≪Fourth Display Control≫ The display control unit 215 counts the number of times a certain term has been extracted by the extraction unit 213 (hereinafter referred to as "extraction"). The display of explanatory information associated with a term may be controlled based on the number of times it is used. Specifically, the display control unit 215 determines that the number of times a certain term is extracted during a predetermined period is a predetermined condition. If the conditions are met, the display of the explanatory information may be restricted. Also, the display control unit 215 will Based on the circumstances and / or temporal conditions, restrictions on the display of the above explanatory information may be relaxed. That's good too.

[0077] Figure 9 shows an example of the fourth display control of explanatory information according to this embodiment. For example, Figure 9 shows screens D41 to D43 corresponding to timings T41 to T43. This explanation will focus on the differences from Figure 6. For example, in Figure 9, the above-mentioned predetermined period is when a certain match begins. The period from when it is initiated until it is terminated shall be P1 and P2, but it shall not be limited to this, for example Alternatively, it may be a fixed period of time such as 1 hour or 30 minutes. Also, in Figure 9, the above-mentioned predetermined conditions are Assume that the number of times a specific term is extracted during period P is n > a predetermined number X (where X > 1). However, this is not the only example.

[0078] As shown in Figure 9, at timing T41, the audio acquisition unit 212 acquires the commentary audio "here The phrase "●● player is doing △△" is obtained, and the extraction unit 213 extracts the term "△△". The number of times the term "△△" is extracted at timing T41 is a predetermined number X, where n > X The condition is not met. Therefore, the display control unit 215 displays the extracted term " Display the explanatory information associated with "△△": "Use a medium punch to keep the enemy at bay."

[0079] At timing T42, the audio acquisition unit 212 records the commentary audio "Player ★★ is doing △△" The term "shin" is acquired, and the extraction unit 213 extracts the term "△△". Timing T42 The number of times the term "△△" is extracted, n, is a predetermined number X+1, and n>X. Therefore, The display control unit 215 displays the solution associated with the extracted term "△△" on screen D42. The display of explanatory information is restricted. For example, on screen D42, this restriction prevents the display of the explanatory information. It is not. Thus, when n > X is satisfied, even if the term "△△" is extracted, the explanatory information is not extracted. The report will not be displayed.

[0080] On the other hand, the display control unit 215, based on the game situation and / or temporal conditions, displays the above specific The restrictions on displaying explanatory information for the term "△△" may be relaxed. Specifically, in Figure 9, the game Based on the situation "Match ended" or "Match started", or the end of period P1 or the start of period P2 Based on the above, the restrictions on displaying explanatory information for the specific term "△△" will be relaxed.

[0081] For example, in Figure 9, when period P2 begins, the number of times the term "△△" is extracted is initialized to n=0. At timing T43, the audio acquisition unit 212 records the commentary audio, "●● player's special move." The phrase "△△" is acquired, and the extraction unit 213 extracts the term "△△". Timing The number of times the specific term "△△" is extracted in T43 is 1, and n > X is not satisfied. Therefore, the display control unit 215 associates the extracted term "△△" with the screen D43. The explanatory information "Use medium punches to keep the enemy at bay" is displayed.

[0082] As shown in Figure 9, the number of times the term "△△" is extracted during period P1 satisfies the predetermined conditions. In addition, by restricting the display of explanatory information regarding the term "△△", the number of viewers (606) can play. This makes it easier to concentrate on the video. On the other hand, when the next period P2 starts, this restriction will be relaxed. Because they are combined, even if the spectators 606 are replaced before the start of the next match, the new spectators 60 For item 6, we can provide explanatory information about the term "△△".

[0083] ≪5th Display Control≫ The display control unit 215 is based on the viewing level associated with a specific term in the term database. Furthermore, the display of explanatory information associated with the specific term may be controlled.

[0084] Figure 10 shows an example of the fifth display control of explanatory information according to this embodiment. Figure 10 Now, similar to Figure 7, in Figure 7, the commentary says, "Here, player ●● is doing △△. However, And, if the situation were □□, then ▽▽ would be more effective, but it's up to player ●● to assess the situation. This assumes that the result "That's impressive." is obtained. Note that Figure 10 shows the differences from Figure 7. I explain it to my mind.

[0085] For example, in Figure 10, the main monitor and sub-monitor are shown as display devices D in venue 60 of Figure 1. When a monitor is provided, the screen displayed on the main monitor is D51 (here, the intermediate screen). The screen (front) and the screen D52 (in this case, the beginner screen) displayed on the sub-monitor are shown. For example, the main monitor screen D51 has a viewing level set to "intermediate," and the sub-monitor... Screen D52 for the user may have a viewing level set to "Beginner". Also, the above commentary audio may be The terms "△△", "□□", and "▽▽" extracted by the extraction unit 213 are shown in Figure 5. In the native terminology database, these terms are associated with viewing levels "Intermediate," "Beginner," and "Beginner," respectively. The game video will be displayed on screen D51, which is the main monitor, and the sub-monitor screen will be... Even if you make it so that the explanatory information for terms extracted in D52 is displayed in a manner appropriate to the viewing level good.

[0086] The display control unit 215 determines that the viewing level associated with the extracted term is on screen D51 or If the viewing level is equal to or higher than that associated with D52, then the specific term is associated with that. The explanatory information may be displayed on screen D51 or D52. For example, the extracted term "△ The viewing level "Intermediate" associated with "△" is the viewing level "Intermediate" set on screen D51. Since it is equal to the above, the display control unit 215 displays the explanatory information associated with the term "△△" on screen D5. It may also be displayed in area R51 within 1. On the other hand, regarding the extracted terms "□□" and "▽▽" The linked viewing level "Beginner" is lower than the viewing level "Intermediate" set for screen D51. Therefore, the display control unit 215 displays the solution associated with the extracted terms "□□" and "▽▽". Do not display explanatory information on screen D51.

[0087] Additionally, the viewing level "Beginner" associated with the extracted terms "□□" and "▽▽" is shown in the image. Since it is equal to the viewing level "Beginner" defined on surface D52, the display control unit 215 extracts The explanatory information associated with the terms "□□" and "▽▽" is located in area R53 and on screen D52. Display it on R54. Also, the viewing level associated with the extracted term "△△" is "Intermediate". " is a viewing level higher than the viewing level "Beginner" set for screen D52, so display The control unit 215 displays explanatory information associated with the term "△△" in area R52 on screen D52. Display it.

[0088] As shown in Figure 10, screens D51 and D52 corresponding to different viewing levels were displayed in venue 60. Display on multiple monitors, and adjust the viewing level on each of those monitors to match the desired level. By displaying only explanatory information, the venue (600) contains a mix of 606 viewers with different viewing levels. Even in that case, it makes it easier for the 606 viewers to concentrate on the gameplay footage.

[0089] Note that in Figure 10, the viewing level of the 606 spectators in the venue 60 does not need to be determined. , however, even when explanatory information is displayed on the display device D of venue 60, The viewing level of the viewer 606 may be determined. That is, the display control unit 215 will determine the viewing level of the viewer 606. A determination unit is configured to determine the viewing level of a user who is watching (I), and the determined viewing level Based on the terms extracted above and the viewing level associated with them, the display of explanatory information. You may restrict it.

[0090] For example, the display control unit 215 is pre-registered by each visitor 606 entering the venue 60. Based on the ratio of viewing levels (e.g., beginner, intermediate, advanced, etc.), the audience within the 60-person venue Determine the viewing level of 606 and associate that viewing level with the extracted term above. Based on the viewing level, the display of explanatory information on display device D in venue 60 may be restricted. For example, if the ratio of viewing levels is beginner:intermediate:advanced = 5:4:1, then the display device D will Displaying the beginner-level screen D52 in Figure 10, the viewing level ratio is Beginner:Intermediate:Advanced = 3:5:2 In that case, the intermediate screen D51 in Figure 10 may be displayed on the display device D. Also, viewing level The way explanatory information is displayed may be changed depending on the ratio of beginners. For example, if there are few beginner viewers In such cases, the display time for explanatory information may be shortened or the display size may be reduced. Since beginner viewers are likely to need more explanatory information than advanced viewers, The degree to which the display style of explanatory information is reflected in the ratio of viewing levels is greater for advanced users. It is acceptable to do so. In this case, even if there are few beginner viewers, beginner-friendly explanatory information will be available. While ensuring that it is displayed, if there are few advanced viewers, the explanation information for advanced users will not stand out. By making it difficult to read, it is possible to ensure that explanatory information is easily understood by beginner viewers.

[0091] Furthermore, if screen D51 or D52 based on the viewing level is delivered to the viewing terminal 4, The display control unit 215 may determine the viewing level of the user of the viewing terminal 4. Viewing level includes, for example, the user's rank as a player, the user's viewing history, The determination can be made based on the user's viewing time, etc. The display control unit 215 determines the user Based on the viewer's viewing level, the screen delivered to the viewing terminal 4 (for example, in Figure 10) You may choose either the intermediate screen D51 or the beginner screen D52. The display control unit 215 determines the viewing level of the user of the viewing terminal 4 and the usage extracted from the live commentary audio. Information about the screen to be delivered to viewing device 4, based on the viewing level associated with the word. (Hereinafter referred to as "screen information") may be generated.

[0092] ≪The 6th Display Control≫ The display control unit 215 controls the display based on the history of term extraction from the live commentary audio. Generally Computer games consist of two parts: the first part in which the gameplay progresses (hereinafter referred to as the "play part") and (The first part is called the "play part") and the second part other than the play part (hereinafter referred to as the "non-play part"), Includes. The display control unit 215, in the non-play part, extracts the above in the play part. You may control the display based on historical data.

[0093] Here, the play part refers to the play within a computer game based on the player's actions. This is the part where the character is being controlled, and the story in the virtual game space progresses. It is in a state of being. The play part is, for example, in the case of a competitive game, the player character This is not limited to the ongoing match.

[0094] Non-play parts are parts other than the play parts, such as computer games. During loading, character setup, stage setup, setting conditions in the virtual game space, The virtual game space has not been set up, and the story within the virtual game space has not progressed. Non-play parts include, for example, in the case of a competitive game, the setting of match conditions, and the end of the previous match. This includes, but is not limited to, the preparation period between matches. The play part and the non-play part may also be called the first and second scenes, respectively.

[0095] Figure 11 shows an example of a sixth display control of explanatory information according to this embodiment. In Figure 11, the non-playing period between the end of the previous match and the start of the next match is shown. The screens D61 and D62 displayed on the display device D are shown. As shown in Figure 11, During the play session, the display control unit 215 displays the play session (for example, the previous match). The replay video may be displayed on screen D61.

[0096] Furthermore, the display control unit 215 extracts the term history from the play part within the most recent predetermined period. Based on this, a glossary of terms may be displayed on screen D62 during non-play parts. The play portion within the recent specified period refers, for example, during the previous match, or during the matches played so far on the same day. Other options may also be used. Furthermore, the glossary contains explanations for each term shown in the extraction history above. The information may also be presented as a list. An example of this glossary is shown on screen D61. It may be displayed regardless of whether or not the replay video is displayed.

[0097] As shown in screen D62 of Figure 11, the glossary is displayed for a predetermined period (for example, during the previous match). Alternatively, in order of the number of times extracted from the commentary audio (on the same day), along with the number of extractions, You may provide explanatory information for the terms used. Display a glossary of terms in non-play parts. This allows the 606 viewers to review the meanings of terms extracted from the commentary audio. ru.

[0098] ≪The 7th Display Control≫ Furthermore, the display control unit 215 displays a predetermined number of explanatory information based on the time series in which specific terms were extracted. Information may be displayed. In addition, the display control unit 215 may display more than the predetermined number of explanatory information. You may restrict it.

[0099] Figure 12 shows an example of the seventh display control of explanatory information according to this embodiment. In step 10, when a term is extracted in the play part, the extracted term is used The explanatory information associated with the word is displayed, but in Figure 12, the term in the play part is Based on the extracted time series, a predetermined number of recent explanatory information may be displayed. That is, This differs from Figures 6-10 in that it displays a real-time glossary of terms during the gameplay portion. The following section will focus on explaining the differences from Figures 6-10.

[0100] Note that in Figure 12, the glossary of terms shown on screens D71 and D72 includes the most recent maximum of 3 While individual explanatory information will be displayed, the number of explanatory information items displayed is not limited to three. Also, on screens D71 and D72, the explanation information for newly extracted terms is displayed at the top. The method of display is not limited to that shown in Figure 12, and may be based on the extraction order of the specific terms in question.

[0101] For example, in Figure 12, the extraction unit 21 extracts from the live commentary audio acquired at timing T71. The terms "△△", "□□", and "▽▽" will be extracted by step 3. On screen D71 Since the most recent three explanatory information items are displayed, the display control unit 215 extracts them at timing T71. The explanatory information for each of the extracted terms "△△", "□□", and "▽▽" is displayed on the screen in the order they were extracted. Display it on D71.

[0102] On the other hand, the display control unit 215 operates as shown in regions R71 and R72, from timing T71. Restrict the display of explanatory information for terms extracted before the time. For example, in region R71, timing It is shown that the specific term "△△" was extracted three times before T71. Also, region R At point 72, it was shown that the specific term "□□" was extracted once before timing T71. It can be done.

[0103] Furthermore, in Figure 12, the extraction unit 213 extracts from the live commentary audio acquired at timing T72. The specific term "〇〇" will be extracted by this method. Screen D72 shows the three most recent explanatory information. Since the report is displayed, the display control unit 215 uses the term "〇〇" extracted from the live audio. The new display is shown on screen D72. Also, the display control unit 215 displays area R7 on screen D72. As shown in 3, the display of explanatory information for the term "△△" extracted most recently on screen D71 is restricted. For example, in region R73, the specific term "△△" appears four times before timing T72. This indicates that it has been extracted.

[0104] Note that in Figure 12, screens D71 and D72, separate from the gameplay video, show real-time data. A glossary of terms will be displayed, but the real-time information will not be displayed on the same screen as the gameplay footage. A glossary of terms may be displayed.

[0105] Additionally, screens D71 and D72, which display a real-time list of terminology explanations, are streamed to the viewing terminal 4. In such cases, the display control unit 215 displays the areas R71, R72 and R73 requests the reference of the explanatory information in response to input from the user of viewing terminal 4. It may be configured as a region, and information about the screen containing that region may be generated. For example, Figure 12 If screen D72 is displayed on viewing terminal 4, the solution regarding the term "△△" which was extracted four times The display of explanatory information is restricted, and the user of the viewing terminal 4 does not recognize the meaning of the term "△△". It is not possible. Therefore, the user of viewing terminal 4 performs a predetermined operation on area R73 (for example, You may request to refer to explanatory information regarding the term "△△" by performing actions such as tapping. stomach.

[0106] As described above, the display control unit 215 uses at least one of the first to seventh display controls The output of the explanatory information selected by the selection unit 214 may be controlled. That is, the display control Part 215 may constitute an "output control unit that controls the output of explanatory information." The display control unit 215 is controlled using at least one of the first to seventh display controls. Screen information relating to the screen (for example, Figures 6-12) may be generated. The display control unit 215, The generated screen information may be output to the display device D. Also, the display control unit 215 The generated screen information may be output to the viewing terminal 4 via the transmitting / receiving unit 23.

[0107] The memory unit 22 stores various information and programs. Specifically, the memory unit 22 stores terminology The database is stored. As described above, the terminology database consists of a common terminology database and a specific terminology database. This may also be done. In addition, the memory unit 22 stores a video database for storing play videos for replay. You may do so.

[0108] The transmitting / receiving unit 23 communicates with the play terminal 3 or the viewing terminal 4 via the communication network 5. The system transmits and / or receives information. The transmitting / receiving unit 23 is referred to as the "transmitting unit" or the "receiving unit". I don't care if I get caught.

[0109] Specifically, the transmitting / receiving unit 23 transmits data related to gameplay to the play terminal 3 (hereinafter The transmitting / receiving unit 23 transmits and / or receives "play data". The screen information is transmitted to the viewing terminal 4.

[0110] -Playing Device- As shown in Figure 4, the play terminal 3 comprises a control unit 31 and a transmitting / receiving unit 32. The control unit 31 and the transmitting / receiving unit 32 are connected to the processor 13 and communication I of the play terminal 3, respectively. It consists of F11. The control unit 31 controls various processes performed on the play terminal 3. For example, the control unit 31 controls the display control unit 311, the input receiving unit 312, and the game control unit 313. To possess.

[0111] The display control unit 311 controls the screen displayed on the output device 15 of the play terminal 3. The display control unit 311 controls the display of the gameplay video.

[0112] The input receiving unit 412 receives input from the operation of the input device 14 of the play terminal 3. Specifically, the input receiving unit 412 is related to the player's gameplay of the computer game. The input receiving unit 412 accepts the operation of the player who has referred to the above viewer information. Even if you accept performance inputs for the audience (for example, audio, video, etc.) good.

[0113] The game control unit 313 executes the computer game according to the operation of the input device 14. Specifically, the game control unit 313 controls the character displayed on the output device 15. The generation and rendering of gameplay footage, including various objects related to the kuta and virtual game space. Control. The gameplay footage may, but is not limited to, be in video format.

[0114] The transmitting / receiving unit 42 transmits information to the server 2 via the communication network 5 and / Or it receives. The transmitting / receiving unit 42 may also be called the "transmitting unit" or the "receiving unit". Specifically The transmitting / receiving unit 42 transmits data used to generate gameplay video (hereinafter referred to as "play data") Send (this message) to server 2.

[0115] -Viewing devices- As shown in Figure 4, the viewing terminal 4 comprises a control unit 41 and a transmitting / receiving unit 42. The control unit 41 and the transmitting / receiving unit 42 are connected to the processor 13 and communication IF1 of the viewing terminal 4, respectively. It consists of 1. The control unit 41 controls various processes performed on the viewing terminal 4. For example The control unit 41 includes a display control unit 411 and an input receiving unit 412.

[0116] The display control unit 411 controls the screen displayed on the output device 15 of the viewing terminal 4. The display control unit 411 controls the display of the gameplay video. Specifically, the display control unit 411 controls the display of the gameplay video. The display control unit 215 extracts from the live commentary audio based on the screen information from the server 2. Controls the display of explanatory information associated with the given term. For example, the display control unit 411 may control the display of the explanatory information based on at least one of the first to seventh display controls described above. That's fine.

[0117] The input reception unit 412 receives an input by operating the input device 14 of the viewing terminal 4. Specifically, the input reception unit 412 may receive an input indicating the use of an electronic medium.

[0118] The transmission / reception unit 42 transmits and / or receives information to / from the server 2 via the communication network 5. The transmission / reception unit 42 may be referred to as a "transmission unit" or a "reception unit". Specifically, the transmission / reception unit 42 receives a play video from the server 2. The transmission / reception unit 42 receives the above screen information from the server 2.

[0119] [Operation of the information processing system] FIG. 13 is a sequence diagram showing the operation of the information processing system according to the present embodiment. Note that some steps in FIG. 13 may be omitted or some orders may be changed. For example, either step st107 or st108 may be omitted. In FIG. 13, the operation in the play part will be described as an example.

[0120] As shown in FIG. 13, in step st101, the play terminal 3 transmits the play data in the play terminal 3 to the server 2. In step st102, the server 2 generates a play video based on the play data.

[0121] In step st103, the server 2 acquires the live audio. In step st104 ​​​​​​​​​In this process, Server 2 uses speech recognition processing to determine from the commentary audio that computer games Extract terms related to st105. In step st105, Server 2 extracts terms from the term DB. Select the explanatory information associated with the terms extracted in step st104.

[0122] In step st106, Server 2 displays the gameplay generated in step st102. Server 2 controls the display of the image and the explanatory information selected in step st105. Using at least one of the 1st to 7th display controls, the solution on the screen (e.g., Figures 6-12) It controls the display of explanatory information and generates screen information related to that screen.

[0123] In step st107, Server 2 sends the gameplay video and screen to Display Device D. The information is output, and the display device D displays the above screen. In step st108, B2 outputs the gameplay video and screen information to the viewing terminal 4, and the viewing terminal 4 is as described above. Display the screen.

[0124] In summary, the program according to this embodiment is controlled by the control unit 21 (computer) of the server 2. The data includes acquiring commentary audio (audio related to playing computer games) and sound Using speech recognition processing, terms related to the computer game are extracted from the commentary audio. This involves associating the terminology related to the computer game with the explanatory information for each term. From the memory unit 22 that stores the information, the explanatory information associated with the extracted term is selected. The system controls the output of the selected explanatory information and performs the following actions.

[0125] [effect] According to the information processing system 1 according to this embodiment, actual situation voice is acquired, and by using speech recognition processing to extract terms related to computer games from the voice, and displaying the explanatory information related to the extracted terms on the display device D and / or the viewing terminal 4, the content of the actual situation voice can be made easier to understand. As a result, the interest of the game event can be improved.

[0126] [Other Embodiments] The various control means and processing procedures described in the above embodiment are examples, and are not intended to limit the scope of the present invention, its applicable objects, or its uses. The various control means and processing procedures can be appropriately designed and changed without changing the gist of the present invention.

[0127] In addition to, or instead of, displaying the explanatory information in the above embodiment, related information corresponding to the extracted terms may be displayed. For example, when the extracted term is a specific action (such as a special skill or combo) by a player character, information such as the damage amount caused by the action and the correction value (increase amount) of the damage amount caused by the combo may be displayed as related information corresponding to the action. In this case, the storage unit associates and stores information such as the damage amount caused by the action in association with the game situation in which the action occurs. Thereby, in addition to, or instead of, displaying the explanatory information, related information corresponding to the extracted terms can be displayed.

[0128] The related information may be information about the player character or other characters, or information about the player. For example, information related to introducing the character or player ​​​​​​If a term is extracted, related information such as a list of characters or players, a correlation table, etc. You may also display the match history and other related information.

[0129] Related information may include information about the game situation, for example, sports games. In this context, match statistics may be displayed. In a soccer game, extracted special In accordance with the specified terminology, the ball possession rate of both teams and the position of players and the ball in specific locations are indicated. Statistical information such as a heatmap showing the time spent may be displayed. In a baseball game, In response to the extracted specific terms, information about the pitcher's pitch type and pitch location, the batter's pitch type, and Information on batting averages by pitch location, the probability of a runner attempting or succeeding at a stolen base by the pitch count, and You may display such information.

[0130] Related information is displayed in a controlled manner depending on the game situation, time conditions, viewer level, etc. It is acceptable. Furthermore, explanatory and related information may be provided based on the game situation, time constraints, and the viewer's viewing level. Depending on the context, the term may be displayed regardless of whether it was extracted from the audio related to gameplay. For example, in specific game situations or non-playable parts, the above-mentioned explanatory information and related information may be used. You may also want the linked information to be displayed automatically.

[0131] In the above embodiment, the computer game played at the game event is a competitive game. While I have given examples of cases where it is a game, it is not limited to these. Games include shooting games, etc. Playing games, simulation games, board games, and puzzle games It can be applied to various types of games.

[0132] The above embodiment illustrates a case where Server 2 operates the program independently, but It is not limited to the above. At least some of the means of the program may be one or more of the means that make up server 2. It may be provided in a counting device.

[0133] The effects and advantages of this embodiment will also be exhibited when these other embodiments are adopted. Furthermore, this embodiment can be combined with other embodiments, and other embodiments can be combined with each other as appropriate. It is possible. [Explanation of Symbols]

[0134] 1. Information Processing System 2 servers 3. Playing devices 4. Viewing devices 5. Communication Network 11 Communication Interface 12 Storage device 13 processors 14 Input Devices 15 Output Devices 16 bus 21 Control Unit 22 Memory section 23 Transmitter / Receiver 31 Control Unit 32 Transmitter / Receiver 41 Control Unit 42 Transmitter / Receiver 211 Video Generation Department 212 Voice acquisition unit 213 Extraction part 214 Selection Section 215 Display Control Unit 311 Display Control Unit 312 Input Reception Section 313 Game Control Unit 411 Display Control Unit 412 Input Reception Section 60 venues 602 Players 606 viewers 608 commentators D Display device M Mike S Speaker

Claims

1. A computer, A means of acquiring audio commentary related to the gameplay of a computer game, An extraction means for extracting terms related to the computer game from the commentary audio using speech recognition processing, A selection means for selecting explanatory information associated with an extracted term from a storage unit that stores each term related to the aforementioned computer game in association with explanatory information related to each term. A display control means for displaying the game video of the computer game and the selected explanatory information on one or more display devices, A determination means for determining the ratio of viewing levels of multiple users who view the computer game play through at least one of the one or more display devices, To make it function as, The memory unit stores each of the terms and the viewing level of each of the terms in association with each other. The display control means is a program characterized by controlling the display of the selected explanatory information based on the ratio of the determined viewing levels and the viewing levels associated with the extracted terms.

2. The program according to claim 1, wherein the one or more display devices include one or more terminal devices used by at least one of the plurality of users.

3. The program according to claim 2, wherein the one or more display devices further include display devices installed in the venue where the computer game is played.

4. The ratio of viewing levels determined by the determination means is: The ratio of viewing levels of one or more users among the aforementioned multiple users who view the computer game play through one or more terminal devices, The ratio of viewing levels of one or more users among the aforementioned multiple users who view the computer game play via a display device installed at the venue, The program according to claim 3, including the program described in claim 3.

5. The computer, An operation relating to the registration of the viewing level of one or more users among the aforementioned multiple users who view the computer game play through one or more terminal devices, An operation relating to the registration of the viewing level of one or more users among the aforementioned multiple users who view the computer game play via a display device installed at the venue, The program according to claim 4, further functioning as a means for receiving information.

6. The display control means is The game video of the computer game and the selected explanatory information are further displayed on a specific user's terminal device. The program according to claim 1, which controls the display of explanatory information on the terminal device of the specific user based on the viewing level of the specific user and the viewing level associated with the extracted term.

7. An acquisition unit that acquires commentary audio related to the gameplay of a computer game, An extraction unit that uses speech recognition processing to extract terms related to the computer game from the commentary audio, A selection unit that selects explanatory information associated with an extracted term from a storage unit that stores each term related to the aforementioned computer game in association with explanatory information related to each term. A display control unit that displays the game video of the computer game and the selected explanatory information on one or more display devices, A determination unit that determines the ratio of viewing levels of multiple users who view the computer game play through at least one of the one or more display devices, Equipped with, The memory unit stores each of the terms and the viewing level of each of the terms in association with each other. The display control unit controls the display of the selected explanatory information based on the determined viewing level ratio and the viewing level associated with the extracted term.

8. A computer, To obtain commentary audio related to playing computer games, Using speech recognition processing, extract terms related to the computer game from the commentary audio, From a memory unit that stores each term related to the aforementioned computer game and explanatory information related to each term in association, the process involves selecting the explanatory information associated with the extracted term. To display the game video of the aforementioned computer game and the selected explanatory information on one or more display devices, Determining the ratio of viewing levels of multiple users who view the computer game play through at least one of the one or more display devices, Make it run, The memory unit stores each of the terms and the viewing level of each of the terms in association with each other. An information processing method that involves displaying the game video of the computer game and the selected explanatory information on one or more display devices, and controlling the display of the selected explanatory information based on the determined ratio of viewing levels and the viewing levels associated with the extracted terms.

Images