Programs and Information Processing Systems

Abstract

This will enable improvements to streaming services. [Solution] The program makes the computer function as a detection means that detects from the sound on the broadcaster's side that the broadcaster has left the broadcast unattended, using a machine learning model that has been trained to perform a predetermined detection based on the sound on the broadcaster's side while the broadcast is in progress.

Description

Technical Field

[0001] The present invention relates to a program and an information processing system.

Background Art

[0002] Conventionally, an information processing system that allows a user to view videos such as games has been known. Also, as this type of information processing system, Patent Document 1 describes a system that estimates the degree of a viewer's reaction based on the viewer's voice.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in conventional distribution services, there has been a problem that it is difficult to suppress an increase in undesirable distributions or increase interesting distributions, and it is difficult to improve the service.

[0005] An object of the present invention is to enable improvement of a distribution service.

Means for Solving the Problems

[0006] According to one embodiment shown in the present disclosure, a computer is caused to function as control means for executing control to advantageously change a reward to be given when the sound on the distributor side obtained by sound acquisition means for acquiring the sound on the distributor side during distribution satisfies a predetermined condition, compared to when the predetermined condition is not satisfied. a program is provided.

Effects of the Invention

[0007] According to the present invention, it is possible to improve distribution services. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram illustrating the schematic configuration of an information processing system. [Figure 2] This is a block diagram showing the functional configuration of an information processing system. [Figure 3] This figure shows an example of a home screen. [Figure 4] This is a diagram showing an example of the first screen of the program guide. [Figure 5] This figure shows an example of the second screen of the program guide. [Figure 6] This is a diagram showing an example of a viewing screen. [Figure 7] This figure shows an example of a streaming screen. [Figure 8] This flowchart shows an example of the process related to the granting of rewards. [Figure 9] This is a diagram illustrating a specific example of the process related to the granting of rewards. [Figure 10] This figure shows an example of a live stream results screen. [Figure 11] This is a block diagram showing the functional configuration of an information processing system. [Figure 12] This figure shows an example of a screen related to forcibly stopping a broadcast. [Figure 13] This flowchart shows an example of a process for imposing penalties on broadcasters based on their specific actions during live streaming. [Figure 14] This figure shows an example of a screen related to forcibly stopping a broadcast. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings.

[0010] <Hardware configuration of the information processing system> As shown in FIG. 1, the information processing system 1 of the present embodiment includes a plurality of terminal devices 10 and a server 20.

[0011] The terminal device 10 and the server 20 are connected via a network 2. The network 2 may be constituted by, for example, the Internet, a mobile communication system (e.g., 3G, 4G, 5G, LTE (Long Term Evolution), etc.), WiFi (Wireless Fidelity), Bluetooth (registered trademark), any other communication line, or a combination thereof. Also, the connection between the terminal device 10 and the server 20 may be either a wired connection or a wireless connection.

[0012] The server 20 (in other words, a computer, an information processing device) may be a general-purpose computer such as a workstation or a personal computer. The server 20 includes a processor 21, a memory 22, a storage 23, a communication IF (interface) 24, and an input / output IF 25. These components included in the server 20 are connected to each other by a communication bus.

[0013] The processor 21 controls the operation of the entire server 20. The processor 21 may include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), etc. The processor 21 reads a program from the storage 23 and expands it in the memory 22. The processor 21 executes the expanded program.

[0014] Memory 22 is the main memory device. Memory 22 is composed of a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory), for example. Memory 22 provides a working area for processor 21 by temporarily storing the program and various data read by processor 21 from storage 23. Memory 22 also temporarily stores various data generated while processor 21 is operating according to the program.

[0015] Note that in this embodiment, the program may be a program for realizing a game by terminal device 10. Also, the program may be a program for realizing the game through the cooperation between terminal device 10 and server 20. As an example, the game realized through the cooperation between terminal device 10 and server 20 may be a game executed on a browser launched on terminal device 10. Also, the program may be a program for realizing the game through the cooperation of a plurality of terminal devices 10. Also, the various data includes, for example, data related to the game such as user information and game information, and instructions and notifications transmitted and received between terminal device 10 and server 20.

[0016] Storage 23 is an auxiliary storage device. Storage 23 is composed of a storage device such as a flash memory or a HDD (Hard Disk Drive), for example. Various data related to the game is stored in storage 23.

[0017] Communication IF 24 controls the transmission and reception of various data via the network between server 20 and terminal device 10, etc.

[0018] Input / output IF 25 is an interface for server 20 to receive data input and an interface for server 20 to output data. Input / output IF 25 may include, for example, an input unit which is an information input device such as a mouse and a keyboard, and a display unit which is a device for displaying and outputting images.

[0019] The terminal device 10 (in other words, a computer or information processing device) may be, for example, a smartphone, feature phone, PDA (Personal Digital Assistant), tablet computer, personal computer, wearable device, or game device. The terminal device 10 may also be a portable device. The terminal device 10 may also be a portable device when the user is running a game.

[0020] The terminal device 10 comprises a processor 11, memory 12, storage 13, communication interface 14, input / output interface 15, input unit 17, and display unit 18. These components of the terminal device 10 are connected to each other by a communication bus.

[0021] The processor 11 controls the operation of the entire terminal device 10. The processor 11 may include a CPU, MPU, and GPU. The processor 11 reads a program from the storage 13 and loads it into the memory 12. The processor 11 executes the loaded program.

[0022] Memory 12 is the main memory. Memory 12 is composed of storage devices such as ROM and RAM. Memory 12 provides the processor 11 with a workspace by temporarily storing programs and various data read by the processor 11 from storage 13. Memory 12 also temporarily stores various data generated by the processor 11 while it is operating according to the program.

[0023] Storage 13 is an auxiliary storage device. Storage 13 is comprised of, for example, a storage device such as flash memory or an HDD. Various data related to the game is stored in Storage 13.

[0024] The communication interface 14 controls the transmission and reception of various types of data over the network between the terminal device 10 and the server 20, etc.

[0025] The input / output interface 15 is an interface for the terminal device 10 to receive data input and an interface for the terminal device 10 to output data. The input / output interface 15 may perform data input and output via, for example, USB (Universal Serial Bus). The input / output interface 15 may include an input unit 17 or a display unit 18, etc.

[0026] The input unit 17 accepts input from the user. The input unit 17 may be, for example, a pointing device such as a touchpad. The display unit 18 displays an image. The display unit 18 may be, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The terminal device 10 includes, for example, a touchscreen 16 which is an electronic component combining the input unit 17 and the display unit 18.

[0027] The input unit 17 has the function of detecting the position input to the input surface by user operation (for example, touch operation, tap operation, slide operation, swipe operation, flick operation, pinch-in operation, and pinch-out operation, etc.) and transmitting information indicating the detected position as an input signal. The touch panel as the input unit 17 can employ a capacitive type or a resistive type, but other types may also be used.

[0028] The input unit 17 may be, for example, a keyboard, various physical buttons, various sensors (e.g., an acceleration sensor, angular velocity sensor, motion sensor, gaze sensor, biopotential sensor, fingerprint sensor, breath sensor, pressure sensor, or image sensor), an operating stick, a camera, or a microphone. The display unit 18 may be, for example, a projector.

[0029] <Functional Configuration of Information Processing Systems> Figure 2 is a block diagram showing the functional configuration of the server 20 and the terminal device 10. In this embodiment, the server 20 has functions such as providing various data and programs necessary to realize the game to each terminal device 10, collecting and managing game-related data from each terminal device 10, and performing synchronization processing between multiple terminal devices 10.

[0030] In this embodiment, the server 20 identifies each user and terminal device 10 using user accounts that have been registered in advance. The method of registering accounts is not particularly limited. For example, a terminal device 10 or another device such as a personal computer may transmit information necessary for user account registration to the server 20 based on user operations, and the server 20 may create and store each user's account based on the received information.

[0031] As shown in Figure 2, the server 20 functions as a control unit 210 and a storage unit 220 through the cooperation of the processor 21, memory 22, storage 23, communication interface 24, and input / output interface 25. The storage unit 220 stores various types of data used by the control unit 210. These types of data include, for example, game programs, game information, and user information.

[0032] The game program is a program that enables the game to be played. Game information and user information are data that the control unit 210 refers to when executing the game program.

[0033] In this embodiment, the game program may include not only the game program executed on the server 20 but also the game program executed on the terminal device 10. Furthermore, the storage unit 220 may store both the game program executed on the server 20 and the game program executed on the terminal device 10.

[0034] Game information is shared across accounts. This information includes, for example, information defining various virtual spaces (in other words, game spaces). A virtual space is the space where objects of user-controllable characters (hereinafter also referred to as "player characters") are placed. Game information also includes various setting information for objects shared across accounts, such as the placement, size, color, and shape of background objects like buildings, trees, and stones, as well as non-player characters (NPCs) placed within the virtual space. Furthermore, game information includes, for example, the setting values ​​of various NPC parameters. In the following, the character objects placed in the virtual space may simply be referred to as "characters."

[0035] User information is information managed for each game account. User information includes, for example, information about the player character, information about owned assets, and information indicating the progress of the game. Owned assets can be described as the value that the user owns in the virtual world. Examples of such value (in other words, in-game value, owned assets) include electronic currency, items, and characters. Examples of electronic currency include in-game currency usable within the game and cryptocurrencies.

[0036] The control unit 210 controls various processes related to the game by executing the game program stored in the memory unit 220. The control unit 210 includes, for example, a transmission / reception unit 211, a game progress unit 212, a user relationship management unit 215, a gift processing unit 216, and a reward granting unit 217.

[0037] The transmitting / receiving unit 211 transmits or receives various types of data. For example, the transmitting / receiving unit 211 receives requests to transmit various types of data and programs, requests for synchronization processing to support the multiplayer function, and data to be synchronized from each terminal device 10, and passes them to the game progress unit 212. The transmitting / receiving unit 211 also transmits various types of data and programs, including instructions for synchronization, to each terminal device 10 in accordance with the control of the game progress unit 212.

[0038] In this embodiment, the multiplayer function is a function that synchronizes the game processing of multiple accounts. The server 20 and terminal device 10 of the information processing system 1 execute various processes to support the multiplayer function when multiple accounts logged into the information processing system 1 participate in the same game.

[0039] The game progress unit 212 provides the game to the terminal device 10 by executing calculations described in the game program in response to requests from the terminal device 10.

[0040] The game progress unit 212 defines the virtual space based on the information for defining the virtual space included in the game information. The game progress unit 212 places objects in the virtual space based on the object setting information included in the game information. The game progress unit 212 controls the objects placed in the virtual space. Specifically, the game progress unit 212 changes the position, orientation, shape, color, etc., of objects in the virtual space, and makes objects perform predetermined actions.

[0041] Furthermore, the game progress unit 212 places the player characters of multiple players in the virtual space based on the play information transmitted from each terminal device 10. In other words, the game progress unit 212 processes the game space, which is an example of a virtual space, to be shared by multiple users. The game progress unit 212 also performs various judgment processes related to the progress of the game based on the play information transmitted from each terminal device 10. In other words, the game progress unit 212 controls objects and performs various judgment processes based on user input operations. Play information is output according to user input operations. For example, the play information may include the coordinate information of the player character as the content of the player character's operation, information about the player character's actions, and information indicating buttons operated by the user. The play information may also include information about the player character's settings. For example, the character's coordinate information is information indicating the character's position in the game space. For example, the action information is information about the character's actions. For example, a character's actions may include the character's posture, item use, skill use, attack, defense, or jump. For example, information regarding a character's settings may include information about the character's equipment, appearance, etc. Furthermore, the character's settings can be changed by the user.

[0042] Furthermore, when the game progress unit 212 receives, for example, a request for synchronization processing to support the multiplayer function or data to be synchronized from the terminal device 10 via the transmission / reception unit 211, it executes the synchronization processing to support the multiplayer function. The game progress unit 212 also commands the transmission / reception unit 211 to send game information or user information. For example, when the server 20 sends information to multiple terminal devices 10, the game progress unit 212 synchronizes the game progressing among the terminal devices 10 by simultaneously sending information to each terminal device 10. By executing the synchronization processing, it becomes possible to simultaneously reflect in-game events caused by an operation entered on one terminal device 10 to other terminal devices 10.

[0043] The user relationship management unit 215 manages information about friends and followers. For example, the user relationship management unit 215 associates one user (e.g., a first user) with another user (e.g., a second user) based on a request from the user relationship processing unit 115, which will be described later, and stores information about the relationships between users in the storage unit 220.

[0044] In this embodiment, the terminal device 10 has functions such as an input device that accepts user input operations, and an output device that outputs game images and sounds.

[0045] The terminal device 10 functions as a control unit 110 and a storage unit 120 through the cooperation of the processor 11, memory 12, storage 13, communication IF 14, and input / output IF 15, etc. The storage unit 120 stores various data used by the control unit 110. These various data include, for example, game programs, game information, and user information. The game program is a program for implementing the game on the terminal device 10 side. Game information and user information are data that the control unit 110 refers to when executing the game program. The game information and user information stored in the storage unit 120 may include the same information as the game information and user information stored in the storage unit 220.

[0046] The control unit 110 controls various processes related to the game executed on the terminal device 10 by executing the game program stored in the memory unit 120. The control unit 110 includes, for example, an operation reception unit 111, a transmission / reception unit 112, a game progress unit 113, a display control unit 114, a user relationship processing unit 115, and a distribution unit 116.

[0047] The operation reception unit 111 receives operations (hereinafter also referred to as "input operations") input by the user via the input unit 17. Specifically, when an input operation is performed on the input unit 17, the operation reception unit 111 detects the coordinates of the input position and the type of input operation. Examples of input operations include various operations performed with fingers, such as touch operations, tap operations, slide operations, swipe operations, flick operations, pinch-in operations, and pinch-out operations. Input operations are not limited to operations that physically contact the input unit 17 (for example, the touchscreen 16), but can also include non-contact operations. Operations that terminate an input operation that was previously performed, such as a touch-off operation that ends contact with the touchscreen 16, can also be considered a form of input operation.

[0048] Here, the operation reception unit 111 can accept input operations performed using operating devices connected via the input / output IF 15, in the same way as input operations performed on the input unit 17.

[0049] The transmitting / receiving unit 112 transmits or receives various types of data. For example, the transmitting / receiving unit 112 transmits various types of data and various requests to the server 20. As an example, the data that the transmitting / receiving unit 112 transmits to the server may include play information, game information, and user information. In other words, the transmitting / receiving unit 112 transmits to the server 20 information regarding input operations received by the operation reception unit 111.

[0050] Furthermore, the transmitting / receiving unit 112 receives various data, programs, and requests from the server. For example, the data that the transmitting / receiving unit 112 receives from the server 20 may include the types of one or more characters to be placed in the game space, character coordinate information, character action information, information regarding character settings, and other information. Also, for example, the data that the transmitting / receiving unit 112 receives from the server may include data for synchronization to support the multiplayer function. Synchronization data may include, for example, the data to be synchronized, the type of that data, and data to specify the timing of the synchronization.

[0051] The game progress unit 113 performs various processes related to the progress of the game. Based on the coordinates of the input position and the type of input operation detected by the operation reception unit 111, the game progress unit 113 identifies the user's instructions. Based on the results of various judgment processes related to the progress of the game performed based on the identified instructions, the game progress unit 113 controls objects, virtual cameras, etc. Depending on the progress of the game, the game progress unit 113 updates, adds, or deletes game information and user information.

[0052] The game progress unit 113 defines a virtual camera for specifying the area to be presented to the user within the virtual space. The game progress unit 113 positions the virtual camera within the virtual space by defining its position and orientation. The game progress unit 113 instructs the display control unit 114 to generate an image that renders the field of view defined by the virtual camera and the objects placed within this field of view.

[0053] The position and orientation of the virtual camera can be determined as appropriate for each virtual space. For example, the game progress unit 113 positions the virtual camera based on the position and orientation of a specific object, so that the specific object is centered in the field of view with a specific orientation. In doing so, the game progress unit 113 adjusts the position and orientation of the virtual camera using the direction, distance, and angle relative to the specific object. The specific object may be a dynamic object such as a player character or a non-player character, or a static object such as a building, tree, or stone. Dynamic objects include player characters that operate based on the actions of each user and non-player characters that operate based on the game program.

[0054] The user relationship processing unit 115 executes various processes related to the friend function and the follow function.

[0055] The distribution unit 116 performs various distribution-related processes, which will be described later.

[0056] The display control unit 114 causes the display unit 18 to display an image. A specific example will be given below.

[0057] The display control unit 114 generates an image that depicts the field of view of the virtual camera defined by the game progress unit 113 within the virtual space, along with the objects present in that field, and displays it on the display unit 18. The display control unit 114 can also superimpose objects related to the UI (User Interface) necessary for various game operations, such as icons, buttons, and menus showing various parameters, onto the image displayed on the display unit 18.

[0058] Furthermore, the control unit 110 of the terminal device 10 may place objects in the virtual space and display a predetermined area of ​​the virtual space on the display unit 18 based on object data sent from the server 20 and information indicating the positions of various objects in the virtual space. Alternatively, the control unit 210 of the server 20 may place objects in the virtual space, control the virtual camera, generate an image to be displayed on the display unit 18, and send it to the terminal device 10, and the control unit 110 of the terminal device 10 may display the image on the display unit 18. In other words, various processes related to object control based on user input, virtual camera control, and generation of images to be displayed on the display unit 18 may be performed by the server 20 or by the terminal device 10.

[0059] Note that the functions of the terminal device 10 and server 20 shown in Figure 2 are merely examples. Each device of the terminal device 10 and server 20 may have at least some of the functions of other devices. In other words, in this embodiment, the server 20 may have some or all of the functional blocks of the terminal device 10, and the terminal device 10 may have some or all of the functional blocks of the server 20. Also, each device such as the terminal device 10 and server 20 does not have to be implemented by a single device, but may be implemented by multiple devices connected via a network, for example. Furthermore, the information processing system 1 may consist of only the terminal device 10 or the server 20, for example. In other words, the information processing system 1 does not have to be implemented by multiple devices connected via a network. Also, the functions of the broadcaster's terminal device 10 and the viewer's terminal device 10, which will be described later, may be different.

[0060] <Processing according to this embodiment> Next, the processing according to this embodiment will be described. In this embodiment, the processor 11 of the terminal device 10 or the processor 21 of the server 20 will be described as performing the processing described later by executing the game program stored in the information processing system 1. However, at least a portion of the processing described later that is performed by the processor 11 may be executed by a processor other than the processor 11. Also, at least a portion of the processing described later that is performed by the processor 21 may be executed by a processor other than the processor 21. In other words, in this embodiment, the computer that executes the game program may be either the terminal device 10 or the server 20, or it may be realized by a combination of multiple devices.

[0061] The following describes an example of applying the configuration of this embodiment to a game in which multiple users form teams. Specifically, the example will be a game in which multiple users are divided into multiple teams and compete against each other (for example, a GvG (Guild Versus Guild) game or an FPS (First Person Shooter) game). In the game of this embodiment, six users form a team and compete against other teams. The configuration of this embodiment may be applied to any game, including role-playing games, action games, and sports games. Furthermore, the configuration of this embodiment is not limited to multiplayer games, but may also be applied to single-player games, etc.

[0062] In the game of this embodiment, each user can control their own character and compete against an opponent. Here, the opponent is another user (in other words, a team to which another user belongs), but the opponent may also be a non-player character or the like.

[0063] Furthermore, in the information processing system 1 of this embodiment, a user can register other users as friends. A friend is a relationship in which one user and another user are associated with each other. In other words, a friend is a relationship in which one user is associated with the other user, and the other user is associated with the first user. That is, if the second user is a friend of the first user, then the first user is a friend of the second user. A friend may also be a relationship that is established based on mutual agreement between one user and another user.

[0064] Furthermore, in the information processing system 1 of this embodiment, users can follow other users. Following means that one user registers another user associating them with themselves. In other words, when a first user follows a second user, it does not necessarily mean that the second user follows the first user. Following may be a relationship that can be established based on the will of one party.

[0065] Information indicating other users associated with each user is stored as user information in memory unit 220 and memory unit 120. In other words, memory unit 220 and memory unit 120 store users who have a predetermined relationship with the first user (specifically, users who are friends of the first user, or users that the first user follows).

[0066] In the following, users associated with a particular user (for example, User 1) (for example, Users who are friends or followers of User 1) will also be referred to as "related users" of that user.

[0067] A user can register another user as a friend by performing a predetermined input operation on the terminal device 10. A user can also follow another user by performing a predetermined input operation on the terminal device 10. Specifically, for example, when a first user performs an input operation on their terminal device 10 related to registering (or following) a second user as a friend (for example, by touching a predetermined button related to such registration), the user relationship processing unit 115 sends a friend registration (or follow) request to the server 20. The user relationship management unit 215 of the server 20 then processes the signal to associate the first user with the second user and stores the second user in a predetermined storage unit as a friend (or followed user) of the first user. Furthermore, when performing the processing based on the signal, the user relationship management unit 215 may transmit a signal to the second user's terminal device 10 informing it that a friend registration request has been made, and perform the processing when the second user performs a predetermined input operation to accept the request at the terminal device 10 that received the notification signal. In other words, the first user may require the consent of the second user to be registered as a friend. In other words, friend registration may only be established when the first user applies to the second user for friend registration and the second user accepts the application. Furthermore, friend registration and following may be performed automatically based on predetermined conditions without any operation by the user (for example, one or both of the first and second users in this case).

[0068] Figure 3 shows an example of the home screen 30 displayed on the display unit 18 in the game of this embodiment. The home screen 30 is the basic screen on which the user performs operations to advance the game. The home screen 30 displays multiple menu items related to the game. The home screen 30 is displayed first, for example, when this game (in other words, an application related to a predetermined service) is started on the terminal device 10. Here, "displayed first when started" includes cases where the home screen 30 is displayed after various displays related to the start (for example, title display, loading display, etc.). The home screen 30 is displayed not only at startup, but also at predetermined triggers. For example, the home screen 30 may be displayed when an input operation is performed on the home button 49, or when an in-game battle ends.

[0069] The display control unit 114 causes the display unit 18 to display the home screen 30. The home screen 30 displays the game space (in other words, the virtual space) and objects that exist in the game space. Specifically, the home screen 30 displays the character 33 (in other words, the player character) owned by the user of the terminal device 10 that is displaying the home screen 30.

[0070] The home screen 30 also displays a battle button 40 that accepts the operation to start a match against an opponent, and a button that accepts the operation to move to a screen for equipping items to character 33 (in other words, settings for character 33). The home screen 30 also displays a broadcast button 44 that accepts the operation to start broadcasting the game (in other words, the match).

[0071] Furthermore, a menu button 48 for displaying the menu screen is displayed on the home screen 30. When an operation (for example, a tap) is performed on the menu button 48, the display control unit 114 displays the menu screen on the display unit 18. The menu screen may display, for example, a user list display button for displaying a list of users who have been added as friends or are being followed, a profile button for displaying a profile screen related to character 33, a ranking button for displaying a predetermined ranking (for example, a ranking related to battles) related to users using the game, an option button for changing game settings, and a help button for receiving instructions on how to use the game. The screen for displaying a list of users who have been added as friends or are being followed can be said to be a screen where the user can check their related users.

[0072] The game progress unit 212 starts a match (in other words, an event) based on an operation on the match button 40 (for example, a tap operation). The user may select their opponent and teammates for the match, or the information processing system 1 (for example, the game progress unit 212) may automatically select them from among multiple users.

[0073] The rules of the game in this embodiment will now be explained. In the game of this embodiment, teams aim to achieve a predetermined goal. Specifically, teams aim to defeat the opposing team. However, the game of this embodiment may also aim to defeat a predetermined enemy character, reach a predetermined destination, or acquire a predetermined object. Here, "enemy character" may be an NPC or a character controlled by another user. Furthermore, the game of this embodiment may also be played by a single user aiming to achieve a predetermined goal, rather than as a team.

[0074] In this embodiment, the game is played under the rule that the team that acquires rule-related objects (e.g., one or more rule-related objects) placed in the virtual space wins. More specifically, for example, the game is played under the rule that the team that acquires (in other words, captures) bases (e.g., one or more bases) placed in the virtual space wins (for example, the team that acquires the most bases wins), or the team that acquires (in other words, collects) the most items (e.g., treasures) placed in the virtual space within a predetermined time wins. Note that the rule-related objects may or may not move in the virtual space. Also, for example, the game may be played under the rule that victory is achieved by defeating all of the opponent's team's characters.

[0075] The game progress unit 212 moves the player character based on user input during a match. Specifically, the game progress unit 212 moves the player character in the virtual space and causes the player character to perform actions related to attacking enemy characters based on user input. By attacking and damaging enemy characters, it is possible to defeat them.

[0076] Furthermore, the method for starting a match and the basic operation methods of the player character (for example, processes related to movement and attacking designated objects) can be the same as in conventional games. In addition, in the game of this embodiment, the user may be able to configure their player character, specifically equipping the player character with items (for example, weapons, armor, etc.) or selecting the type of player character to use in a match, but the method for configuring such player characters can also be the same as in conventional games.

[0077] Furthermore, in the information processing system 1 of this embodiment, each user can distribute videos of matches in which they participate (hereinafter referred to as "play videos") to other users, and can also watch distributed play videos. In other words, each user can distribute their own gameplay. Specifically, the application for playing games (e.g., matches) is provided with functions for distributing matches and functions for viewing matches. That is, the information processing system 1 of this embodiment enables the distribution and viewing of events taking place in the virtual space. In other words, the information processing system 1 of this embodiment provides a video distribution service. Note that each user can also play the game (in other words, a match) without distributing it. In other words, the game progression units 113 and 212 can advance the match (in other words, the game) even when no distribution is taking place.

[0078] The distribution unit 116 starts distribution based on, for example, a user operation on the distribution button 44 (e.g., a tap operation). Specifically, based on a user operation on the distribution button 44, the distribution unit 116 sends data to the server 20 for displaying a video (in other words, a gameplay video) corresponding to the user's gameplay status on another user's terminal device 10. That is, when a user operates the distribution button 44, the user's gameplay video is distributed. The distribution unit 116 also stops (in other words, terminates) distribution based on, for example, a user operation on the distribution button 44 during distribution (e.g., a tap operation).

[0079] The control unit 110 receives data from the server 20 to display (in other words, play) the distributed gameplay video on the terminal device 10 based on the user's input operation related to starting to watch the distributed gameplay video (for example, a tap operation on the thumbnail 60 for a specific distribution, as described later), and instructs the display control unit 114 to display the gameplay video on the display unit 18. In other words, the display control unit 114 displays the gameplay video on the display unit 18 based on the operation related to starting to watch the distributed gameplay video. In other words, the display control unit 114 displays the video of the distribution selected by the user from among the viewable distributions on the display unit 18.

[0080] In other words, when an input operation related to the start of video distribution is performed on the first user's terminal device 10 and distribution begins, the second user's terminal device 10 becomes able to view the video. Here, the video (in other words, the distribution) that the second user views is the first user's gameplay video, showing the progress of the match in which the first user is participating. In other words, the second user's terminal device 10 is able to view the first user's gameplay, in other words, the first user playing the game, in real time. The second user's terminal device 10 may display a screen similar to the game screen displayed on the first user's terminal device 10 as the first user's gameplay video. Publicly known technologies can be used for the video distribution method and viewing method.

[0081] If a user wants to broadcast a match they are participating in to other users, they can, for example, operate the broadcast button 44 displayed on the home screen 30. The broadcast function may not be available to a user unless they achieve a certain required rank. Specifically, if a user has not reached the required rank, the broadcast button 44 may not be displayed, or it may be displayed but input operations to start broadcasting may not be accepted. The rank can be said to indicate the user's skill level, or their relative position among other users. The rank includes what is commonly known as a level in general games. The user's rank may be the user's own rank, or it may be the rank of the character 33 the user is using.

[0082] Furthermore, if a user wants to watch a broadcast from another user, they perform an operation (for example, a tap) on the program guide transition button 46 displayed on the home screen 30. When this operation is performed, the display control unit 114 displays the program guide first screen 32 shown in Figure 4 on the display unit 18. In other words, when this operation is performed, the display control unit 114 transitions the home screen 30 to the program guide first screen 32.

[0083] The first screen of the program guide, screen 32, is the top screen of the program guide. It also displays a list of viewable broadcasts (in other words, programs). The first screen of the program guide displays thumbnails 60 of viewable broadcasts, categorized into multiple categories such as "Popular," "Favorites," and "New Arrivals." Furthermore, on the first screen of the program guide, by touching the area corresponding to each category and performing a horizontal scroll operation, the thumbnails 60 of that category (in other words, thumbnails 60 hidden outside the display screen) are displayed sequentially. The user can then select (for example, by tapping) a specific thumbnail 60 (in other words, a specific broadcast) from this list of thumbnails 60, and view the broadcast corresponding to the selected thumbnail 60. Note that the area of ​​each category on the first screen of the program guide may only display a selection of currently viewable broadcasts. Specifically, for example, the area of ​​each category on the first screen of the program guide may only display broadcasts selected according to predetermined indicator values ​​(in other words, points, scores). Such indicator values ​​may fluctuate depending on the actions of the broadcaster and the actions of viewers toward the broadcasted video. Specifically, for example, an indicator value showing the popularity of a broadcast may fluctuate based on one or more of the following: broadcast time, viewing time, number of viewers, specific values ​​sent by viewers toward the broadcast, and the number of viewer comments. Among the broadcasts belonging to each category, broadcasts with high indicator values ​​may be displayed in the respective category area of ​​the program guide screen 32. In this embodiment, the higher the broadcast points described later, the higher the indicator value.

[0084] Furthermore, in this embodiment, when an operation (for example, a tap) is performed on a category detail button 50 corresponding to each category on the first program guide screen 32, the display control unit 114 controls the display so that it switches to a screen that displays only the broadcasts (in other words, thumbnails 60) of the category for which the operation was performed. For example, when an operation is performed on the category detail button 50a corresponding to the "Favorites" category, the display control unit 114 displays the second program guide screen 34 shown in Figure 5 on the display unit 18, which displays only the broadcasts belonging to the "Favorites" category. That is, when the operation is performed, the display control unit 114 transitions the first program guide screen 32 to the second program guide screen 34. Then, on the second program guide screen 34, by performing an input operation such as scrolling the screen up or down, the thumbnails 60 of the broadcasts belonging to the "Favorites" category (in other words, thumbnails 60 hidden outside the display screen) are displayed sequentially. Note that in Figure 4, the category detail button 50 is shown as a button with an arrow mark and a tab-type button with the category name written on it.

[0085] In other words, when the first program guide screen 32, which displays a list of broadcasts in multiple categories, is displayed, and an input operation is performed to select a specific category, the display control unit 114 displays the second program guide screen, which displays a list of broadcasts in the selected specific category. Furthermore, broadcasts in categories other than the selected specific category are not displayed on the second program guide screen 34. In other words, in this embodiment, only a portion (in this case, one) of the categories displayed on the first program guide screen 32 are displayed on the second program guide screen 34. Note that broadcasts in categories other than the selected specific category may also be displayed on the second program guide screen.

[0086] Here, the multiple categories related to distribution include the "Favorites" category, as mentioned above. The "Favorites" category corresponds to distributions from users who have a predetermined relationship with the user attempting to view (in other words, the user of the terminal device 10 on which the program guide screen 1 32 or program guide screen 2 34 is displayed). Specifically, in this embodiment, only distributions from users related to the user attempting to view belong to the "Favorites" category. That is, only distributions from related users are displayed on the program guide screen 2 34 for the "Favorites" category.

[0087] Furthermore, the first program guide screen 32 may have certain restrictions on the display of information related to related users compared to the second program guide screen 34. In this embodiment, the first program guide screen 32 has a limited number of displayed broadcasts (in other words, thumbnails 60) compared to the second program guide screen 34. Specifically, in the second program guide screen 34, scrolling the screen (specifically, scrolling vertically) displays all currently broadcasting broadcasts related to the user. On the other hand, in the first program guide screen 32, even if the screen is scrolled (specifically, horizontally in the area corresponding to the "Favorites" category), a maximum of 5 broadcasts related to related users will be displayed. The maximum 5 broadcasts displayed in the first program guide screen 32 are broadcasts selected for each category based on a predetermined indicator (for example, the indicator value mentioned above). In other words, the first program guide screen 32 displays only broadcasts for each category whose ranking, determined based on the predetermined indicator, is a predetermined rank or higher (in this case, up to 5th place).

[0088] Furthermore, both or either of the first program guide screen 32 and the second program guide screen 34 may display only currently airing broadcasts. In other words, past broadcasts may or may not be displayed on the first program guide screen 32 or the second program guide screen 34. To put it another way, in this embodiment, only real-time viewing (in other words, live streaming) of broadcasts may be possible. Also, past broadcasts may be displayed on both or either of the first program guide screen 32 and the second program guide screen 34.

[0089] The display control unit 114 of the terminal device 10 of the user (i.e., viewer) watching the broadcast displays the viewing screen 70 for watching the broadcast, as shown in Figure 6, on the display unit 18, based on the user's operation on the thumbnail 60. Specifically, the display control unit 114 displays the viewing screen 70 for watching the broadcast corresponding to the specific thumbnail 60 on the display unit 18, based on the user's operation to select a specific thumbnail 60 from the list of thumbnails 60.

[0090] On the viewing screen 70, the gameplay video is played, and the user can watch the stream corresponding to the selected thumbnail 60. The viewing screen 70 also displays a chat section 72 that shows chat related to the stream being watched. The chat section 72 displays comments entered by the streamer and comments entered by viewers (the user and other users) watching the stream.

[0091] (Sending a specific value) In the information processing system 1 of this embodiment, so-called tipping is possible, similar to conventional video streaming services. In other words, users (in other words, viewers) can send specific value to other users (in other words, broadcasters). Here, the "specific value" that can be sent to other users may be something that a user can purchase by consuming their own assets, or the asset itself. That is, the "specific value" may be, for example, money (in other words, electronic currency), a substitute for money, or a predetermined item related to this game (for example, an item used in a match). In other words, "sending specific value" includes so-called tipping, sending items, etc. Hereafter, sending specific value will also be referred to as "sending a gift."

[0092] In the information processing system 1 of this embodiment, it is possible to send gifts to the broadcaster of a broadcast while watching it (in other words, within the broadcast), similar to conventional video streaming services. The method for sending gifts while watching a broadcast can be the same as in conventional video streaming services, but for example, it may be as follows.

[0093] As described above, the display control unit 114 displays a viewing screen 70 on the display unit 18 based on the user's operation on the thumbnail 60. On the viewing screen 70, as shown in Figure 6(a), the play video is displayed in a predetermined area P, and a gift button 73 is also displayed. The user can then send a gift to the broadcaster of the stream they are watching by operating the gift button 73.

[0094] Specifically, as shown in Figure 6(b), the display control unit 114 displays a selection UI 74 on the display unit 18 as a UI for selecting the content of the gift to be sent (in other words, at least one of the type of value or the amount of value to be sent) based on an operation on the gift button 73 (e.g., a tap operation). The selection UI 74 displays a list of selectable gift contents. Then, by an operation to select a specific option from the displayed options (e.g., a tap operation on a specific option) and an operation on the execute button 75 included in the selection UI 74 (e.g., a tap operation), the gift of the selected content is sent to the broadcaster of the stream being viewed.

[0095] In other words, the operation reception unit 111 receives user operations on the gift button 73 and the selection UI 74 as operations to send a gift (specifically, the value of the content corresponding to the selection made in the selection UI 74) from the user to the broadcaster of the broadcast being viewed. The sending / receiving unit 112 sends a request to the server 20 for the user to send a gift to the broadcaster based on the operations on the gift button 73 and the selection UI 74. The gift processing unit 216 increases the broadcaster's assets by the amount of the gift sent by the user, and decreases the user's assets by the amount corresponding to the gift sent to the broadcaster (in other words, the amount equivalent to the consideration). In other words, the gift processing unit 216 sends a gift from the user to the broadcaster based on the user's operations on the gift button 73 and the selection UI 74.

[0096] (Reactions to gift sending) The display control unit 114 of the broadcaster's terminal device 10 displays the broadcast screen 77, illustrated in Figure 7, on the display unit 18. The broadcast screen 77 displays the content being broadcast to other users in a predetermined area Q. In other words, the broadcast screen 77 allows users to check the content displayed on the terminal devices 10 of other users who are watching the broadcast. The broadcast screen 77 also displays a chat field 78 that displays chat related to the broadcast. The chat field 78 displays comments entered by the broadcaster and comments entered by viewers watching the broadcast. The broadcast content and the chat field 78 may be displayed separately or overlappingly. In this embodiment, the broadcast screen 77 displays a game screen for the broadcaster to play a game as the broadcast content, and the broadcaster plays the game by operating the player character while viewing the game screen. The broadcaster may also be able to broadcast images (for example, the broadcaster's face) captured by the camera of the terminal device 10. In this case, the content displayed on the streaming screen 77 will be the image captured by the camera in question.

[0097] When a user sends a gift to a broadcaster, the broadcaster is notified that a gift has been sent. Specifically, the gift processing unit 216, based on a predetermined operation by the user, sends a signal to the broadcaster's terminal device 10 indicating that a gift has been sent. The control unit 110 of the broadcaster's terminal device 10 then notifies the broadcaster that a gift has been sent based on this signal. Specifically, the display control unit 114 of the broadcaster's terminal device 10 displays a notification that a gift has been sent in the chat field 78 of the broadcasting screen 77. More specifically, the display control unit 114 displays the username of the user who sent the gift and the contents of the gift in the chat field 78. In this embodiment, users can also send gifts anonymously, and if a gift is sent anonymously, the username of the user who sent the gift is not displayed. Furthermore, the control unit 110 of the broadcaster's terminal device 10 may notify the broadcaster that a gift has been sent by outputting a predetermined sound from the speaker of the terminal device 10.

[0098] (Control based on sound from the streamer) The control unit 110 of the broadcaster's terminal device 10 acquires sound input (in other words, sound from the broadcaster's side) from an audio input unit (e.g., a microphone) connected via the input / output IF 15. The sound acquired by the broadcaster's terminal device 10 is then transmitted from the broadcaster's terminal device 10 to the viewer's terminal device 10. The control unit 110 of the viewer's terminal device 10 then outputs the received sound to an audio output unit (e.g., a speaker or headphones) connected via the input / output IF 15. In this way, the broadcaster's sounds, such as the broadcaster's speech during the broadcast, are delivered to the viewer. The broadcaster's sounds may be provided to the viewer as part of the broadcast video. In other words, the broadcaster's sounds may be sent from the broadcaster's terminal device 10 to the server 20 and from the server 20 to the viewer's terminal device 10 as part of the broadcast video together with the gameplay video, or they may be sent separately from the gameplay video from the broadcaster's terminal device 10 to the server 20 and from the server 20 to the viewer's terminal device 10. The audio input and audio output sections may be built into the terminal device 10.

[0099] The reward distribution unit 217 performs control to make the rewards given to users more favorable compared to cases where the predetermined conditions (hereinafter referred to as "favorable control conditions") are not met, when the sound from the broadcaster meets predetermined conditions. Here, the users to whom rewards are given may be either the broadcaster or the viewer, or both. In other words, the reward distribution unit 217 may make the rewards given to the broadcaster more favorable compared to cases where the favorable control conditions are not met, when the sound from the broadcaster meets the favorable control conditions. The reward distribution unit 217 may also make the rewards given to viewers more favorable compared to cases where the favorable control conditions are not met, when the sound from the broadcaster meets the favorable control conditions. Note that "making rewards more favorable" may mean increasing the quality of the rewards given, or increasing the amount of rewards given. Also, "making rewards more favorable" may mean that the unfavorable side (in other words, when the favorable control conditions are not met) receives no reward at all. Also, "making rewards more favorable" may mean reducing the rewards when the favorable control conditions are not met, so that the rewards are more favorable when the favorable control conditions are met. In other words, the reward granting unit 217 may control the system so as not to grant a predetermined penalty that would be granted if the favorable control conditions were not met, when the favorable control conditions are met.

[0100] For example, the system may set it so that the favorable control condition is met when there is sound from the broadcaster (in other words, when there is sound), and not met when there is no sound from the broadcaster (in other words, when there is silence). That is, the reward granting unit 217 may grant a more favorable reward when the broadcaster is making sound compared to when the broadcaster is not making sound. The determination of whether there is sound or silence may be made, for example, by observing the waveform of the sound input from the sound input unit, or by determining whether the microphone or other settings are muted.

[0101] Furthermore, for example, the system may set it so that the favorable control condition is met when the volume of the broadcaster's sound exceeds a predetermined level, and not met when the volume does not exceed the predetermined level. In other words, the reward granting unit 217 may grant a more favorable reward when the volume of the sound emitted by the broadcaster exceeds a predetermined standard compared to when it does not exceed the predetermined standard.

[0102] Furthermore, for example, the system may satisfy the favorable control condition when the sound from the broadcaster is related to the broadcaster's speech, and not satisfy the favorable control condition when it is not related to the broadcaster's speech. In other words, the reward granting unit 217 may grant a more favorable reward when the broadcaster is speaking (in other words, when it is determined that the broadcaster is speaking) compared to when the broadcaster is not speaking (in other words, when it is determined that the broadcaster is not speaking).

[0103] Furthermore, for example, the system may satisfy the favorable control condition when the sound from the broadcaster is related to human speech, and not satisfy the favorable control condition when it is not related to human speech. In other words, the reward-granting unit 217 may grant a more favorable reward when a human is speaking (in other words, when it is determined that a human is speaking) compared to when a human is not speaking (in other words, when it is determined that a human is not speaking).

[0104] Furthermore, for example, the system may set it so that the favorable control condition is met when the broadcaster's sound relates to an utterance of a predetermined content, and not met when it does not relate to an utterance of a predetermined content. Specifically, the system may set it so that the favorable control condition is met when the broadcaster's sound relates to an utterance containing a specific keyword, and not met when it does not relate to an utterance containing a specific keyword. Here, the specific keyword may be, for example, a word such as "thank you," or it may be the viewer's username (for example, the viewer's username registered in association with the viewer's account while watching the broadcast). In other words, the reward granting unit 217 may grant a more favorable reward when the broadcaster utters a specific keyword compared to when the broadcaster does not utter a specific keyword.

[0105] Furthermore, for example, the system may define a favorable control condition as being met when the sound from the broadcaster indicates that the broadcaster has consumed a predetermined amount of calories or more, and not met when it does not indicate that the broadcaster has consumed a predetermined amount of calories or more. In other words, the reward-granting unit 217 may grant a more favorable reward when the broadcaster consumes a predetermined amount of calories or more through speaking compared to when they do not consume a predetermined amount of calories or more.

[0106] In other words, the favorable control condition may be met if a sound that meets a predetermined standard is obtained as the sound on the broadcaster's side (for example, a sound that exceeds a predetermined volume, a sound that is determined to be the broadcaster's own speech, a sound that is determined to be human speech, a sound related to a predetermined content, or a sound that is determined to have consumed a predetermined number of calories, etc.), and the favorable control condition may not be met if a sound that meets the predetermined standard is not obtained.

[0107] Furthermore, for example, whether or not the favorable control condition is met may be determined depending on the circumstances of the broadcast and the sound from the broadcaster (in other words, the relationship between the circumstances and the sound). For example, the favorable control condition may be met if there is sound from the broadcaster when the circumstances of the broadcast are in a specific state, and not met if there is no sound from the broadcaster when the circumstances of the broadcast are in a specific state. Also, for example, the favorable control condition may be met if a sound that meets a predetermined criterion (e.g., a sound exceeding a predetermined volume, a sound determined to be the broadcaster's own speech, a sound determined to be human speech, a sound related to a predetermined content, or a sound determined to have consumed a predetermined amount of calories) is acquired when the circumstances of the broadcast are in a specific state, and not met if a sound that meets a predetermined criterion is not acquired when the circumstances of the broadcast are in a specific state. Here, the specific circumstances may be, for example, a situation in which a viewer has performed a predetermined action on the broadcast (e.g., a predetermined action related to communication with the broadcaster, such as sending a comment or a gift). Furthermore, the specific circumstances can be rephrased as, for example, within a specified period of time after a viewer has performed a specified action in response to the broadcast (for example, a specified action related to communication with the broadcaster). In other words, the reward-granting unit 217 may reward the broadcaster more favorably when the broadcaster responds to the viewer's specified action compared to when the broadcaster does not respond to the viewer's specified action. To put it another way, the reward-granting unit 217 may reward the broadcaster more favorably depending on the sound from the broadcaster's side when the broadcast situation is a specific one.

[0108] Furthermore, for example, whether or not the advantageous control condition is met may be determined according to the situation of the game being streamed (in other words, the event, or in this embodiment, the match) and the sound from the streamer's side (in other words, the relationship between the situation and the sound). For example, the advantageous control condition may be met if there is sound from the streamer's side when the game situation is in a specific state, and not met if there is no sound from the streamer's side when the game situation is in a specific state. Also, for example, the advantageous control condition may be met if a sound that meets a predetermined criterion (for example, a sound exceeding a predetermined volume, a sound determined to be the streamer's own speech, a sound determined to be human speech, a sound related to a predetermined content, or a sound determined to indicate the consumption of a predetermined amount of calories) is acquired when the game situation is in a specific state, and not met if a sound that meets the predetermined criterion is not acquired when the game situation is in a specific state. Here, the specific situation may be, for example, a situation in which a predetermined event occurs in the game being streamed. The specific situation can also be rephrased as, for example, within a predetermined period of time after a predetermined event occurs in the game being streamed. In other words, the reward-granting unit 217 may reward the streamer more favorably when they react to a predetermined event in the game compared to when they do not react to the predetermined event. To put it another way, the reward-granting unit 217 may reward the streamer more favorably depending on the sound they make when the game being streamed is in a specific state. To put it another way, the reward-granting unit 217 may reward the streamer more favorably when they make a utterance in response to the excitement of the game being streamed compared to when they do not make a utterance in response to the excitement of the game being streamed.

[0109] The information processing system 1 (for example, the control unit 110 or the control unit 210) has a detection unit 117 that performs predetermined detections on the sound from the broadcaster's side acquired by the broadcaster's terminal device 10. In other words, the detection unit 117 detects predetermined matters related to the sound from the broadcaster's side. The reward granting unit 217 then makes the reward granted to the user more favorable according to the result of the predetermined detection. In other words, the reward granting unit 217 makes the reward granted to the user more favorable when the predetermined detection is made (in other words, when the predetermined matters are detected) compared to when the predetermined detection is not made (in other words, when the predetermined matters are not detected). In other words, the detection unit 117 determines whether or not the favorable control conditions are met.

[0110] For example, the detection unit 117 may detect, as the predetermined detection, that there is sound from the broadcaster's side (in other words, that there is no silence).

[0111] Furthermore, the detection unit 117 may also detect that a sound meeting a predetermined standard has been acquired as a predetermined detection. Specifically, the detection unit 117 may detect that the volume exceeds a predetermined standard as a predetermined detection. Furthermore, the detection unit 117 may also detect that the broadcaster themselves is speaking as a predetermined detection. Furthermore, the detection unit 117 may also detect that a human is speaking as a predetermined detection. The detection of the broadcaster themselves speaking, in other words, the control to identify who is speaking and to identify that the broadcaster is speaking, can be performed by known speaker recognition technology. Furthermore, the detection of a human speaking can be performed, for example, by calculating the length of the sound, the volume of the sound, the interval of silence, the intonation of the voice, etc., from the sound from the broadcaster side that is acquired, and determining that a human and not a machine are speaking. Furthermore, whether or not the volume exceeds a predetermined standard may be determined based on whether or not it exceeds a certain standard volume, or it may be determined based on the volume difference between the volume in the first period and the volume in the second period. In other words, for example, the detection unit 117 may determine that the volume exceeds a predetermined standard (in other words, detect that it exceeds a predetermined standard) when the volume of the sound from the broadcaster when the broadcasting situation (or the situation of the game being broadcast) is in a specific situation is greater than or equal to a predetermined amount compared to the volume of the sound from the broadcaster when the situation is not in a specific situation (in other words, when the broadcaster makes sounds corresponding to the excitement of the game).

[0112] Furthermore, the detection unit 117 may also detect that the broadcaster is making a speech related to the broadcast as part of the predetermined detection. Specifically, the detection unit 117 may detect that there is sound from the broadcaster's side (in other words, that there is no silence) when the broadcast situation is in a specific state. The detection unit 117 may also detect that a sound meeting a predetermined criterion has been acquired when the broadcast situation is in a specific state (for example, a sound exceeding a predetermined volume, a sound determined to be the broadcaster's own speech, a sound determined to be human speech, a sound related to a predetermined content, or a sound determined to indicate the consumption of a predetermined amount of calories). In other words, the detection unit 117 may detect that the broadcaster is communicating with the viewers. In other words, the detection unit 117 may determine whether or not the broadcaster is communicating with the viewers based on the broadcast situation and the sound from the broadcaster's side, and the reward granting unit 217 may give a more favorable reward when it is determined that communication is taking place compared to when it is not determined that communication is taking place. Furthermore, the detection unit 117 may detect that there is sound from the streamer's side (in other words, that there is no silence) when the game being streamed is in a specific state. Also, the detection unit 117 may detect that a sound meeting a predetermined criterion (for example, a sound exceeding a predetermined volume, a sound determined to be the streamer's own speech, a sound determined to be human speech, a sound related to a predetermined content, or a sound determined to indicate the consumption of a predetermined amount of calories, etc.) has been acquired when the game being streamed is in a specific state. In other words, the detection unit 117 may detect that the streamer is live-streaming a game. In other words, the detection unit 117 may determine whether or not the streamer is live-streaming a game based on the game being streamed and the sound from the streamer's side, and the reward granting unit 217 may give a more favorable reward when it is determined that the streamer is live-streaming a game compared to when it is not determined that the streamer is live-streaming a game. Such detection related to the streaming situation or the game situation can be performed, for example, as follows.

[0113] In other words, for example, the detection unit 117 may determine (in other words, detect that communication is taking place) that the broadcaster is communicating with viewers if the data related to the broadcaster's sound during the period corresponding to the timing when a viewer sends a comment or gift meets a predetermined standard. Alternatively, for example, the detection unit 117 may determine (in other words, detect that game commentary is taking place) that the broadcaster is live-streaming a game if the data related to the broadcaster's sound during the period corresponding to the timing when a predetermined event occurs in the game being streamed meets a predetermined standard. The timing when a predetermined event occurs in the game (in other words, whether the game situation is in a specific state or not) may be determined, for example, as follows: First, events that trigger the awarding of rewards are pre-registered in a predetermined memory unit (for example, memory unit 120 or memory unit 220). For example, events that trigger the awarding of rewards may include the broadcaster (or the broadcaster's team) defeating an enemy character, clearing a game, or acquiring a rare item. The detection unit 117 then determines, when any of the registered events occur, whether the sound from the broadcaster at the time the event occurred meets a predetermined standard.

[0114] The detection unit 117 may also continuously monitor the sound from the broadcaster while the broadcast is in progress and detect when the sound reaches a predetermined state (specifically, a state that is the target of a predetermined detection) (in other words, perform a predetermined detection). Alternatively, the detection unit 117 may only monitor the sound from the broadcaster for a specific period while the broadcast is in progress and detect when the sound reaches a predetermined state (specifically, a state that is the target of a predetermined detection) (in other words, perform a predetermined detection). Here, a specific period could be, for example, when the broadcast status or the status of the game being broadcast reaches a specific state. Specifically, the detection unit 117 may observe the sound on the broadcaster's side when a predetermined event occurs during broadcasting (for example, when a viewer performs a predetermined action such as sending a message or a gift (in other words, a predetermined period after the predetermined action is performed), or when a predetermined event occurs in the game being broadcast (in other words, a predetermined period after the predetermined event occurs)), and detect when the sound reaches a predetermined state (in other words, perform a predetermined detection).

[0115] Furthermore, the detection unit 117 may perform the predetermined detection using AI (Artificial Intelligence). Various AIs have been proposed for performing various voice detections, such as who is speaking and what they are saying, and various known methods can be used for predetermined detections of the broadcaster's sound using AI. The AI ​​may be either machine learning type or non-machine learning type (rule-based). An example of predetermined detection using AI is given below. When using a machine learning type, for example, the broadcaster's own voice may be provided as training data to generate a learning model that identifies the broadcaster's voice, and the detection unit 117 may determine whether the sound on the broadcaster's side is related to the broadcaster's own speech based on the learning model. Alternatively, for example, various existing broadcasts in which the broadcaster makes speech related to the broadcast (in other words, the audio of the broadcast) may be provided as training data to generate a learning model that determines whether the broadcaster is making speech related to the broadcast, and the detection unit 117 may determine whether the broadcaster is making speech related to the broadcast based on the learning model. Alternatively, for example, various existing broadcasts in which the broadcaster communicates with viewers (in other words, the audio of the broadcast) may be provided as training data to generate a learning model that can determine whether the broadcaster is communicating with viewers, and the detection unit 117 may determine whether or not the broadcaster is communicating with viewers based on this learning model. Alternatively, for example, various existing game commentary broadcasts (in other words, the audio of the game commentary) may be provided as training data to generate a learning model that can determine whether or not the broadcaster is doing game commentary, and the detection unit may determine whether or not the broadcaster is doing game commentary based on this learning model. Furthermore, when using a non-machine learning type, for example, multiple keywords may be registered in a predetermined memory unit, and the detection unit 117 may detect that the broadcaster's audio is related to speech of predetermined content when the registered keywords are included in the broadcaster's audio.

[0116] (Processing related to the granting of rewards) Next, with reference to Figure 8, an example of the process related to the awarding of rewards performed by the information processing system 1 will be explained.

[0117] The control unit 110 of the broadcaster's terminal device 10 acquires sound from the broadcaster's side (step S101). Specifically, the control unit 110 acquires sound input from a microphone connected to or built into the terminal device 10.

[0118] The detection unit 117 observes the sound from the broadcaster. When the sound from the broadcaster reaches a state that is subject to a predetermined detection, it performs a predetermined detection. The reward granting unit 217 then determines whether or not the predetermined detection has been performed (step S102).

[0119] If a predetermined detection occurs (YES in step S102), the reward distribution unit 217 increases the reward distributed to the user (step S103). If the predetermined detection does not occur (NO in step S102), the reward distribution unit 217 does not increase the reward distributed to the user. In other words, the reward distribution unit 217 makes the reward distributed to the user more favorable when the sound from the broadcaster satisfies the favorable control conditions compared to when the favorable control conditions are not met. In addition, if a predetermined detection occurs (YES in step S102), the reward distribution unit 217 may, instead of or in addition to the process in step S103, distribute the reward to the user at the time the predetermined detection occurs. Furthermore, if a predetermined detection occurs (YES in step S102), the reward distribution unit 217 may change the reward distributed to the user in a direction that is favorable to the user. Furthermore, the reward distribution unit 217 may perform a process to reduce the reward given to the user if the predetermined detection is not performed (NO in step S102), and may not perform a process to reduce the reward given to the user if the predetermined detection is performed (YES in step S102). Also, the reward distribution unit 217 may change the reward given to the user in a direction unfavorable to the user if the predetermined detection is not performed (NO in step S102).

[0120] A specific example of the process for granting rewards will be explained with reference to Figure 9. Here, we assume that there are viewers A, B, and C who watch the broadcast. Furthermore, the broadcaster who conducts the broadcast will be granted a predetermined reward. Here, when a broadcast is conducted, the broadcaster will be granted a predetermined electronic currency as a reward, specifically in-game currency that can be used within the game. Specifically, the in-game currency will be granted to the broadcaster after the broadcast ends. That is, the reward granting unit 217 may increase the amount of in-game currency to be granted to the broadcaster at various triggers described later (in other words, each time the detection unit 117 makes a predetermined detection), and after the broadcast ends, the accumulated in-game currency may be granted to the broadcaster. In addition, viewers who watch the broadcast (for example, viewers who watch for a predetermined time or longer) may also be granted a predetermined reward. In other words, the reward distribution unit 217 may increase the amount of in-game currency distributed to viewers at various triggers described later (in other words, each time the detection unit 117 makes a predetermined detection), and after the end of the broadcast, distribute the accumulated in-game currency to the viewers.

[0121] For example, as shown in Figure 9, if during a broadcast viewer A sends the comment "Hello," and the broadcaster inputs the voice "Hello" (in other words, the broadcaster's voice) within a predetermined period after the comment is sent, the detection unit 117 detects that the broadcaster has responded to the viewer's comment based on the fact that the broadcaster's voice was input (in other words, that there was a speech) within a predetermined period after the comment was sent. In addition to the fact that the broadcaster's voice was input within a predetermined period after the comment was sent, the detection unit 117 may also detect that the broadcaster has responded to the viewer's comment based on the fact that the voice contains the keyword "Hello." The reward distribution unit 217 then increases the rewards it grants to the user based on the detection that the broadcaster has responded to the viewer's comment. Specifically, the reward distribution unit 217 increases the in-game currency it grants to the broadcaster. The reward distribution unit 217 may also increase the in-game currency it grants to viewer A, the recipient of the response from the broadcaster.

[0122] Furthermore, for example, if during a live stream, viewer B sends the comment "Nice to meet you," and the streamer then inputs the voice (in other words, the streamer's voice) saying "Nice to meet you, B," the detection unit 117 detects that the streamer has responded to the viewer's comment based on the fact that the streamer called out viewer B's username after the comment was sent. The detection unit 117 may also detect that the streamer has responded to the viewer's comment based on the fact that the streamer called out viewer B's username, as well as the fact that the streamer's voice was input within a predetermined period after the comment was sent. The reward distribution unit 217 then increases the rewards it awards to the user based on the detection that the streamer has responded to the viewer's comment. Specifically, the reward distribution unit 217 increases the in-game currency awarded to the streamer. The reward distribution unit 217 may also increase the rewards it awards to viewer B, the recipient of the response from the streamer.

[0123] Furthermore, for example, if viewer C sends a gift to the streamer during a live stream, and the streamer then inputs an audio message (in other words, an audio message from the streamer) saying "Thank you for the gift, C," the detection unit 117 detects that the streamer has responded to the gift from the viewer, based on the fact that the streamer's audio message was input (in other words, that there was a speech) within a predetermined period of time after the gift was sent. In addition to the fact that the streamer's audio message was input within a predetermined period of time after the gift was sent, the detection unit 117 may also detect that the streamer has responded to the gift from the viewer based on the fact that the streamer called out viewer C's username or that the audio message included keywords such as "thank you" or "gift." The reward granting unit 217 then increases the rewards it grants to the user based on the detection that the streamer has responded to the gift from the viewer. Specifically, the reward granting unit 217 increases the in-game currency it grants to the streamer. The reward granting unit 217 may also increase the rewards it grants to viewer C, the recipient of the response from the streamer.

[0124] For example, if the broadcaster does not input audio for a predetermined period during a broadcast (in other words, if there is no sound from the broadcaster for a predetermined period, or if sound meeting a predetermined standard is not acquired for a predetermined period), the detection unit 117 may detect that the broadcaster is neglecting the broadcast (in other words, broadcasting content of little interest, or not performing predetermined actions such as chatting or playing games during the broadcast) based on the lack of audio input for a predetermined period. The reward distribution unit 217 may then reduce the rewards to be given to the user based on the detection that the broadcaster is neglecting the broadcast. Specifically, the reward distribution unit 217 may reduce the in-game currency given to the broadcaster. The reward distribution unit 217 may also reduce the rewards given to viewers who are watching the broadcast (in other words, rewards obtained by watching the broadcast).

[0125] For example, let's assume the stream is a game stream. Then, for example, in the game being streamed, an event occurs where the streamer defeats an enemy character, and afterwards the streamer inputs the voice "Nice" (in other words, the streamer's voice), and the detection unit 117 detects that the streamer is commentating on the game (in other words, reacting to the event) based on the fact that the streamer's voice was input (in other words, that there was a speech) within a predetermined period of time from the event to the event. In addition to the fact that the streamer's voice was input within a predetermined period of time from the event to the event, the detection unit 117 may also detect that the streamer is commentating on the game based on whether the voice contains keywords such as "Nice". The reward distribution unit 217 then increases the rewards it gives to users based on the detection that the streamer is commentating on the game. Specifically, the reward distribution unit 217 increases the in-game currency given to the streamer. The reward distribution unit 217 may also increase the in-game currency given to viewers who were watching the event.

[0126] In this embodiment, the detection unit 117 may detect the broadcaster's speech or perform various detections based on the broadcaster's speech. However, the detection unit 117 may also consider the broadcaster's speech to have occurred if any sound is acquired by the sound input unit (e.g., a microphone), or it may consider the broadcaster's speech to have occurred based on the determination that the sound acquired by the sound input unit meets a predetermined criterion. In other words, for example, the "broadcaster's voice" in the specific example described here does not necessarily have to be the broadcaster's own voice.

[0127] The rewards awarded by the reward awarding unit 217 may, for example, be distribution points that affect the aforementioned index value indicating the popularity of a distribution. In other words, the awarding of rewards by the reward awarding unit 217 may increase the index value indicating the popularity of a distribution (in other words, the parameter related to the display priority of the distribution). That is, if the sound from the distributioner performing the distribution satisfies the favorable control conditions, the display priority of the distribution being performed by that distributioner on the screen that lists viewable distributions may be higher compared to when the favorable control conditions are not met.

[0128] Furthermore, the rewards given by the reward distribution unit 217 may be items usable in the game. That is, such items may be given to at least one of the streamer performing the broadcast or the viewers. If the sound on the streamer's side during the broadcast satisfies the advantageous control conditions, items with higher performance (in other words, parameters) or rarity, or more items, may be given compared to when the advantageous control conditions are not met.

[0129] The display control unit 114 of the broadcaster's terminal device 10 may, when the broadcast ends, display a results screen 80 on the display unit 18, as illustrated in Figure 10(a), which displays the results of the broadcast. The results screen 80 may display information such as, for example, the time the broadcast was running, the time the broadcaster spoke during the broadcast (for example, the total time the broadcaster's speech was detected during the broadcast), the calories consumed by the broadcaster during the broadcast, the number of viewer comments on the broadcast (in other words, the broadcaster), the number of times the broadcaster responded to viewer comments, the percentage of viewer comments the broadcaster responded to, the total amount of gifts sent by viewers to the broadcast (in other words, the broadcaster), the number of times the broadcaster responded to viewer gifts, the percentage of viewer gifts the broadcaster responded to, the number of viewers who watched the broadcast (for example, the total number of viewers or the maximum number of viewers watching simultaneously (in other words, the number of simultaneous connections)), or information related to rewards earned (in other words, awarded) through the broadcast.

[0130] Furthermore, the results screen 80 may display advice 81 regarding future speech in broadcasts, based on the broadcaster's sound during the broadcast. For example, the control unit 210 may determine advice 81 regarding future broadcasts to be provided to the broadcaster after the broadcast ends, based on the broadcaster's sound during the broadcast. The control unit 210 may then instruct the broadcaster's terminal device 10 to display the determined advice 81. The display control unit 114 of the broadcaster's terminal device 10 may then display the advice 81 on the display unit 18 based on this instruction. In other words, the control unit 210 may, after the broadcast ends, provide the broadcaster with advice 81 regarding future speech in broadcasts, based on the broadcaster's sound during the broadcast.

[0131] For example, the control unit 210 may provide the broadcaster with advice 81 corresponding to the detection results of the detection unit 117. Alternatively, for example, the control unit 210 may provide the broadcaster with advice 81 corresponding to various information displayed on the results screen 80. Specifically, the control unit 210 may provide the broadcaster with advice 81 corresponding to the number of comments sent by viewers during the broadcast and the number of times the broadcaster responded to those comments. In other words, the control unit 210 may provide the broadcaster with advice 81 corresponding to the number of times the detection unit 117 detected the broadcaster's response to a predetermined action by a viewer. For example, if the number of times the broadcaster responded to a comment sent by a viewer falls below a predetermined standard (in other words, if it is too few), the control unit 210 may control the display unit 18 to display advice 81 indicating that responding more to comments from viewers could increase the broadcaster's reward. Furthermore, for example, if the control unit 210 determines from the sound on the broadcaster's side that the broadcaster's voice lacks intonation, it may control the display unit 18 to display advice 81 suggesting that the reward could be increased by adding more intonation. Also, for example, if the control unit 210 determines from the sound on the broadcaster's side that there is a long period of silence, it may control the display unit 18 to display advice 81 suggesting that the reward could be increased by talking more. In addition, the detection results of the detection unit 117 (for example, the percentage of times the broadcaster responded to comments from viewers, or the number of times the broadcaster did not respond to comments from viewers, etc.) and the types of advice 81 to be provided to the broadcaster may be stored in advance in a predetermined storage unit (for example, storage unit 220), and the control unit 210 may determine the advice 81 to be provided to the broadcaster based on this correspondence.

[0132] Furthermore, the control unit 210 may assign a title to the broadcaster based on the broadcaster's sound during the broadcast. For example, the control unit 210 may assign a title to the broadcaster according to the detection result of the detection unit 117. Alternatively, for example, the control unit 210 may assign a title to the broadcaster according to various information displayed on the results screen 80. For example, the control unit 210 may provide the broadcaster with a title based on the number of times the detection unit 117 detected the broadcaster's reaction to a predetermined action by a viewer, the intonation of the broadcaster's voice, or the amount of time the broadcaster spoke during the broadcast. The correspondence between the detection result of the detection unit 117 and the title to be assigned to the broadcaster may be stored in advance in a predetermined storage unit (for example, storage unit 220), and the control unit 210 may determine the title to be assigned to the broadcaster based on this correspondence. The assigned title may also be displayed on the results screen 80.

[0133] Furthermore, when viewing the broadcast ends, the display control unit 114 of the viewer's terminal device 10 may display a results screen 84 on the display unit 18, as shown in Figure 10(b), which displays the results of the viewing. The results screen 84 may display information such as the time spent watching the broadcast, the time the broadcaster spoke during the viewing (for example, the total time the broadcaster's speech was detected during viewing), the calories consumed by the broadcaster during the viewing, the number of comments made by the viewer (in other words, the viewer) to the broadcast (in other words, the broadcaster), the number of times the broadcaster responded to the viewer's comments, the percentage of times the broadcaster responded to the viewer's comments, the total amount of gifts sent by the viewer to the broadcast (in other words, the broadcaster), the number of times the broadcaster responded to the viewer's gifts, the percentage of times the broadcaster responded to the viewer's gifts, or information related to rewards earned (in other words, granted) by viewing the broadcast. Furthermore, "ending the stream" may mean stopping viewing while the stream is still running, or it may mean that viewing ends when the stream ends.

[0134] Furthermore, it is possible to have multiple broadcasters for a single stream. In other words, multiple users may appear in a single stream. Such streams featuring multiple users may include so-called collaborative streams.

[0135] Furthermore, if multiple broadcasters are set for a single broadcast (in other words, if multiple user accounts as broadcasters are linked), the control unit 210 may be able to identify which of the multiple broadcasters made the statement. For example, the control unit 210 may identify which broadcaster made the statement by identifying which broadcaster's terminal device 10 (in other words, the microphone corresponding to which broadcaster) acquired the sound. Alternatively, the control unit 210 may be able to identify which broadcaster made the statement by speaker recognition from data containing the voices of multiple broadcasters. The reward distribution unit 217 may then determine the distribution of rewards to each of the multiple broadcasters based on each broadcaster's statements. For example, the reward distribution unit 217 may determine the distribution of rewards to each of the multiple broadcasters based on the proportion of each broadcaster's statements during the broadcast, the content of their statements, etc. Specifically, the reward distribution unit 217 may determine the distribution of rewards to each of the multiple broadcasters based on the proportion of each broadcaster who emitted sounds that met a predetermined standard during the broadcast. In other words, the reward distribution unit 217 may implement control to award more rewards to broadcasters who spoke more during the broadcast.

[0136] According to the information processing system 1 of this embodiment, the reward can be varied depending on whether the sound input by the broadcaster meets predetermined conditions. For example, it is possible to reward broadcasters who do not speak during their broadcasts lower than broadcasters who speak during their broadcasts. Also, for example, it is possible to reward viewers who watch broadcasts of broadcasters who do not speak during their broadcasts lower than viewers who watch broadcasts of broadcasters who speak during their broadcasts. Also, for example, it is possible to reward broadcasters who communicate with viewers higher than broadcasters who do not communicate with viewers. Also, for example, it is possible to reward viewers who communicate with broadcasters higher than viewers who do not communicate with broadcasters. Also, for example, it is possible to reward broadcasters who provide commentary during game broadcasts higher than broadcasters who do not provide commentary. Also, for example, it is possible to reward viewers who watch broadcasts of broadcasters who provide commentary during game broadcasts higher than viewers who watch broadcasts of broadcasters who do not provide commentary. Therefore, it is possible to encourage broadcasters to input sounds that meet predetermined conditions, thereby suppressing the increase of undesirable broadcasts and increasing the number of interesting broadcasts. Specifically, this could, for example, suppress the increase in streams where the streamer does not speak, or increase the number of streams with engaging and enthusiastic comments. Furthermore, since it is predicted that the more rewards viewers receive, the more viewers there will be, controlling the rewards viewers receive could encourage an increase in streams that offer higher rewards.

[0137] (Second Embodiment) Next, a second embodiment of the present invention will be described. Since the information processing system 1 according to this embodiment has basically the same configuration as the information processing system 1 according to the first embodiment, the explanation of the same configuration as the information processing system 1 according to the first embodiment will be omitted or simplified.

[0138] In the information processing system 1 of this embodiment, the control unit 110, as shown in Figure 11, includes an operation detection unit 118 that detects a predetermined operation of the broadcaster while broadcasting, and a sound detection unit 119 that detects sound from the broadcaster's side.

[0139] The operation detection unit 118 detects the broadcaster's operation on the touchscreen 16, which is a predetermined input unit 17. The operation detection unit 118 may also detect the broadcaster's operation on a predetermined controller or the like connected to the terminal device 10. In other words, the operation detection unit 118 detects operations performed by the user. Furthermore, the operation detection unit 118 may detect some of the operations on the touchscreen 16 (in other words, specific operations). Also, the operation detection unit 118 may detect some of the operations on a predetermined controller or the like connected to the terminal device 10 (in other words, specific operations).

[0140] The sound detection unit 119 detects sound input from an audio input unit (e.g., a microphone) connected to or built into the broadcaster's terminal device 10 (in other words, sound from the broadcaster's side).

[0141] The distribution unit 116 controls the distribution to stop if a predetermined operation by the distributor performing the distribution is not detected for a predetermined period of time. Specifically, the distribution unit 116 forcibly stops the distribution if the operation detection unit 118 does not detect any operation by the distributor on the touchscreen 16 for a certain period of time (for example, 10 minutes). In this embodiment, stopping the distribution means ending the distribution, but it may also mean interrupting the distribution (in other words, pausing it), etc.

[0142] The distribution unit 116 instructs the display control unit 114 to display specific information on the display unit 18 based on the fact that no predetermined operation by the distributor performing the distribution has been detected for a predetermined period of time. The display control unit 114 displays the specific information on the display unit 18 based on this instruction. Specifically, if the operation detection unit 118 does not detect any operation by the distributor on the touchscreen 16 for a certain period of time (for example, 9 minutes), the distribution unit 116 displays warning information (in other words, a warning screen) 90, as exemplified in Figure 12(a), on the display unit 18 as specific information. Here, the time from when the operation detection unit 118 fails to detect any operation by the distributor on the touchscreen 16 until the warning information 90 is displayed is shorter than the time until the distribution is forcibly stopped. In other words, the distribution unit 116 provides the warning information 90 to the user before stopping the distribution.

[0143] In this embodiment, the warning information 90 displays that the distribution will be stopped if a predetermined operation is not performed (in Figure 12(a), the text "Distribution will be terminated because there has been no operation for a certain period of time." is displayed), the remaining time until the distribution is stopped, and a display related to the operation to continue the distribution. In other words, the warning information 90 displays the content of the penalty to be imposed on the distributor, the reason for the penalty being imposed, and methods to avoid the penalty. In this embodiment, the distribution continuation button 91, which is a UI that accepts the operation to continue the distribution, is displayed as a display related to the operation to continue the distribution, but text notifying the operation to continue the distribution may also be displayed. Specifically, when distribution is continued by touching any position on the display unit 18, text such as "Please touch the screen." may be displayed.

[0144] In this embodiment, the display of the remaining time until the broadcast stops counts down the time until the broadcast stops. That is, the display control unit 114 changes the display of the remaining time until the broadcast stops over time in accordance with the decrease in remaining time. However, the display of the remaining time until the broadcast stops may indicate the time from when the display starts until the broadcast stops, and may not change in accordance with the decrease in remaining time. Alternatively, the display control unit 114 may not change the display of the remaining time until the broadcast stops in accordance with the decrease in remaining time until a specific point in time between when the display starts and when the broadcast stops, and may change it over time in accordance with the decrease in remaining time from that specific point in time (in other words, when the remaining time becomes small).

[0145] The distribution unit 116 stops distribution if, after displaying warning information, no predetermined operation by the distributor is detected. Specifically, the distribution unit 116 stops distribution if, after displaying warning information, the operation detection unit 118 does not detect any operation by the distributor on the touchscreen 16 for a certain period of time (for example, 1 minute). More specifically, the distribution unit 116 stops distribution if, after displaying warning information, no operation is performed on the distribution continuation button 91, which is a specific operation to avoid stopping distribution, within a certain period of time (for example, 1 minute). However, operations such as touching any position on the display unit 18 (in other words, operations on parts other than the distribution continuation button) may be accepted as such specific operations.

[0146] Furthermore, if the distribution unit 116 stops distribution based on the failure to detect a predetermined operation by the distributor, it instructs the display control unit 114 to display a notification on the display unit 18 indicating that distribution has been stopped due to the failure to perform the predetermined operation. Based on this instruction, the display control unit 114 displays a notification on the display unit 18 indicating that distribution has been stopped due to the failure to perform the predetermined operation. Specifically, if the operation detection unit 118 does not detect any operation by the distributor on the touchscreen 16 for a certain period of time (for example, 10 minutes), the distribution unit 116 displays a notification screen 92 on the display unit 18, as illustrated in Figure 12(b), informing the distributor that distribution has been stopped due to the failure to perform the predetermined operation.

[0147] In this embodiment, input operations related to gameplay (for example, input operations to move the player character) also serve as predetermined operations to avoid forced termination of the stream. Therefore, when a user is playing the game while streaming, forced termination of the stream is automatically avoided.

[0148] The display control unit 114 of the broadcaster's terminal device 10 displays the result screen 80, as illustrated in Figure 10(a), on the display unit 18 when the user successfully stops (in other words, terminates) the broadcast (specifically, when the user stops the broadcast by operating the broadcast button 44). On the other hand, if the display control unit 114 forcibly terminates the broadcast based on the failure to detect a predetermined operation by the broadcaster, the result screen 80 is not displayed on the display unit 18. In other words, if a broadcast is forcibly terminated, information such as the duration of the broadcast, the time the broadcaster spoke during the broadcast (for example, the total time the broadcaster's speech was detected during the broadcast), the calories consumed by the broadcaster during the broadcast, the number of viewer comments directed at the broadcast (in other words, the broadcaster), the number of times the broadcaster responded to viewer comments, the percentage of viewer comments the broadcaster responded to, the total amount of gifts sent by viewers to the broadcast (in other words, the broadcaster), the number of times the broadcaster responded to viewer gifts, the percentage of viewer gifts the broadcaster responded to, the number of viewers who watched the broadcast (for example, the total number of viewers or the maximum number of viewers watching simultaneously (in other words, the number of simultaneous connections)), or rewards earned (in other words, awarded) from the broadcast will not be displayed. Furthermore, in a configuration where this information is counted as the broadcaster's broadcasting performance when the broadcast is stopped normally, it may be configured so that this information is not counted as the broadcaster's broadcasting performance when the broadcast is forcibly terminated. In other words, for example, in a system where a predetermined reward is given to a broadcaster based on the total amount of time they broadcast (specifically, the total broadcast time from multiple broadcasts) or the total number of viewers who watched their broadcasts (specifically, the total number of viewers from multiple broadcasts) reaching predetermined values, the broadcast time and number of viewers for broadcasts that are forcibly terminated may be excluded from the calculation of these various totals.Furthermore, in a configuration where a predetermined reward is given to the broadcaster based on the number of viewers who watched the broadcast reaching a predetermined value (for example, the number of simultaneous connections exceeding the previous maximum), the predetermined reward may not be given for broadcasts that are forcibly terminated (in other words, the fact that the number of viewers who watched the broadcast reached a predetermined value may be invalidated). Note that warning information 90 (or warning information 96 described later) may include warnings that the results screen 80 will not be displayed, or warnings that the various information displayed on the results screen 80 will not be counted as achievements.

[0149] Furthermore, the display control unit 114 of the broadcaster's terminal device 10 may be capable of displaying a history of past broadcasts made by the broadcaster (for example, a list of history). In such a history display, for broadcasts that were forcibly terminated, the fact that they were forcibly terminated and the reason for that termination (for example, that the broadcast was forcibly terminated because it was left unattended) may be clearly indicated. In other words, the history of past broadcasts made by the broadcaster may be stored in a predetermined storage unit (for example, storage unit 120 or 220). And for broadcasts that were forcibly terminated, the fact that they were forcibly terminated and the reason for that termination may be stored in the predetermined storage unit as a record of the broadcast.

[0150] As described above, in the information processing system 1 of this embodiment, the distribution unit 116 imposes a penalty on the distributor if, after displaying warning information as specific information, a predetermined operation by the distributor is not detected. Specifically, the distribution unit 116 performs control to forcibly stop the distribution as a penalty. The distribution unit 116 may also perform control to prevent the display of the results screen 80 as a penalty, or control to prevent the counting of various information displayed on the results screen 80 as achievements. Furthermore, the distribution unit 116 may also perform control to reduce the reward based on the distribution (a reward given to at least one of the distributor or the viewer) as a penalty. Here, reducing the reward includes eliminating the reward (in other words, controlling so that no reward is given to the distributor or the viewer).

[0151] (Processing related to the granting of rewards) Next, referring to Figure 13, we will explain an example of a process for imposing penalties on broadcasters based on their predetermined actions related to broadcasting.

[0152] When distribution begins, the control unit 110 of the broadcaster's terminal device 10 starts measuring the time during which no predetermined operation has been detected (step S201).

[0153] Furthermore, the control unit 110 of the broadcaster's terminal device 10 determines whether or not a predetermined operation has been detected during broadcasting (step S202).

[0154] Then, if a predetermined operation is detected (YES in step S202), the control unit 110 of the broadcaster's terminal device 10 resets the time measurement (step S203) and starts the time measurement again from the beginning (step S201).

[0155] If the predetermined operation is not detected (NO in step S202), the control unit 110 of the broadcaster's terminal device 10 determines whether a predetermined time, specifically 10 minutes, has elapsed since the start of time measurement (step S204).

[0156] If 10 minutes have elapsed since the start of time measurement (YES in step S204), the control unit 110 of the broadcaster's terminal device 10 forcibly stops (specifically terminates) the broadcast (step S205).

[0157] If 10 minutes have not elapsed since the start of time measurement (NO in step S204), the control unit 110 of the broadcaster's terminal device 10 determines whether a predetermined time, specifically 9 minutes, has elapsed since the start of time measurement (step S206).

[0158] If nine minutes have elapsed since the start of time measurement (YES in step S206), the control unit 110 of the broadcaster's terminal device 10 displays warning information 90 on the display unit 18 (step S207). For example, the control unit 110 displays the remaining time until the broadcast is forcibly stopped as the warning information 90.

[0159] If 9 minutes have not elapsed since the start of time measurement (NO in step S206), the process returns to step S202 to determine whether or not the predetermined operation has been detected.

[0160] In this embodiment, the sound detection unit 119 may also function as the operation detection unit 118. That is, the distribution unit 116 imposes a penalty on the distributor if a predetermined operation by the distributor is not detected for a predetermined period of time, but the predetermined operation may be an operation in which the distributor inputs voice. In other words, the distribution unit 116 may impose a penalty on the distributor if the distributor's voice (in other words, the sound on the distributor's side) is not detected for a predetermined period of time.

[0161] Furthermore, even if a predetermined operation is not performed, the distribution unit 116 may choose not to impose a penalty. For example, in a configuration where the predetermined operation is performed by the distributor, and the distribution unit 116 imposes a penalty on the distributor based on the failure to detect the predetermined operation by the distributor for a predetermined period, if the sound detection unit 119 detects sound from the distributor within that predetermined period, the distribution unit 116 may choose not to impose a penalty on the distributor. In other words, the distribution unit 116 may impose a penalty on the distributor if the predetermined operation by the distributor is not detected for a predetermined period (e.g., 10 minutes) and sound from the distributor is not detected for that predetermined period (e.g., 10 minutes), but may choose not to impose a penalty on the distributor if the predetermined operation by the distributor is not detected for that predetermined period (e.g., 10 minutes) but sound from the distributor is detected within that predetermined period (e.g., 10 minutes). More specifically, the distribution unit 116 may provide warning information 90 to the distributor if a predetermined operation by the distributor is not detected for a predetermined period (e.g., 9 minutes) and the distributor's sound is not detected for the same predetermined period (e.g., 9 minutes), but may not provide warning information 90 to the distributor if the distributor's predetermined operation is not detected for the same predetermined period (e.g., 9 minutes) but the distributor's sound is detected within that predetermined period (e.g., 9 minutes). In other words, in the information processing system 1 of this embodiment, if the distributor does not perform a predetermined operation for a predetermined period during distribution, a penalty is imposed (e.g., distribution is forcibly stopped), but the distributor may be able to avoid the imposition of the penalty by speaking. In other words, whether or not the distributor is neglecting the distribution may be determined based solely on whether or not the distributor has performed a predetermined operation, or it may be determined by taking into account the distributor's voice, etc., in addition to whether or not the distributor has performed a predetermined operation. Here, "the distributor's sound was detected (or not detected)" may be read as "a predetermined detection was made (or the predetermined detection was not made) regarding the distributor's sound."

[0162] Up to this point, we have explained how to impose a penalty on a streamer based on the failure to detect a predetermined operation performed by the streamer while they are streaming (specifically, the failure to detect the operation for a predetermined period of time, or in other words, the failure to detect the predetermined operation even after displaying certain information). The streaming unit 116 may, instead of or in addition to imposing a penalty based on the failure to detect a predetermined operation performed by the streamer while they are streaming, impose a penalty based on the streamer's performance in a game during the stream that does not meet a predetermined standard in terms of score (in other words, performance).

[0163] Specifically, if a streamer is broadcasting a game (for example, a competitive game), and the streamer performs multiple plays (in other words, matches) within a single broadcast in which their score (in other words, performance) does not meet a predetermined standard, the streamer may be penalized. Here, the score can be described as a parameter calculated based on the user's (in other words, the streamer's) gameplay. For example, points may be assigned to various actions that a user can perform during a game (in other words, a match), and the game progress unit 212 (or game progress unit 113) may award the user the points assigned to the action each time the user performs an action for which points are awarded, and calculate the total points awarded to the user in a single match as the score. For example, the user may be awarded 10 points when they attack an enemy character, and 100 points when they defeat an enemy character. In other words, a play where the score does not meet the predetermined criteria may include, for example, a match in a GvG game or FPS game where the number of attacks made against enemy characters is extremely low, the number of times enemy characters are defeated is extremely low, the number of times the player is defeated by enemy characters is extremely high, the number of times the player character is made to perform predetermined actions (for example, actions related to attacking enemy characters or actions related to movement) is extremely low, or the distance the player character moves is extremely short. In other words, the distribution unit 116 may infer that the streamer is engaging in disruptive behavior such as AFK play or actions that benefit the enemy (specifically, repeatedly), based on a predetermined score (in other words, parameters) calculated based on the user's play, and may impose a penalty on the streamer based on this inference. The score may also be something that can be viewed by predetermined users who participated in the match (for example, themselves, their teammates, or their opponents) at a predetermined timing such as the end of the match (in other words, something that is displayed on the terminal device 10 of the predetermined user). Furthermore, a ranking may be generated (in other words, a ranking may be assigned) for multiple users who participated in the match based on their scores, and this ranking may be viewable by the users who participated in the match.

[0164] For example, the distribution unit 116 will forcibly stop (in other words, terminate) a game stream if the streamer performing a play that falls below a predetermined score standard three times during a single stream. Furthermore, the distribution unit 116 instructs the display control unit 114 to display specific information on the display unit 18 when the streamer performing a play that falls below a predetermined score standard for the first time and the second time during a single stream. The display control unit 114 displays the specific information on the display unit 18 based on this instruction. Specifically, the distribution unit 116 displays warning information (in other words, a warning screen) 96, as exemplified in Figure 14(a), on the display unit 18. In other words, the distribution unit 116 provides the warning information 96 to the user before stopping the stream.

[0165] In this embodiment, the warning information 96 displays that the stream will be stopped because the score does not meet a predetermined standard (in other words, because play deemed abnormal has occurred), that if the stream is forcibly stopped, there will be a restriction on the next stream for a certain period of time, and how many more times play that does not meet the predetermined standard will result in the stream being stopped (in Figure 14(a), the text "Abnormal battle play may be occurring. If two more significantly low battle scores are detected, the stream will be forcibly terminated." is displayed). In other words, the warning information 96 displays the content of the penalty to be imposed on the streamer, the reason for the penalty, and methods to avoid the penalty.

[0166] Furthermore, if the distribution unit 116 stops the distribution because the score does not meet a predetermined standard, it instructs the display control unit 114 to display a notification on the display unit 18 indicating that the distribution has been stopped because it is presumed that abnormal gameplay is taking place. Based on this instruction, the display control unit 114 displays a notification on the display unit 18 indicating that the distribution has been stopped because it is presumed that abnormal gameplay is taking place. Specifically, if the distributor has played three matches in a single distribution in which the score does not meet a predetermined standard, the distribution unit 116 displays a notification screen 97 on the display unit 18, as illustrated in Figure 14(b), informing the distributor that the distribution has been stopped because it is presumed that abnormal gameplay is taking place.

[0167] Furthermore, the penalty imposed by the distribution unit 116 does not necessarily have to be one that forcibly stops the distribution. For example, instead of or in addition to the control that forcibly stops the distribution, the distribution unit 116 may impose a predetermined restriction on the execution of the next distribution as a penalty. For example, the distribution unit 116 may prohibit the start of the next distribution for a predetermined period (for example, several hours or several days) after the current distribution (for example, by not accepting operations on the distribution button 44). Also, for example, the distribution unit 116 may limit the maximum time that distribution is possible for the next distribution, or limit the rewards that can be obtained in the distribution (for example, limit the maximum amount of rewards, or reduce the rewards given to a predetermined percentage (for example, 80%) that would be given if no penalty were imposed). In addition, multiple conditions for imposing a penalty may be set, and the distribution unit 116 may control the severity of the penalty imposed depending on which conditions are met, or how many conditions are met. For example, the distribution unit 116 may only perform control to forcibly stop the distribution if it does not detect a predetermined operation by the distributor while the distribution is in progress. If the distributor performs plays that do not meet a predetermined score standard multiple times (for example, three times), it may perform control to forcibly stop the distribution in addition to imposing a predetermined restriction on the next distribution. In other words, when imposing a penalty, there is no limit to the number of penalties that can be imposed.

[0168] Furthermore, the penalty imposed by the distribution unit 116 may relate to the game being distributed. In other words, the penalty imposed by the distribution unit 116 does not have to relate to the distribution itself. For example, the distribution unit 116 may, as a penalty, implement a predetermined control that is disadvantageous to the streamer in the next game to be started (for example, a match). Such disadvantageous predetermined control may, for example, be a control that reduces the parameters (in other words, performance) of the player character used by the streamer. Also, such disadvantageous predetermined control may be a control that restricts the objects that can be selected when the streamer can select predetermined objects such as the player character used by the streamer or items to be equipped to the player character to run the game.

[0169] In this specification, the application for playing the game is provided with functions for streaming and viewing the game. However, at least one of the streaming and viewing functions may be performed by an application different from the application in question. For example, streaming and viewing may be implemented using a video streaming service that does not have a game-playing function. In this case, by linking the user's account in the video streaming service with the user's account in the game in advance, it becomes possible to reflect the results of the user's actions related to streaming (for example, actions such as inputting specific audio during streaming or leaving the stream unattended) in the game.

[0170] Furthermore, the information processing system 1 of this embodiment does not necessarily have the function to play games; for example, it may only have the function to distribute and view videos.

[0171] It should be noted that the present invention is not limited to the embodiments described above, and can be implemented in various modified forms without departing from its essence. Within the scope of the invention, it is possible to freely combine the components of each embodiment, modify any component of each embodiment, or omit any component of each embodiment. Furthermore, the processing flow described herein is merely an example, and the order and configuration of each process may differ. Also, some of the various judgment processes described herein may not exist. In other words, the processing flow and specific judgment processes may differ from those exemplified herein.

[0172] <Note> The matters described in the above embodiments may also be described as follows:

[0173] (Note 1-1) Computers, The sound acquisition means, which acquires the sound from the broadcaster's side while the broadcast is in progress, functions as a control means (for example, a reward granting unit 217) that performs control to make the reward granted more favorable when the sound from the broadcaster's side acquired by the sound acquisition means meets predetermined conditions, compared to when the predetermined conditions are not met. program. With this configuration, the reward can be varied depending on whether the sound input by the broadcaster meets predetermined conditions. Therefore, it becomes possible to encourage broadcasters to input sounds that meet the predetermined conditions, thereby suppressing the increase of undesirable broadcasts and increasing the increase of interesting broadcasts. Thus, the broadcasting service can be improved.

[0174] (Appendix 1-2) The control means adjusts the reward to be more favorable in accordance with the sound from the broadcaster when the broadcasting situation is in a specific state. The program described in Appendix 1-1. With this configuration, the rewards for broadcasters can be varied depending on whether or not they are making utterances appropriate to the broadcast situation. Therefore, it becomes possible to increase the number of broadcasts in which utterances appropriate to the broadcast situation are made, thereby improving the broadcasting service.

[0175] (Appendix 1-3) The aforementioned specific situation is a situation in which a viewer has performed a predetermined action relating to communication with the broadcaster. The program described in Appendix 1-2. With this configuration, the rewards can be varied depending on the streamer's response when viewers perform certain actions related to communication with the streamer.

[0176] (Appendix 1-4) The aforementioned broadcast is a game broadcast, The control means adjusts the reward to be more favorable in response to the sound from the streamer when the game being streamed is in a specific state. The program described in Appendix 1-1. With this configuration, the rewards for streamers can be varied depending on whether or not they are making comments that are relevant to the game being streamed. Therefore, it becomes possible to increase the number of streams in which comments are relevant to the game being streamed, thereby improving the streaming service.

[0177] (Appendix 1-5) Computers, After the aforementioned broadcast ends, the device functions as a means (for example, the control unit 210 or the display control unit 114) to provide the broadcaster with advice on what to say in future broadcasts, based on the broadcaster's sound during the broadcast. The program described in any one of the appendices 1-1 to 1-4. With this configuration, advice about the broadcast can be provided to the broadcaster based on the sound they input during the broadcast, thereby improving the quality of the broadcaster's broadcast.

[0178] (Appendix 1-6) The system includes a control means (for example, a reward granting unit 217) that, when the sound from the broadcaster's side acquired by the sound acquisition means that acquires the sound from the broadcaster's side during broadcasting satisfies predetermined conditions, performs control to make the reward granted more favorable compared to when the predetermined conditions are not met. Information processing system. With this configuration, the same effects and benefits as the program described in Appendix 1-1 can be achieved.

[0179] (Note 2-1) Computers, Detection means for detecting a predetermined operation by the user while the distribution is in progress (for example, operation detection unit 118 or sound detection unit 119), A display control means (for example, a display control unit 114) that causes specific information to be displayed on a display means based on the fact that the user's predetermined operation has not been detected for a predetermined period of time, If the user does not perform the predetermined operation after the display of the specific information, a penalty imposition means (e.g., distribution unit 116) is provided to impose a penalty on the user. program. With this configuration, penalties can be imposed on users who do not perform the prescribed actions during a live stream. For example, it becomes possible to infer that a streamer is neglecting their stream (in other words, they are streaming content with little substance, or are not performing prescribed actions such as chatting or playing games during the stream) based on their failure to perform the prescribed actions, and to impose penalties on that streamer. Therefore, it becomes possible to suppress the increase in undesirable streams such as unattended streams and increase the percentage of streams where streamers properly perform the prescribed actions, thereby improving the streaming service.

[0180] (Note 2-2) The penalty imposition means performs the penalty by stopping the distribution if the user does not perform the predetermined operation after the display of the specific information. The program described in Appendix 2-1. This configuration allows for the cessation of streaming for users who do not perform the required actions during streaming, preventing undesirable streaming from continuing. Therefore, the streaming service can be improved.

[0181] (Appendix 2-3) The display control means terminates the display of the specific information after the display of the specific information, if the user performs an operation corresponding to the specific information. If, after the display of the aforementioned specific information, the user performs an action corresponding to that specific information, the distribution will continue. The program described in Appendix 2-2. With this configuration, in a system that stops streaming for users who do not perform a predetermined operation during streaming, it is possible to give the user an opportunity to continue streaming.

[0182] (Appendix 2-4) The penalty imposition means performs the penalty by stopping the distribution if, after the display of the specific information, the user does not perform any action corresponding to the specific information for a certain period of time. The program described in Appendix 2-1. With this configuration, users who do not perform a specified action during a broadcast are given an opportunity to continue the broadcast and a certain amount of time before the broadcast can be stopped if they still do not perform the specified action.

[0183] (Appendix 2-5) The aforementioned specific information includes information on the remaining time until the aforementioned certain period of time has elapsed. The program described in Appendix 2-4. This configuration allows the system to inform users of the remaining time until the distribution stops and encourage them to take action before that time elapses.

[0184] (Appendix 2-6) The penalty imposition means, if the user does not perform the predetermined operation after the display of the specific information, imposes a predetermined restriction on the execution of the next delivery as a penalty. The program described in Appendix 2-1. With this configuration, it becomes difficult for users who do not perform the required operations during a broadcast to broadcast again, thereby suppressing broadcasts by users who tend to engage in undesirable broadcasts such as unattended broadcasts, and encouraging such users to properly perform the required operations.

[0185] (Appendix 2-7) Computers, This is configured to function as a sound detection means for detecting the sound from the user. The aforementioned predetermined operation is an operation performed by the user. The display control means causes the specific information to be displayed on the display means when the user's predetermined operation is not detected for the predetermined period and the user's sound is not detected for the predetermined period. The penalty imposing means imposes the penalty on the user if, after the display of the specific information, the user's predetermined operation is not detected and no sound from the user's side is detected. The program described in any one of the appendices 2-1 to 2-6. With this configuration, penalties can be imposed on users if they fail to perform the required manual operations and provide audio input. Therefore, it becomes possible to infer that a streamer is neglecting their stream (in other words, they are streaming content that is lacking in substance, or they are not performing the required actions such as chatting or playing games during the stream) based on their failure to perform both the required manual operations and audio input, and to impose penalties on the streamer.

[0186] (Appendix 2-8) Detection means for detecting a predetermined operation by the user while the distribution is in progress (for example, operation detection unit 118 or sound detection unit 119), A display control means (for example, a display control unit 114) that causes specific information to be displayed on a display means based on the fact that the user's predetermined operation has not been detected for a predetermined period of time, The system includes a penalty imposition means (e.g., distribution unit 116) that imposes a penalty on the user if the user does not perform the predetermined operation after the display of the specific information. Information processing system. With this configuration, the same effects as the program described in Appendix 2-1 can be achieved. [Explanation of symbols]

[0187] 1 Information processing system, 10 Terminal device, 11 Processor, 12 Memory, 13 Storage, 17 Input unit, 18 Display unit, 20 Server, 21 Processor, 22 Memory, 23 Storage, 80 Result screen, 81 Advice, 110 Control unit, 111 Operation reception unit, 112 Transmission / reception unit, 113 Game progress unit, 114 Display control unit, 115 User relationship processing unit, 116 Distribution unit, 117 Detection unit, 120 Memory unit, 210 Control unit, 211 Transmission / reception unit, 212 Game progress unit, 215 User relationship management unit, 216 Gift processing unit, 217 Reward granting unit, 220 Memory unit

Claims

1. Computers, This system uses a pre-trained machine learning model to detect when a streamer is neglecting their broadcast, based on the sounds from the streamer's side during the broadcast. program.

2. The detection means can detect if a broadcaster is neglecting their broadcast by using the machine learning model, which has been trained to identify the broadcaster's voice, to detect whether the sound on the broadcaster's side is related to the broadcaster's own speech during the broadcast. The program according to claim 1.

3. The detection means can detect whether a broadcaster is making utterances related to the broadcast using the machine learning model that has been trained to determine whether a broadcaster is making utterances related to the broadcast, thereby detecting whether a broadcaster is making utterances related to the broadcast. The program according to claim 1.

4. The detection means can detect whether a broadcaster is neglecting their broadcast by using the machine learning model, which has been trained to determine whether a broadcaster is communicating with viewers, to detect whether or not the broadcaster is communicating with viewers. The program according to claim 1.

5. Computers, This system functions as a control mechanism to implement a more favorable reward system for streamers who are not detected as neglecting their broadcast, compared to when they are detected. The program according to any one of claims 1 to 4.

6. Computers, This system will function as a penalty imposition mechanism to penalize streamers if it is detected that they are neglecting their broadcasts. The program according to any one of claims 1 to 4.

7. The system includes a detection means that detects from the sound of the streamer's side when the streamer is not actively streaming, using a machine learning model that has been trained to perform a predetermined detection based on the sound of the streamer's side while they are streaming. Information processing system.

Images