Information Processing Apparatus and Game Image Distribution Method

Abstract

The message generation unit 116 generates a notification message. The setting unit 120 registers setting information for determining whether the camera image is to be included in the distribution image. The distribution processing unit 156 distributes the distribution image. When the camera image is set to be included in the distribution image, the image processing unit 130 generates the distribution image including the area where the notification message is superimposed thereon. When the camera image is set not to be included in the distribution image, the image processing unit 130 generates the distribution image not including the area where the notification message is superimposed thereon.

Description

Technical Field

[0001] The present invention relates to a technique for distributing game images. Background Art

[0002] PTL 1 discloses an image sharing system in which a distribution image including a game image that a distribution user is playing is distributed to a viewing user by a sharing server. During the distribution of the game image, when a message including personal information or privacy information is displayed in a pop-up window on the game image, there is a problem that the message displayed in the pop-up window is made public not only to the distribution user but also to the viewing user.

[0003] To solve this problem, the image sharing system disclosed in PTL 1 is provided with a component that allows a distribution user to set whether a notification message is included in the distribution image in a visually recognizable manner for each type of notification message. As a technique for not including a notification message in the distribution image in a visually recognizable manner, PTL 1 discloses a technique of using a black image to obscure a notification message displayed in a pop-up window on a game image so that the notification message cannot be visually recognized.

[0004] Citation List

[0005] Patent Literature

[0006] [PTL 1]

[0007] JP2019-97889A

[0008] Technical Problem

[0009] In terms of easily covering the content of a message, obscuring a notification message with a black image is a very important and useful solution. However, the black image only hinders the viewing user from viewing the distribution image, and thus, frequent display of the black image is not preferable. In view of this, it is necessary to reduce the display frequency of the black image.

[0010] In view of this, an object of the present invention is to provide a technique for enhancing the usability of an image sharing system for distributing game images to a viewing user.

[0011] Solution to Problem

[0012] To solve the above problems, an information processing apparatus according to an aspect of the present invention includes:

[0013] a game image generation unit configured to generate a game image;

[0014] a message generation unit configured to generate a notification message;

[0015] A setting unit configured to register setting information for determining whether a camera image is to be included in a distribution image;

[0016] An image processing unit configured to generate a distribution image including the game image; and

[0017] A distribution processing unit configured to distribute the distribution image.

[0018] When the camera image is set to be included in the distribution image, the image processing unit generates the distribution image including a region where the notification message is superimposed, and when the camera image is set not to be included in the distribution image, the image processing unit generates the distribution image not including the region where the notification message is superimposed.

[0019] An information processing apparatus according to another mode of the present invention includes:

[0020] A game image generation unit configured to generate a game image;

[0021] A game frame buffer configured to store the game image generated by the game image generation unit;

[0022] A system image generation unit configured to generate a system image;

[0023] A system frame buffer configured to store the system image generated by the system image generation unit; and

[0024] An image processing unit having a function of merging the game image stored in the game frame buffer with the system image stored in the system frame buffer.

[0025] The system image generation unit generates a first system image and a second system image different from the first system image, and the system frame buffer includes a first frame buffer storing the first system image and a second frame buffer storing the second system image.

[0026] According to still another mode of the present invention, there is provided a game image distribution method including: a step of generating a game image, a step of generating a notification message, a step of setting whether a camera image is to be included in a distribution image, a step of generating a distribution image including the game image, and a step of distributing the distribution image. When the camera image is set to be included in the distribution image, the distribution image generation step generates the distribution image including a region where the notification message is superimposed, and when the camera image is set not to be included in the distribution image, the distribution image generation step generates the distribution image not including the region where the notification message is superimposed.

[0027] Note that any combination of the above components and the conversion of the expression of the present invention among methods, apparatuses, systems, recording media, computer programs, etc. are also effective as modes of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 is a diagram depicting an image sharing system according to an embodiment of the present invention.

[0029] Figure 2 is a diagram depicting the hardware configuration of an information processing apparatus.

[0030] Figure 3 is a diagram depicting the functional blocks of an information processing apparatus.

[0031] Figure 4 is a diagram depicting an example of a game screen.

[0032] Figure 5 is a diagram depicting an example of a pop-up window.

[0033] Figure 6 is a diagram depicting a system image stored in a system buffer.

[0034] Figure 7 is a diagram depicting an example of an input screen indicating options for sharing processing.

[0035] Figure 8 is a diagram depicting an example of a setting screen.

[0036] Figure 9 is a diagram depicting an example of merged control information.

[0037] Figure 10 is a diagram depicting an example of a system image.

[0038] Figure 11 is a diagram depicting an example of a screen to be displayed on an output device.

[0039] Figure 12 is a diagram depicting an example of a system image.

[0040] Figure 13 is a diagram depicting an example of a screen to be displayed on an output device.

[0041] Figure 14 is a diagram depicting an example of a screen to be displayed on an output device.

[0042] Figure 15 is a diagram depicting the configuration of a frame buffer unit in a modification example.

[0043] Figure 16 is a diagram depicting an example of merged control information in a modification example. Detailed implementation manner

[0044] Figure 1 FIG. is a diagram depicting an image sharing system 1 according to an embodiment of the present invention. The image sharing system 1 realizes an environment in which a user A as a distributor distributes game images and sounds (game images and game sounds) in real time during play, and other viewing users B, C, and D view the game images and sounds. In this embodiment, the streaming distribution of game images is particularly described. However, it should be noted that the game sounds are also streamed together with the game images at the same time. Note that the viewing users B, C, and D are merely examples and are not limited to three. In addition, the viewing users are not limited to users registered as friends of the distributing user A, and can be unspecified users who can access the sharing server 11.

[0045] The image sharing system 1 includes an information processing device 10 operated by the distributing user A, information processing terminals 12b, 12c, and 12d (hereinafter referred to as "information processing terminals 12" without particularly distinguishing them from each other) operated by the respective viewing users B, C, and D, a management server 5, and a sharing server 11, and they are connected to each other through a network 3 such as the Internet. Note that in this embodiment, since the configuration of the information processing terminal 12 of each viewing user is the same as the configuration of the information processing device 10 of the distributing user A. The configuration of the peripheral devices of the information processing device 10 of the distributing user A will be described below as a representative.

[0046] An access point (hereinafter referred to as "AP") 8 has the functions of a wireless access point and a router, and the information processing device 10 is connected to the AP 8 in a wireless or wired manner to communicably connect to the management server 5, the sharing server 11, and the information processing terminal 12 on the network 3.

[0047] An input device 6 operated by the user is connected to the information processing device 10 in a wireless or wired manner, and the input device 6 outputs the operation information of the user to the information processing device 10. When receiving the operation information from the input device 6, the information processing device 10 reflects the operation information regarding the processing of the system software or application software, and causes the output device 4 to output the result of the processing. In this embodiment, the information processing device 10 can be a game device that executes a game program, and the input device 6 can be a game controller. The input device 6 includes a plurality of input parts, such as a plurality of push-button operation buttons, an analog stick capable of inputting an analog amount, and a rotary button.

[0048] The auxiliary storage device 2 is a storage such as a hard disk drive (HDD) or a solid state drive (SSD), and may be an in-built storage device or an external storage device connected to the information processing device 10 via a universal serial bus (USB). The output device 4 may be a television set having a display for outputting an image and a speaker for outputting sound. The output device 4 may be a head-mounted display. The camera 7 captures the space where the user appears.

[0049] During a game, the information processing device 10 performs streaming distribution of game images to the shared server 11 to broadcast the game images to the information processing terminals 12 accessing the shared server 11. Thus, the image sharing system 1 in the present embodiment functions as a game image distribution system. Note that the information processing terminal 12 may be the same fixed game console as the information processing device 10 or may be a portable terminal device such as a smart phone or a tablet computer.

[0050] The management server 5 provides a network service to the users of the information processing device 10 and the users of the information processing terminals 12. The management server 5 manages network accounts for identifying users, and each user logs in to the network service using his or her own network account. By logging in to the network service, the user can register save data of a game or virtual prizes (trophies) obtained during the game in the management server 5. In addition, the user can perform streaming distribution of game images and sounds to the shared server 11. Further, the user accesses the shared server 11 and can view game images and sounds via the shared server 11.

[0051] In the embodiment, user A plays a game by operating the input device 6, and game images during the game (hereinafter also referred to as "game images") are displayed on the output device 4. At this time, the game images are also distributed from the information processing device 10 to the information processing terminals 12b, 12c, and 12d of the respective viewing users via the shared server 11 so as to be displayed on each of the output devices 14b, 14c, and 14d (hereinafter referred to as "output device 14" without particularly distinguishing them from each other). Note that the resolution of the game images to be distributed may be set lower than the resolution of the game images to be displayed on the output device 4.

[0052] Figure 2 is a diagram depicting the functional blocks of the information processing device 10. The information processing device 10 includes a main power button 20, a power-on light emitting diode (LED) 21, a standby LED 22, a system controller 24, a clock 26, a device controller 30, a media drive 32, a USB module 34, a flash memory 36, a wireless communication module 38, a wired communication module 40, a subsystem 50, and a main system 60.

[0053] The main system 60 includes a main central processing unit (CPU), a memory as the main storage device, a memory controller, a graphics processing unit (GPU), etc. The GPU is mainly used for the arithmetic processing of game programs. These functions can be configured as a system-on-chip and formed on one chip. The main CPU has the function of executing game programs recorded in the auxiliary storage device 2 or the read-only memory (ROM) medium 44.

[0054] The subsystem 50 includes a sub-CPU, a memory as the main storage device, a memory controller, etc. The subsystem 50 does not include a GPU. In addition, the subsystem 50 does not have the function of executing game programs. The number of circuit gates of the sub-CPU is less than that of the main CPU, and the operating power consumption of the sub-CPU is lower than that of the main CPU. The sub-CPU operates when the main CPU is in the standby state, and the processing function of the sub-CPU is limited to suppress the power consumption of the sub-CPU at a lower level.

[0055] The main power button 20 is an input unit that executes an operation input from the user, and is provided on the front surface of the housing of the information processing device 10 for operating to turn on or off the power of the main system 60 of the information processing device 10. When the main power button 20 is turned on, the power-on LED 21 lights up, and when the main power button 20 is turned off, the standby LED 22 lights up.

[0056] The system controller 24 detects the user's pressing of the main power button 20. When the main power button 20 is pressed while the main power is in the off state, the system controller 24 obtains the pressing operation as an "on instruction". On the contrary, when the main power button 20 is pressed while the main power is in the on state, the system controller 24 obtains the pressing operation as an "off instruction".

[0057] The clock 26 is a real-time clock, generates the current date and time information, and provides the generated information to the system controller 24, the subsystem 50, and the main system 60. The device controller 30 is configured as a large-scale integrated circuit (LSI) that performs information delivery between devices like a south bridge. As Figure 2 shown, devices such as the system controller 24, the medium drive 32, the USB module 34, the flash memory 36, the wireless communication module 38, the wired communication module 40, the subsystem 50, and the main system 60 are connected to the device controller 30. The device controller 30 absorbs the differences in electrical characteristics and data transfer rates between devices and controls the timing of data transfer.

[0058] The medium drive 32 is a driving device that loads the ROM medium 44 on which application software and license information for games and the like are recorded, and drives the ROM medium 44 to read programs, data, etc. from the ROM medium 44. The ROM medium 44 can be a read-only recording medium such as an optical disc, a magneto-optical disc, or a Blu-ray disc.

[0059] The USB module 34 is a module that connects to an external device via a USB cable. The USB module 34 can be connected to the auxiliary storage device 2 and the camera 7 via the USB cable. The flash memory 36 is an auxiliary storage device that configures the internal memory. The wireless communication module 38 wirelessly communicates with the input device 6, for example, by using a communication protocol (such as the Bluetooth (registered trademark) protocol or the Institute of Electrical and Electronics Engineers (IEEE) 802.11 protocol). The wired communication module 40 communicates with an external device in a wired manner and is connected to an external network via the AP 8.

[0060] Figure 3 Depicts the functional blocks of the information processing device 10 that operates as a distribution device for streaming data. The information processing device 10 includes a processing unit 100, a communication unit 102, and a receiving unit 104. The processing unit 100 includes an execution unit 110, a message generation unit 116, a camera image supply unit 118, a setting unit 120, a system image generation unit 122, an image processing unit 130, a sound providing unit 132, a frame buffer unit 140, and a shared processing unit 150.

[0061] The execution unit 110 includes a game image generation unit 112 and a game sound generation unit 114. The frame buffer unit 140 includes a plurality of frame buffers, such as a game buffer 142 and a system buffer 144. In the present embodiment, the game buffer 142 includes a plurality of frame buffers, and the system buffer 144 includes one frame buffer. Note that, as described later, in a modification example, the system buffer 144 can include a plurality of frame buffers. The shared processing unit 150 includes an image acquisition unit 152, a sound acquisition unit 154, a distribution processing unit 156, and a setting image generation unit 158.

[0062] In Figure 3 , the elements indicated as functional blocks for performing various processing operations can be configured by hardware (such as a circuit block, a memory, or another LSI), or implemented by software (such as system software or a game program loaded into the memory). Therefore, those skilled in the art will understand that these functional blocks can be implemented differently by only hardware, only software, or a combination of hardware and software. The functional blocks are not limited to any of these.

[0063] The communication unit 102 receives operation information obtained due to an operation by the user on the input section of the input device 6, and transmits the image and sound data generated in the processing unit 100 to the shared server 11. It is assumed that the communication unit 102 has Figure 2 the functional blocks of the wireless communication module 38 and the wired communication module 40 depicted.

[0064] The acceptance unit 104 is provided between the communication unit 102 and the processing unit 100, and transmits data or information to and from the communication unit 102 and the processing unit 100. When the operation information of the input device 6 is accepted through the communication unit 102, the acceptance unit 104 provides the accepted operation information to a predetermined functional block of the processing unit 100.

[0065] The execution unit 110 executes a game program (hereinafter sometimes simply referred to as "game"). The functional blocks provided as the execution unit 110 are implemented by system software, game software, hardware (such as a GPU), etc. When receiving the result of the execution of the game program, the game image generation unit 112 generates image data of the game, and the game sound generation unit 114 generates sound data of the game. Note that the game is merely an example of an application, and the execution unit 110 can execute applications other than games.

[0066] When user A is playing a game, the execution unit 110 executes the game program, and performs arithmetic processing based on the operation information input by user A using the input device 6 to move the game character in the virtual space. The game image generation unit 112 includes a GPU that performs rendering processing, etc., and receives the result of the arithmetic processing in the virtual space to generate game image data according to the viewpoint positioning (virtual camera) in the virtual space. In addition, the game sound generation unit 114 generates game sound data in the virtual space.

[0067] Figure 4 is a diagram depicting an example of the game screen displayed on the output device 4 of user A. This game screen is the game screen before streaming distribution. During user A's game, the game image generation unit 112 generates a game image and stores the generated game image in the game buffer 142. In addition, the game sound generation unit 114 generates game sound and provides the generated game sound to the sound providing unit 132.

[0068] The game buffer 142 in this embodiment includes a plurality of frame buffers, and the game image generation unit 112 can generate a plurality of game images up to the same number as the frame buffers. For example, when the game buffer 142 has three frame buffers, the game image generation unit 112 generates one main image including a background image and a character image and two sub-images including supplementary information for the game process, and stores each image in a respective one of the frame buffers. For example, the sub-image can be a map image indicating the positions of opponent teams in a competitive game, or can be a list image of information about weapons that the player can use. The image processing unit 130 combines the three game images stored in the three frame buffers to generate a display image. Note that the game image generation unit 112 is not necessarily required to generate three game images. For example, the game image generation unit 112 only needs to generate one main image and use one frame buffer, and can not use the other two frame buffers.

[0069] The image processing unit 130 provides the display image to the output device 4, and the sound providing unit 132 provides the game sound to the output device 4. The output device 4 outputs the game image and the game sound, and user A plays the game while watching the game image and sound output from the output device 4.

[0070] Figure 5 is a diagram depicting an example of a pop-up window displayed in a superimposed manner on the game screen. In the image sharing system 1, the management server 5 registers the friends of user A. For example, when a friend is online or the friend creates a message for user A, the management server 5 sends status information about the friend or a message from the friend to the information processing device 10 of user A. When the receiving unit 104 receives the status information about the friend or the message from the friend, the message generation unit 116 generates a notification message for user A, and then provides the generated notification message for user A to the system image generation unit 122.

[0071] In addition, the message generation unit 116 can generate a notification message according to an event generated during the game. For example, when user A wins a trophy during the game, the game program notifies the message generation unit 116 of the information about the won trophy. Upon receiving this notification, the message generation unit 116 generates a notification message about the won trophy to provide the generated notification message to the system image generation unit 122.

[0072] In this way, during the game, the message generation unit 116 generates notification messages for various reasons. The system image generation unit 122 generates a system image including the notification message and stores the generated system image in the system buffer 144. The system image generation unit 122 is included in the system software, and the system image in this embodiment refers to an image generated by the system software.

[0073] Figure 6 Depicts the system image stored in the system buffer. The system image generation unit 122 generates a system image to be merged into the game image and stores the generated system image in the system buffer 144. The image processing unit 130 merges the game image read from the game buffer 142 with the system image read from the system buffer 144 to generate a display image (see Figure 5 ). The image processing unit 130 in this embodiment performs the merging process of the game image and the system image by superimposing the system image on the game image. In this way, when a notification message is generated during the game, the generated notification message is displayed in the form of a pop-up window 180 at the upper left corner of the display screen for a fixed period of time.

[0074] The user name 184 of the friend who sent the message and the text 182 of the message indicating at least part (the first sentence) of the sent message are included in the Figure 5 depicted pop-up window 180. When the management server 5 requests real name registration as the user name, the real name of the friend is included in the pop-up window 180. Figure 5 The game screen depicted in is the game screen before performing streaming distribution, and the display of the real name "Yamada Taro" can only be viewed by user A. Accordingly, there is no problem of public disclosure of personal information at this time. However, when performing streaming distribution, personal information may be publicly disclosed to non-designated viewing users, which may be a problem in terms of public disclosure of personal information.

[0075] Hereinafter, the sharing process in the embodiment will be described.

[0076] The sharing processing unit 150 performs a process for sharing the image and sound data of the game that user A is playing with another user through the sharing server 11. The users accessing the sharing server 11 are not limited to the friends of user A, and may also include non-designated users using the service of the sharing server 11. When user A operates a specified input button (sharing button) provided as a trigger in the input device 6, the sharing process of the game image and sound data starts, and the setting image generation unit 158 generates an input image indicating options regarding the sharing of the image and sound data.

[0077] Figure 7An example of an input screen indicating options in shared processing is depicted. The setting image generation unit 158 generates an input image indicating options in shared processing and stores the generated input image in the system buffer 144. The image processing unit 130 reads out the input image from the system buffer 144 to display the read input image on the output device 4.

[0078] On this input screen, three options regarding the sharing of image and sound data are indicated. The option "Upload Video Clip" is a graphical user interface (GUI) element for specifying uploading an image recorded in the auxiliary storage device 2 to the shared server 11. The option "Upload Screenshot" is a GUI element for specifying uploading an image of a screenshot to the shared server 11. The option "Broadcast Game" is a GUI element for specifying real-time relaying of image and sound data of a game through the shared server 11. User A operates the input device 6 to move the selection box 200 and then selects any one of the GUI elements and presses the ENTER button, thereby executing the selected shared processing.

[0079] In this embodiment, it is assumed that the GUI element "Broadcast Game" is selected. Note that after selecting this GUI element, the setting image generation unit 158 displays a setting screen for selecting setting information in broadcast distribution on the output device 4.

[0080] Figure 8 An example of a setting screen to be displayed when "Broadcast Game" is selected is depicted. This setting screen includes the following items for setting the distribution mode of the broadcast.

[0081] (a) An item for selecting whether a camera image is included in the distributed image

[0082] Regarding item (a), the checkbox "Include Camera Video Image in Broadcast" may be in a selected state by default. When User A does not want to distribute the camera image (an image captured by the camera), User A deselects the checkbox. Note that when the option "Include Camera Video Image in Broadcast" is selected, another option for setting the display position of the camera image may be provided, and User A may be allowed to specify the display position of the camera image.

[0083] (b) An item for selecting whether to distribute microphone sound

[0084] Regarding item (b), the checkbox "Include Microphone Sound in Broadcast" may be in a selected state by default. When User A does not want to distribute the microphone sound, User A deselects the checkbox.

[0085] (c) An item for selecting whether to display comments from viewing users on the display screen

[0086] Regarding item (c), the checkbox "Display comments on screen" may be selected by default. When User A does not want to display any comments, User A deselects the checkbox.

[0087] (d) An item for selecting the image quality of the distributed image

[0088] Regarding item (d), User A can select a resolution equal to or lower than the resolution of the game image to be displayed on the output device 4. As the resolution of the distributed image, a resolution lower than the resolution of the game image displayed on the output device 4 can be set by default.

[0089] In addition, on the setting screen, User A can be able to set whether the notification message is included in the distributed image for each type of content of the notification message so as to be visually recognizable. As described above, the setting unit 120 sets the content selected by User A in items (a), (b), (c), and (d) regarding streaming distribution. Specifically, when User A checks the box 202 on "Start broadcast" and presses the enter button of the input device 6, the setting unit 120 registers the content selected by User A in items (a), (b), (c), and (d) in the auxiliary storage device 2 as the setting information of the streaming distribution information, and provides the setting information to the system image generation unit 122 and the image processing unit 130.

[0090] In this embodiment, the image processing unit 130 refers to the merge control information associated with the information indicating whether to distribute the camera image and the information identifying the image forming the distributed image, and performs a merge process on the image to be distributed.

[0091] Figure 9 An example of the merge control information. The merge control information is information for controlling the merge of the images stored in the frame buffer unit 140, and is stored in the flash memory 36 or a storage unit (such as the auxiliary storage device 2). Figure 9 The image control information indicated in determines the following.

[0092] - In the case where the camera image is included in the distributed image, the distributed image is generated by merging the game image and the system image.

[0093] - In the case where the camera image is not included in the distributed image, the distributed image is generated by using only the game image and not including the system image.

[0094] Before starting the streaming distribution, the setting unit 120 provides the image processing unit 130 with the setting information regarding the streaming distribution. During the streaming distribution, the image processing unit 130 generates a display image based on the content of item (a) included in the setting information and the merge control information.

[0095] The following is a description of the image generation process when "including camera video images in the broadcast" is set in item (a) of the setting information.

[0096] Figure 10 An example of the system image generated by the system image generation unit 122 is depicted. During the streaming distribution, the camera image supply unit 118 supplies the camera image captured by the camera 7 to the system image generation unit 122, and the system image generation unit 122 generates a system image including the camera image. The generated system image is stored in the system buffer 144.

[0097] Figure 11 An example of the screen displayed on the output devices of user A and the viewing users during the streaming distribution is depicted. The image processing unit 130 refers to the setting information and the merging control information regarding the streaming distribution, and then determines the images to be merged. In this example, it is set that the camera image is included in the distribution image, and thus, the image processing unit 130 merges the game image read from the game buffer 142 with the system image read from the system buffer 144 to generate a display image.

[0098] During the streaming distribution, the image processing unit 130 generates a display image including the game image to output to the output device 4 and the sharing processing unit 150. The sound providing unit 132 outputs the game sound generated in the game sound generation unit 114 to the output device 4, and also superimposes the sound input to the microphone of the information processing device 10 on the game sound, thereby outputting the sound to the sharing processing unit 150.

[0099] The image acquisition unit 152 acquires the image provided by the image processing unit 130, and the sound acquisition unit 154 acquires the sound provided by the sound providing unit 132. The image acquired by the image acquisition unit 152 and the sound acquired by the sound acquisition unit 154 are respectively the distribution image and the distribution sound to be distributed to the sharing server 11. The distribution processing unit 156 adjusts the quality of each of the acquired distribution image and distribution sound as needed, encodes them, and distributes the encoded image data and sound data to one or more of the information processing terminals 12 through the sharing server 11 by streaming. Thus, in the image sharing system 1, the game image and the game sound viewed by the user A playing the game are distributed as they are by streaming, while the quality of each of the game image and the game sound is changed. Accordingly, the viewing users can access the sharing server 11 from the information processing terminals 12 to view the same game image and the same game sound as user A.

[0100] In the following, the case where the message generation unit 116 generates a notification message will be described. As described above, the message generation unit 116 generates notification messages for various reasons during the game of user A. When the message generation unit 116 generates a notification message, the system image generation unit 122 generates a system image including the notification message.

[0101] Figure 12 An example of the system image generated by the system image generation unit 122 is depicted. When the message generation unit 116 generates a notification message, the system image generation unit 122 generates a system image including the notification message together with the camera image. The system image generated in this way is stored in the system buffer 144. Note that the notification message will be displayed only for a predetermined period of time so that the system image generation unit 122 includes the notification message in the system image for the predetermined period of time.

[0102] Figure 13 An example of the screen displayed on the output device of user A and the viewing user during the streaming distribution is depicted. The image processing unit 130 merges the game image read from the game buffer 142 with the system image read from the system buffer 144. At this time, the image processing unit 130 places the notification message in the system image in a state where the notification message is not visually recognized. In this example, the image processing unit 130 uses a black image to mask the area 190 where the notification message is arranged, resulting in the notification message being placed in an unreadable state. Note that the image processing unit 130 can cause the notification message to be visually unrecognizable by other methods. For example, image processing such as mosaicing can be performed on the notification message. Accordingly, personal information included in the notification message can be prevented from being distributed together with the game image.

[0103] As described above, in the information processing device 10, when the camera image is set to be included in the distribution image, the image processing unit 130 generates a distribution image including the area 190 where the notification message is superimposed, and places the notification message in a state where the notification message is not visually recognized. However, as Figure 13 shown, the area 190 covered in black disrupts the progress of the game and should not be included in the distribution image if possible.

[0104] In view of this, in the information processing device 10, when the camera image is set not to be included in the distribution image, the image processing unit 130 generates a distribution image that does not include the area 190 where the notification message is superimposed. On the Figure 8 shown setting screen, user A cancels the selection of the checkbox "Include camera video image in the broadcast", and the setting unit 120 sets the distribution mode in the broadcast so that the camera image is not included in the distribution image.

[0105] The image processing unit 130 refers to the setting information and merging control information regarding streaming distribution to determine the images to be merged. In this example, the setting is made not to include the camera image in the distributed images, and thus, the image processing unit 130 generates a display image that includes the game images read from the game buffer 142 and does not include the system image. In other words, when the setting is made not to include the camera image in the distributed images, the image processing unit 130 does not merge the game image with the system image. Therefore, even when the message generation unit 116 generates a notification message and the system image generation unit 122 generates a system image including the notification image, the image processing unit 130 does not include the system image in the distributed images, and thus, the distributed images do not include the area 190 where the notification message is superimposed.

[0106] Figure 14 Examples of the screens to be displayed on each output device of User A and the viewing users are illustrated. When the camera image is not included in the distributed images, the image processing unit 130 does not merge the system image into the game image so that the area 190 shaded in black is not displayed on the display screen and the viewing users can view the game images to be distributed without stress.

[0107] In the foregoing description, the present invention has been described based on embodiments. These embodiments are merely illustrative, and those skilled in the art understand that the combinations of the constituent elements and processes of the embodiments can be modified in various ways, and such modifications are also within the scope of the present invention.

[0108] In the above embodiment, in the frame buffer unit 140, the game buffer 142 includes a plurality of frame buffers, and the system buffer 144 includes one frame buffer. In a modified example, a description of the display image generation process in the case where the system buffer 144 includes a plurality of frame buffers is provided.

[0109] Figure 15 Indicates the configuration of the frame buffer unit 140 in the modified example. The game buffer 142 stores the game images generated by the game image generation unit 112, and the system buffer 144 stores the system images generated by the system image generation unit 122. The system buffer 144 has a plurality of frame buffers, and in this modified example, has two frame buffers, which are the first frame buffer 144a and the second frame buffer 144b.

[0110] In the modified example, the system image generation unit 122 generates two types of system images in this case: a first system image and a second system image different from the first system image. The system image generation unit 122 stores the generated first system image in the first frame buffer 144a, while storing the generated second system image in the second frame buffer 144b. In the modified example, the system image generation unit 122 generates a first system image including a camera image and a second system image not including the camera image. When the message generation unit 116 generates a notification message, the system image generation unit 122 generates a second system image including the notification message. Therefore, in the modified example, the system image generation unit 122 does not include the camera image and the notification message in the same system image.

[0111] Figure 16 Indicates the merge control information in the modified example. The merge control information is information for controlling the merging of images stored in the frame buffer unit 140, and is stored in the flash memory 36 or a storage unit (such as the auxiliary storage device 2). Figure 16 The image control information indicated in determines the following.

[0112] - When the camera image is included in the distribution image, the distribution image is generated by merging the game image and the first system image.

[0113] - When the camera image is not included in the distribution image, the distribution image is generated by including only the game image without including the first system image and the second system image.

[0114] Before starting the streaming distribution, the setting unit 120 provides the setting information about the streaming distribution to the image processing unit 130. During the streaming distribution, the image processing unit 130 generates a display image according to the content of item (a) included in the setting information and the merge control information. Therefore, in the modified example, when the camera image is set to be included in the distribution image, the image processing unit 130 generates the distribution image by merging the game image with the first system image. On the contrary, when the camera image is set not to be included in the distribution image, the image processing unit 130 generates a distribution image including the game image without including the first system image and the second system image.

[0115] In the modified example, the system buffer 144 has a plurality of frame buffers so that the system image generation unit 122 can generate a first system image including a camera image and a second system image including a notification message. During the streaming distribution, the image processing unit 130 does not merge the second system image into the game image, so that the notification message can be excluded from the distribution image.

[0116] Note that during the distribution of the game, user A may be unable to play the game for various reasons within a short period of time. User A may be able to operate a predetermined button (e.g., the home button) of the input device 6, thereby allowing the distribution of the camera to be temporarily suspended. In this case, the image processing unit 130 may generate an image indicating "temporarily suspended now" and provide the image to the image acquisition unit 152. Alternatively, the image processing unit 130 may provide a game image in which the system image is not merged to the image acquisition unit 152.

[0117] Industrial Applicability

[0118] The present invention can be applied to the technical field related to the distribution of game images.

[0119] List of Reference Signs

[0120] 1: Image sharing system

[0121] 4: Output device

[0122] 10: Information processing device

[0123] 11: Sharing server

[0124] 12b, 12c, 12d: Information processing terminals

[0125] 14b, 14c, 14d: Output devices

[0126] 100: Processing unit

[0127] 102: Communication unit

[0128] 104: Reception unit

[0129] 110: Execution unit

[0130] 112: Game image generation unit

[0131] 114: Game sound generation unit

[0132] 116: Message generation unit

[0133] 118: Camera image supply unit

[0134] 120: Setting unit

[0135] 122: System image generation unit

[0136] 130: Image processing unit

[0137] 132: Sound providing unit

[0138] 140: Frame buffer unit

[0139] 142: Game buffer

[0140] 144: System buffer

[0141] 144a: First frame buffer

[0142] 144b: Second frame buffer

[0143] 150: Shared processing unit

[0144] 152: Image acquisition unit

[0145] 154: Sound acquisition unit

[0146] 156: Distribution processing unit

[0147] 158: Setup image generation unit

Claims

1. An information processing apparatus, comprising: A game image generation unit configured to generate game images; A message generation unit configured to generate notification messages; A setting unit configured to register setting information for determining whether a camera image is to be included in a distribution image; An image processing unit configured to generate a distribution image including the game images; A distribution processing unit configured to distribute the distribution image; and A system image generation unit configured to generate a system image including the notification message, wherein when the camera image is set to be included in the distribution image, the image processing unit generates the distribution image including a region where the notification message is superimposed, and when the camera image is set not to be included in the distribution image, the image processing unit generates the distribution image not including the region where the notification message is superimposed, wherein when the camera image is set to be included in the distribution image, the system image generation unit generates the system image including the camera image, when the camera image is set to be included in the distribution image, the image processing unit combines the game image and the system image to generate the distribution image, and when the camera image is set not to be included in the distribution image, the image processing unit generates the distribution image including the game image and not including the system image.

2. The information processing apparatus according to claim 1, further comprising: A game frame buffer configured to store the game images generated by the game image generation unit; and A system frame buffer configured to store the system images generated by the system image generation unit, wherein the image processing unit has a function of combining the game image stored in the game frame buffer and the system image stored in the system frame buffer.

3. An information processing apparatus, comprising: A game image generation unit configured to generate game images; A game frame buffer configured to store the game images generated by the game image generation unit; A system image generation unit configured to generate system images; A system frame buffer configured to store the system images generated by the system image generation unit; and An image processing unit configured to combine the game image stored in the game frame buffer and the system image stored in the system frame buffer, and generate a distribution image including the game image; and A setting unit configured to register setting information for determining whether a camera image is to be included in the distribution image, wherein the system image generation unit generates a first system image and a second system image different from the first system image, and the system frame buffer includes a first frame buffer storing the first system image and a second frame buffer storing the second system image, wherein the system image generation unit generates the first system image including a camera image and the second system image not including the camera image, Wherein, when the camera image is set to be included in the distribution image, the image processing unit merges the game image with the first system image to generate the distribution image, and when the camera image is set not to be included in the distribution image, the image processing unit generates the distribution image including the game image and not including the first system image and the second system image.

4. The information processing apparatus according to claim 3, further comprising: A distribution processing unit configured to distribute the distribution image.

5. A game image distribution method, comprising: A step of generating a game image by a game image generation unit; A step of generating a notification message by a message generation unit; A step of setting by a setting unit whether a camera image is to be included in the distribution image; A step of generating a distribution image including the game image by an image processing unit; A step of distributing the distribution image by a distribution processing unit; and A step of generating a system image including the notification message by a system image generation unit, wherein, when the camera image is set to be included in the distribution image, the distribution image generation step generates the distribution image including an area where the notification message is superimposed, and when the camera image is set not to be included in the distribution image, the distribution image generation step generates the distribution image not including the area where the notification message is superimposed, wherein, when the camera image is set to be included in the distribution image, the system image generation unit generates the system image including the camera image, when the camera image is set to be included in the distribution image, the image processing unit merges the game image with the system image to generate the distribution image, and when the camera image is set not to be included in the distribution image, the image processing unit generates the distribution image including the game image and not including the system image.

6. A program causing a computer to implement the following functions: A function of generating a game image by a game image generation unit; A function of generating a notification message by a message generation unit; A function of setting by a setting unit whether a camera image is to be included in the distribution image; A function of generating a distribution image including the game image by an image processing unit; A function of distributing the distribution image by a distribution processing unit; and A function of generating a system image including the notification message by a system image generation unit, Among them, when the camera image is set to be included in the distribution image, the distribution image generation function includes a function of generating the distribution image including an area where the notification message is superimposed, and when the camera image is set not to be included in the distribution image, the distribution image generation step includes a function of generating the distribution image not including the area where the notification message is superimposed, wherein, when the camera image is set to be included in the distribution image, the system image generation unit generates the system image including the camera image, When the camera image is set to be included in the distribution image, the image processing unit merges the game image and the system image to generate the distribution image, and when the camera image is set not to be included in the distribution image, the image processing unit generates the distribution image including the game image but not including the system image.

Images