Program and information processing system

Abstract

To provide a technology for a viewer to view a game distribution, etc. more comfortably.SOLUTION: First camera control means 180 controls a first virtual camera disposed in a virtual space of a game according to an input operation of a distributor. Second camera control means 181 controls an operating second virtual camera according to an operation of the first virtual camera by the first camera control means 180. Operation control means 190 determines whether or not the operation of the first virtual camera satisfies a predetermined condition (moving volume, angle, velocity, etc.), and if the operation of the first virtual camera satisfies the predetermined condition, restricts the operation of the second virtual camera. Third camera control means 182 controls a third virtual camera that does not interlock with the operations of the first virtual camera and the second virtual camera. Image management means 183 manages various game images presented to the distributor or the viewer.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a program and an information processing system. [Background technology]

[0002] In recent years, the increase in the amount of information displayed on the screen in games, movies, etc. has led to a problem of so-called screen sickness in users. In this regard, a technique has been proposed for reducing screen sickness in users by, for example, limiting the operating angle of a virtual camera (see, for example, paragraph

[0045] of Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-226767 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in conventional technologies including the technology described in Patent Document 1, when measures are taken to reduce screen-induced sickness in users playing games, the sense of realism and speed of the game is lost. On the other hand, in recent years, game streaming, in which game images are distributed to a large number of viewers, has also become common. In game streaming, if measures to reduce screen sickness, such as the technology described in Patent Document 1, are applied, it is thought that this will affect the game-playing technique itself, which is the main attraction of the stream.

[0005] The present invention has been made in view of the above circumstances, and provides a technology that allows viewers to watch game broadcasts and the like more comfortably.

[0006] In order to achieve the above object, a first aspect of the present invention is a first information processing terminal used by a first user who plays a game; a second information processing terminal used by a second user who watches the game broadcast; An information processing device constituting an information processing system including: a first camera control means for controlling a first virtual camera disposed in a virtual space of the game in response to an input operation by the first user; a second camera control means for controlling an operating second virtual camera in accordance with the operation of the first virtual camera; an image presenting means for presenting a first image generated by the first virtual camera to the first user and a second image generated by the second virtual camera to the second user; It is a program that functions as a

[0007] In addition, in the first aspect, the program can further function as an operation restriction means that determines whether the operation of the first virtual camera satisfies a predetermined condition and restricts the operation of the second virtual camera if the condition is satisfied.

[0008] In addition, in the first aspect, the program can further function as a third camera control means for controlling a third virtual camera that is not linked to the operation of the first virtual camera and the second virtual camera, and the image presentation means can present a third image generated by the third virtual camera to the second user when the operation restriction means determines that the condition is satisfied.

[0009] Also, in the first aspect, the second camera control means can further function as a stimulus reduction means that executes processing to reduce screen sickness of the second user who is presented with the second image.

[0010] In addition, in the first aspect, the stimulus reduction means can execute processing to reduce vertical shaking of the second virtual camera.

[0011] The second aspect of the present invention is a first information processing terminal used by a first user who plays a game; a second information processing terminal used by a second user who watches the game broadcast; An information processing system comprising: a first camera control means for controlling a first virtual camera disposed in a virtual space of the game in response to an input operation by the first user; a second camera control means for controlling an operating second virtual camera in accordance with the operation of the first virtual camera; an image presenting means for presenting a first image generated by the first virtual camera to the first user and a second image generated by the second virtual camera to the second user; The information processing system includes:

[0012] An information processing system according to an aspect of the present invention is also provided as an information processing system corresponding to a program according to an aspect of the present invention. [Effects of the Invention]

[0013] According to the present invention, it is possible to provide a technology that allows viewers to watch game broadcasts and the like more comfortably. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a diagram illustrating an example of a configuration of an information processing system according to a first embodiment of the present invention. [Figure 2] 2 is a diagram illustrating an example of a hardware configuration of a distributor terminal in the information processing system according to the first embodiment of the present invention. FIG. [Figure 3] 1 is a block diagram showing an example of the functional configuration of a distributor terminal, a viewer terminal, and a server according to a first embodiment of the present invention. [Figure 4] FIG. 2 is an image diagram for explaining a method for generating a first viewer image according to the first embodiment of the present invention. [Figure 5] 4 is a flowchart illustrating the flow of a first viewer image generation process executed by the server of FIG. 3. [Figure 6]FIG. 4 is an image diagram showing an example of an image displayed on the distributor terminal of FIG. 3. [Figure 7] FIG. 4 is an image diagram showing an example of an image displayed on the viewer terminal of FIG. 3. [Figure 8] FIG. 10 is a diagram illustrating an example of a configuration of an information processing system according to a second embodiment of the present invention. [Figure 9] FIG. 10 is a block diagram showing an example of the functional configuration of a distributor terminal and a viewer terminal according to a second embodiment of the present invention. [Figure 10] 10 is a conceptual diagram showing an image displayed on the distributor terminal or the viewer terminal of FIG. 9. FIG. [Figure 11] 10 is a flowchart illustrating the flow of a second viewer image generation process executed by the distributor terminal of FIG. 9. DETAILED DESCRIPTION OF THE INVENTION

[0015] [First embodiment] An information processing system according to a first embodiment of the present invention (hereinafter referred to as "the first system") will be described with reference to the drawings.

[0016] First, before explaining this first system, we will briefly explain "screen sickness (3D sickness)" related to this first system. As mentioned above, in recent games, movies, etc., the phenomenon of screen sickness, which causes mild dizziness and nausea, has been known due to improvements in screen transition speed and advanced graphics performance. Although the exact mechanism of this screen sickness has not been clarified, it is generally considered to be a phenomenon caused by a discrepancy between the movement predicted by one's own kinesthetic sense and the movement perceived by one's vision. Therefore, in many conventional technologies, including the technology described in the above-mentioned Patent Document 1, attempts have been made to reduce the phenomenon of screen sickness by narrowing the range of the angle of view of the displayed image, slowing down the speed of image transitions, etc. However, these methods not only detract from the realism and sense of speed inherent in games, but also have the effect of, for example, reducing the player's playing skills when high-level competition is assumed (the player will no longer be able to play with fast screen transitions). This reduction in playing skills can be a problem, especially in game streaming. It is also known that the symptoms of screen sickness improve with habituation. Therefore, it is thought that screen sickness is unlikely to be a problem for users who play games on a daily basis. However, many viewers of game streaming services do not normally play games, and it is thought that they are more likely to experience screen sickness problems.

[0017] Against this background, the first system is an information processing system that realizes game distribution by providing a gaming environment to users who wish to distribute games (hereinafter referred to as "distributors"), and sharing game images of the distributors with users who wish to watch the game distribution (hereinafter referred to as "viewers"). One of the features of this first system is that the game images presented to the broadcaster and the game images presented to the viewers are not necessarily the same. That is, this first system provides the broadcaster with a normal game environment (game images), while presenting the viewers with game images (hereinafter referred to as "first viewer images") that have been edited to reduce the risk of motion sickness. This allows the broadcaster to freely play the game in a normal game environment, while viewers who are not accustomed to game images can safely enjoy the game broadcast without getting motion sickness.

[0018] Here, the game related to this first system (hereinafter referred to as "this game") is, for example, a network-type fighting game called an FPS (First Person Shooter) or a TPS (Third Person Shooter). In this game, for example, many players connected via a network share a virtual space, and each player fights using weapons (firearms, etc.) and recovery items, aiming to win the game. When a player's HP (hit points), which decreases due to various factors in the game such as being attacked by an enemy, falls below a certain value, the player is no longer allowed to continue playing and is eliminated from the game. In the following explanation, the term "image" may include not only a simple image but also letters, symbols, sounds, etc. In addition, in this game, the streamer can independently give instructions to operate the character and instructions to operate the viewpoint of the background image (control of the virtual camera).

[0019] <Summary> FIG. 1 shows an example of the configuration of an information processing system according to the first embodiment of the present invention. 1, the first system includes a distributor terminal 1, viewer terminals 2-1 to 2-n (n is any integer value equal to or greater than 1), and a server 3. The distributor terminal 1, viewer terminals 2-1 to 2-n, and server 3 are interconnected via a network N such as the Internet. However, the network N is not an essential component, and for example, NFC (Near Field Communication), Bluetooth (registered trademark), LAN (Local Area Network), etc. may be used. When there is no need to distinguish between the viewer terminals 2-1 to 2-n, they will be collectively referred to as "viewer terminal 2."

[0020] The distributor terminal 1 is used by the distributor of this game. The distributor terminal 1 is composed of a general-purpose personal computer, game console, tablet, etc. The distributor terminal 1 communicates with other hardware, etc., and executes various processes required for the progress of this game and the distribution of this game.

[0021] The viewer terminal 2 is used by viewers of the game broadcast. The viewer terminal 2 is composed of a general-purpose personal computer, smartphone, tablet, etc. The viewer terminal 2 executes various processes required for viewing the game broadcast.

[0022] The server 3 is managed by an administrator of the first system, etc. The server 3 is configured with a general-purpose personal computer, etc. The server 3 executes various processes in the first viewer image generation process described below. The server 3 also executes the storage and management of information required for the progress of the game on the broadcaster terminal 1, etc.

[0023] <Hardware configuration> FIG. 2 shows an example of the hardware configuration of a distributor terminal in the information processing system according to the first embodiment of the present invention.

[0024] As shown in Figure 2, the distributor terminal 1 includes a control unit 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a memory unit 18, a communication unit 19, and a drive 20.

[0025] The control unit 11 is configured by a microcomputer including a CPU, a GPU, a semiconductor memory, etc. The control unit 11 executes various processes according to a program recorded in a ROM 12 or a program loaded from a storage unit 18 to a RAM 13. The RAM 13 also stores information necessary for the control unit 11 to execute various processes as needed.

[0026] The control unit 11, ROM 12, and RAM 13 are connected to one another via a bus 14. An input / output interface 15 is also connected to this bus 14. An output unit 16, an input unit 17, a memory unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.

[0027] The output unit 16 outputs image information, audio information, etc. to a display, a speaker, etc. The image information and audio information output by the output unit 16 are output from the display, the speaker, etc. in a form that can be recognized by a person as an image or audio.

[0028] The input unit 17 is composed of a mouse, keyboard, game controller, etc., and inputs various information in response to input operations by the distributor, etc.

[0029] The storage unit 18 is configured with a hard disk drive (HDD), a solid state drive (SSD), etc., and stores various information. For example, the storage unit 18 stores various game programs, save data, account information, etc., which are necessary for progressing through the game.

[0030] The communication unit 19 controls mutual communications with other hardware and the like via a network N including the Internet.

[0031] The drive 20 is provided as needed. Removable media 31, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, is appropriately attached to the drive 20. Various programs for executing the game are stored in the removable media 31. The programs read from the removable media 31 by the drive 20 are installed in the storage unit 18 as needed. Furthermore, the removable medium 31 can also store various types of information stored in the storage unit 18 in the same manner as the storage unit 18.

[0032] Here, the hardware configuration of the viewer terminal 2 and the server 3 can be basically the same as the hardware configuration of the distributor terminal 1, so a description thereof will be omitted. The cooperation of such various hardware and software enables the distributor terminal 1, viewer terminal 2, and server 3 to execute various processes.

[0033] FIG. 3 shows an example of the functional configuration of a distributor terminal, a viewer terminal, and a server according to the first embodiment of the present invention. First, an example of the functional configuration of the distributor terminal 1 will be described. As shown in Figure 3, the control unit 11 of the broadcaster terminal 1 executes various programs, etc., causing a game processing execution means 60, a camera control means 61, a camera information management means 62, a broadcaster image generation means 63, and an output control means 64 to function.

[0034] The game processing execution means 60 executes various processes related to the game. Specifically, the game processing execution means 60 reads virtual game space objects and textures included in the game information from a storage unit (not shown) in accordance with various input operations by the distributor, and generates two-dimensional or three-dimensional images and sounds related to the game while executing the game program. In other words, the game processing execution means 60 controls the progress of the game by generating and managing the results of the user's operation instructions. The game processing execution means 60 also appropriately acquires various information required for the progress of the game from the server 3, etc.

[0035] The camera control means 61 controls a virtual camera placed in the virtual space of the game in response to input operations by the streamer, etc. Specifically, the camera control means 61 executes control processing related to the position (three-dimensional coordinates in the virtual space, etc.) and rotation angle (range of the angle of view in the line of sight from the above-mentioned coordinates, etc.) of an arbitrary viewpoint in the virtual space that serves as a reference for generating a game image in response to input operations by the streamer, etc.

[0036] The camera information management means 62 transmits information regarding the position and rotation angle in the virtual space of the virtual camera controlled by the camera control means 61 (hereinafter referred to as "distributor camera information") to the server 3. The camera information management means 62 also transmits information regarding input operations by the distributor (hereinafter referred to as "distributor input information") to the server 3.

[0037] The image generation means for broadcaster 63 generates a game image (hereinafter referred to as "image for broadcaster") to be presented to the broadcaster as a result of various game processes based on the broadcaster's input operations and information on the position and rotation angle of the virtual camera controlled by the camera control means 61. That is, the image for the broadcaster is a game image directed in a predetermined viewpoint direction from a predetermined position in the virtual space, which reflects the results of the game processing based on the broadcaster's input operation.

[0038] The output control means 64 executes control processing for outputting various images (game images, etc.), sounds, etc. to the output unit 16, etc.

[0039] Next, an example of the functional configuration of the server 3 will be described. As shown in FIG. 3, the control unit 120 of the server 3 executes various programs, etc., thereby causing a distributor information acquisition means 140, a condition determination means 141, a viewer image generation means 142, and a presentation image management means 143 to function.

[0040] The distributor information acquisition means 140 acquires the camera information and distributor input information transmitted from the distributor terminal 1 via the communication unit 130.

[0041] The condition determination means 141 determines whether the input operation of the broadcaster or the image presented to the broadcaster satisfies predetermined conditions related to screen sickness, based on the camera information and broadcaster input information acquired by the broadcaster information acquisition means 140. Specifically, cases in which the streamer's input operations or the images presented to the streamer meet certain conditions related to screen sickness include, for example, when there is a large change between images, when each image is presented quickly, when the image's viewing angle is large, when the image's background has a large depth, and when the game character's movements are difficult to imagine as normal human movements. The condition determination means 141 determines, for example, based on these elements, whether or not the input operation of the distributor or the image presented to the distributor satisfies a predetermined condition related to screen sickness. Furthermore, if the condition determination means 141 does not determine that the input operation of the streamer or the image presented to the streamer satisfies the predetermined condition related to screen sickness, it generates a normal game image for viewing to be presented to viewers based on the streamer camera information and streamer input information acquired by the streamer information acquisition means 140. Note that the normal game image for viewing here is basically the same as the streamer image.

[0042] When the condition determination means 141 determines that a predetermined condition is met, the viewer image generation means 142 takes measures to reduce screen sickness and generates a game image to be presented to the viewer (hereinafter referred to as the "first viewer image"). Here, the viewer image generating means 142 is provided with image and audio editing means 150. The image and audio editing means 150 executes editing processing on the game image of a section where the condition determining means has determined that a predetermined condition is satisfied (hereinafter referred to as a "detection section"). Details of the editing processing by the image and audio editing means 150 will be described later with reference to FIG. 4. That is, when the condition determining means 141 has determined that a predetermined condition is satisfied, the viewer image generating means 142 generates a first viewer image based on the camera information, the distributor input information, and the result of the editing processing by the image and audio editing means 150. The term "interval" is used to indicate a unit of time used for managing the passage of time in the game and game images. That is, the detected interval indicates a certain interval in which a predetermined condition is determined to be satisfied by the condition determination means, for example, based on a predetermined unit of in-game time.

[0043] If the condition determination means 141 does not determine that the specified condition is met, the presentation image management means 143 transmits information regarding the normal game image for viewing generated by the condition determination means 141 (hereinafter referred to as "normal game image information") to the viewer terminal 2. In addition, when the condition determination means 141 determines that a predetermined condition is satisfied, the presentation image management means 143 transmits information regarding the first viewer image generated by the viewer image generation means 142 (hereinafter referred to as "first viewer image information") to the viewer terminal 2.

[0044] Next, an example of the functional configuration of the viewer terminal 2 will be described. As shown in FIG. 3, the control unit 80 of the viewer terminal 2 executes various programs and the like, thereby causing an image information management means 100 and an output control means 101 to function.

[0045] The image information management means 100 acquires the normal game image information or the first viewer image information transmitted from the server 3 via the communication unit 90.

[0046] The output control means 101 executes control processing for outputting various images (game images, etc.), sounds, etc. to an output unit (not shown), etc. For example, the output control means 101 presents a normal game image for viewing or an image for the first viewer to the viewer based on normal game image information or image information for the first viewer.

[0047] Next, an example of editing processing by the image and audio editing means 150 will be described with reference to Fig. 4. Fig. 4 shows an image of a method for generating a first viewer image according to the first embodiment of the present invention.

[0048] In Figure 4(A), one area on the horizontal axis is labeled "detected section." This indicates that a detected section was detected in a specific area of ​​the game's time course shown on the horizontal axis. A detected section is a section where the original game image contains images with large movements or changes, and where there is a high possibility of causing motion sickness if the generated game image is presented to the viewer as is. Therefore, in this first system, as shown in (B) of Figure 4, for example, by increasing the number of times images are displayed per time period in the detection section (slowing down the image playback speed), or by applying a so-called slow-motion effect, it is possible to generate game images (first viewer images) that are less likely to cause motion sickness. This allows viewers of game distribution to slowly recognize the movements and changes in the game situation without the risk of motion sickness, even in game images that would normally have large movements and changes. In addition, when sound or the like is linked to a game image or the like in the detection section, this first system may impart a slow motion effect to the sound or the like, or may play the sound or the like at normal speed in accordance with the timing at which the image presentation in the detection section ends, as shown in (B) of Figure 4.

[0049] The flow of the first viewer image generation process will be described with reference to Fig. 5. Fig. 5 shows an example of the flow of the first viewer image generation process executed by the server in Fig. 3 .

[0050] In step S1, the distributor information acquisition means 140 of the server 3 acquires the camera information and distributor input information transmitted from the distributor terminal 1 via the communication unit .

[0051] In step S2, the condition determination means 141 determines whether the input operation of the broadcaster or the image presented to the broadcaster satisfies predetermined conditions related to screen sickness, based on the camera information and broadcaster input information acquired by the broadcaster information acquisition means 140. If the input operation of the distributor or the image presented to the distributor does not satisfy the predetermined conditions regarding screen sickness, step S2 is determined as No, and the processing proceeds to step S5. On the other hand, if the input operation of the distributor or the image presented to the distributor satisfies the predetermined condition related to screen sickness, step S2 is determined as Yes, and the processing proceeds directly to step S3.

[0052] In step S3, the image / audio editing means 150 executes editing processing on the game image etc. in the detection section for which the condition determining means has determined that the predetermined condition is satisfied.

[0053] In step S4, the viewer image generating means 142 generates a first viewer image based on the camera information acquired by the distributor information acquiring means 140, the distributor input information, and the result of the editing process by the image and audio editing means 150. Then, the process proceeds to step S6.

[0054] In step S5, if the condition determination means 141 determines that the input operation of the streamer or the image presented to the streamer does not satisfy the predetermined condition related to screen sickness, it generates a normal game image to be presented to viewers based on the streamer camera information and streamer input information acquired by the streamer information acquisition means 140. Then, the processing proceeds to step S6.

[0055] In step S6, the presentation image management means 143 transmits the normal game image information or the first viewer image information to the viewer terminal 2. This completes the first viewer image generation process.

[0056] Here, an example of the editing process by the video / audio editing means 150, which is different from the example in FIG. 4, will be described with reference to FIGS. First, in the example of Fig. 6(A), in a game image (field of view) facing from the bottom (south) of the screen to the top (north) of the screen, character C1 is displayed holding a weapon (gun) toward the left of the screen. In contrast, in Fig. 6(B), at the moment (the timing when the game image is displayed) after Fig. 6(A), in a game image (field of view) facing from the top (north) of the screen to the bottom (south) of the screen, character C1 is displayed holding a weapon toward the right of the screen. Note that the indications t (where t is any integer value equal to or greater than 1), t+1, and t+2 at the top of each diagram indicate the predetermined time units in which each game image is processed within the game. In other words, various processes in the game involve processing input information at predetermined unit times such as t, t+1, and t+2, generating game images based on the input information for each unit time, and progressing the game. 6A and 6B show, simply put, the transition of the game image when an instruction to turn the screen to the right and an instruction to change the viewpoint of the background image are simultaneously given to the character C1, who is holding a weapon facing the left side of the screen in the virtual space. When such operation instructions are given quickly in the game, the content of the displayed game image changes suddenly, which may result in motion sickness in the streamer and viewers.

[0057] In contrast to this, FIG. 7 shows an example of a first viewer image that is displayed to the viewer in order to prevent motion sickness. Looking at (A) in Figure 7, as in (A) in Figure 6, in a game image (field of view) facing from the bottom of the screen (south) to the top of the screen (north), character C1 is displayed holding a weapon facing left of the screen. In contrast, in (B) of Fig. 7, in a game image (field of view) facing from the bottom (south) of the screen to the top (north) of the screen, character C1 is displayed holding a weapon (gun) toward the right of the screen. And in (C) of Fig. 7, similar to (B) of Fig. 6, in a game image (field of view) facing from the top (north) of the screen to the bottom (south) of the screen, character C1 is displayed holding a weapon toward the right of the screen. In the example of FIG. 7(B), similar to FIG. 7(C), character C1 is holding a weapon toward the right of the screen at the streamer's instruction, but the viewpoint of the background image is not changed, and the game image is shown from the same viewpoint as FIG. 7(A). In other words, FIG. 7(B) is an edited image generated by fixing the viewpoint of the background image when transitioning from the game image of FIG. 7(A) to the game image of FIG. 7(C). By presenting such intermediate edited images only to viewers, the first system can reduce the risk of viewers experiencing motion sickness while allowing the streamer to play the game freely. This concludes the explanation of the first system.

[0058] [Second embodiment] Next, an information processing system according to a second embodiment of the present invention (hereinafter referred to as "the second system") will be described with reference to the drawings. In the second embodiment of the present invention, an example will be shown in which a game image for viewers that reduces the risk of screen sickness is generated by a method different from that of the first embodiment of the present invention.

[0059] FIG. 8 shows an example of the configuration of an information processing system according to the second embodiment of the present invention. 8, this second system includes a distributor terminal 1 and viewer terminals 2-1 to 2-m (m is an arbitrary integer value equal to or greater than 1). The distributor terminal 1 and viewer terminals 2-1 to 2-m are connected to each other via a network N such as the Internet. However, the network N is not an essential component, and for example, NFC (Near Field Communication), Bluetooth (registered trademark), LAN (Local Area Network), etc. may be used. The hardware configurations of the distributor terminal 1 and the viewer terminals 2-1 to 2-m are the same as those in the first embodiment shown in Fig. 2 etc. In the following description, when there is no need to particularly distinguish between the viewer terminals 2-1 to 2-m, they will be referred to as "viewer terminal 2" as in the first embodiment.

[0060] FIG. 9 shows an example of the functional configuration of a distributor terminal and a viewer terminal according to the second embodiment of the present invention. 9, control unit 11 of broadcaster terminal 1 executes various programs and the like, thereby causing game processing execution means 60, first camera control means 180, second camera control means 181, third camera control means 182, image management means 183, and output control means 64 to function. The functional configurations of game processing execution means 60 and output control means 64 are the same as the contents of the corresponding functional configurations in the first embodiment.

[0061] The first camera control means 180 controls the first virtual camera placed in the virtual space of the game in response to input operations by the streamer. Specifically, the first camera control means 180 executes control processing related to the position (three-dimensional coordinates in the virtual space, etc.) and rotation angle (range of the angle of view in the line of sight from the above-mentioned coordinates, etc.) of an arbitrary viewpoint in the virtual space that serves as a reference for generating a game image in response to input operations by the streamer, etc.

[0062] Second camera control means 181 controls the operating second virtual camera in accordance with the operation of the first virtual camera by first camera control means 180. Specifically, second camera control means 181 follows the operation of the first virtual camera and executes control processing related to the position and rotation angle of an arbitrary viewpoint in the virtual space that serves as a reference for generating a game image.

[0063] Here, the second camera control means 181 is provided with an operation restriction means 190 . The movement restriction means 190 determines whether the movement of the first virtual camera satisfies predetermined conditions (amount of movement, angle, speed, etc.), and if the movement of the first virtual camera satisfies the predetermined conditions, executes control to restrict the movement of the second virtual camera.

[0064] Third camera control means 182 controls a third virtual camera that is not linked with the operations of the first virtual camera and the second virtual camera. Specifically, third camera control means 182 executes control processing related to the position and rotation angle of an arbitrary viewpoint in a virtual space that is set arbitrarily independent of the operations of the first virtual camera and the second virtual camera.

[0065] The image management means 183 manages various game images to be presented to the distributor or viewers. Specifically, the image management means 183 is provided with a distributor image generation means 200 and a viewer image generation means 201.

[0066] The image generation means 200 for broadcaster generates an image for broadcaster to be presented to the broadcaster as a result of various game processes based on the broadcaster's input operations and information on the position and rotation angle of the first virtual camera controlled by the first camera control means 180.

[0067] The viewer image generating means 201 generates a game image to be presented to the viewer (hereinafter referred to as a "second viewer image"). Specifically, if the operation restriction means 190 does not determine that the operation of the first virtual camera satisfies predetermined conditions (amount of movement, angle, speed, etc.), the viewer image generation means 201 generates a second viewer image to present to the viewer based on the input operation of the distributor and the position and rotation angle of the second virtual camera controlled by the second camera control means 181. On the other hand, if the operation restriction means 190 determines that the operation of the first virtual camera satisfies predetermined conditions (amount of movement, angle, speed, etc.), the viewer image generation means 201 generates a second viewer image to present to the viewer based on the input operation of the distributor, the position and rotation angle of the second virtual camera controlled by the second camera control means 181, and the position and rotation angle of the third virtual camera controlled by the third camera control means 182. Furthermore, the viewer image generating means 201 transmits information relating to the generated second viewer image (hereinafter referred to as "second viewer image information") to the viewer terminal 2.

[0068] 9, the control unit 80 of the viewer terminal 2 executes various programs and the like, thereby causing the second viewer image information acquisition means 230 and the output control means 101 to function. The functional configuration of the output control means 101 is the same as the contents of the corresponding functional configurations of the first embodiment.

[0069] The second viewer image information obtaining means 230 obtains the second viewer image information transmitted from the distributor terminal 1 via the communication unit 90.

[0070] Next, an image of the second viewer image will be described with reference to Fig. 10. Fig. 10 shows an image of the second viewer image displayed on the distributor terminal 1 or the viewer terminal 2.

[0071] 10(A) is an example of a normal game image captured by the first virtual camera. Let us now assume that, in the game situation shown in FIG. 10(A), the operation of the first virtual camera is confirmed such that operation limiting means 190 determines that a predetermined condition is satisfied. In this case, as described above, the operation of the first virtual camera limits the operation of the second virtual camera, and the game image captured by the third virtual camera is adopted as the second viewer image. A game image captured from the viewpoint of this third virtual camera is, for example, the image shown in Fig. 10(B). As described above, the position and rotation angle of the third virtual camera are set at a position independent of the first and second virtual cameras. In the example of Fig. 10(B), the viewpoint is from above in the game space. That is, when operation restriction means 190 determines that a predetermined condition is satisfied, viewer image generation means 201 not only controls the second virtual camera but also generates a second viewer image by appropriately using an image captured by the third virtual camera, and presents the second viewer image to the viewer. This ensures an environment in which the distributor can freely play the game, while reducing the possibility of viewers experiencing motion sickness.

[0072] The flow of the process of generating an image for the second viewer will be described with reference to Fig. 11. Fig. 11 shows an example of the flow of the process of generating an image for the second viewer executed by the distributor terminal of Fig. 9.

[0073] In step S21, the first camera control means 180 controls a virtual camera placed in the virtual space of the game in response to an input operation by the broadcaster.

[0074] In step S22, the image generation means 200 for the broadcaster generates an image for the broadcaster to present to the broadcaster as a result of various game processing based on the broadcaster's input operation and information on the position and rotation angle of the first virtual camera controlled by the first camera control means 180.

[0075] In step S23, second camera control means 181 controls the second virtual camera to operate in accordance with the operation of the first virtual camera by first camera control means 180.

[0076] In step S24, movement restriction means 190 determines whether or not the movement of the first virtual camera satisfies predetermined conditions (amount of movement, angle, speed, etc.). If the operation of the first virtual camera does not satisfy the predetermined conditions (amount of movement, angle, speed, etc.), operation restriction means 190 determines that step S24 is No, and the process proceeds to step S26. On the other hand, if the operation of the first virtual camera satisfies the predetermined conditions (amount of movement, angle, speed, etc.), step S24 is determined as Yes, and the process proceeds directly to step S25.

[0077] In step S25, if the operation restriction means 190 determines that the operation of the first virtual camera satisfies predetermined conditions (amount of movement, angle, speed, etc.), the viewer image generation means 201 generates a second viewer image to present to the viewer based on the input operation of the distributor, the position and rotation angle of the second virtual camera controlled by the second camera control means 181, and the position and rotation angle of the third virtual camera controlled by the third camera control means 182.

[0078] In step S26, if the operation restriction means 190 does not determine that the operation of the first virtual camera satisfies the predetermined conditions (amount of movement, angle, speed, etc.), the viewer image generation means 201 generates a second viewer image to present to the viewer based on the input operation of the distributor and the position and rotation angle of the second virtual camera controlled by the second camera control means 181.

[0079] In step S27, the viewer image generating means 201 transmits second viewer image information relating to the generated second viewer image to the viewer terminal 2. This completes the second viewer image generating process.

[0080] Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope of achieving the object of the present invention are included in the present invention.

[0081] <Other embodiments> Furthermore, in the above-described first and second embodiments, the first viewer image or the second viewer image for distribution is described as being automatically generated by the server 3 or the like, but this is not limited thereto. The first system or the second system may have a function that allows the distributor to edit the video. Note that, hereinafter, when there is no need to distinguish between the first viewer image and the second viewer image, they will simply be referred to as viewer images, and when there is no need to distinguish between the first system and the second system, they will simply be referred to as the system. Specifically, for example, the present system may set a flag for editing when condition determination means 141, operation restriction means 190, or the like determines that the operation of the first virtual camera satisfies a predetermined condition. This allows the editor to easily edit moving images and the like that have a high risk of causing motion sickness and generate images for viewers.

[0082] In the first embodiment, the camera information is transmitted to the server, but this is not limited to this. For example, the server may obtain only the rotation angle, movement speed, etc. of the camera and perform various determinations. Also, for example, various determinations may be made by another information processing terminal (for example, the broadcaster terminal 1). Note that the program related to the various determinations may be included in the game program, or may be processed by a separately prepared program. To summarize these aspects, in the first embodiment described above, all or part of the processing performed by the server 3 may be performed by the distributor terminal 1 or the viewer terminal 2.

[0083] Furthermore, when the system accepts editing of moving images by a distributor as described above, it may accept, for example, the following editing. For example, the system may accept editing such as changing the speed at which the moving image is played back to 0.5x speed, 1.2x speed, or 2.0x speed. Furthermore, the system may accept a change in the playback speed of the moving image from the viewer or the like.

[0084] Furthermore, although not explained in the first and second embodiments described above, the present system may change the content of the image for the viewer to be generated depending on the degree of operation of the first virtual camera (such as the degree to which the conditions are exceeded).

[0085] Furthermore, although only a simplified explanation has been given in the first and second embodiments described above, the present system may employ, for example, the following editing method for generating images for viewers as an editing method for reducing screen sickness (e.g., the image and audio editing means 150 of the first embodiment, etc.). (1) The system may generate an image for the viewer by, for example, deleting the background image in the detection section in the above-described embodiment or reducing the number of images (number of frames) to be displayed. (2) For example, when a camera (the virtual camera in the first embodiment or the first virtual camera in the second embodiment) satisfies a predetermined condition and particularly when vertical shaking is observed in the acquired image (for example, when a game character moves significantly up and down in the virtual space), the system may generate an image for the viewer by deleting unnecessary images above and below based on the position coordinates of the virtual camera or character. Note that the system may generate an image for the viewer by complementing the unnecessary images with corrected images, etc., rather than simply deleting the unnecessary images. (3) For example, the system may fix all images in the detection section and generate an image for the viewer. (4) For example, the system may generate an image for the viewer by allowing only the image in the center of the detected area (around the character) to be changed, and fixing or deleting the image in the outer periphery (including the background, etc.) of the image.

[0086] Although not explained in the first and second embodiments, the present system can also utilize rendering and other technologies in generating images for viewers (editing images). For example, the present system may generate an image by rendering, in which only the character portion moves and the background image and the like are all fixed.

[0087] Furthermore, in the above-described first and second embodiments, it has been explained that whether or not the condition determination means 141 or the operation restriction means 190 satisfies a predetermined condition is uniform regardless of the distributor or the character used by the distributor, but this is not limited thereto. For example, the system may change the content of the conditions depending on the progress of the game (specific events, enemies), the characteristics of the character (level or job), the game media owned, the characteristics of the viewer, etc. Furthermore, the system may employ specifications that allow the distributor or viewer to change the content of the conditions.

[0088] In the second embodiment described above, the operation restriction means 190 prohibits the operation of the second virtual camera (switches the operating virtual camera to the third virtual camera) when the first virtual camera satisfies a predetermined condition (movement amount, angle, speed, etc.), but this is not limited thereto. The operation restriction means 190 may restrict the operation (movement amount, angle, speed, etc.) of the second virtual camera when the first virtual camera satisfies a predetermined condition (movement amount, angle, speed, etc.). In this case, the third virtual camera may or may not operate simultaneously with the second virtual camera.

[0089] Furthermore, although not explained in the second embodiment above, the present system may set priorities for switching between the second virtual camera and the third virtual camera, or may present both images from the second virtual camera and the third virtual camera to viewers, etc. For example, if it is known in advance that a scene will occur in which an enemy character or the like will suddenly appear as the game progresses, an image from the third virtual camera can be automatically acquired at the time such a scene occurs and an image for the viewer can be generated, easily reducing the risk of viewer motion sickness and generating powerful moving images (by acquiring such an image in advance with the third virtual camera). Furthermore, for example, the system may present an image from the second virtual camera or the third virtual camera to the broadcaster, etc. This allows the broadcaster to broadcast (or play the game) more appropriately by checking the image presented to the viewers. In this case, the system may display the image from the second virtual camera or the third virtual camera as an image separate from the image from the first virtual camera, or may present the image from the second virtual camera or the third virtual camera to the broadcaster by constructing it in a region of the image from the first virtual camera.

[0090] Although not described in the second embodiment, the present system may have multiple third virtual cameras. By switching to an appropriate third virtual camera depending on the position of the character in the game, more appropriate game images can be generated.

[0091] Although not described in the second embodiment, the present system may take measures to reduce various stimuli that may cause motion sickness when controlling the second virtual camera. Here, measures to reduce stimuli include, for example, a so-called gimbal function employed in digital cameras, drones, etc., to stabilize image capture by preventing up-and-down shaking, camera shake, etc.

[0092] Although not explained in the first and second embodiments, if a specific section (such as a spoiler-free section) is set in advance in a game to impose restrictions on distribution, the system may, for example, display a still image generated in that section or forcibly stop capturing images from each virtual camera. When displaying a still image, the system may also present the broadcaster's voice to the viewer in conjunction with the still image.

[0093] Although the present system has been described as being applied to games, it is not limited thereto, and may be applied to general-purpose information processing systems other than games, such as distribution systems for various types of video images.

[0094] Furthermore, the hardware on which the game is run may be, for example, a home game console such as PlayStation (registered trademark), a portable game console such as Nintendo Switch (registered trademark), various game consoles designed for commercial use, or electronic devices such as personal computers, smartphones, tablets, etc.

[0095] Furthermore, in the above-described embodiment and other embodiments, the games to which this system is applicable have been described as being network-based competitive games known as FPS and TPS, but this is not limited thereto. This system may be applied to any games, such as role-playing games (RPGs), simulation games, sports games, card games, multiplayer online battle arenas (MOBAs), music games, fighting games, and quiz games.

[0096] The above-described series of processes can be executed by hardware or software. In other words, the functional configurations shown in FIGS. 3, 9, etc. are merely examples and are not particularly limited. That is, it is sufficient if the information processing system is provided with a function that can execute the above-described series of processes as a whole, and the type of functional block used to realize this function is not limited to the examples in Figures 3, 9, etc. Furthermore, the location of the functional block is not limited to the examples in Figures 3, 9, etc., and may be arbitrary. Furthermore, one functional block may be configured by hardware alone, by software alone, or by a combination of these.

[0097] Furthermore, the number of various types of hardware or users that make up this system is arbitrary, and this system may be configured arbitrarily to include other hardware, etc.

[0098] Furthermore, when a series of processes is executed by software, the program that constitutes the software may be installed into a computer or the like from a network or a recording medium.

[0099] Furthermore, the various hardware in the above-described embodiments may be freely adopted as any computer, any mobile terminal such as a smartphone, any game console, etc. Furthermore, any combination of types and contents of various input units and various output units may be adopted.

[0100] The computer in the above-described embodiment may be a computer incorporated in dedicated hardware, or may be a computer capable of executing various functions by installing various programs.

[0101] Furthermore, the recording medium containing such a program may not only be constituted by a removable medium (not shown) that is provided separately from the device main body in order to provide the program to the user, etc., but may also be constituted by a recording medium that is provided to the user in a state that it is pre-installed in the device main body.

[0102] In this specification, the steps of writing the program to be recorded on the recording medium may be executed in a time-series manner, or may be executed in parallel or individually. Also, some of the steps described in the above embodiments may be omitted.

[0103] In addition, in this specification, the term "system" refers to an overall device that is made up of a plurality of devices, a plurality of means, etc.

[0104] The effects of this embodiment can be achieved even when these other embodiments are adopted. Furthermore, this embodiment can be combined with other embodiments, and other embodiments can be combined with each other as appropriate.

[0105] To sum up, the information processing system to which the present invention is applied can take various forms having the following configurations. That is, the program to which the present invention is applied is a first information processing terminal used by a first user who plays a game; a second information processing terminal used by a second user who watches the game broadcast; An information processing device constituting an information processing system including: a first camera control means (for example, a first camera control means 180) that controls a first virtual camera arranged in a virtual space of the game in response to an input operation by the first user; a second camera control means (for example, second camera control means 181) that controls a second virtual camera that operates in accordance with the operation of the first virtual camera; an image presentation means (e.g., image management means 183) that presents a first image generated by the first virtual camera to the first user and a second image generated by the second virtual camera to the second user; Any program that functions as such is sufficient.

[0106] That is, the camera control means 61 functions as a camera control means. The distributor image generating means 63 functions as an image generating means. The image and audio editing means 150 functions as an image and audio editing means. The presented image management means 153 functions as an image display means. The first camera control means 180 functions as the first camera control means. The second camera control means 181 functions as a second camera control means. The third camera control means 182 functions as a third camera control means. The movement restriction means 190 functions as a movement restriction means. The image management means 183 functions as an image presentation means.

[0107] <Effects> This allows viewers to enjoy game broadcasts and the like more comfortably. [Explanation of symbols]

[0108] First Embodiment 1. Streamer terminal 11 Control section 60 Game processing execution means 61 Camera control means 62 Camera information management means 63 Image generation means for distributors 64 Output control means 2 (2-1 to 2-n) Viewer terminal 80 Control Unit 100 Image information management means 101 Output control means 3 Server 120 control section 140 Means of obtaining distributor information 141 Condition determination means 142 Viewer image generation means 143 Presentation image management means 150 Image and audio editing means Second Embodiment 1. Streamer terminal 60 Game processing execution means 180 first camera control means 181 second camera control means 182 third camera control means 183 Image Management Tools 190 Operational Restriction Means 200 Image generation means for distributors 201 Viewer image generation means 2 (2-1 to 2-m) Viewer terminal 80 Control Unit 230 Second viewer image information acquisition means 101 Output control means

Claims

1. a first information processing terminal used by a first user who plays a game; a second information processing terminal used by a second user who watches the game broadcast; An information processing device constituting an information processing system including: a first camera control means for controlling a first virtual camera disposed in a virtual space of the game in response to an input operation by the first user; a second camera control means for controlling an operating second virtual camera in response to an operation of the first virtual camera; an image presenting means for presenting a first image generated by the first virtual camera to the first user and a second image generated by the second virtual camera to the second user; an operation limiting means for determining whether or not an operation of the first virtual camera satisfies a condition related to at least one of a movement amount, an angle, and a speed of the first virtual camera, and for limiting the operation of the second virtual camera when the condition is satisfied; a third camera control means for controlling a third virtual camera that is not linked with the operations of the first virtual camera and the second virtual camera; It functions as the image presenting means presents a third image generated by the third virtual camera to the second user when the operation restricting means determines that the condition is satisfied. program.

2. The second camera control means further functions as a stimulus reduction means that executes a process for reducing screen sickness of the second user who is presented with the second image. The program according to claim 1.

3. the stimulus reduction means executes a process of reducing vertical shaking of the second virtual camera. The program according to claim 2.

4. A first information processing terminal used by a first user who plays a game; a second information processing terminal used by a second user who watches the game broadcast; An information processing method executed by an information processing device constituting an information processing system including: a first camera control step of controlling a first virtual camera arranged in a virtual space of the game in response to an input operation of the first user; a second camera control step of controlling an operating second virtual camera in response to the operation of the first virtual camera; an image presenting step of presenting a first image generated by the first virtual camera to the first user and presenting a second image generated by the second virtual camera to the second user; an operation limiting step of determining whether or not an operation of the first virtual camera satisfies a condition related to at least one of a movement amount, an angle, and a speed of the first virtual camera, and limiting the operation of the second virtual camera when the condition is satisfied; a third camera control step of controlling a third virtual camera that is not linked with the operations of the first virtual camera and the second virtual camera; Including, the image presenting step presents a third image generated by the third virtual camera to the second user when it is determined that the condition is satisfied in the action restricting step; Information processing methods.

5. a first information processing terminal used by a first user who plays a game; a second information processing terminal used by a second user who watches the game broadcast; An information processing system comprising: a first camera control means for controlling a first virtual camera disposed in a virtual space of the game in response to an input operation by the first user; a second camera control means for controlling an operating second virtual camera in response to an operation of the first virtual camera; an image presenting means for presenting a first image generated by the first virtual camera to the first user and a second image generated by the second virtual camera to the second user; an operation limiting means for determining whether or not an operation of the first virtual camera satisfies a condition related to at least one of a movement amount, an angle, and a speed of the first virtual camera, and for limiting the operation of the second virtual camera when the condition is satisfied; a third camera control means for controlling a third virtual camera that is not linked with the operations of the first virtual camera and the second virtual camera; Equipped with the image presenting means presents a third image generated by the third virtual camera to the second user when the operation restricting means determines that the condition is satisfied. Information processing system.

Images