Stop control device, stop control method and program

Abstract

Provided are a stop control device, a stop control method, and a program capable of reducing the disadvantages that a user suffers due to temporary deterioration of a communication situation. A server-side monitoring unit (26) monitors a communication situation between a cloud server (10) that executes a game process in a streaming game, and a terminal (12) that displays a moving image showing a playing situation in a streaming game generated by the execution of the game process. A server-side game process control unit (28) controls whether or not to stop the game process being executed by the cloud server (10) depending on the communication situation.

Description

[Technical field]

[0001] The present invention relates to a stop control device, a stop control method, and a program. [Background technology]

[0002] In a technology of cloud gaming services that has been attracting attention in recent years, operation data corresponding to input operations by a user to a terminal is wirelessly transmitted from the terminal to a cloud server. The cloud server then executes game processing corresponding to the operation data, and generates a frame image representing the game play status based on the result of the game processing. Image data encoding the frame image is then wirelessly transmitted from the cloud server to the terminal, and the frame image obtained by decoding the image data is displayed on the terminal. This series of processes is repeatedly executed, and a moving image representing the game play status is displayed on the terminal. Summary of the Invention [Problem to be solved by the invention]

[0003] When communication conditions become poor in streaming game services such as cloud gaming services, game play may be hindered, such as input operations not being reflected in the game play status, frame images displayed on the terminal not being updated, etc. This is particularly likely to occur in streaming game services provided via mobile communication systems such as the fourth generation mobile communication system (4G) and the fifth generation mobile communication system (5G).

[0004] Sometimes the communication conditions would later recover, but in this case, game processing would have progressed while the communication conditions were temporarily degraded, causing users playing the game to suffer disadvantages, such as the game already being over.

[0005] This also generally applies to streaming games other than cloud gaming services.

[0006] The present invention has been made in consideration of the above-mentioned situation, and one of its objectives is to provide a stop control device, a stop control method, and a program that can reduce the disadvantage suffered by users due to a temporary deterioration in communication conditions. [Means for solving the problem]

[0007] In order to solve the above problem, the stop control device of the present invention includes a monitoring unit that monitors the communication status between a server that executes game processing in a streaming game and a terminal that displays a moving image showing the play status of the streaming game generated by executing the game processing, and a game processing control unit that controls whether or not to stop the game processing being executed on the server depending on the communication status.

[0008] In one aspect of the present invention, when the terminal continues to fail to receive image data relating to the moving image for a predetermined period of time, the game processing control unit stops the game processing.

[0009] In addition, in one aspect of the present invention, when the server continues to fail to receive operation data related to the streaming game for a predetermined period of time, the game processing control unit stops the game processing.

[0010] In one aspect of the present invention, the game processing control unit resumes the stopped game processing in response to recovery of the communication situation when the game processing is stopped.

[0011] In this aspect, the game processing control unit may resume the game processing from a playing situation specified by a user playing the streaming game, in response to an operation on the terminal of the user.

[0012] The game processing control unit may also perform control so that data indicating a play situation at which the game processing is to be resumed is transmitted from the terminal to the server.

[0013] In addition, the stop control method of the present invention includes a step of monitoring a communication status between a server that executes game processing in a streaming game and a terminal that displays a moving image showing the play status of the streaming game generated by executing the game processing, and a step of controlling whether or not to stop the game processing being executed on the server depending on the communication status.

[0014] In addition, the program of the present invention causes a computer to execute the following steps: monitoring the communication status between a server that executes game processing in a streaming game and a terminal that displays a moving image showing the play status of the streaming game generated by executing the game processing; and controlling whether or not to stop the game processing being executed on the server depending on the communication status. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a diagram illustrating an example of the overall configuration of a cloud gaming system according to one embodiment of the present invention. [Diagram 2] A functional block diagram showing an example of functions implemented in a cloud gaming system according to one embodiment of the present invention. [Diagram 3] FIG. 4 is a flow chart showing an example of a flow of processing performed in a terminal according to an embodiment of the present invention. [Figure 4] FIG. 4 is a flow diagram showing an example of a flow of processing performed in a cloud server according to an embodiment of the present invention. [Diagram 5] FIG. 4 is a flow diagram showing an example of a flow of a process performed in a cloud server according to an embodiment of the present invention. [Figure 6] FIG. 4 is a flow chart showing an example of a flow of processing performed in a terminal according to an embodiment of the present invention. [Figure 7] FIG. 4 is a flow chart showing an example of a flow of processing performed in a terminal according to an embodiment of the present invention. [Figure 8]FIG. 4 is a flow diagram showing an example of a flow of a process performed in a cloud server according to an embodiment of the present invention. [Figure 9] FIG. 4 is a flow diagram showing an example of a flow of a process performed in a cloud server according to an embodiment of the present invention. [Figure 10] FIG. 4 is a flow chart showing an example of a flow of processing performed in a terminal according to an embodiment of the present invention. [Figure 11] FIG. 13 is a diagram showing an example of an image during a stoppage. [Figure 12] FIG. 13 is a diagram showing an example of a resumption image. [Figure 13] FIG. 13 is a diagram showing an example of a resumption image. [Figure 14] FIG. 13 is a diagram showing an example of a restart instruction image. [Figure 15] FIG. 13 is a diagram showing an example of a resumption image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0017] Fig. 1 is a diagram showing an example of the overall configuration of a cloud gaming system 1 according to an embodiment of the present invention. As shown in Fig. 1, the cloud gaming system 1 according to this embodiment includes a cloud server 10 and a terminal 12, both of which are configured mainly with a computer.

[0018] The cloud server 10 and the terminal 12 are connected to a computer network 14 including a mobile communication system such as a fourth generation mobile communication system (4G) or a fifth generation mobile communication system (5G) and the Internet. For example, the cloud server 10 is connected to the Internet, and the terminal 12 is connected to a mobile communication system such as 4G or 5G. The cloud server 10 and the terminal 12 are capable of communicating with each other via the computer network 14.

[0019] The cloud server 10 according to the present embodiment is, for example, a server computer that executes a game process in a streaming game by executing a program of the streaming game.

[0020] As shown in FIG. 1, the cloud server 10 includes, for example, a processor 10a, a storage unit 10b, and a communication unit 10c.

[0021] The processor 10a is a program-controlled device such as a CPU, and executes various types of information processing according to programs stored in the storage unit 10b.

[0022] The storage unit 10b is, for example, a storage element such as a ROM or a RAM, a solid-state drive (SSD), etc. The storage unit 10b stores programs executed by the processor 10a, etc.

[0023] The communication unit 10c is a communication interface for transmitting and receiving data to and from a computer such as the terminal 12 via the computer network 14, for example.

[0024] As shown in FIG. 1, the terminal 12 includes, for example, a processor 12a, a storage unit 12b, a communication unit 12c, a display unit 12d, an operation unit 12e, a sensor unit 12f, and an audio output unit 12g.

[0025] The processor 12a is a program-controlled device such as a CPU, and executes various types of information processing according to programs stored in the storage unit 12b.

[0026] The storage unit 12b is, for example, a storage element such as a ROM or a RAM, a solid-state drive (SSD), etc. The storage unit 12b stores programs executed by the processor 12a, etc.

[0027] The communication unit 12c is a communication interface for transmitting and receiving data to and from a computer such as the cloud server 10 via the computer network 14, for example.

[0028] The display unit 12d is a display device such as a liquid crystal display or an organic EL display.

[0029] The operation unit 12e is, for example, an operation member for performing an operation input to the processor 12a.

[0030] The sensor unit 12f is a sensor such as a motion sensor capable of detecting, for example, acceleration and angular velocity.

[0031] The audio output unit 12g is an audio output device such as a speaker that outputs the sound represented by the audio data.

[0032] The terminal 12 may include a touch panel. In this case, the touch panel serves as both the display unit 12d and the operation unit 12e.

[0033] In this embodiment, when a user performs an input operation on the operation unit 12e while playing a streaming game, the terminal 12 generates operation data corresponding to the input operation and transmits the operation data to the cloud server 10.

[0034] The cloud server 10 then executes game processing for the game in accordance with the received operation data. The cloud server 10 then generates a play image, which is a frame image representing the game play situation, based on the result of the game processing. The cloud server 10 then encodes the generated play image to generate image data representing the play image. The cloud server 10 then transmits the generated image data to the terminal 12.

[0035] Then, the terminal 12 decodes the image data received from the cloud server 10, and displays a play image generated by the decoding on the display unit 12d. In this manner, a moving image showing the play status of the game, which is generated by executing the game processing in the streaming game, is displayed on the terminal 12.

[0036] In this manner, the cloud server 10 according to the present embodiment delivers, by streaming, moving images generated in accordance with the game play status to the terminal 12 used by the user who is playing the game.

[0037] In this embodiment, for example, the reception of the image data is monitored in terminal 12. Then, when the state in which terminal 12 fails to receive the image data continues for a predetermined time (for example, Xa seconds), terminal 12 transmits a stop request signal to cloud server 10. Then, in response to receiving the stop request signal, cloud server 10 stops the game processing.

[0038] In this embodiment, for example, reception of the above-mentioned operation data is monitored in the cloud server 10. Then, when the state in which the cloud server 10 fails to receive the above-mentioned operation data continues for a predetermined time (for example, Ya seconds), the cloud server 10 stops the game processing and transmits a game stop notification to the terminal 12.

[0039] When the game processing is stopped in the above manner, a downlink communication quality confirmation signal (hereinafter referred to as a DL communication quality confirmation signal) is transmitted at predetermined time intervals from the cloud server 10 to the terminal 12. Also, an uplink communication quality confirmation signal (hereinafter referred to as a UL communication quality confirmation signal) is transmitted at predetermined time intervals from the terminal 12 to the cloud server 10.

[0040] Then, when it is confirmed that the cloud server 10 has been able to stably receive the UL communication quality confirmation signal, the cloud server 10 transmits to the terminal 12 an uplink communication quality OK notification (hereinafter, referred to as a UL communication quality OK notification).

[0041] Then, when it is confirmed that the DL communication quality confirmation signal has been stably received at the terminal 12 and the terminal 12 receives a UL communication quality OK notification, the terminal 12 transmits a game resume notification to the cloud server 10.

[0042] Then, in response to receiving the game restart notification, the cloud server 10 restarts the game processing.

[0043] In this embodiment, the game processing may be stopped or resumed by executing a game program. For example, the game processing may be stopped or resumed by executing a pause process or an unpause process in the game program.

[0044] Furthermore, the game processing may be stopped or resumed by executing a system program such as an operating system. For example, the game processing may be stopped or resumed by executing a suspend process or a resume process in the system program.

[0045] When communication conditions become poor in a streaming game, problems may occur in playing the game, such as input operations not being reflected in the game play status, frame images displayed on the terminal 12 not being updated, etc. This is particularly likely to occur in streaming game services provided via mobile communication systems such as 4G and 5G.

[0046] Sometimes the communication conditions would later recover, but in this case, game processing would have progressed while the communication conditions were temporarily degraded, causing users playing the game to suffer disadvantages, such as the game already being over.

[0047] In this embodiment, as described above, whether or not to stop the game process being executed on the cloud server 10 is controlled depending on the communication situation. As a result, according to this embodiment, it is possible to reduce the disadvantage suffered by the user due to a temporary deterioration in the communication situation.

[0048] The functions implemented in the cloud gaming system 1 according to this embodiment and the processes executed in the cloud gaming system 1 will be further described below.

[0049] Fig. 2 is a functional block diagram showing an example of functions implemented in the cloud gaming system 1 according to this embodiment. Note that it is not necessary for all of the functions shown in Fig. 2 to be implemented in the cloud gaming system 1 according to this embodiment, and functions other than the functions shown in Fig. 2 may also be implemented.

[0050] As shown in FIG. 2, the cloud server 10 of this embodiment functionally includes, for example, an operation data receiving unit 20, a game processing execution unit 22, an image data transmission unit 24, a server-side monitoring unit 26, a server-side game processing control unit 28, a server-side signal transmission unit 30, and a server-side signal receiving unit 32.

[0051] The operation data receiving unit 20, the image data transmitting unit 24, the server-side signal transmitting unit 30, and the server-side signal receiving unit 32 are implemented mainly in the communication unit 10c. The game processing executing unit 22, the server-side monitoring unit 26, and the server-side game processing control unit 28 are implemented mainly in the processor 10a.

[0052] The above functions may be implemented by executing a program including instructions corresponding to the above functions, which is installed in the cloud server 10, which is a computer, on the processor 10a. This program may be supplied to the cloud server 10 via a computer-readable information storage medium, such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, or a flash memory, or via the Internet, for example.

[0053] As shown in FIG. 2, the terminal 12 according to this embodiment functionally includes, for example, an operation data generation unit 40, an operation data transmission unit 42, an image data receiving unit 44, a display control unit 46, a terminal side monitoring unit 48, a terminal side game processing control unit 50, a terminal side signal transmission unit 52, and a terminal side signal receiving unit 54.

[0054] The operation data generating unit 40 is mainly implemented by the processor 12a and the operation unit 12e. The operation data transmitting unit 42, the image data receiving unit 44, the terminal side signal transmitting unit 52, and the terminal side signal receiving unit 54 are mainly implemented by the communication unit 12c. The display control unit 46 and the terminal side game processing control unit 50 are mainly implemented by the processor 12a and the display unit 12d. The terminal side monitoring unit 48 is mainly implemented by the processor 12a.

[0055] The above functions may be implemented by executing a program including instructions corresponding to the above functions on the processor 12a, which is installed in the terminal 12, which is a computer. This program may be supplied to the terminal 12 via a computer-readable information storage medium, such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, or a flash memory, or via the Internet, for example.

[0056] In this embodiment, for example, the operation data receiving unit 20 receives operation data corresponding to an input operation by a user. For example, the operation data receiving unit 20 receives operation data related to a streaming game corresponding to an input operation during play of the streaming game.

[0057] In this embodiment, for example, the game processing execution unit 22 executes game processing in a streaming game in accordance with the operation data received by the operation data receiving unit 20. The processing executed by the game processing execution unit 22 includes, for example, processing such as generating a play image representing the play status of the streaming game, and generating image data representing the play image.

[0058] In this embodiment, the image data transmission unit 24 transmits, for example, image data generated by the game processing execution unit 22 to the terminal 12.

[0059] In this embodiment, the server-side monitoring unit 26 monitors, for example, the communication status between the cloud server 10 and the terminal 12. The server-side monitoring unit 26 monitors, for example, the reception of operation data, a stop request signal, a UL communication quality confirmation signal, and a game restart notification. The server-side monitoring unit 26 may also monitor the throughput of the cloud server 10.

[0060] In this embodiment, the server-side game processing control unit 28 controls whether or not to stop the game processing being executed by the cloud server 10, depending on, for example, the communication status monitored by the server-side monitoring unit 26. For example, the server-side game processing control unit 28 stops the game processing when the state in which the terminal 12 fails to receive image data continues for a predetermined time. Also, for example, the server-side game processing control unit 28 stops the game processing when the state in which the cloud server 10 fails to receive operation data related to a streaming game continues for a predetermined time.

[0061] In addition, in this embodiment, for example, the server-side game processing control unit 28 resumes the stopped game processing in response to recovery of the communication conditions when the game processing being executed on the cloud server 10 is stopped.

[0062] In this embodiment, the server-side signal transmitting unit 30 transmits to the terminal 12, for example, a game stop notification, a DL communication quality confirmation signal, a UL communication quality OK notification, and a game resume notification.

[0063] In this embodiment, the server-side signal receiving unit 32 receives, for example, a stop request signal, a UL communication quality confirmation signal, and a game restart notification from the terminal 12.

[0064] In this embodiment, the operation data generating unit 40 generates the above-mentioned operation data in response to an input operation by a user, for example.

[0065] In this embodiment, the operation data transmission unit 42 transmits, for example, the operation data generated by the operation data generation unit 40 to the cloud server 10.

[0066] In this embodiment, the image data receiving unit 44 receives image data related to a moving image showing a play situation in a streaming game, for example. The image data receiving unit 44 receives image data transmitted from the cloud server 10, for example.

[0067] In this embodiment, for example, the display control unit 46 decodes the image data received by the image data receiving unit 44 to generate a play image, which is a frame image represented by the image data, and displays the generated play image on the display unit 12d.

[0068] In this embodiment, the terminal side monitoring unit 48 monitors, for example, the communication status between the cloud server 10 and the terminal 12. The terminal side monitoring unit 48 monitors, for example, the reception of image data, a game stop notification, a DL communication quality confirmation signal, a UL communication quality OK notification, and a game resume notification. The terminal side monitoring unit 48 may also monitor the throughput of the terminal 12.

[0069] In this embodiment, for example, the terminal-side game processing control unit 50 controls whether or not to stop the game processing being executed on the cloud server 10, depending on the communication status monitored by the terminal-side monitoring unit 48. For example, the terminal-side game processing control unit 50 stops the game processing when the state in which the terminal 12 fails to receive image data continues for a predetermined time. Also, for example, the terminal-side game processing control unit 50 stops the game processing when the state in which the cloud server 10 fails to receive operation data related to a streaming game continues for a predetermined time.

[0070] In addition, in this embodiment, for example, the terminal side game processing control unit 50 resumes the stopped game processing in response to recovery of the communication conditions when the game processing being executed on the cloud server 10 is stopped.

[0071] In this embodiment, the terminal-side signal transmitting unit 52 transmits to the cloud server 10, for example, a stop request signal, a UL communication quality confirmation signal, and a game restart notification.

[0072] In this embodiment, the terminal-side signal receiving unit 54 receives, for example, a game stop notification, a DL communication quality confirmation signal, a UL communication quality OK notification, and a game resume notification from the cloud server 10.

[0073] Below, we will explain some examples of processing executed by the cloud server 10 and the terminal 12. In each of the processing examples explained below, it is assumed that operation data is transmitted from the terminal 12 to the cloud server 10 at intervals of 4.16 milliseconds, and image data is transmitted from the cloud server 10 to the terminal 12 at intervals of 16.6 milliseconds.

[0074] First, an example of the flow of processing executed by terminal 12 when a state in which terminal 12 has failed to receive image data continues for a predetermined period of time (e.g., Xa seconds) will be described with reference to the flow diagram shown in FIG. 3.

[0075] In this processing example, the terminal side monitoring unit 48 monitors the reception of image data by the image data receiving unit 44 (S101).

[0076] Then, when the terminal-side monitoring unit 48 detects that the image data receiving unit 44 has not received image data for Xa seconds or more, the terminal-side game processing control unit 50 controls the terminal-side signal transmitting unit 52 to transmit a stop request signal to the cloud server 10. As a result, the terminal-side signal transmitting unit 52 transmits the stop request signal to the cloud server 10 (S102).

[0077] Then, the terminal-side game processing control unit 50 controls the operation data transmission unit 42 to stop transmitting the operation data, which causes the operation data transmission unit 42 to stop transmitting the operation data (S103).

[0078] In addition, in the process shown in S103, the terminal-side game processing control unit 50 may control the operation data generating unit 40 to stop generating the operation data. Then, as a result, the operation data generating unit 40 may stop generating the operation data.

[0079] Then, the terminal-side game processing control unit 50 controls the terminal-side signal transmitting unit 52 to start transmitting a UL communication quality confirmation signal. As a result, the terminal-side signal transmitting unit 52 starts transmitting a UL communication quality confirmation signal to the cloud server 10 at a predetermined time interval (S104). Here, for example, the UL communication quality confirmation signal may be transmitted at the same time interval as the transmission interval of the operation data (for example, 4.16 millisecond intervals).

[0080] Then, the terminal side monitoring unit 48 monitors the reception of the DL communication quality confirmation signal by the terminal side signal receiving unit 54 (S105).

[0081] Here, it is assumed that the terminal-side monitoring unit 48 has determined that the terminal-side signal receiving unit 54 has stably received the DL communication quality confirmation signal transmitted from the cloud server 10 for a predetermined time (for example, Xb seconds) or more. In this case, the terminal-side monitoring unit 48 monitors the reception of a UL communication quality OK notification by the terminal-side signal receiving unit 54 (S106).

[0082] In the process shown in S106, for example, when the terminal-side signal receiving unit 54 receives the DL communication quality confirmation signal continuously for a predetermined time or more at an interval within a predetermined time, it may be determined that the DL communication quality confirmation signal has been stably received for a predetermined time or more. For example, when the DL communication quality confirmation signal is successfully received continuously for 100 milliseconds or more at an interval within 33.2 milliseconds, it may be determined that the DL communication quality confirmation signal has been stably received for a predetermined time or more.

[0083] If it is not confirmed that the terminal side signal receiving unit 54 receives the UL communication quality OK notification within a predetermined time (for example, Xc seconds) from the timing when the process shown in S106 is started, the process returns to the process shown in S105.

[0084] Assume that it is confirmed that the terminal-side signal receiving unit 54 has received the UL communication quality OK notification within a predetermined time (e.g., Xc seconds) from the timing when the process shown in S106 is started. In this case, the terminal-side game processing control unit 50 controls the terminal-side signal transmitting unit 52 to stop transmitting the UL communication quality confirmation signal. As a result, the terminal-side signal transmitting unit 52 stops transmitting the UL communication quality confirmation signal (S107).

[0085] Then, the terminal-side game processing control unit 50 controls the terminal-side signal transmitting unit 52 to transmit a game resume notification, so that the terminal-side signal transmitting unit 52 transmits the game resume notification to the cloud server 10 (S108).

[0086] Then, the terminal-side game processing control unit 50 controls the operation data transmission unit 42 to resume transmission of the operation data. As a result, the operation data transmission unit 42 resumes transmission of the operation data (S109). Then, the process returns to the process shown in S101.

[0087] In addition, in the process shown in S109, the terminal-side game processing control unit 50 may control the operation data generating unit 40 to resume the generation of the operation data. Then, as a result, the operation data generating unit 40 may resume the generation of the operation data.

[0088] Moreover, the processes shown in S103 and S109 do not have to be executed.

[0089] Next, an example of the flow of the process executed by the cloud server 10, triggered by the reception of the stop request signal transmitted in the process shown in S102 described above, will be described with reference to the flow diagram shown in FIG.

[0090] In this processing example, the server-side monitoring unit 26 monitors the reception of a stop request signal by the server-side signal receiving unit 32 (S201).

[0091] Then, when the server-side monitoring unit 26 detects that the server-side signal receiving unit 32 has received the stop request signal, the server-side game processing control unit 28 causes the game processing executing unit 22 to stop the game processing. As a result, the game processing executing unit 22 stops the game processing (S202).

[0092] Then, the server-side game processing control unit 28 controls the server-side signal transmitting unit 30 to start transmitting a DL communication quality confirmation signal. As a result, the server-side signal transmitting unit 30 starts transmitting a DL communication quality confirmation signal to the terminal 12 at a predetermined time interval (S203). Here, for example, the DL communication quality confirmation signal may be transmitted at the same time interval as the transmission interval of the image data (for example, 16.6 millisecond intervals).

[0093] Then, the server side monitoring unit 26 monitors the reception of the UL communication quality confirmation signal by the server side signal receiving unit 32 (S204).

[0094] Here, it is assumed that the server-side monitoring unit 26 has determined that the server-side signal receiving unit 32 has stably received the UL communication quality confirmation signal transmitted from the terminal 12 for a predetermined time (e.g., Yb seconds) or more. In this case, the server-side game processing control unit 28 controls the server-side signal transmitting unit 30 to transmit a UL communication quality OK signal. As a result, the server-side signal transmitting unit 30 transmits the UL communication quality OK signal to the terminal 12 (S205).

[0095] In the process shown in S205, for example, when the server-side signal receiving unit 32 receives the UL communication quality confirmation signal continuously for a predetermined time or more at an interval within a predetermined time, it may be determined that the UL communication quality confirmation signal has been stably received for a predetermined time or more. For example, when the DL communication quality confirmation signal is successfully received continuously for 100 milliseconds or more at an interval within 33.2 milliseconds, it may be determined that the UL communication quality confirmation signal has been stably received for a predetermined time or more.

[0096] Then, the server-side monitoring unit 26 monitors whether the server-side signal receiving unit 32 has received a game restart notification (S206).

[0097] Furthermore, the server side monitoring unit 26 monitors whether or not a predetermined time (for example, Yc seconds) has elapsed since starting transmission of the UL communication quality OK signal (S207).

[0098] In this processing example, while reception of the game restart notification is not confirmed, the processing shown in S205 is repeatedly executed until Yc seconds have elapsed since the start of transmission of the UL communication quality OK signal.

[0099] If Yc seconds have elapsed since the start of transmission of the UL communication quality OK signal without confirming receipt of the game restart notification, the process returns to S204.

[0100] When the reception of the game restart notification is confirmed in the process shown in S206, the server-side game processing control unit 28 controls the server-side signal transmitting unit 30 to stop the transmission of the DL communication quality confirmation signal, which causes the server-side signal transmitting unit 30 to stop the transmission of the DL communication quality confirmation signal (S208).

[0101] Then, the server-side game processing control unit 28 controls the game processing execution unit 22 to resume the game processing. (S209). Then, the process returns to S201.

[0102] In the above-mentioned processing example, the processing shown in S205 does not have to be repeatedly executed. For example, if the reception of the game restart notification is not confirmed within Yc seconds from the start of the execution of the processing shown in S206, the processing may be returned to the processing shown in S204.

[0103] Next, an example of the flow of processing executed by the cloud server 10 when the cloud server 10 continues to fail to receive the above-mentioned operation data for a predetermined period of time (e.g., Ya seconds) will be described with reference to the flow diagram shown in FIG.

[0104] In this processing example, the server side monitoring unit 26 monitors the reception of operation data by the operation data receiving unit 20 (S301).

[0105] Then, when the server-side monitoring unit 26 detects that the operation data receiving unit 20 has not received operation data for Ya seconds or more, the server-side game processing control unit 28 causes the game processing executing unit 22 to stop the game processing. As a result, the game processing executing unit 22 stops the game processing (S302).

[0106] Then, the server-side game processing control unit 28 controls the server-side signal transmitting unit 30 to transmit a game stop notification, so that the server-side signal transmitting unit 30 transmits the game stop notification to the terminal 12 (S303).

[0107] Thereafter, the cloud server 10 executes the same processes as those shown in S203 to S209 described above (S304 to S310). The processes shown in S304 to S310 are the same as those shown in S203 to S209, and therefore their explanation will be omitted. When the process shown in S310 ends, the process returns to the process shown in S301.

[0108] Next, an example of the flow of the process executed by the terminal 12, triggered by the reception of the game stop notification transmitted in the process shown in S303 described above, will be described with reference to the flow diagram shown in FIG.

[0109] In this processing example, the terminal side monitoring unit 48 monitors the reception of a game stop notification by the terminal side signal receiving unit 54 (S401).

[0110] Then, when the terminal-side monitoring unit 48 detects that the terminal-side signal receiving unit 54 has received the game stop notification, the terminal-side game processing control unit 50 controls the operation data transmitting unit 42 to stop transmitting the operation data, which causes the operation data transmitting unit 42 to stop transmitting the operation data (S402).

[0111] In addition, in the process shown in S402, the terminal-side game processing control unit 50 may control the operation data generating unit 40 to stop generating the operation data. Then, as a result, the operation data generating unit 40 may stop generating the operation data.

[0112] Thereafter, the cloud server 10 executes the same processes as those shown in S104 to S109 described above (S403 to S408). The processes shown in S403 to S408 are the same as those shown in S104 to S109, and therefore will not be described. When the process shown in S408 ends, the process returns to the process shown in S401.

[0113] It should be noted that the processes shown in S402 and S408 do not necessarily have to be executed.

[0114] In this embodiment, the process triggered by failure to receive image data shown in Figures 3 and 4 and the process triggered by failure to receive operation data shown in Figures 5 and 6 may be executed simultaneously, or one of them may be executed.

[0115] In this embodiment, only the communication status from the cloud server 10 to the terminal 12 may be taken into consideration. In this case, an example of the flow of processing executed by the terminal 12 when the state in which the terminal 12 fails to receive the above-mentioned image data continues for a predetermined time (for example, Xa seconds) will be described with reference to the flow diagram shown in FIG.

[0116] In this processing example, the terminal side monitoring unit 48 also monitors the reception of image data by the image data receiving unit 44 (S501).

[0117] Then, when the terminal-side monitoring unit 48 detects that the image data receiving unit 44 has not received image data for Xa seconds or more, the terminal-side game processing control unit 50 controls the terminal-side signal transmitting unit 52 to transmit a stop request signal to the cloud server 10. As a result, the terminal-side signal transmitting unit 52 transmits the stop request signal to the cloud server 10 (S502).

[0118] Then, the terminal-side game processing control unit 50 controls the operation data transmission unit 42 to stop transmitting the operation data, which causes the operation data transmission unit 42 to stop transmitting the operation data (S503).

[0119] In addition, in the process shown in S503, the terminal-side game processing control unit 50 may control the operation data generating unit 40 to stop generating the operation data. Then, by this, the operation data generating unit 40 may stop generating the operation data.

[0120] Then, the terminal side monitoring unit 48 monitors the reception of the DL communication quality confirmation signal by the terminal side signal receiving unit 54 (S504).

[0121] Here, it is assumed that the terminal-side monitoring unit 48 has determined that the terminal-side signal receiving unit 54 has stably received the DL communication quality confirmation signal transmitted from the cloud server 10 for a predetermined time (e.g., Xb seconds) or more. In this case, the terminal-side game processing control unit 50 controls the terminal-side signal transmitting unit 52 to transmit a game resume notification. As a result, the terminal-side signal transmitting unit 52 transmits the game resume notification to the cloud server 10 (S505).

[0122] Then, the terminal-side game processing control unit 50 controls the operation data transmission unit 42 to resume transmission of the operation data. As a result, the operation data transmission unit 42 resumes transmission of the operation data (S506). Then, the process returns to S501.

[0123] In addition, in the process shown in S506, the terminal-side game processing control unit 50 may control the operation data generating unit 40 to resume the generation of the operation data. Then, as a result, the operation data generating unit 40 may resume the generation of the operation data.

[0124] Next, an example of the flow of the process executed by the cloud server 10, triggered by the reception of the stop request signal transmitted in the process shown in S502 described above, will be described with reference to the flow diagram shown in FIG.

[0125] In this processing example, the server-side monitoring unit 26 also monitors the reception of a stop request signal by the server-side signal receiving unit 32 (S601).

[0126] Then, when the server-side monitoring unit 26 detects that the server-side signal receiving unit 32 has received the stop request signal, the server-side game processing control unit 28 causes the game processing executing unit 22 to stop the game processing. As a result, the game processing executing unit 22 stops the game processing (S602).

[0127] Then, the server-side game processing control unit 28 controls the server-side signal transmitting unit 30 to start transmitting a DL communication quality confirmation signal. As a result, the server-side signal transmitting unit 30 starts transmitting a DL communication quality confirmation signal to the terminal 12 at a predetermined time interval (S603). Here, for example, the DL communication quality confirmation signal may be transmitted at the same time interval as the transmission interval of the image data (for example, 16.6 millisecond intervals).

[0128] Then, the server-side monitoring unit 26 monitors whether the server-side signal receiving unit 32 has received a game restart notification (S604).

[0129] When the reception of the game restart notification is confirmed in the process shown in S604, the server-side game processing control unit 28 controls the server-side signal transmitting unit 30 to stop the transmission of the DL communication quality confirmation signal, which causes the server-side signal transmitting unit 30 to stop the transmission of the DL communication quality confirmation signal (S605).

[0130] Then, the server-side game processing control unit 28 controls the game processing execution unit 22 to resume the game processing. (S606). Then, the process returns to S601.

[0131] In this embodiment, only the communication status from the terminal 12 to the cloud server 10 may be taken into consideration. In this case, an example of the flow of processing executed by the cloud server 10 when a state in which the cloud server 10 fails to receive the above-mentioned operation data continues for a predetermined time (e.g., Ya seconds) will be described with reference to the flow diagram shown in FIG.

[0132] In this processing example, the server side monitoring unit 26 also monitors the reception of operation data by the operation data receiving unit 20 (S701).

[0133] Then, when the server-side monitoring unit 26 detects that the operation data receiving unit 20 has not received operation data for Ya seconds or more, the server-side game processing control unit 28 causes the game processing executing unit 22 to stop the game processing. As a result, the game processing executing unit 22 stops the game processing (S702).

[0134] Then, the server-side game processing control unit 28 controls the server-side signal transmitting unit 30 to transmit a game stop notification, so that the server-side signal transmitting unit 30 transmits the game stop notification to the terminal 12 (S703).

[0135] Then, the server side monitoring unit 26 monitors the reception of the UL communication quality confirmation signal by the server side signal receiving unit 32 (S704).

[0136] Here, it is assumed that the server-side monitoring unit 26 has determined that the server-side signal receiving unit 32 has stably received the UL communication quality confirmation signal transmitted from the terminal 12 for a predetermined time (e.g., Yb seconds) or more. In this case, the server-side game processing control unit 28 controls the server-side signal transmitting unit 30 to transmit a game resume notification. As a result, the server-side signal transmitting unit 30 transmits the game resume notification to the terminal 12 (S705).

[0137] Then, the server-side game processing control unit 28 controls the game processing execution unit 22 to resume the game processing. (S706). Then, the process returns to S701.

[0138] Next, an example of the flow of the process executed by the terminal 12, triggered by the reception of the game stop notification transmitted in the process shown in S703 described above, will be described with reference to the flow diagram shown in FIG.

[0139] In this processing example, the terminal side monitoring unit 48 also monitors the reception of a game stop notification by the terminal side signal receiving unit 54 (S801).

[0140] Then, when the terminal-side monitoring unit 48 detects that the terminal-side signal receiving unit 54 has received the game stop notification, the terminal-side game processing control unit 50 controls the operation data transmitting unit 42 to stop transmitting the operation data, causing the operation data transmitting unit 42 to stop transmitting the operation data (S802).

[0141] In addition, in the process shown in S802, the terminal-side game processing control unit 50 may control the operation data generating unit 40 to stop generating the operation data. Then, by this, the operation data generating unit 40 may stop generating the operation data.

[0142] Then, the terminal-side game processing control unit 50 controls the terminal-side signal transmitting unit 52 to start transmitting a UL communication quality confirmation signal. As a result, the terminal-side signal transmitting unit 52 starts transmitting a UL communication quality confirmation signal to the cloud server 10 at a predetermined time interval (S803). Here, for example, the UL communication quality confirmation signal may be transmitted at the same time interval as the transmission interval of the operation data (for example, 4.16 millisecond intervals).

[0143] Then, the terminal side monitoring unit 48 monitors the reception of a game restart notification by the terminal side signal receiving unit 54 (S804).

[0144] When reception of the game restart notification is confirmed in the process shown in S804, the terminal-side game processing control unit 50 controls the terminal-side signal transmitting unit 52 to stop transmitting the UL communication quality confirmation signal, which causes the terminal-side signal transmitting unit 52 to stop transmitting the UL communication quality confirmation signal (S805).

[0145] Then, the terminal-side game processing control unit 50 controls the operation data transmission unit 42 to resume transmission of the operation data. As a result, the operation data transmission unit 42 resumes transmission of the operation data (S806). Then, the process returns to S801.

[0146] In addition, in the process shown in S806, the terminal-side game processing control unit 50 may control the operation data generating unit 40 to resume the generation of the operation data. Then, as a result, the operation data generating unit 40 may resume the generation of the operation data.

[0147] In the process shown in S105 and S504 in the process example described above, the terminal side monitoring unit 48 may monitor the throughput of the terminal 12. Then, in the process shown in S106 and S505, if the throughput of the terminal 12 is equal to or higher than a predetermined threshold continuously for a predetermined time or more, it may be determined that the DL communication quality confirmation signal has been stably received for a predetermined time or more. For example, if a state in which the throughput is 5 Mbps or higher continues for 100 milliseconds or more, it may be determined that the DL communication quality confirmation signal has been stably received for a predetermined time or more.

[0148] Furthermore, in the process shown in S204 and S704 in the process example described above, the server-side monitoring unit 26 may monitor the throughput of the cloud server 10. Then, in the process shown in S205 and S705, if the throughput of the cloud server 10 is equal to or higher than a predetermined threshold continuously for a predetermined time or more, it may be determined that the UL communication quality confirmation signal has been stably received for a predetermined time or more. For example, if a state of a throughput of 1 Mbps or more continues for 100 milliseconds or more, it may be determined that the UL communication quality confirmation signal has been stably received for a predetermined time or more.

[0149] Here, taking into consideration that the data size of operation data is smaller than the data size of image data, a value smaller than the throughput threshold for judgment related to the DL communication quality confirmation signal is set as the throughput threshold for judgment related to the UL communication quality confirmation signal.

[0150] In this embodiment, in response to the game processing being stopped, the terminal-side game processing control unit 50 may display a stopped image 60 indicating that the game processing is stopped on the display unit 12d as shown in FIG. 11. For example, when the terminal 12 transmits a stop request signal, the terminal-side game processing control unit 50 may display a stopped image 60 as shown in FIG. 11 on the display unit 12d. Alternatively, when the terminal 12 receives a game stop notification, the terminal-side game processing control unit 50 may display a stopped image 60 as shown in FIG. 11 on the display unit 12d. In this case, the stopped image 60 may be superimposed on the displayed play image P1. Note that a character string indicating that the game is stopped may be displayed on the display unit 12d.

[0151] Also, for example, in the processing shown in S108, S408, or S505, before a game resume notification is sent, the terminal side game processing control unit 50 may cause the display unit 12d to display a resume image such as those shown in Figures 12, 13, and 15.

[0152] Fig. 12 is a diagram showing an example of a resume image 62. As shown in Fig. 12, the resume image 62 may be displayed so as to be superimposed on the displayed play image P2.

[0153] Then, in response to receiving a predetermined operation by the user (for example, an operation of pressing a button not used in playing the game), the terminal-side game processing control unit 50 may control the terminal-side signal transmitting unit 52 to transmit a game resume notification. Then, the terminal-side signal transmitting unit 52 may transmit the game resume notification to the cloud server 10.

[0154] Fig. 13 is a diagram showing another example of the resume image 64. This resume image 64 may also be displayed superimposed on the displayed play image, similar to the resume image 62. A resume button 66 and an end button 68 are arranged on the resume image 64 shown in Fig. 13.

[0155] Here, when the user selects the resume button 66, the terminal-side game processing control unit 50 may control the terminal-side signal transmitting unit 52 to send a game resume notification, and the terminal-side signal transmitting unit 52 may transmit the game resume notification to the cloud server 10.

[0156] On the other hand, when a selection operation of the end button 68 by the user is accepted, the terminal-side game processing control unit 50 may control the terminal-side signal transmitting unit 52 to transmit a game end notification, and the terminal-side signal transmitting unit 52 may transmit the game end notification to the cloud server 10. Then, the server-side signal receiving unit 32 may accept the game end notification, and the server-side game processing control unit 28 may instruct the game processing executing unit 22 to end the game processing being executed. Then, the game processing executing unit 22 may end the game processing being executed.

[0157] Furthermore, when a user selects the resume button 66, the terminal-side game processing control unit 50 may display a resume instruction image 70 on the display unit 12d as shown in Fig. 14. In this case, the resume instruction image 70 may be superimposed on the displayed play image. The resume instruction image 70 has a plurality of instruction buttons 72 (72a, 72b, and 72c) arranged thereon, each of which corresponds to a play situation.

[0158] Then, for example, in response to reception of a selection operation of the instruction button 72 by the user, the terminal-side game processing control unit 50 may generate a game resume notification associated with play situation data indicating the play situation associated with the selected instruction button 72. Then, the terminal-side game processing control unit 50 may control the terminal-side signal transmitting unit 52 to transmit the generated game resume notification, and the terminal-side signal transmitting unit 52 may transmit the game resume notification to the cloud server 10.

[0159] Then, the server-side game processing control unit 28 may control the game processing execution unit 22 to resume the game processing from the play situation indicated by the play situation data associated with the game resume notification. Then, the game processing execution unit 22 may resume the game processing from the play situation.

[0160] The above-mentioned play situation data may be, for example, data indicating the time (0 seconds, 5 seconds, 10 seconds, etc.) going back from the timing when the game processing was stopped when the game processing is resumed. The above-mentioned play situation data may be, for example, data indicating the frame number of the play image indicating the play situation when the game processing is resumed.

[0161] For example, when instruction button 72a is selected, game processing may be resumed from the play situation when the game processing was stopped. When instruction button 72b is selected, game processing may be resumed from the play situation 5 seconds before the game processing was stopped. When instruction button 72c is selected, game processing may be resumed from the play situation 10 seconds before the game processing was stopped. Such resumption of game processing may be implemented using, for example, a technology as described in JP2014-184316A.

[0162] For example, as described above, the terminal-side game processing control unit 50 may control so that data indicating a play situation at which game processing is resumed is transmitted from the terminal 12 to the cloud server 10. Here, the terminal-side game processing control unit 50 may control so that data indicating a play situation designated by a user playing a streaming game is transmitted from the terminal 12 to the cloud server 10.

[0163] Furthermore, the server-side game processing control unit 28 may resume game processing from a play situation specified by a user playing a streaming game in response to an operation of the user on the terminal 12. Furthermore, the terminal-side game processing control unit 50 may resume game processing from a play situation specified by a user playing a streaming game in response to an operation of the user on the terminal 12. In this way, the user can resume game processing from a desired play situation.

[0164] Fig. 15 is a diagram showing another example of the resume image 74. The resume button 66, the end button 68, and the play button 76 are arranged on the resume image 74 shown in Fig. 15.

[0165] Here, when a selection operation of the play button 76 is accepted, the terminal-side game processing control unit 50 may cause the display unit 12d to display a moving image showing the play situation for a predetermined period of time until the play is stopped.

[0166] For example, a video showing the play status of a streaming game being played may be stored in terminal 12. Then, in response to reception of a selection operation of play button 76, the video stored in terminal 12 may be played.

[0167] Also, a video showing the play status of the streaming game being played may be stored in the cloud server 10. Then, in response to the reception of a selection operation of the play button 76, the terminal 12 may transmit an instruction to play the video to the cloud server 10. Then, in response to the reception of the play instruction, the cloud server 10 may transmit the video stored in the cloud server 10 to the terminal 12. Then, the terminal 12 may display the video received from the cloud server 10 on the display unit 12d. Also, by operating a seek bar or the like, any frame image (play image) included in the video may be displayed on the display unit 12d. Then, in response to a designation operation by the user, a game resume notification associated with play status data showing the frame number of the play image displayed at the time of the designation operation may be transmitted from the terminal 12 to the cloud server 10. In this way, the user can search for a play status in which the user wants to resume the game process.

[0168] When the resume button 66 shown in Fig. 15 is selected, the same process as that when the resume button 66 shown in Fig. 13 is selected may be executed. When the end button 68 shown in Fig. 15 is selected, the same process as that when the end button 68 shown in Fig. 13 is selected may be executed.

[0169] The stopped image 60, the resume image 62, the resume image 64, the resume instruction image 70, and the resume image 74 may be images generated by the terminal-side game processing control unit 50, or may be images stored in advance in the terminal 12. The stopped image 60, the resume image 62, the resume image 64, the resume instruction image 70, and the resume image 74 may be images stored in advance in the cloud server 10. The stopped image 60, the resume image 62, the resume image 64, the resume instruction image 70, and the resume image 74 may be images generated by the server-side game processing control unit 28 and transmitted by the server-side signal transmission unit 30 to the terminal 12.

[0170] Also, for example, in the processes shown in S108, S408, and S505, if the time during which the game processing has been stopped is longer than a predetermined time, the terminal-side game processing control unit 50 may display the above-mentioned resume image on the display unit 12d before the game resume notification is transmitted. On the other hand, if the time during which the game processing has been stopped is equal to or shorter than the predetermined time, the game resume notification may be transmitted immediately without displaying the above-mentioned resume image. In this way, if the game processing has been stopped for longer than the predetermined time, the user can select whether or not to resume the game processing, and if not, the game processing is resumed smoothly without user intervention.

[0171] In the processes shown in S109, S408, S506, and S806, the operation data transmitted first after the transmission of the operation data is resumed may be associated with data indicating the play situation at which the game processing is resumed. For example, the operation data may be associated with a frame number of a play image indicating the play situation at which the game processing is resumed.

[0172] It should be noted that the present invention is not limited to the above-described embodiment.

[0173] Furthermore, the scope of application of the present invention is not limited to the cloud gaming system 1.

[0174] Furthermore, the scope of application of the present invention is not limited to computer networks 14 including mobile communication systems such as 4G and 5G. The present invention is also applicable to computer networks 14 in which wireless communication is performed by Wi-Fi (registered trademark) instead of wireless communication via mobile communication systems such as 4G and 5G.

[0175] Furthermore, the specific character strings and numerical values ​​described above and the specific character strings and numerical values ​​in the drawings are merely examples, and the present invention is not limited to these character strings and numerical values.

Claims

1. a monitoring unit that monitors a communication status between a server that executes a game process in a streaming game and a terminal that displays a moving image that shows a play status of the streaming game and is generated by executing the game process; a game processing control unit that controls whether or not to stop the game processing being executed on the server in accordance with the communication status; a communication quality confirmation signal transmission control unit that controls, when the game processing is stopped, to stop transmission of operation data related to the streaming game from the terminal to the server and to transmit a communication quality confirmation signal from at least one of the server and the terminal to the other, The game processing control unit: a means for displaying, on a terminal, a play status for a predetermined time period until the game process is stopped, when recovery of the communication status is confirmed based on the communication status of the communication quality confirmation signal; means for resuming the stopped game process and transmission of operation data from the terminal to the server from the play status at the timing designated by the user in response to receiving a designation operation by the user at the predetermined time; A stop control device comprising:

2. when a state in which the terminal fails to receive image data relating to the moving image continues for a predetermined time, the game processing control unit stops the game processing. The stop control device according to claim 1 .

3. when a state in which the server fails to receive operation data related to the streaming game continues for a predetermined time, the game processing control unit stops the game processing. The stop control device according to claim 1 .

4. the game processing control unit resumes the game processing from a play status designated by a user playing the streaming game in response to an operation of the user on the terminal. The stop control device according to claim 1 .

5. the game processing control unit controls so that data indicating a play situation at which the game processing is resumed is transmitted from the terminal to the server; 5. The stop control device according to claim 4.

6. a monitoring step of monitoring a communication status between a server that executes a game process in a streaming game and a terminal that displays a moving image that shows a play status of the streaming game and is generated by the execution of the game process; a game processing control step of controlling whether or not to stop the game processing being executed by the server in accordance with the communication status; a communication quality confirmation signal transmission control step of controlling, when the game processing is stopped, transmission of operation data related to the streaming game from the terminal to the server to be stopped, and transmitting a communication quality confirmation signal from at least one of the server and the terminal to the other, The game processing control step includes: when recovery of the communication state is confirmed based on the communication state of the communication quality confirmation signal, displaying on the terminal a play state for a predetermined time until the game process is stopped; in response to receiving a designation operation by the user at the predetermined time, restarting the stopped game process and the transmission of operation data from the terminal to the server from the play status at the time designated by the user, A stop control method comprising:

7. a monitoring step of monitoring a communication status between a server that executes a game process in a streaming game and a terminal that displays a moving image showing a playing status of the streaming game, the moving image being generated by the execution of the game process; a game processing control procedure for controlling whether or not to stop a game processing being executed on the server in accordance with the communication status; a communication quality confirmation signal transmission control procedure for controlling, when the game processing is stopped, transmission of operation data related to the streaming game from the terminal to the server to be stopped, and transmitting a communication quality confirmation signal from at least one of the server and the terminal to the other, The game processing control procedure includes: a step of displaying, on a terminal, a play status for a predetermined time until the game process is stopped, when recovery of the communication status is confirmed based on the communication status of the communication quality confirmation signal; in response to receiving a designation operation by the user at the predetermined time, restarting the stopped game process and the transmission of operation data from the terminal to the server from the play status at the time designated by the user, A program characterized by:

Images