Information processing system, information processing method, and program

Abstract

An aspect of the present invention is an information processing system in which at least one of the connection between an input / output device and a computer and the connection between the computer and a central computer is connected via a network and multiple users use the same content via the network by means of their respective input / output devices, the information processing system comprising: a delay measuring device that measures a transport delay amount occurring between the input / output device of each user and the central computer; and a delay adjusting device that adjusts, on the basis of the measured transport delay amount, the difference in the transport delay amount between the users such that the difference does not exceed a predetermined value.

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a program technology. [Background technology]

[0002] In recent years, remote events involving multiple users via a network have become more common. Examples of such events include eSports, gaming, and online transactions (such as auctions). When the scale of an online event is large, operations will change from the conventional local communication environment to one in which multiple computers are connected to a central server or the like using a cloud environment (see, for example, Non-Patent Document 1).

[0003] Furthermore, a device called a KVM extender (KVM = Keyboard, Video, Mouse) is used as a device that enables a UI device to be installed in a location physically separated from the computer. 21 is a diagram showing an example of the configuration of an information processing system in the prior art. As shown in FIG. 21, the information processing system has user systems 900 (900a, 900b, . . . 900z), computer systems 910 (910a, 910b, . . . 910z), and a central computer system 920.

[0004] The user system 900 includes input / output devices 901 (901a, 901b, ... 901z) such as an image display device, keyboard, mouse, tablet, etc., an input / output management device 902 (902a, 902b, ... 902z) that manages the input / output devices 901, and an input / output signal transmission / reception device 903 (903a, 903b, ... 903z) with communication capabilities.

[0005] The computer system 910 comprises an input / output signal transmission / reception device 911 (911a, 911b, ... 911z) that transmits and receives information with the user system 900, a computer 912 (912a, 912b, ... 912z) that performs information processing, and an input / output signal transmission / reception device 913 (913a, 913b, ... 913z) that transmits and receives information with a central computer system 920.

[0006] The central computer system 920 includes a signal transmitting / receiving device 921 having a communication function, and a central computer 922 that adjusts and controls the entire content. The user system 900 and the computer system 910 are connected by a first network, and the computer system 910 and the central computer system 920 are connected by a second network. The network may be wired or wireless.

[0007] 21, the amount of delay occurring between user system 900a and computer system 910a is Tfa, the amount of delay occurring between user system 900b and computer system 910b is Tfb, ..., the amount of delay occurring between user system 900z and computer system 910z is Tfz. Also, the amount of delay occurring between computer system 910a and central computer system 920 is Tba, the amount of delay occurring between computer system 910b and central computer system 920 is Tbb, ..., the amount of delay occurring between computer system 910z and central computer system 920 is Tbz.

[0008] In addition, Tfa, Tfb, ..., Tfz often have different delay amounts because devices at different locations are rarely in the same delay environment. Also, for the same reason, Tba, Tbb, ..., Tbz often have different delay amounts. [Prior art documents] [Non-patent literature]

[0009] [Non-Patent Document 1] Ryan Shea and Jiangchuan Liu, “Cloud Gaming: Architecture and Performance”, IEEE Network July / August 2013, IEEE, 2013, p16-p21 Summary of the Invention [Problem to be solved by the invention]

[0010] FIG. 22 is a diagram showing the amount of delay for each user in the conventional technology. In the conventional information processing system, as shown in FIG. 22, each user individually achieved the lowest possible delay, so when multiple users used the same content, there was a difference in delay between users. As a result, since there is a lot of content in which users with low delay have an advantage, it is difficult to hold an event in a fair environment in a highly competitive event. In addition, when a packet switching network such as the Internet is used in the network, the amount of delay fluctuates greatly over time due to the service provider and external factors.

[0011] In view of the above circumstances, an object of the present invention is to provide a technique capable of reducing the difference in delay amount between users. [Means for solving the problem]

[0012] One aspect of the present invention is an information processing system in which at least one of the connections between an input / output device and a computer and the connections between the computer and a central computer are connected via a network, and multiple users use the same content via the input / output device via the network, the information processing system comprising a delay measurement device that measures the amount of transmission delay that occurs between the input / output device and the central computer for each user, and a delay adjustment device that adjusts the difference in the amount of transmission delay between the users based on the measured amount of transmission delay so as to keep it within a predetermined value.

[0013] One aspect of the present invention is an information processing method in an information processing system in which at least one of the connections between an input / output device and a computer and the connections between the computer and a central computer are connected via a network, and multiple users use the same content via the input / output device via the network, in which a delay measurement device measures the amount of transmission delay that occurs between the input / output device and the central computer for each user, and a delay adjustment device adjusts the difference in the amount of transmission delay between the users based on the measured amount of transmission delay so as to keep it within a predetermined value.

[0014] One aspect of the present invention is a program that causes a computer of a delay adjustment device in an information processing system in which at least one of the connections between an input / output device and a computer and the connections between the computer and a central computer are connected via a network, and in which multiple users use the same content via the input / output device via the network, to measure the amount of transmission delay that occurs between the input / output device and the central computer for each user, and to adjust the difference in the amount of transmission delay between the users based on the measured amount of transmission delay so as to keep it within a predetermined value. Effect of the Invention

[0015] According to the present invention, it is possible to improve the operational feel when a user interface device and a computer are installed at separate locations. [Brief description of the drawings]

[0016] [Figure 1] 1 is a diagram illustrating an example of an overall configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 11 is a sequence diagram showing an example of a procedure for measuring a delay amount according to the embodiment. [Diagram 3] FIG. 13 is a diagram showing an example of a total delay amount before adjustment from a user system to a computer system to a central computer system. [Figure 4] 11 is a sequence diagram showing an example of a procedure for adjusting a delay amount according to the embodiment; FIG. [Diagram 5] FIG. 13 is a diagram illustrating an example of an adjusted delay amount. [Figure 6] FIG. 1 illustrates an example of implementation of an information processing system according to an embodiment. [Figure 7] FIG. 13 is a diagram illustrating a first example of a target for delay adjustment. [Figure 8] FIG. 13 is a diagram illustrating a second example of a target for delay adjustment. [Figure 9] FIG. 13 is a diagram illustrating a third example of a target for delay adjustment. [Figure 10] 1 is a schematic configuration diagram of an information processing system according to a first embodiment. [Figure 11] FIG. 11 is a diagram showing the amount of delay without adjustment in the first embodiment. [Figure 12] FIG. 11 is a diagram illustrating an example in which the maximum delay amount of a computer system is added in the first embodiment. [Figure 13] FIG. 11 is a diagram illustrating an example of end-to-end adjustment of a computer system in the first embodiment. [Figure 14] FIG. 11 is a schematic configuration diagram of an information processing system according to a second embodiment. [Figure 15] FIG. 11 is a diagram showing the amount of delay without adjustment in the second embodiment. [Figure 16] FIG. 11 is a diagram illustrating an example in which the maximum delay amount of a computer system is added in the second embodiment. [Figure 17] FIG. 11 is a diagram illustrating an example in which the amount of delay is adjusted between user groups in the second embodiment. [Figure 18] FIG. 11 is a diagram showing a first application pattern. [Figure 19] FIG. 13 is a diagram showing a second application pattern. [Figure 20] FIG. 13 is a diagram showing a third application pattern. [Figure 21] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to a conventional technique. [Figure 22] FIG. 1 is a diagram showing the amount of delay for each user in the conventional technology. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0018] First Embodiment Fig. 1 is a diagram showing an example of the overall configuration of an information processing system according to this embodiment. As shown in Fig. 1, the information processing system 1 includes user systems 3 (3-1, 3-2, ..., 3-n (n is an integer of 2 or more)), computer systems 4 (4-1, 4-2, ..., 4-n), a central computer system 5, and a delay adjustment device 6.

[0019] The user system 3 includes, for example, input / output devices 31 (31-1, 31-2, ..., 31-n), input / output management devices 32 (32-1, 32-2, ..., 32-n), delay control devices 33 (33-1, 33-2, ..., 33-n), and input / output signal transmitting / receiving devices 34 (34-1, 34-2, ..., 34-n).

[0020] The computer system 4, for example, includes an input / output signal transmitting / receiving device 41 (41-1, 41-2, ..., 41-n), a first delay control device 42 (42-1, 42-2, ..., 42-n), computers 43 (43-1, 43-2, ..., 43-n), a second delay control device 44 (44-1, 44-2, ..., 44-n), and a signal transmitting / receiving device 45 (45-1, 45-2, ..., 45-n).

[0021] The user system 3 and the computer system 4 are connected by a first network NW1 (NW1-1, NW1-2, ..., NW1-n). The first network NW1 may be a wired network or a wireless network, and may have any physical topology or logical topology, and may be a circuit-switched network or a packet-switched network. The communication methods of the first networks NW1-1, NW1-2, ..., NW1-n may be the same or different. The first network NW1 may be, for example, the Internet, and may include a communication network and a roaming data transfer network. The communication network and the roaming data transfer network may be integrated or separate. The first network NW1 may have an authentication function.

[0022] The central computer system 5 includes, for example, signal transmitting / receiving devices 51 (51-1, 51-2, . . . , 51-n), delay control devices 52 (52-1, 52-2, . . . , 52-n), and a central computer 53.

[0023] The computer system 4 and the central computer system 5 are connected by a second network NW2 (NW2-1, NW2-2, ..., NW2-n). The second network NW2 may be a wired network or a wireless network, may have any physical topology or logical topology, and may be a circuit-switched network or a packet-switched network. The communication methods of the second networks NW2-1, NW2-2, ..., NW2-n may be the same or different.

[0024] In addition, the delay adjustment device 6 is connected to a delay control device 33 of the user system 3, a first delay control device 42 of the computer system 4, a second delay control device 44 of the computer system 4, and a delay control device 52 of the central computer system 5.

[0025] First, the user system 3 will be described. The input / output device 31 is, for example, an image display device, a keyboard, a mouse, a game controller, a tablet, a scanner, a printer, a speaker, etc. The input / output device 31 is connected to an input / output management device 32.

[0026] The input / output management device 32 manages the output of information to the input / output device 31, the output of information from the input / output device 31, etc. The input / output management device 32 is connected to a delay control device 33.

[0027] The delay control device 33, together with the first delay control device 42 of the computer system 4, measures the amount of transmission delay occurring between the user system 3 and the computer system 4 (hereinafter, the "amount of transmission delay occurring between A and B" will be referred to as the "amount of delay between A and B"), which is the amount of delay occurring between the input / output device 31 and the computer 43, and outputs delay information indicating the measured amount of delay to the delay adjustment device 6. The delay control device 33 adjusts the amount of delay between the user system 3 and the computer system 4 according to the control of the delay adjustment device 6. The delay control device 33 is connected to the input / output signal transmission / reception device 34.

[0028] The input / output signal transmitting / receiving device 34 receives a signal from the computer system 4, and outputs the received signal to the input / output management device 32 via the delay control device 33. The input / output signal transmitting / receiving device 34 acquires a signal output by the input / output management device 32 via the delay control device 33, and transmits the acquired signal to the computer system 4. The signal from the computer system 4 includes, for example, an image signal, an audio signal, etc. Furthermore, the signal from the user system 3 to the computer system 4 includes, for example, operation information of a keyboard, a mouse, etc.

[0029] Next, the computer system 4 will be described. The computer system 4 is, for example, a data center, a communication building, a server room, or the like.

[0030] The input / output signal transmitting / receiving device 41 receives a signal output by the user system 3, and outputs the received signal to the computer 43 via the first delay control device 42. The input / output signal transmitting / receiving device 41 acquires the signal output by the computer 43 via the delay control device 33, and transmits the acquired signal to the user system 3. The input / output signal transmitting / receiving device 41 is connected to the first delay control device 42.

[0031] The first delay control device 42, together with the delay control device 33 of the user system 3, measures the amount of delay between the user system 3 and the computer system 4, which is the amount of delay between the input / output device 31 and the computer 43, and outputs delay information indicating the measured amount of delay to the delay adjustment device 6. The first delay control device 42 adjusts the amount of delay between the user system 3 and the computer system 4 under the control of the delay adjustment device 6. The first delay control device 42 is connected to the computer 43.

[0032] The computer 43 processes and controls the content in response to a signal output by the user system 3. The computer 43 may be a physical computer or a logical computer (virtual computer). In the case of a virtual computer, for example, a CPU, a GPU (Graphics Processing Unit), a memory, a storage, etc. are virtualized. The computer 43 may also be a game device.

[0033] The second delay control device 44, together with the delay control device 52 of the central computer system 5, measures the amount of delay between the computer system 4 and the central computer system 5, which is the amount of delay between the computer 43 and the central computer 53, and outputs delay information indicating the measured amount of delay to the delay adjustment device 6. The second delay control device 44 adjusts the amount of delay between the computer system 4 and the central computer system 5 under the control of the delay adjustment device 6. The second delay control device 44 is connected to the signal transmission / reception device 45.

[0034] The signal transmitting / receiving device 45 transmits the signal output by the computer 43 to the central computer system 5. The signal transmitting / receiving device 45 receives a signal from the central computer system 5, and outputs the received signal to the computer 43 via the second delay control device 44.

[0035] Next, the central computer system 5 will be described. The signal transmission / reception device 51 receives a signal transmitted by the computer system 4, and outputs the received signal to the central computer 53 via the delay control device 52. The signal transmission / reception device 51 acquires a signal from the central computer 53 via the delay control device 52, and transmits the acquired signal to the computer system 4. The signal transmission / reception device 51 is connected to the delay control device 52.

[0036] The delay control device 52, together with the second delay control device 44 of the computer system 4, measures the amount of delay between the computer system 4 and the central computer system 5, which is the amount of delay between the computer 43 and the central computer 53, and outputs delay information indicating the measured amount of delay to the delay adjustment device 6. The delay control device 52 adjusts the amount of delay between the computer system 4 and the central computer system 5 under the control of the delay adjustment device 6. The delay control device 52 is connected to the central computer 53.

[0037] The central computer 53 is, for example, a server. The central computer 53 communicates with each computer and performs processing according to the content. The central computer 53 sets rooms and user groups. Rooms and user groups will be described later.

[0038] In the example of Figure 1, a "delay control device" is provided on both communication sections to measure and adjust delay on the signal receiving side, but the configuration is not limited to this.In the case of a use case where delay adjustment is only performed in one direction (such as video distribution), the "delay control device" on the transmitting side may be omitted. The "delay control device" is not limited to being a single physical device, but may be implemented as a functional unit within the device connected in the vicinity of the delay control device. The functional unit within the device may be implemented, for example, as an internal function of the signal transmitting / receiving device 45, or logically implemented as an application within the computer 43.

[0039] Next, the delay adjustment device 6 will be described. The delay adjustment device 6 acquires user information from the user system 3 and the like, and transmits the acquired user information to the central computer system 5. The user information may include, for example, information such as the number of users, the room used or selected by the user, and the user group to which the user belongs. The delay adjustment device 6 instructs each delay control device (33, 42, 44, 52) to measure the amount of delay for each user, and acquires the measurement results. The delay adjustment device 6 adjusts the amount of delay based on the acquired amount of delay for each user.

[0040] The computer 43, the central computer 53, and the delay adjustment device 6 are configured using a processor such as a CPU (Central Processing Unit) and a memory. All or part of the functions of the computer 43, the central computer 53, and the delay adjustment device 6 may be realized using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The above program may be recorded on a computer-readable recording medium. The computer-readable recording medium may be, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a semiconductor storage device (for example, an SSD: Solid State Drive), or a storage device such as a hard disk or a semiconductor storage device built into a computer system. The above program may be transmitted via an electric communication line.

[0041] Next, an example of a method for measuring the amount of delay will be described with reference to FIG. FIG. 2 is a sequence diagram showing an example of a procedure for measuring the amount of delay according to the present embodiment.

[0042] The delay adjustment device 6 measures the total amount of delay of the user system 3 - computer system 4 - central computer system 5 in advance by each delay control device (33, 42, 44, 52) before starting to use the computer 43, for example.

[0043] The delay adjustment device 6 transmits a delay amount measurement instruction to each delay control device (33, 42, 44, 52) (step S1). Each delay control device receives the delay amount measurement instruction (steps S2 to S5).

[0044] The first delay control device 42 of the computer system 4 transmits a delay amount measurement instruction to the user system 3 via the input / output signal transmission / reception device 41 in response to the control of the delay adjustment device 6, and starts measuring and counting the delay amount. When the delay control device 33 of the user system 3 receives the delay amount measurement instruction, it transmits reception information indicating the reception to the computer system 4 via the input / output signal transmission / reception device 34. The first delay control device 42 receives the reception information from the user system 3 via the input / output signal transmission / reception device 41, and ends the measurement and counting of the delay amount (step S6). The measurement may be performed by the delay control device 33 on the user system 3 side. In this way, the delay amount is, for example, the delay time between the delay control device 33 of the user system 3 and the first delay control device 42 of the computer system 4.

[0045] The first delay control device 42 or the delay control device 33 transmits the measured delay amount information to the delay adjustment device 6 (step S7). The delay adjustment device 6 receives the measured delay amount information (step S8).

[0046] Furthermore, for example, the second delay control device 44 of the computer system 4 transmits a delay amount measurement instruction to the central computer system 5 via the signal transmission / reception device 45 in response to the control of the delay adjustment device 6, and starts measuring and counting the delay amount. When the delay control device 52 of the central computer system 5 receives the delay amount measurement instruction, it transmits reception information indicating the reception to the computer system 4 via the signal transmission / reception device 51. The second delay control device 44 receives the reception information from the central computer system 5 via the signal transmission / reception device 45 central computer system 5, and ends the measurement and counting of the delay amount (step S9). Note that the measurement may be performed by the delay control device 52 on the central computer system 5 side. In this way, the delay amount is, for example, the delay time between the second delay control device 44 of the computer system 4 and the delay control device 52 of the central computer system 5.

[0047] The second delay control device 44 or the delay control device 52 transmits the measured delay amount information to the delay adjustment device 6 (step S10). The delay adjustment device 6 receives the measured delay amount information and stores each received delay amount information (step S11).

[0048] The delay between the user system 3 and the computer system 4 and the delay between the computer system 4 and the central computer system 5 may be measured simultaneously. The delay measurement may be performed at any timing except for a pre-measurement before delay adjustment. Each delay control device may perform the measurement periodically with a timeout and send the results successively to the delay adjustment device 6. Each delay control device may omit sending information to the delay adjustment device 6 if the difference between the measurement result and the past result is within an acceptable range (for example, less than 1 (ms)).

[0049] The amount of delay is measured for all user systems 3 and computer systems 4 connected to the content handled by the central computer 53 .

[0050] FIG. 3 is a diagram showing an example of the total delay amount before adjustment of the user system 3 to the computer system 4 to the central computer system 5. In FIG. 3, the horizontal axis indicates the user, and the vertical axis indicates the delay amount. In FIG. 3, the delay amount between the user system 3-1 and the computer system 4-1 is Tfa (for example, 20 (ms)), the delay amount between the user system 3-2 and the computer system 4-2 is Tfb (for example, 30 (ms)), and the delay amount between the user system 3-z and the computer system 4-z is Tfz (for example, 40 (ms)). In addition, the delay amount between the computer system 4-1 and the central computer system 5 is Tba (for example, 30 (ms)), the delay amount between the computer system 4-2 and the central computer system 5 is Tbb (for example, 40 (ms)), and the delay amount between the computer system 4-z and the central computer system 5 is Tbz (for example, 20 (ms)).

[0051] The total delay amount of user system 3-1, computer system 4-1, and central computer system 5 is Ta (=Tfa+Tba). The total delay amount of user system 3-2, computer system 4-2, and central computer system 5 is Tb (=Tfb+Tbb). The total delay amount of user system 3-z, computer system 4-z, and central computer system 5 is Tz (=Tfz+Tbz). Furthermore, Ta is the smallest total delay amount, and Tb is the largest.

[0052] Next, an example of a method for adjusting the amount of delay will be described with reference to FIG. FIG. 4 is a sequence diagram showing an example of a procedure for adjusting the amount of delay according to the present embodiment.

[0053] The delay adjustment device 6 calculates the total amount of delay of the user system 3 to the computer system 4 to the central computer system 5 based on the delay amount information received from each delay control device (step S51).

[0054] The delay adjustment device 6 calculates an adjustment delay amount based on the delay amount information received from each delay control device and the calculated total delay amount (step S52). The delay adjustment device 6 transmits the calculated adjustment delay amount information to each delay control device (step S53). Each delay control device receives the adjustment delay amount information (steps S54 to S57). The adjustment delay amount information may include information indicating which delay control device will adjust the delay amount. Alternatively, the delay adjustment device 6 may transmit the adjustment delay amount information to the delay control device that will adjust the delay amount.

[0055] Each delay control device adjusts the amount of delay based on the received adjusted delay amount information (steps S58 to S61).

[0056] Fig. 5 is a diagram showing an example of the delay amount after adjustment, in which the horizontal axis represents users and the vertical axis represents the delay amount. The delay adjustment device 6 adjusts the amount of delay between the user system 3 and the computer system 4. Based on measurement information of the amount of delay between all user systems, the computer system, and the central computer system, the delay adjustment device calculates an adjustment amount of delay so that the delay between "the central computer and the computer" and "between the computer and the user system" falls within the allowable range between all users. Based on the calculated adjustment amount of delay for each user, the delay control device present in the transmission path of each user is set to add a delay. In the example of FIG. 1, since there are two communication sections, between the "input / output device" and the "computer" and between the "computer" and the "central computer," the delay between users is adjusted to be equal in each communication section.

[0057] The delay adjustment device 6 adjusts the other delay amounts to, for example, the largest delay amount Tfz. For this reason, the delay adjustment device 6 controls the delay control devices of the user system 3-1 and the computer system 4-1 to adjust the delay amount Tfa by adding an adjustment delay amount ATfa (=Tfz-Tfa). The delay adjustment device 6 also controls the delay control devices of the user system 3-2 and the computer system 4-2 to adjust the delay amount Tfb by adding an adjustment delay amount ATfb (=Tfz-Tfb).

[0058] Next, the delay adjustment device 6 adjusts the delay amount between the user system 3 and the computer system 4. For example, the delay adjustment device 6 adjusts the other delay amounts to the largest delay amount Tbb. For this reason, the delay adjustment device 6 controls the delay control devices of the computer system 4-1 and the central computer system 5 to adjust the delay amount Tba by adding the adjusted delay amount ATba (=Tbb-Tba). In addition, the delay adjustment device 6 controls the delay control devices of the computer system 4-z and the central computer system 5 to adjust the delay amount Tbz by adding the adjusted delay amount ATbz (=Tbb-Tbz).

[0059] The delay adjustment device 6 may compare the total delay amount or the delay amount in units of 1 (ms), for example, and may consider the total delay amount or the delay amount to be the same if they are within a predetermined range. Alternatively, the unit may be changed (for example, from 1 (ms) to 0.1 (ms)) depending on the service environment, the content used, etc.

[0060] The above-mentioned measurement method and adjustment method are merely examples and are not limited thereto. If a change in the amount of delay occurs over time (for example, if a change is detected by delay measurement at an arbitrary timing), the amount of delay may be adjusted again. Similarly, if a change (increase or decrease) occurs in the number of users connected to the content being handled, the above-mentioned process may be executed again to adjust the amount of delay.

[0061] The delay amount may be adjusted using, for example, the following well-known techniques (References 1 and 2).

[0062] ·(Reference 1) T. Ono et al., “Novel ODU path switching for ODU reallocation without bit disruption using dynamic delay control scheme”, IEEE, 2011 Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference, 2011 (Reference 2) Yuki Fujisaki et al., “P2P-TV Traffic Induction Method Using Delay Insertion Based on Location Information,” Institute of Electronics, Information and Communication Engineers, 2013, IEICE Transactions on Information and Communications Engineers Vol. J96-B No. 8 p. 819-830

[0063] According to this embodiment, since the amount of delay is adjusted as described above, it is possible to create a fair communication environment among a plurality of users. The two communication sections between the "input / output device" and the "computer" and between the "computer" and the "central computer" may use a network including a packet switching network such as the Internet, or a network including a circuit switching network such as optical communication. By using a network including a circuit switching network, this embodiment makes it possible to suppress the amount of delay variation compared to a packet switching network, and to reduce the frequency of changing the amount of delay adjustment.

[0064] <Implementation example> Next, an implementation example of an information processing system will be described. FIG. 6 is a diagram illustrating an example of implementation of the information processing system according to the present embodiment. As shown in FIG. 6, the user system 3A is composed of, for example, an input / output signal transmitting / receiving device 34A, a delay control device 33A, an input / output signal conversion device 35A, an image device 311A, and an input / output device 312A.

[0065] The input / output signal conversion device 35A converts, for example, a signal received from the computer system 4A into an image signal conforming to the HDMI (registered trademark) (High-Definition Multimedia Interface) standard, or converts a signal output by the input / output device 312A into a transmittable signal. The input / output signal transmitting / receiving device 34A receives signals from the computer system 4A and transmits signals from its own device to the computer system 4A.

[0066] The delay control device 33A measures and controls the amount of delay between the user system 3A and the computer system 4A. The image display device 311A ​​is, for example, a liquid crystal image display device, an organic EL (Electro-Luminescence) image display device, or the like.

[0067] The input / output device 312A is a device related to a user interface, such as a keyboard, a mouse, an operation controller (actuator), a camera, a VR (virtual reality) headset, an AR (augmented reality) headset, a microphone, a speaker, etc. Alternatively, the input / output device 312A may be any device that inputs and outputs the five human senses (touch, sight, hearing, smell, taste) to and from the computer 43A. Alternatively, the input / output device 312A may be a sensor. The sensor may be, for example, a sensor that detects the movement of the user's hand, face, body, etc., a position sensor, an altitude sensor, a speed sensor, an acceleration sensor, a temperature sensor, a humidity sensor, a pressure sensor, a vibration sensor, a light sensor, a sound sensor, an electric field sensor, a magnetic field sensor, etc.

[0068] The input / output signal transmitting / receiving device 34A and the delay control device 33A, and the delay control device 33A and the input / output signal conversion device 35A are connected, for example, by an Ethernet (registered trademark) cable 301. The input / output signal conversion device 35A and the image device 311A ​​are connected, for example, by a cable 302 conforming to the HDMI standard, and the input / output signal conversion device 35A and the input / output device 312A are connected, for example, by a cable 303 conforming to the USB (Universal Serial Bus) standard. The input / output signal conversion device 35A and the image device 311A ​​may be connected by a Displayport or USB Type C, or may be connected by a single input / output format including a USB signal used in the control device (for example, both signals are carried on USB Type C).

[0069] The computer system 4A is composed of, for example, a transmission device 46A, a second delay control device 44A, a computer 43A, an input / output signal conversion device 47A, a first delay control device 42A, and an input / output signal transmitting / receiving device 41A.

[0070] The transmission device 46A receives a signal from the central computer system 5A and transmits a signal from itself to the central computer system 5A. The second delay control device 44A measures and controls the amount of delay between the central computer system 5A and the computer system 4A.

[0071] The computer 43A performs processing according to the contents. The input / output signal conversion device 47A converts, for example, a signal received from the central computer system 5A into a signal that can be transmitted to the user system 3A, and converts a signal received from the user system 3A into a signal that can be transmitted to the central computer system 5A.

[0072] The first delay control device 42A measures and controls the amount of delay between the user system 3A and the computer system 4A. The input / output signal transmitting / receiving device 41A receives a signal from the user system 3A and transmits a signal from the device itself to the user system 3A.

[0073] The transmission device 46A and the second delay control device 44A, the second delay control device 44A and the computer 43A, the input / output signal conversion device 47A and the first delay control device 42A, and the first delay control device 42A and the input / output signal transmission / reception device 41A are each connected by, for example, an Ethernet cable 401. Furthermore, the computer 43A and the input / output signal conversion device 47A are connected by, for example, a cable 402 conforming to the HDMI standard and a cable 403 conforming to the USB standard.

[0074] The central computer system 5A is composed of, for example, a central computer 53A, a delay control device 52A, and a transmission device 54A.

[0075] The central computer 53A transmits and receives signals to and from the computer system 4A and performs processing according to the contents. The delay control device 52A measures and controls the amount of delay between the central computer system 5A and the computer system 4A. The transmission device 54A receives a signal from the computer system 4A, and transmits a signal from itself to the computer system 4A.

[0076] 6 is merely an example, and is not limited thereto. Other components may be included, and as described above, depending on the application, the delay control device may be included in, for example, either the user system 3A or the computer system 4A.

[0077] <Examples of delay adjustment> Here, examples of targets for delay adjustment will be described with reference to Fig. 7 to Fig. 9. Setting target users for delay adjustment as shown in Fig. 7 to Fig. 9 makes it possible to adjust the minimum amount of delay necessary. When determining targets, the delay adjustment device 6 determines users to be delay targets by acquiring user information and content operation information (for example, a list of users using content Room A) from the central computer 53 where the content operates.

[0078] First, the terms used in the following description will be defined. A room refers to a group of users who can interact with the content that the user is playing. For example, in a mahjong game, the room is made up of four users. Note that the room may be determined by the user, for example, when the participating users are decided in advance. Or, for example, when playing an online game alone, the system may decide which users will enter the room, for example, when matching and placing the user in a room that can accommodate up to 10 users.

[0079] The user group is assumed to be a team unit in content such as team vs. team in eSports. Note that the user side may decide the user group, such as when a team and a user group are to be matched in a team vs. team situation in eSports. Alternatively, when playing an online game alone, the system side may select users to be included in the user group, such as when a user is on the same team as another user, making it a team vs. team situation. In the following example, the delay amount is adjusted on a content or room basis.

[0080] Fig. 7 is a diagram showing a first example of a target for delay adjustment. In the first example of Fig. 7, four users a to d use a content in one Room, using the user systems 3-m (m is a to d) and the computer system 4-m. In this way, when one content is used by four users, the entire range g11 of the user systems 3-m (m is a to d), the computer system 4-m, and the central computer system 5 is a target for delay adjustment.

[0081] FIG. 8 is a diagram showing a second example of the target of delay adjustment. In the second example of FIG. 8, two users a and b use content in Room A through user systems 3-a and b and computer systems 4-a and b. Also, two users c and d use content in Room B through user systems 3-c and d and computer systems 4-c and d. In such a case, the range g21 of the user systems 3-a and b, computer systems 4-a and b, and central computer system 5 used by the group of users a and b in Room A is the first delay amount adjustment range. Also, the range g22 of the user systems 3-c and d, computer systems 4-c and d, and central computer system 5 used by the group of users c and d in Room B is the second delay amount adjustment range. In the example of FIG. 8, the delay adjustment device 6 and each delay control device adjust the delay amount in units of two or more user groups that can interfere with each other in the same content. The delay amount adjustment method in such a case will be described later.

[0082] Fig. 9 is a diagram showing a third example of a target for delay adjustment. In the third example of Fig. 9, one content is used by six users a to f, but is divided into two or more user groups that can interfere with each other within the same content. In the example of Fig. 9, the delay adjustment device 6 and each delay control device adjust the amount of delay in units of two or more user groups within the two or more user groups that can interfere with each other within the same content. A method of adjusting the amount of delay in such a case will be described later.

[0083] In the explanation using FIG. 5, it is assumed that the delay difference between multiple users using the content can be made zero. On the other hand, there may be a case where a plurality of users having a delay difference exceeding the adjustable amount of the delay control device are targeted. In such a case, even if the maximum adjustable delay amount is adjusted, a situation may occur where one or more users are not in a fair environment. An example of an adjustment method in such a case will be described in the following embodiment.

[0084] <First Example> In the first embodiment, a group of users for whom delay can be adjusted is created in advance, and a pre-emptive measure is taken. The delay adjustment device 6 transmits delay amount information for each user to the central computer on which the content runs. The central computer 53 selects users to enter a room or a user group based on the received delay amount information. As a result, according to the first embodiment, it is possible to gather only users whose delay amount can be adjusted in the same room or the same user group. As a result, according to the first embodiment, it is possible to prevent the occurrence of a situation in which one or more users are not provided with an equal environment.

[0085] <Second Example> The second and third examples are post-facto measures to create a pseudo-fair environment. If the first example is not sufficient, the following pseudo-fair environment may be created.

[0086] A method for adjusting the amount of delay in a case such as that shown in FIG. 8 will be described with reference to FIGS. 10 to 13. In this embodiment, for simplicity, an example will be described in which there are two users, but the number of users is not limited to this. The first embodiment is a case in which each user participates in the content. Here, an example will be described in which a post-event measure is taken to create a pseudo-fair environment.

[0087] Fig. 10 is a schematic configuration diagram of an information processing system in Example 1. In the example of Fig. 10, user a uses user system 3-a and computer system 4-a, and user b uses user system 3-b and computer system 4-b.

[0088] Fig. 11 is a diagram showing the amount of delay when no adjustment is made in the first embodiment. In Fig. 11, the horizontal axis represents users, and the vertical axis represents the amount of delay (for example, (ms)). 10 and 11, it is assumed that the delay Tfa between the user system 3-a and the computer system 4-a is 10 (ms), and the delay Tba between the computer system 4-a and the central computer system 5 is 10 (ms). It is also assumed that the delay Tfb between the user system 3-b and the computer system 4-b is 10 (ms), and the delay Tbb between the computer system 4-b and the central computer system 5 is 40 (ms).

[0089] Fig. 12 is a diagram showing an example in which the maximum delay amount of the computer system is added in the first embodiment. Each axis in Fig. 12 is the same as that in Fig. 11. For example, assume that the maximum delay amount that each delay control device (33, 42, 44, 52) can adjust is 20 (ms). Therefore, even if the second delay control device 44-a of the computer system 4-a adds an adjustment delay amount ATba of 20 (ms), the delay amounts of user a and user b cannot be adjusted equally.

[0090] 13 is a diagram showing an example of end-to-end adjustment of a computer system in the first embodiment. Each axis in FIG. 13 is the same as in FIG. 10, when there are multiple communication intervals, the delay amount is adjusted so that the delay amount is uniform end-to-end (for example, between a user system and a central computer system) rather than adjusted for each communication interval. In addition, the delay adjustment device 6 and each delay control unit control the delay difference as close to zero as possible by this means.

[0091] In this case, for example, the second delay control device 44-a of the computer system 4-a adds an adjustment delay amount ATba of 20 (ms), and the first delay control device 42-a of the computer system 4-a further adds an adjustment delay amount ATfa of 10 (ms), thereby adjusting the total delay amount of user a to 40 (ms), the same as that of user b.

[0092] In the above example, the adjustment delay amount ATba is set to be greater than the adjustment delay amount ATfa. However, the adjustment delay amount ATfa may be greater than the adjustment delay amount ATba, or the adjustment delay amount ATba and the adjustment delay amount ATfa may be the same.

[0093] <Third Example> Next, a method for adjusting the amount of delay in a case such as that shown in Fig. 9 will be described with reference to Figs. 14 to 17. In this embodiment, for simplicity, an example will be described in which there are four users, but the number of users is not limited to this. In this embodiment, an example will be described in which the amount of delay is adjusted taking into account the amount of delay between user groups.

[0094] Fig. 14 is a schematic configuration diagram of an information processing system in Example 2. In the example of Fig. 14, for example, Room A is used by users a and b of user group g51, and Room B is used by users c and d of user group g52.

[0095] Fig. 15 is a diagram showing the amount of delay without adjustment in the second embodiment. In Fig. 15, the horizontal axis represents users, and the vertical axis represents the amount of delay (for example, (ms)). 14 and 15, suppose that the delay Tfa between the user system 3-a and the computer system 4-a is 10 (ms), and the delay Tba between the computer system 4-a and the central computer system 5 is 10 (ms). Suppose that the delay Tfb between the user system 3-b and the computer system 4-b is 20 (ms), and the delay Tbb between the computer system 4-b and the central computer system 5 is 40 (ms).

[0096] Assume that the delay Tfc between user system 3-c and computer system 4-c is 20 (ms), and the delay Tbc between computer system 4-c and central computer system 5 is 20 (ms). Assume that the delay Tfd between user system 3-d and computer system 4-d is 40 (ms), and the delay Tbd between computer system 4-d and central computer system 5 is 10 (ms).

[0097] Also in this embodiment, it is assumed that the maximum adjustable delay amount of each delay control device is 20 (ms). 16 is a diagram showing an example in which the maximum delay amount of the computer system is added in the second embodiment. The axes in FIG. 16 are the same as those in FIG.

[0098] 16, for example, the second delay control device 44-a of the computer system 4-a adds an adjustment delay amount ATba of 20 (ms), and the first delay control device 42-a of the computer system 4-a adds an adjustment delay amount ATfa of 20 (ms). Also, for example, the first delay control device 42-b of the computer system 4-b adds an adjustment delay amount ATfb of 20 (ms).

[0099] For example, the second delay control device 44-c of the computer system 4-c adds an adjustment delay amount ATbc of 20 (ms), and the first delay control device 42-c of the computer system 4-c adds an adjustment delay amount ATfc of 20 (ms). Also, for example, the second delay control device 44-d of the computer system 4-d adds an adjustment delay amount ATbd of 20 (ms).

[0100] 17 is a diagram showing an example in which the delay amount is adjusted between user groups in the second embodiment. The axes in FIG. 17 are the same as those in FIG. In FIG. 17, the adjusted delay amount ATfa is 20 (ms), the adjusted delay amount ATba is 10 (ms), the adjusted delay amount ATbc is 10 (ms), and the adjusted delay amount ATbd is 10 (ms).

[0101] In this case, the total delay Ta for user a is 50 (=10+20+10+10) (ms), the total delay Tb for user b is 60 (=20+40) (ms), and the average total delay for user group g51 is 55 (=(50+60) / 2) (ms). In addition, the total delay Ta of user c is 50 (=20+20+10) (ms), the total delay Td of user d is 60 (=40+10+10) (ms), and the average total delay of user group g52 is 55 (=(50+60) / 2) (ms).

[0102] In this embodiment, for example, the delay may be adjusted to match the average delay between the user groups, thereby performing delay adjustment taking the user groups into consideration. Note that the second embodiment may also perform the same adjustment as the first embodiment. In this way, by taking into account the amount of delay between user groups, it is possible to perform delay adjustment that suppresses the absolute amount of delay while maintaining fairness on a team-by-team basis.

[0103] <Application pattern example> Next, examples of application patterns of the above-described embodiment will be described. FIG. 18 is a diagram showing a first application pattern. The first application pattern is a "local type" in which a computer on which a content such as a game runs is present in the same location as the user. In such a case, the input / output device and the computer are connected without a network, so the amount of delay between the input / output device and the computer is small. Therefore, in the first application pattern, the amount of delay is adjusted by adding an adjustment delay amount ATbn for the difference in the amount of delay caused by the first network NW1 between the computer and the central computer.

[0104] FIG. 19 is a diagram showing the second application pattern. The second application pattern is a "fog type" in which a computer on which a content such as a game runs is located at a different location from the user (for example, the computer is located closer to the user physically or logically than the central computer). The configuration example of FIG. 1 is the second application pattern. In this case, there is a second network NW2 between the input / output device and the computer, and a first network NW1 between the computer and the central computer, and a delay amount occurs in each of them. Therefore, in the second application pattern, an adjustment delay amount ATbn is added for the difference in the delay amount due to the first network NW1 between the computer and the central computer, and an adjustment delay amount ATfn is added for the difference in the delay amount due to the second network NW2 between the computer and the input / output device to adjust the delay amount.

[0105] Fig. 20 is a diagram showing the third application pattern. The third application pattern is a "cloud type" in which a computer on which a content such as a game runs exists on a cloud, and a central computer also exists in the cloud. In this case, the delay amount is adjusted by adding an adjustment delay amount Atfn to the delay amount caused by the second network NW2 between the computer and the input / output device.

[0106] Note that the application patterns shown in FIGS. 18 to 20 are just examples, and the classification is merely for the sake of convenience, and some forms of cloud gaming are similar to fog gaming. Depending on the configuration of the information processing system 1, the delay amount may be adjusted by combining the above-mentioned first to third application patterns.

[0107] <Modification> Here, a modified example will be described. The method and configuration of this embodiment can be applied even when the central computer is configured in multiple stages. In that case, the relationship between the central computer and the computers may be adapted to a relationship between a central computer (upper) and a central computer (lower). In this case, the delay amount adjustment targets may be three: the delay amount Tfn between the input / output device and the computer, the delay amount Tb1n between the computer and the central computer, and the delay amount Tb2n between the central computer (upper) and the central computer (lower). In such a case, for example, a delay control device may be provided between the central computer (upper) and the central computer (lower).

[0108] As described above, according to the embodiment, the example, and the modified example, the amount of delay between a plurality of users having different communication environments can be kept constant by measuring the amount of delay between the central computer and the computer, and between the computer and the input / output device, and adjusting the delay pattern. As a result, according to the embodiment, the example, and the modified example, the amount of delay between participants in a highly competitive event can be made uniform, so that fairness can be maintained.

[0109] The above-mentioned implementation examples are merely examples, and the implementation configuration is not limited to these. For example, the user system 3, the computer system 4, and the central computer system 5 may be connected to other devices.

[0110] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and designs that do not deviate from the gist of the present invention are also included. [Industrial Applicability]

[0111] The present invention is applicable to, for example, gaming systems, eSports systems, remote desktop systems, computer rental systems, and the like. [Explanation of symbols]

[0112] 1...information processing system, 3...user system, 4...computer system, 5...central computer system, 6...delay adjustment device, 31...input / output device, 32...input / output management device, 33...delay control device, 34...input / output signal transmitting / receiving device, 41...input / output signal transmitting / receiving device, 42...delay control device, 43...computer, 44...delay control device, 45...signal transmitting / receiving device, 51...signal transmitting / receiving device, 52...delay control device, 53...central computer, NW1...first network, NW2...second network

Claims

1. An information processing system in which at least one of a connection between an input / output device and a computer and a connection between the computer and a central computer is made via a network, and a plurality of users use the same content via the network by using each of the plurality of input / output devices, a delay measurement device for measuring a transmission delay amount occurring between the input / output device and the central computer for each user; a delay adjustment device that adjusts the difference in the transmission delay between the users based on the measured transmission delay so as to keep the difference within a predetermined value; Equipped with The delay adjustment device adjusts the transmission delay amount in units of one or more user groups generated based on the transmission delay amount for each user, each of which includes only users among the plurality of users who can be adjusted to keep the difference in the transmission delay amount between the users within the predetermined value, and when there are a plurality of communication sections in the connection between the input / output device and the computer and the connection between the computer and the central computer, the delay adjustment device adjusts the transmission delay amount so that the end-to-end transmission delay amount is uniform between the users, rather than adjusting the amount in each communication section. Information processing system.

2. The delay adjustment device includes: adjusting the transmission delay amount so that the transmission delay amount is equal among the users; The information processing system according to claim 1 .

3. The network includes a circuit-switched network.

3. The information processing system according to claim 1 or 2.

4. The delay adjustment device includes: adjusting the transmission delay amount for each group of two or more users who may interfere with each other within the same content; The information processing system according to any one of claims 1 to 3.

5. An information processing method in an information processing system in which at least one of a connection between an input / output device and a computer and a connection between the computer and a central computer is made via a network, and a plurality of users use the same content via the network by using each of the plurality of input / output devices, comprising: a measurement step in which a delay measurement device measures a transmission delay amount occurring between the input / output device for each user and the central computer; an adjustment step in which a delay adjustment device adjusts the difference in the transmission delay amount between the users based on the measured transmission delay amount so as to keep the difference within a predetermined value; having In the adjustment step, the delay adjustment device adjusts the transmission delay amount in units of one or more user groups generated based on the transmission delay amount for each user, each of which includes only users among the plurality of users who can be adjusted to keep the difference in the transmission delay amount between the users within the predetermined value, and when there are a plurality of communication sections in the connection between the input / output device and the computer and the connection between the computer and the central computer, the delay adjustment device adjusts the transmission delay amount so that the end-to-end transmission delay amount is uniform between the users, rather than adjusting the transmission delay amount in each communication section. Information processing methods.

6. A computer of a delay adjustment device in an information processing system in which at least one of the connections between an input / output device and a computer and the connection between the computer and a central computer is connected via a network, and a plurality of users use the same content via the network by using each of the plurality of input / output devices, a measuring step of measuring a transmission delay amount occurring between the input / output device and the central computer for each user; an adjustment step of adjusting the difference in the transmission delay amount between the users based on the measured transmission delay amount so as to keep the difference within a predetermined value; Run the command, In the adjustment step, the computer adjusts the transmission delay amount for each of one or more user groups, each of which includes only users among the plurality of users who can be adjusted to keep the difference in the transmission delay amount between the users within the predetermined value, and when there are a plurality of communication sections in the connection between the input / output device and the computer and the connection between the computer and the central computer, the computer adjusts the transmission delay amount so that the end-to-end transmission delay amount is uniform between the users, rather than adjusting the amount in each communication section. program.

Images