Information processing system and information processing method

Abstract

An aspect of the present invention relates to an information processing system comprising: a calculator which is installed in a calculator location; a first transmission and reception device which is connected to the calculator; a second transmission and reception device which is installed in a user location and used by a user; a device which is connected to the second transmission and reception device; and a delay control device which measures a delay amount generated between the first transmission and reception device and the second transmission and reception device, and controls the measured delay amount.

Description

[Technical field]

[0001] The present invention relates to an information processing system. and information processing method Regarding technology. [Background technology]

[0002] A UI (user interface) device such as a display, keyboard, mouse, operation controller, etc. is connected to and operated by a computer or a game machine (hereinafter referred to as "computer"). In many computers 901, as shown in FIG. 20, a UI device 902 at the user's hand is connected to a computer 901 also installed at the user's hand (user site 900) by wire or wirelessly. In some cases, a sensor 903 that detects the movements of the hands, face, body, etc. of the user US is connected to the computer 901 by wire or wirelessly. FIG. 20 is a diagram showing an example of a configuration in which a computer and a UI device are directly connected in the prior art.

[0003] A device called a KVM extender (KVM=Keyboard, Video, Mouse, hereinafter referred to as an extender) is used as a device that enables a UI device to be installed at a location physically separated from a computer. In the configuration example of FIG. 21, a UI device 902 at hand is connected to an extender 904, and is connected to a computer 911 in which an opposing extender 912 is installed via a transmission line 915. The computer 911 and the extender 912 are installed, for example, at a computer base 910. FIG. 21 is a diagram showing an example of a connection between a UI device and a computer using an extender in the conventional technology. In addition, in the configuration example using an extender, when there are a plurality of computer bases 910-1 to 910-3 as shown in FIG. 22, a switch 921 switches the connection between the extender 904 at the user base 900 and the computer bases 910-1 to 910-3. FIG. 22 is a diagram showing another example of a connection between a UI device and a computer using an extender in the conventional technology.

[0004] Another conventional technology that enables a UI device and a computer to be installed in physically separate locations is a remote desktop function (see, for example, Non-Patent Document 1). FIG. 23 is a diagram showing an example of the configuration of a remote desktop in the conventional technology. UI devices (902-1 to 902-3) at the users' (US1 to US3) locations (user locations 900-1 to 900-3) are connected to the computers (901-1 to 901-3) at the users' locations, and the computers are connected to computers (911-1 to 911-3) at remote locations (e.g., computer location 910A) via a network (915-1 to 915-3) such as the Internet. In the remote desktop, a program running on a remote computer can be operated using a UI device at hand, and it is also possible to change the computer to which the connection is made. [Prior art documents] [Non-patent literature]

[0005] [Non-Patent Document 1] Takamichi Nishijima, Yuto Nakai, Hiroyuki Osaki et al., "Impact of Network Environment on Remote Desktop Protocol Performance," IEICE Technical Report CQ2012-21 (July 2012), Institute of Electronics, Information and Communication Engineers, 2012, pp. 23-28 Summary of the Invention [Problem to be solved by the invention]

[0006] When a user interface device and a computer are installed in separate locations, delays occur in the communication path connecting the user interface device and the computer. For applications that are sensitive to delays, it is necessary to control the delays, but conventional techniques have not been able to control the delays.

[0007] In view of the above circumstances, an object of the present invention is to provide a technique that makes it possible to adjust the delay between a user interface and a computer when the user interface and the computer are installed in separate locations. [Means for solving the problem]

[0008] One aspect of the present invention is an information processing system comprising a computer installed at a computer base, a first transceiver connected to the computer, a second transceiver installed at a user base used by a user, a device connected to the second transceiver, and a delay control device that measures the amount of delay that occurs between the first transceiver and the second transceiver and controls the measured amount of delay.

[0009] One aspect of the present invention is a delay control device that measures the amount of delay that occurs between a first transceiver connected to a computer installed at a computer site and a second transceiver installed at a user site used by a user and to which a device used by the user is connected, and controls the measured amount of delay.

[0010] One aspect of the present invention is an information processing method in an information processing system having a computer installed at a computer base, a first transceiver connected to the computer, a second transceiver installed at a user base used by a user, a device connected to the second transceiver, and a delay control device, in which the delay control device measures the amount of delay that occurs between the first transceiver and the second transceiver, and controls the measured amount of delay.

[0011] One aspect of the present invention is a program that causes a computer of a delay control device in an information processing system having a computer installed at a computer base, a first transceiver connected to the computer, a second transceiver installed at a user base used by a user, a device connected to the second transceiver, and a delay control device to measure the amount of delay that occurs between the first transceiver and the second transceiver, and control the measured amount of delay. Effect of the Invention

[0012] According to the present invention, it is possible to adjust the delay between a user interface and a computer when the user interface and the computer are located at separate locations. [Brief description of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating an example of an overall configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of a computer base and an example of a second network according to an embodiment. [Diagram 3] FIG. 11 is a diagram showing an example of connections when three users use the information processing system. [Figure 4] 11A and 11B are diagrams illustrating an example of a delay amount before and after adjustment. [Diagram 5] 11 is a sequence diagram of an example of a delay amount adjustment process procedure according to the embodiment; FIG. [Figure 6] 11 is a sequence diagram of an example of a delay amount adjustment process procedure according to the embodiment; FIG. [Figure 7] 13A and 13B are diagrams illustrating an example of delay amount adjustment when the number of users is increased. [Figure 8] 13A and 13B are diagrams illustrating an example of delay amount adjustment when the number of users is reduced. [Figure 9] 11 is a flowchart illustrating an example of a process for adjusting the amount of delay when the number of users according to the embodiment changes. [Figure 10] FIG. 2 is a diagram illustrating an example of a configuration of a UI transmission / reception device according to the embodiment. [Figure 11] FIG. 1 is a diagram illustrating a first specific example configuration of an information processing system. [Figure 12] FIG. 11 is a diagram illustrating a second specific configuration example of the information processing system. [Figure 13] FIG. 11 is a diagram illustrating a third specific example configuration of the information processing system. [Figure 14] FIG. 13 is a diagram illustrating a fourth specific configuration example of the information processing system. [Figure 15] FIG. 11 is a diagram illustrating a fifth specific configuration example of the information processing system. [Figure 16] FIG. 13 is a diagram illustrating a sixth specific configuration example of the information processing system. [Figure 17]FIG. 13 is a diagram showing a seventh specific configuration example of an information processing system, in which a plurality of computer locations are connected to each other. [Figure 18] FIG. 13 is a diagram showing an eighth specific configuration example of an information processing system, and another example of a connection connecting adjacent computer sites. [Figure 19] FIG. 13 is a diagram showing a ninth specific configuration example of an information processing system, and another example of a connection connecting adjacent computer sites. [Figure 20] FIG. 1 is a diagram showing an example of a configuration in which a computer and a UI device are directly connected in the prior art. [Figure 21] FIG. 1 is a diagram showing an example of a connection between a UI device and a computer using an extender in the prior art. [Figure 22] FIG. 11 is a diagram showing another example of a connection between a UI device and a computer using an extender in the prior art. [Figure 23] FIG. 1 is a diagram illustrating an example of the configuration of a remote desktop in the prior art. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0015] First Embodiment Fig. 1 is a diagram showing an example of the overall configuration of an information processing system according to this embodiment. As shown in Fig. 1, the information processing system 1 includes a delay control device 2, computer bases 3 (3-1, 3-2, ..., 3-n (n is an integer of 1 or more)), user bases 4 (4a-1, 4b-1, 4a-2, 4b-2, ..., 4a-m (m is an integer of 1 or more), 4b-m), a first network NW1, and a second network NW2 (networks).

[0016] At the computer base 3, one or more computers 31 and a UI transmission / reception device 32 are installed. In the example of FIG. 1, at the computer base 3, computers 31 (31a-n, 31b-n, ...) and UI transmission / reception devices 32 (32a-n, 32b-n, ...) (first transmission / reception devices) are installed. Note that the computer 31 and the UI transmission / reception device 32 may be integrated. In FIG. 1, some of the components installed at the computer base 3 are omitted. Note that the components installed at the computer base 3 will be described using FIG. 2 etc.

[0017] At the user location 4, UI devices 41 (41a-m, 41b-m, ...), sensors 42 (42a-m, 42b-m, ...), and UI transmission / reception devices 43 (43a-m, 43b-m, ...) (second transmission / reception devices) are installed.

[0018] The information processing system 1 includes one or more computer locations 3 .

[0019] The delay control device 2 measures the amount of delay occurring between the UI transmission / reception devices (32, 43) and performs delay adjustment control. The delay control device 2 controls the connection relationship between the UI transmission / reception device 43 at the user site 4 and the UI transmission / reception device 32 at the computer site 3. The delay control device 2 is connected to the computer 31 and the UI transmission / reception device 32 at the computer site 3, a communication device (not shown) constituting the second network NW2, and the UI transmission / reception device 43 at the user site 4, and is capable of checking the setting information of each device and changing the settings. The delay control device 2 is connected to each of the computer site 3, the user site 4, the first network NW1, and the second network NW2 by wire or wirelessly.

[0020] The delay control device 2 is configured using a processor such as a CPU (Central Processing Unit) and a memory. All or part of the functions of the delay control device 2 may be realized using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The above program may be recorded on a computer-readable recording medium. Examples of computer-readable recording media include portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and semiconductor storage devices (e.g., SSDs: Solid State Drives), and storage devices such as hard disks and semiconductor storage devices built into computer systems. The above program may be transmitted via an electric communication line.

[0021] The first network NW1 is, for example, the Internet and includes a communication network. The first network NW1 may have an authentication function. The first network NW1 may include a communication device.

[0022] The second network NW2 may be a wired or wireless network, may have any physical or logical topology, may be a circuit-switched or packet-switched network, and may include communication equipment.

[0023] Next, the computer base 3 will be described. The computer base 3 is, for example, a data center, a communication building, a server room, or the like.

[0024] The computer 31 may be a physical computer or a logical computer (virtual computer). In the case of a virtual computer, for example, a CPU, a GPU (Graphics Processing Unit), a memory, a storage, and the like are virtualized. The computer 31 may also be a game device. The computer 31 is connected to other computers and a server (not shown) in a data center via a first network NW1. The computer 31 is connected to a UI transmission / reception device 32, and user interface information such as a display signal and operation information of the computer 31 is exchanged. Specific examples of the display signal include HDMI (registered trademark, High-Definition Multimedia Interface) and DisplayPort, and examples of the operation information signal include USB (Universal Serial Bus). Examples of a signal that combines the display signal and the operation information include USB4 and Thunderbolt (registered trademark) 3. Note that one user may use a plurality of physical GPUs in cooperation with each other to boost the GPUs.

[0025] The UI transmission / reception device 32 receives a display signal and operation information, and converts them into a signal format that can be communicated over a long distance via the second network NW2. The UI transmission / reception device 32 is also connected to a UI transmission / reception device 43 at the user site 4 via the second network NW2. Examples of the signal format that can be communicated over a long distance include Ethernet (registered trademark) and OTN (Optical Transport Network). An example of the configuration of the UI transmission / reception device 32 will be described later.

[0026] Next, the user location 4 will be described. The user base 4 is a base where the user US (US1, . . . ) works, plays games, or the like, and is, for example, a home, an office, a rental space for business use, a game center, or the like.

[0027] The UI device 41 is a device related to a user interface, such as a display, a keyboard, a mouse, an operation controller (actuator), a camera, a VR (virtual reality) headset, an AR (augmented reality) headset, a microphone, a speaker, etc. Alternatively, the UI device 41 may be any device that inputs and outputs the five human senses (touch, sight, hearing, smell, taste) to and from the computer 31. The UI device 41 and the UI transmission / reception device 43 are connected by a signal format such as HDMI, DisplayPort, or USB.

[0028] The sensor 42 is, for example, a sensor for detecting the movement of the hand, face, body, etc. of the user US, a position sensor, an altitude sensor, a speed sensor, an acceleration sensor, a temperature sensor, a humidity sensor, a pressure sensor, a vibration sensor, a light sensor, a sound sensor, an electric field sensor, a magnetic field sensor, etc. The sensor 42 and the UI transmission / reception device 43 are connected by a signal format such as USB.

[0029] The UI transmission / reception device 43 is connected to the UI transmission / reception device 32 at the computer site 3 via the second network NW2. The second network NW2 is provided with a switching function, and can flexibly change the connection relationship between the UI transmission / reception device 32 at the computer site 3 and the UI transmission / reception device 43 at the user site 4. A plurality of UI signals may be multiplexed in the output of the UI transmission / reception device 43. It is sufficient that at least one of the UI device 41 or the sensor 42 is connected to the UI transmission / reception device 43.

[0030] Next, an example of a connection between the user site 4 and the computer site 3 will be described. In the example of FIG. 1, two users US1 and US2 use a computer 31 via a second network NW2. In the first route Cn1, the UI transmission / reception device 43a-1 of the user site 4a-1 and the UI transmission / reception device 32b-1 of the computer site 3-1 are connected via a second network NW2. In the second route Cn2, the UI transmission / reception device 43b-1 of the user site 4b-1 and the UI transmission / reception device 32b-2 of the computer site 3-2 are connected via a second network NW2. The connection relationship between the UI transmission / reception devices (32, 43) is controlled by the delay control device 2.

[0031] Next, a configuration example of a computer base and the second network will be described. Fig. 2 is a diagram showing an example of the configuration of a computer base and an example of a second network according to the present embodiment. In the example of Fig. 2, at least one computer 31 (31a-1, 31b-1, 31a-2, 31b-2), at least one UI transmission / reception device 32 (32a-1, 32b-1, 32a-2, 32b-2), an allocation device 33 (33-1, 33-2), and a switching device 34 (34-1, 34-2) are installed in the computer base 3 (3-1, 3-2).

[0032] The UI transmission / reception device 43 of each user site 4 is connected to the switching device 34 of the computer site 3 via a transmission path Tm (Tm-11, Tm-12, ..., Tm-21, Tm-22, ...). The transmission path Tm may be, for example, a colored IF (interface) using a WDM (Wavelength Division Multiplexing) signal of a wavelength division multiplexing method or a grey IF using a non-WDM signal. The switching device 34 is also connected to the switching device 34 of another computer site 3 via the transmission path Tm, and it is possible to flexibly change the connection relationship between the UI transmission / reception devices (32, 43). The switching device 34 is connected to the allocation device 33 of the same computer site 3, and it is possible to set which computer 31 of the computer site 3 it is connected to.

[0033] The switching device 34 (switch) switches the transmission path Tm according to the control of the delay control device 2. The switching device 34 is, for example, an optical switch, an electric switch, or a robot panel switch.

[0034] The allocation device 33 (switch) switches the UI transmission / reception device 32 connected to the UI transmission / reception device 43 of the user site 4 under the control of the delay control device 2. The allocation device 33 is, for example, an optical switch, an electric switch, or a robot panel switch.

[0035] In the example of Figure 2, when a first user US1 uses the user site 4a-1, based on the control of the delay control device 2, the UI transmission / reception device 43a-1 of the user site 4a-1 is connected to the UI transmission / reception device 32b-1 of the computer site 3-1 via the transmission path Tm-11, the switching device 34-1 of the computer site 3-1, and the allocation device 33-1, as in route Cn11.

[0036] Furthermore, when a second user US2 uses the user site 4b-1, based on the control of the delay control device 2, the UI transmission / reception device 43b-1 of the user site 4b-1 is connected to the UI transmission / reception device 32b-2 of the computer site 3-2 via the transmission path Tm-12 and the switching device 34-1 of the computer site 3-1, and via the transmission path Tm, the switching device 34-2 of the computer site 3-2, and the allocation device 33-2, as in route Cn12.

[0037] In this case, the second network NW2 is a network including a circuit switching function (hereinafter referred to as a "circuit switching network"). The circuit switching network is, for example, an OTN (Optical Transport Network) or an SDH (Synchronous Digital Hierarchy). The circuit switching network includes transmission lines Tm, Tm-11, Tm-12, ..., Tm-21, Tm-22, ..., etc.

[0038] For example, in the case of a remote desktop function of the conventional technology, UI information is exchanged over a network using Ethernet switches and routers, which requires switching of MAC (Media Access Control address) frames and IP (Internet Protocol) packets at various points in the network. When these switching operations occur, the signal is temporarily stored in a switching queue, and then the signal is switched when it becomes possible to switch, so that fluctuations occur in the delay time.

[0039] On the other hand, in the circuit-switched network according to the present embodiment, one user can occupy the communication capacity and the delay time is constant, so that the communication between the UI transceiver device 32 and the UI transceiver device 43 is stable. One user can occupy the communication capacity by allocating communication time slots by time division multiplexing. The delay time is constant because the allocated time slots are switched regularly and without delay even during switching.

[0040] Circuit-switched networks also include packet-switched networks that emulate circuit switching. In packet-switched networks that emulate circuit switching, bandwidth is secured by assigning priorities to packets, and switching is also prioritized according to the priority of the packets to stabilize switching delay times.

[0041] Next, a case where three users use the information processing system will be described. Fig. 3 is a diagram showing a connection example in which three users use the information processing system. In the example of Fig. 3, the UI transmission / reception device 43a-1 of the user site 4a-1 is connected to the UI transmission / reception device 32b-1 of the computer site 3-1 as in the route Cn11, and the first user US1 uses the computer 31b-1. Also, the UI transmission / reception device 43b-1 of the user site 4b-1 is connected to the UI transmission / reception device 32a-2 of the computer site 3-2 as in the route Cn13, and the second user US2 uses the computer 31a-2. Furthermore, the UI transmission / reception device 43a-2 of the user site 4a-2 is connected to the UI transmission / reception device 32b-2 of the computer site 3-2 as in the route Cn14, and the third user US3 uses the computer 31b-2.

[0042] In such a case, the delay time will differ for each user due to the transmission delay of the transmission path Tm (Tm-11, Tm-12, Tm-21) connecting the UI transmission / reception device 43 at each user's user site 4 and the UI transmission / reception device 32 at the computer site 3, and the processing delay within the devices that make up the second network NW2.

[0043] 4 is a diagram showing an example of the delay amount before and after adjustment. In the delay amount state g1 for each user before adjustment and the delay amount state g2 for each user after adjustment, the horizontal axis is the user and the vertical axis is the delay amount (for example, (ms)). As shown in the delay state g1 for each user before adjustment, the delay g101 of the first user US1 is the smallest Ta, the delay g102 of the second user US2 is the largest Tb, and the delay g103 of the third user US3 is Tc, which is between Ta and Tb.

[0044] If these users use applications that are sensitive to delays, unfairness will occur due to differences in delays between users. Examples of applications that are sensitive to delays include online gaming, eSports, online stock trading, etc. For example, in the case of online gaming, a user with low delay among the users competing against each other has the most advantage since user operations are reflected quickly, while a user with large delays is at a disadvantage since user operations are reflected late.

[0045] For this reason, in this embodiment, the delay control device 2 adjusts the delay amount to match the largest delay amount, as in the adjusted per-user delay amount state g2. In the adjusted per-user delay amount state g2, the delay control device 2 controls the adjustment correction amount g111 of the route of the first user US1 to (Tb-Ta), and controls the adjustment correction amount g112 of the route of the third user US3 to (Tb-Tc).

[0046] Here, an example of the procedure for adjusting the delay amount will be described with reference to Fig. 5 and Fig. 6. Fig. 5 and Fig. 6 are sequence diagrams of an example of the procedure for adjusting the delay amount according to this embodiment. In the example of the procedure in Fig. 5, a case where there are two users will be described for the sake of simplicity.

[0047] The delay control device 2 controls the switching device 34 and the allocation device 33 of the computer base 3 so as to connect the UI transmission / reception device 43 of the user base 4 with the UI transmission / reception device 32 of the computer base 3 (step S1).

[0048] The switching device 34-1 and the allocation device 33-1 of the computer base 3-1 switch the transmission paths to be connected under the control of the delay control device 2, and connect the UI transmission / reception device 43a-1 and the UI transmission / reception device 32b-1 (step S2). The switching device 34-2 and the allocation device 33-2 of the computer base 3-2 switch the transmission paths to be connected under the control of the delay control device 2, and connect the UI transmission / reception device 43a-2 and the UI transmission / reception device 32b-2 (step S3).

[0049] The delay control device 2 transmits a delay amount measurement instruction to each UI transmission / reception device (32, 43) (step S4). Each UI transmission / reception device (32, 43) receives the delay amount measurement instruction transmitted by the delay control device 2 (steps S5 to S8).

[0050] The UI transmission / reception device 43a-2 at the user site 4a-2 and the UI transmission / reception device 32b-2 at the computer site 3-2 measure the amount of delay between the UI transmission / reception device 43a-2 and the UI transmission / reception device 32b-2 based on the received delay measurement instruction (step S9).

[0051] At least one of the UI transmission / reception device 43a-2 and the UI transmission / reception device 32b-2 transmits the measured delay amount information to the delay control device 2. In the example of Fig. 5, the UI transmission / reception device 32b-2 transmits the measured delay amount information to the delay control device 2 (step S10). The delay control device 2 receives the delay amount information transmitted by the UI transmission / reception device 32b-2 (step S11).

[0052] The UI transmission / reception device 43a-1 at the user site 4a-1 and the UI transmission / reception device 32b-1 at the computer site 3-1 measure the amount of delay between the UI transmission / reception device 43a-1 and the UI transmission / reception device 32b-1 based on the received delay amount measurement instruction (step S12).

[0053] At least one of the UI transmission / reception device 43a-1 and the UI transmission / reception device 32b-1 transmits the measured delay amount information to the delay control device 2. In the example of Fig. 5, the UI transmission / reception device 32b-1 transmits the measured delay amount information to the delay control device 2 (step S13). The delay control device 2 receives the delay amount information transmitted by the UI transmission / reception device 32b-1 (step S14).

[0054] Let us now turn to FIG. The delay control device 2 compares the received delay amounts to detect the largest delay amount, and then calculates an adjustment delay amount to match the largest detected delay amount (step S15).

[0055] The delay control device 2 transmits the calculated adjustment delay amount information to each UI transmission / reception device (32, 43) (step S16). Note that the delay control device 2 does not need to transmit the adjustment delay amount information to a UI transmission / reception device (32, 43) for which the adjustment delay amount is 0, i.e., for which the delay amount is not adjusted. Each UI transmission / reception device (32, 43) receives the adjustment delay amount information transmitted by the delay control device 2 (steps S17 to S20).

[0056] The UI transmission / reception device 43a-2 and the UI transmission / reception device 32b-2 adjust the delay amount based on the received adjustment delay amount information (step S21). The UI transmission / reception device 43a-1 and the UI transmission / reception device 32b-1 adjust the delay amount based on the received adjustment delay amount information (step S22). The UI transmission / reception device (32, 43) may transmit to the delay control device 2 delay amount adjustment completion information indicating that the delay amount has been adjusted.

[0057] By this process, according to this embodiment, the delays of users are made uniform, and unfairness can be rectified.

[0058] The delay adjustment method may include a method of adding a delay in the UI transmission / reception device 32 (or 43), a method of adding a delay by the computer 31, a method of adding a delay by a communication device of the second network NW2, etc. Alternatively, the delay adjustment method may reduce the delay difference by appropriately selecting a route in the second network NW2. The delay amount may be adjusted, for example, with or without a momentary interruption of the signal between the UI transmission / reception devices (32, 43).

[0059] The delay control device 2 may measure the amount of delay by, for example, ODU Delay Measurement (ODU DM) defined in OTN. The delay control device 2 may adjust the amount of delay by, for example, a method using First in First out (FIFO). Here, an example of a method for adjusting delay without interruption using FIFO will be described. In this method, the FIFO clock frequency is intentionally increased or decreased, making it possible to adjust the delay time while still allowing signals to pass. In this method, for example, if the read clock frequency is set higher than the write clock frequency, the FIFO usage gradually decreases, making it possible to shorten the delay time. Conversely, in this method, if the read clock frequency is set lower than the write clock frequency, the FIFO usage gradually increases, making it possible to lengthen the delay time.

[0060] Next, an example of how to adjust the delay amount when the number of users is increased will be described. Fig. 7 is a diagram showing an example of delay amount adjustment when the number of users is increased. Fig. 7 shows a case where a fourth user US4 is added after the delay amounts for the three users in Fig. 4 are adjusted. In Fig. 7, in the adjustment amount state g3 for each user before adjustment after the number of users is increased, and the delay amount state g4 for each user after adjustment after the number of users is increased, the horizontal axis is the user and the vertical axis is the delay amount (for example, (ms)). As in the adjustment amount state g3 for each user before adjustment, the delay amount g104 of the fourth user US4 is Td, which is larger than Tb.

[0061] In this case, the delay control device 2 re-adjusts the delay amounts of the first user US1, the second user US2, and the third user US3, as shown in the delay amount state g4 for each user after adjustment, so as to match Td with the largest delay amount g104. In this embodiment, the delay amount of the fourth user US4 who joined later is also re-adjusted, so that it is fair.

[0062] Specifically, the delay control device 2 controls the adjustment correction amount g111' of the route of the first user US1 to (Td-(Tb-Ta)), controls the adjustment correction amount g113 of the route of the second user US2 to (Td-(Tb)), and controls the adjustment correction amount g112' of the route of the third user US3 to (Td-(Tb-Tc)).

[0063] For example, if the number of participants increases during a gaming match, the delay can be adjusted without causing a momentary interruption in the signal, allowing the user to continue playing the game without being aware that the amount of delay is being adjusted.

[0064] Next, an example of adjusting the delay amount when the number of users is reduced will be described. Fig. 8 is a diagram showing an example of delay amount adjustment when the number of users is reduced. Fig. 8 shows an example of a state (g5) in which the number of users is reduced to two from the state (g4) in Fig. 7 where the second user US2 and the fourth user US4 are removed. In Fig. 8, the horizontal axis indicates users and the vertical axis indicates delay amount (for example, (ms)) in the delay amount state g4 for each user after adjustment, the delay amount state g5 for each user before adjustment of the delay amount after the number of users is reduced, and the delay amount state g6 for each user after adjustment of the delay amount after the number of users is reduced.

[0065] In this case, the first user US1 and the third user US3 are competing with each other in a state where an extra delay (over-corrected delay) has been added to them, as in the delay amount state g5 for each user before the delay amount is adjusted after the number of users is reduced. When the number of users is reduced, as in the delay amount state g6 for each user after the delay amount is adjusted after the number of users is reduced, the delay control device 2 removes this extra delay and adjusts it to match the delay amount of the third user US3, who has the larger delay of the two users.

[0066] Specifically, the delay control device 2 controls the adjustment correction amount g111'' of the path of the first user US1 from (Td-(Tb-Ta)) to (Tc-Ta), and controls the correction delay amount of the path of the third user US3 to return to 0.

[0067] Here, an example of the procedure for adjusting the delay amount when the number of users changes will be described. Fig. 9 is a flowchart showing an example of the adjustment process of the delay amount when the number of users changes according to this embodiment.

[0068] The delay control device 2 transmits a delay amount measurement instruction to each UI transmission / reception device (32, 43) (step S101). The delay control device 2 receives the delay amount information transmitted from each UI transmission / reception device (32, 43) (step S102).

[0069] The delay control device 2 detects the maximum delay amount from the received delay amount information (step S103). The delay control device 2 compares each detected delay amount with each delay amount to calculate an adjustment delay amount (step S104). The delay control device 2 transmits the calculated adjustment delay amount to each UI transmission / reception device (32, 43) (step S105).

[0070] The delay control device 2 detects whether the number of participants has changed (step S106). The delay control device 2 may detect the change in the number of participants by detecting, for example, that the user has operated the UI device 41 to log in. If the delay control device 2 determines that the number of participants has changed (step S106; YES), it proceeds to the process of step S107. If the delay control device 2 determines that the number of participants has not changed (step S106; NO), it ends the process.

[0071] The delay control device 2 determines whether the number of participants has increased or decreased (step S107). If the delay control device 2 determines that the number of participants has decreased (step S107; decrease), it returns to the process of step S103. If the delay control device 2 determines that the number of participants has increased (step S107; increase), it proceeds to the process of step S108.

[0072] The delay control device 2 transmits a delay amount measurement instruction to the UI transmission / reception device 43 at the user site 4 used by the increased user and to the UI transmission / reception device 32 at the computer site 3 (step S108). The delay control device 2 receives the delay amount information transmitted by the UI transmission / reception devices (32, 43) (step S109).

[0073] 9 is merely an example, and is not intended to be limiting. For example, the number of participants may be changed by interrupt processing.

[0074] As described above, in this embodiment, the UI device 41 and the sensor 42 at the user site 4 are connected to the computer 31 at the computer site 3 via the second network NW2 by the above-mentioned configuration and processing. Furthermore, in this embodiment, the amount of delay between the UI device 41 or the sensor 42 and the computer 31 is adjusted. Also, in this embodiment, when the number of participants increases or decreases during a game, eSports, or the like, the amount of delay is adjusted.

[0075] As a result, according to this embodiment, in cases where fairness is required in games, eSports, etc., or in applications that require time synchronization, it is possible to adjust the unevenness of delay for each user due to conditions such as transmission paths, etc., to achieve equal delay conditions. As a result, according to this embodiment, it is possible to perform an operation suitable for implementing delay-sensitive applications used by multiple users.

[0076] In the above description, the case where the delays of multiple users are made the same has been described, but for example, when the performance difference between the computers used by each user is large and the processing delays of the computers are different, the delay control device 2 may set a network-side delay for each user so as to offset the difference in the processing delays of the computers. In this way, according to this embodiment, the difference in the processing delays of the computers can be offset. Furthermore, the delay control device 2 may intentionally set different delays to provide a handicap when there is a large difference in the skills of multiple users. In this way, according to this embodiment, a handicap can be provided.

[0077] Next, a configuration example of the UI transmission / reception device will be described. FIG. 10 is a diagram showing an example of the configuration of a UI transmission / reception device according to this embodiment. In the following description, the UI transmission / reception device 32 and the UI transmission / reception device 43 have the same configuration, but the configurations may be different. As shown in FIG. 10, the UI transmission / reception device 32 of the computer base 3 includes, for example, a monitoring control unit 301, at least one UI input / output unit 302 (302a, ...) or a sensor input / output unit 307 (307a, ...), at least one compression / decompression unit 303 (303a, 303b, ...), at least one mapping / demapping unit 304 (304a, 304b, ...), a multiplexing / demultiplexing unit 305, a transmission / reception unit 306, and a delay measurement unit 308. The delay measurement unit 308 may be located between the mapping / demapping unit 304 and the multiplexing / demultiplexing unit 305. The configuration shown in FIG. 10 is an example, and is not limited to this.

[0078] Moreover, the UI transmission / reception device 43 of the user site 4 includes, for example, a monitoring control unit 401, at least one UI input / output unit 402 (402a, ...) or a sensor input / output unit 407 (407a, ...), at least one compression / decompression unit 403 (403a, 403b, ...), at least one mapping / demapping unit 404 (404a, 404b, ...), a multiplexing / demultiplexing unit 405, a transmission / reception unit 406, and a delay measurement unit 408. Note that the delay measurement unit 408 may be located between the mapping / demapping unit 404 and the multiplexing / demultiplexing unit 405. Note that in FIG. 10, some of the configuration of the UI transmission / reception device 43 is omitted.

[0079] In the case of the UI transmission / reception device 32, the monitoring control unit 301 is connected to the delay control device 2 via a wired or wireless line, the transmission / reception unit 306 is connected to the allocation device 33, and the UI input / output unit 302 and the sensor input / output unit 307 are connected to the computer 31.

[0080] In the case of the UI transmission / reception device 43, the monitoring control unit 401 is connected to the delay control device 2 by a wired or wireless line, the transmission / reception unit 406 is connected to the transmission path Tm, the UI input / output unit 402a is connected to the UI device 41, and the sensor input / output unit 407a is connected to the sensor 42. Note that the arrangement of the transmission / reception unit 406 and the multiplexing / demultiplexing unit 405 may be reversed.

[0081] The monitoring and control unit 301 is connected to each unit of the UI transmission / reception device 32, and monitors the status of each unit and changes the settings. The monitoring and control unit 301 is connected to the delay control device 2, and changes the connection relationship of the UI transmission / reception device 32, monitors the connection status with the computer 31, and sets the operation. The monitoring control unit 401 is connected to each unit of the UI transmission / reception device 43, and monitors the state of each unit and changes the settings. The monitoring control unit 401 is connected to the delay control device 2, and changes the connection relationship of the UI transmission / reception device 43, and monitors the state of the UI device 41 and sets its operation. The monitoring control unit 301 (401) acquires the amount of delay measured by the delay measurement unit 308 (408). At least one of the monitoring control unit 301 and the monitoring control unit 401 outputs delay amount information indicating the acquired amount of delay to the delay control device 2.

[0082] For example, in the case of the computer base 3, the UI input / output unit 302a is connected to a UI signal from the computer 31. The UI signal is, for example, an HDMI, DisplayPort, USB, Thunderbolt, Bluetooth (registered trademark), analog audio, or digital audio signal. The UI input / output unit 302a is connected to a compression / decompression unit 303a. For example, the UI input / output unit 402a is connected to the UI device 41. The UI input / output unit 402a is connected to the compression / decompression unit 403a.

[0083] For example, the sensor input / output unit 307a is connected to a UI signal from the computer 31. The sensor input / output unit 307a is connected to the compression / decompression unit 303b. For example, the sensor input / output unit 407a is connected to the sensor 42. The sensor input / output unit 407 is connected to the compression / decompression unit 403b.

[0084] The compression / decompression unit 303 compresses or decompresses the capacity of a compressible UI signal according to the control of the monitoring control unit 301. A specific example is the compression of a display signal such as an HDMI or DisplayPort signal, and examples of the compression method include DSC (Display Stream Compression), VDC-M (VESA Display Compression for Mobile), and MPEG (Moving Picture Experts Group), which are defined by VESA (Video Electronics Standards Association). The compression / decompression unit 303 may not be required. The compression / decompression unit 303 may change the compression method or decompression method according to the state of the transmission path Tm. For example, the latency of the compression / decompression unit 303 increases as the compression ratio increases. For this reason, the compression / decompression unit 303 uses, for example, no compression or a compression method with a low compression ratio to achieve low latency. The compression / decompression unit 303 is connected to the mapping / demapping unit 304.

[0085] The compression / decompression unit 403 performs the reverse process of the compression / decompression unit 303 under the control of the monitor and control unit 401. The compression / decompression unit 403 is connected to the mapping / demapping unit 404.

[0086] The mapping / demapping unit 304 converts the UI signal into a signal format that can be transmitted over long distances under the control of the monitor and control unit 301. The signal format is, for example, OTN defined by the ITU-T. The mapping / demapping unit 304 is connected to the multiplexing / demultiplexing unit 305. The mapping / demapping unit 404 converts the UI signal into a signal format suitable for long distance transmission under the control of the monitor and control unit 401. The mapping / demapping unit 404 is connected to the multiplexing / demultiplexing unit 405.

[0087] The multiplexer / demultiplexer 305 multiplexes and demultiplexes a plurality of signals according to the control of the monitor / controller 301. For example, when OTN is used as a signal format that can be transmitted over long distances, the multiplexer / demultiplexer 305 multiplexes a plurality of ODU (Optical Data Unit) signals output from the mapping / demapping unit 304 to multiplex an ODU with a larger capacity. The multiplexer / demultiplexer 305 is connected to a delay measurement unit 308. The multiplexer / demultiplexer 405 performs the inverse process of the multiplexer / demultiplexer 305 under the control of the monitor and controller 401. The multiplexer / demultiplexer 405 is connected to the delay measurement unit 308 (408).

[0088] The delay measurement unit 308 (408) measures the delay between the delay measurement unit of the opposing UI transmitting / receiving device. The delay measurement method is, for example, ODU Delay Measurement (ODU DM) defined in OTN. The delay measurement unit 308 (408) also applies a delay as necessary. The delay measurement unit 308 (408) is connected to the transmitting / receiving unit 306 (406). The delay measurement unit 308 (408) may be located between the mapping / demapping unit 304 (404) and the multiplexing / demultiplexing unit 305 (405). In that case, it is also possible to adjust the delay independently for each UI signal or sensor signal.

[0089] The transmitting / receiving unit 306 transmits and receives signals transmitted through the second network NW2 in response to the control of the monitoring and control unit 301. For example, in the case of OTN, the transmitting / receiving unit 306 transmits and receives OTU (Optical-channel Transport. Unit) signals. The transmitting / receiving unit 306 is connected to the second network NW2 and is connected to the UI transmitting / receiving device 43 of the user site 4 via the allocation device 33, the switching device 34, and the transmission path Tm. The information capacity to be transmitted and received is, for example, OTU0LL, OTU1, OTU2, OTU2e, OTU3, OTU4, OTUCn, GbE (Gigabit Ethernet), 2.5GbE, 5GbE, 10GbE, 25GbE, 50GbE, 100GbE, 400GbE, etc. The transmitting / receiving unit 306 may change the capacity in response to the state of the transmission path Tm. The transmitting / receiving unit 406 transmits and receives information to and from the computer base 3 via the transmission line Tm in accordance with the control of the monitor and control unit 401 .

[0090] The delay control device 2 then acquires delay amount information from multiple UI transmission / reception devices 32 (or 43). In the example of Fig. 10, the delay amount is the delay time between the UI transmission / reception device 32 and the UI transmission / reception device 43. The delay amount may be measured under the control of the computer 31 at the computer base 3.

[0091] <First Example> FIG. 11 is a diagram showing a first specific configuration example of an information processing system. In the example of FIG. 11, a graphic board (including a GPU 321) is mounted on a computer 31A installed at a computer base 3A, and a DisplayPort is output as a video signal. The graphic board may be equipped with a plurality of terminals, and for example, two DisplayPort signal lines 351 and 352 may be used simultaneously as shown in FIG. 11. Note that a single computer may be equipped with a plurality of graphic boards, and the plurality of terminals may be used by one user or a plurality of users. In addition, the computer 31A exchanges operation information and the like via a USB (for example, USB 2.0 or USB 3.2) terminal and signal lines 353 and 354. In addition, the UI transmission / reception device 32A of the computer base 3A and the UI transmission / reception device 43A of the user base 4A are connected, for example, via an I / O (input / output port) 311 of the QSFP28 standard and a transmission line TmA.

[0092] The function of the UI transmission / reception device 32A is implemented in, for example, an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). Fig. 11 shows an example in which an FPGA is used for the UI transmission / reception device 32A to accommodate and multiplex various signals in the OTN.

[0093] The signal transmitted from the UI transceiver 32A is transmitted through the optical fiber transmission path TmA and sent to the UI transceiver 43A at the user site 4A. The transmission path TmA may be single-core bidirectional or dual-core bidirectional. The transmission path may be different depending on the transmission direction. For example, the downstream transmission path may be a passive optical network PON (Passive Optical Network), and the upstream transmission path may be a fourth-generation communication standard or a fifth-generation communication standard.

[0094] The UI transmission / reception device 43A restores the original signal by performing processing reverse to that performed on the transmission side. The restored signals, here the signals of DisplayPort 451 and 452, USB 3.0 (413), and USB 2.0 (414), are output from the UI transmission / reception device 43A and connected to the display device 411, the display device 412, the external device 413, and the input device 414. Examples of the external device 413, which is a USB device, and the input device 414, which is a USB device, include input / output devices such as a keyboard, a mouse, and a gaming controller, a large-capacity storage device, an audio interface, a camera, and various sensors. Note that devices connected to the UI transmission / reception device 43A are not limited to these. Similarly, in the following configuration examples, devices connected to the UI transmission / reception device at the user site are not limited to these.

[0095] Although the signal flow from the UI transceiver 32A at the computer site 3A to the UI transceiver 43A at the user site 4A has been described, data can also be transferred in the opposite direction by similar signal processing.

[0096] Next, an example of implementing the UI transmission / reception device 32A in an FPGA will be described with reference to Fig. 11. Note that in the implementation example g11 and the following embodiments, Comp is an abbreviation for Compression, MAP is an abbreviation for Mapping, MUX is an abbreviation for Multiplexing, Encryp is an abbreviation for Encryption, and FEC is an abbreviation for Forward Error Correction. The FPGA implements the OTN function as shown in the implementation example g11. There are various possible resolutions, refresh rates, and color depths of video signals. For example, in the case of 4K resolution, 120 (fps) (frames per second), and 24 (bpp) (bits per pixel) in DisplayPort 1.4, the bit rate is about 26 (Gbps). The compression / decompression unit (Comp) 303 (303a, 303b) compresses this signal as necessary. Compression is performed, for example, by VESA DSC. When VESA DSC is used, 3:1 compression is performed and the bit rate can be reduced to about 8.7 (Gbps). When compression is not performed, there is an advantage of low latency because the compression process does not take time, but on the other hand, the transfer capacity is large. On the other hand, when compression is performed, there is an advantage of low latency because the compression process takes time compared to the non-compression case, but on the other hand, the transfer capacity can be reduced.

[0097] The image bit rate is, for example, 4.67 (Gbps) for 1080p 240 (Hz) DSC, 8.61 (Gbps) for 4K 120 (Hz) 24 (bpp) DSC, and 49.65 (Gbps) for 8K 60 (Hz) 24 (bpp).

[0098] Here, the process for the non-compressed case will be described. The DisplayPort signal is accommodated in an ODU frame by the mapping function (MAP 363 to 366) of OTN. The mapping / demapping unit 304 has a mapping function. For example, the Bit-synchronous Mapping Procedure (BMP), Asynchronous Mapping Procedure (AMP), or Generic Mapping Procedure (GMP) defined by OTN can be applied for mapping.

[0099] The signal accommodated in the ODU is multiplexed into a higher ODU frame by the multiplexing function (MUX367) of the OTN. When multiplexing a signal of about 26 (Gbps) when the higher ODU is ODU4, since the size of the tributary slot of ODU4 is 1.302 (Gbps), it is possible to multiplex into 20 tributary slots, that is, ODTU4.20. In the implementation example g11, for example, the multiplexing stage between MAP363-365 and MUX367 is ODUflex (371-373), and the multiplexing stage between MAP366 and MUX367 is ODU0 (374). Also, the multiplexing step between MUX367 and Encryp368, the multiplexing step between Encryp368 and FEC369, and the multiplexing step between FEC377 and I / O311 of the QSFP28 standard are ODU4 (375, 376, 377). Note that Encryp368 performs encryption processing. FEC369 performs error correction code processing.

[0100] Here, the USB signals will be described. The example in Figure 11 shows a USB3.0 signal and a USB2.0 signal. The bit rate of the USB3.0 signal is 5 (Gbps), and the bit rate of the USB2.0 signal is 480 (Mbps). As with the DisplayPort, the USB signals are first accommodated in an ODU frame by the mapping function of the OTN, and then multiplexed into the required number of tributary slots of the upper ODU frame. When the upper ODU is ODU4, the USB3.0 signal can be multiplexed into four tributary slots, and the USB2.0 signal can be multiplexed into one tributary slot.

[0101] An example of the usage of the ODU4 tributary slots is shown in the area surrounded by the symbol g12 in Fig. 11. As long as there are vacant tributary slots, multiplexing of signals other than those shown here is also possible. After being multiplexed, the signals are encrypted as necessary, and then forward error correction (FEC) is added to the ODU, and the signal is output from the UI transceiver as an OTU4 signal. To transmit and receive the OTU4 signal from the UI transceiver 32A, for example, a 100G optical module conforming to the QSFP28 standard or an electrical cable (DAC; Direct Attachment Cable) with QSFP28 connectors on both ends can be used.

[0102] <Second Example> FIG. 12 is a diagram showing a specific second configuration example of the information processing system. In the example of FIG. 12, a signal line 355 of the computer 31B (31B-1, 31B-2) of the computer base 3B is a signal line that transmits a signal of the Thunderbolt 3 standard. The computer 31B and the UI transmission / reception device 32B are connected by this signal line 355. In addition, since the Thunderbolt 3 is a signal in which a video signal, a USB signal, etc. are multiplexed, both the video signal and the USB signal can be transmitted and received just by transferring the Thunderbolt 3. As in the area surrounded by the symbol g22 in FIG. 12, the Thunderbolt 3 signal is accommodated in an ODU frame as in the first embodiment, and then multiplexed into a higher-level ODU, and transmitted from the UI transmission / reception device 32B to the user base 4B.

[0103] As shown in FIG. 12, the UI transmission / reception device 32B may be connected to a plurality of computers 31B (31B-1, 31B-2) and signals from these computers 31B may be multiplexed and transmitted.

[0104] The transmission line TmB between the computer site 3B and the user site 4B is, for example, OUT4, OTL4.4. The UI transmission / reception device 43B of the user site 4B is connected to a Thunderbolt 3 dock 44B (44B-1, 44B-2). The Thunderbolt 3 dock 44B separates the multiplexed signals. One or more display devices 411 (411-1, 411-2), 412 (412-1, 412-2), external devices 413 (413-1, 413-2) that are USB 3.0 devices, and input devices 414 (414-1, 414-2) such as a keyboard and a mouse are connected to the Thunderbolt 3 dock 44B.

[0105] <Third Example> Fig. 13 is a diagram showing a specific third example of the configuration of the information processing system. In the example of Fig. 13, two DisplayPort signals are input / output via signal lines 351 and 352 from a computer 31C at a computer base 3C, and one USB 2.0 signal is input / output via a signal line 354. These signals are input to a UI transmission / reception device 32C. In this example, a video signal of 1080p, 60 (fps), and 24 (bpp) is shown. In this case, the bit rate of the video signal is about 3.2 (Gbps). USB 2.0 is 480 (Mbps).

[0106] As in the first and second embodiments, these signals are first mapped to an ODU frame. Each ODU signal is multiplexed into a higher-level ODU. Here, an ODU2 signal is used as the higher-level ODU. The capacity of an ODU2 tributary slot is 1.249 (Gbps), and the ODUs to which each signal is mapped are multiplexed into the required number of tributary slots, as in the area surrounded by reference symbol g32 in FIG. 13. An ODU accommodating DisplayPort is multiplexed into three tributary slots, i.e., ODTU2.3. An ODU accommodating USB 2.0 is multiplexed into one tributary slot, i.e., ODTU2.1.

[0107] As shown in the area surrounded by symbol g31 in Figure 13, the UI transceiver 32C encrypts the ODU2 signal as necessary, adds an error correction code, and then transmits it as an OTU2 signal from a 10 (Gbps) optical module 311C called, for example, SFP+.

[0108] The transmission line TmC between the computer site 3C and the user site 4C is, for example, OTU2(LR). Note that the transmission line TmC may be a single-core bidirectional line or a two-core bidirectional line. The UI transmission / reception device 43C at the user site 4C restores the original signal by performing processing inverse to that performed on the transmission side. The restored signals, here the DisplayPort 451, 452 and USB 2.0 (454) signals, are output from the UI transmission / reception device 43C and connected to display devices 411, 412 and a USB 2.0 device, for example, an input device 414.

[0109] <Fourth Example> Fig. 14 is a diagram showing a fourth specific example of the configuration of an information processing system. In the example of Fig. 14, a plurality of computers 31D (31D-1, 31D-2, 31D-3, ...) and a plurality of UI transmission / reception devices 32D (32D-1, 32D-2, 32D-3, ...) are installed at a computer base 3D.

[0110] In this embodiment, the performance of the graphic boards GPUs 321D (321D-1, 321D-2, 321D-3) of the three computers 31D-1, 31D-2, 31D-3 is different. For example, the GPU 321D-1 is a high-performance graphic board, the GPU 321D-2 is a medium-performance graphic board, and the GPU 321D-3 is a low-performance graphic board.

[0111] As in the first to third embodiments, each computer 31D is connected to a UI transceiver 32D. An optical switch 35D (switch) is connected to the output of the UI transceiver 32D. The optical switch is, for example, a robot patch panel that changes the connection relationship of optical connectors by operating a robot arm. The optical switch is connected to each transmission path TmD (TmD-1, TmD-2, TmD-3, ...), and is connected to UI transceivers 43D (43D-1, 43D-2, 43D-3, ...) of the user site 4D (4D-1, 4D-2, 4D-3, ...). The transmission path TmD is, for example, OTU4 or OTL4.4 (LR4).

[0112] The UI transmission / reception device 43D of the user site 4D is connected to a display device, an external device such as a USB 3.0 device, and an input device such as a USB 2.0 device, in the same manner as in the first to third embodiments.

[0113] Here, when a user uses high-performance graphics performance at a first time, the computer 31D to be used can be selected by changing the connection relationship between the UI transceiver device 32D and the UI transceiver device 43D using the optical switch 35D in accordance with the control of the delay control device 2.

[0114] When the same user uses the computer at a second time for an application for which low graphics performance is sufficient, the connection relationship between the UI transceiver unit 32D and the UI transceiver unit 43D is changed by an optical switch in accordance with the control of the delay control device 2, making it possible to use the appropriate computer 31D.

[0115] <Fifth Example> The mechanism for changing the computer to be used is not limited to the configuration using the optical switch 35D shown in Fig. 14 of the fourth embodiment. Fig. 15 is a diagram showing a specific fifth configuration example of the information processing system. In the example of Fig. 15, a switch 35E is provided between the computer 31D (31D-1, 31D-2, 31D-3, ...) of the computer base 3E and the UI transmission / reception device 32D (32D-1, 32D-2, 32D-3, ...). The switch 35E is, for example, a DP (display) and USB switch, and is switched under the control of the delay control device 2.

[0116] <Sixth Example> Moreover, the optical switch 35D shown in Fig. 14 of the fourth embodiment may be a Thunderbolt 3 switch 35F (switch) as shown in Fig. 16. Fig. 16 is a diagram showing a specific sixth configuration example of an information processing system. In the example of Fig. 16, a Thunderbolt 3 switch 35F is provided between computers 31F (31Fa-1, 31Fb-1, 31Fa-2, 31Fb-2, 31Fa-3, 31Fb-3, ...) of a computer base 3F and a UI transmission / reception device 32F (32F-1, 32F)-2, 32F-3, ...).

[0117] In this case, the output port 356 of the computer 31F is, for example, a USB Type-C, and the computer 31F and the Thunderbolt 3 switch 35F are connected by a signal line 355 or the like conforming to the Thunderbolt 3 standard. For example, computer 31F-1 (31Fa-1, 31Fb-1) is a high-performance graphics board, computer 31F-2 (31Fa-2, 31Fb-2) is a medium-performance graphics board, and computer 31F-3 (31Fa-3, 31Fb-3) is a low-performance graphics board.

[0118] Furthermore, at the user site 4F (4F-1, 4F-2, 4F-3, ...), each port of the UI transmission / reception device 43F (43F-1, 43F-2, 43F-3, ...) is connected to a Thunderbolt 3 dock 44F (44Fa-1, 44Fb-1, 44Fa-2, 44Fb-2, 44Fa-3, 44Fb-3, ...) via a signal line 456. The delay control device 2 controls the switching of the Thunderbolt 3 dock 44F. Moreover, the configurations of the user locations 4F-1, 4F-2, and 4F-3 may be the same or different.

[0119] <Seventh Example> FIG. 17 is a diagram showing a seventh specific configuration example of an information processing system, in which a plurality of computer locations are connected to each other. Here, referring to Figure 17, we will explain the case where a user at user site 4D-1 attempts to use a computer 31G with the desired performance, but at computer site 3G-1 directly connected to user site 4D-1 via a transmission line, all of the computers 31G with the performance required by the user are being used by other users and there are no available computers, or no such computers 31G are installed.

[0120] In this case, it is assumed that a computer 31G having the performance desired by the user is installed at computer base 3G-2 and is available for use. At this time, the signal from the UI transceiver 43D-1 of the user site 4D-1 is connected to the optical switch 35G-1 of the computer site 3G-1, which is directly connected to the user site 4D-1 through the transmission line TmD-1 as shown by the dashed line of the route Cn21, according to the control of the delay control device 2. Then, in the computer site 3G-1, the signal is sent to the optical transmission device 36Ga-1 for communication with the computer site 3G-2, where the computer 31G having the user's desired performance is installed. In the computer site 3G-1, after the optical transmission device 36Ga-1, the signal is optically multiplexed by the optical multiplexer 37G-1 as necessary and arrives at the computer site 3G-2.

[0121] At the computer site 3G-2, the signal is demultiplexed by an optical multiplexer 37G-2, and the demultiplexed signal is input to an optical transmission device 36Ga-2 and connected to a UI transmission / reception device 32G-2 via an optical fiber switch 35G-2.

[0122] The ports of the optical transmission device 36G (36Ga-1, 36Gb-1, 36Ga-2, 36Gb-2) ​​connected to the optical switch 35G (35G-1, 35G-2) (switch) are, for example, ports of the QSFP28 standard. Also, the ports of the optical transmission device 36G (36Ga-1, 36Gb-1, 36Ga-2, 36Gb-2) ​​connected to the optical multiplexer 37G (37G-1, 37G-2) are, for example, ports of the QSFP56-DD standard.

[0123] The optical switches 35G (35G-1, 35G-2) are, for example, optical fiber switches, robot patch panels, etc. The computer bases 3G are connected to each other by a transmission line TmG. The transmission line TmG is, for example, an optical fiber cable that transmits a signal conforming to the 400G-ZR (DWDM) or OTU4 standard.

[0124] In addition, in Fig. 17, the signal flow in only one direction is explained, but the flow in the opposite direction is similar. With the above-mentioned configuration, it becomes possible to connect to the UI transmission / reception device 32G of another computer base 3G, and it becomes possible to accommodate the resources of the computer 31G having the desired performance.

[0125] <Eighth Example> FIG. 18 is a diagram showing an eighth specific configuration example of an information processing system, and another connection example connecting adjacent computer sites. In this embodiment, the computer sites 3H (3H-1, 3H-2) are connected by a transmission medium 5H such as a multi-core optical fiber or a multi-core fiber. The transmission medium 5H enables a connection between the UI transceiver 43D-1 at the user site 4D-1 and the UI transceiver 32H-2 at the computer site 3H-2. The transmission medium 5H may be a multi-way path.

[0126] <Ninth Example> FIG. 19 is a ninth specific configuration example of an information processing system, showing another connection example connecting adjacent computer sites. In this embodiment, the UI transceiver 43J (43J-1, 43J-2) of the user site 4J (4J-1, 4J-2) is provided with a WDM interface.

[0127] As in the path Cn31, the signal from the UI transceiver 43J reaches the optical switch 35J-1 of the computer site 3J-1 to which the user site 4J-1 is directly connected via the transmission path TmD (TmD-1, TmD-2). The optical switch 35J (35-J, 35J-2) (switch) may be an optical switch, a robot patch switch, or the like. The signal is switched by the optical switch 35J-1, input to an optical multiplexer 37J-1 or a ROADM (Reconfigurable Optical Add Drop Multiplexer) for transmission to the adjacent computer site 3J-2, and transmitted to the adjacent computer site 3J-2. The transmitted signal is separated by the optical multiplexer 37J-2 or the ROADM, and connected to the desired UI transceiver 32J-2 via the optical fiber switch 35J-2.

[0128] The UI transceiver 32J (32J-1, 32J-2) of the computer site 3J (3J-1, 3J-2) is connected to the optical switch 35J, for example, via a CFP2 port 312. The UI transceiver 43J of the user site 4J is connected to the transmission path TmD (TmD-1, TmD-2) via a CFP2 port 457, for example. The transmission line TmJ is, for example, an optical fiber cable that transmits signals conforming to the OTU4 (WDM) standard.

[0129] The above-mentioned implementation examples are merely examples, and the implementation configuration is not limited to these. For example, other devices may be connected to the computer site 3 and the user site 4.

[0130] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and designs that do not deviate from the gist of the present invention are also included. [Industrial Applicability]

[0131] The present invention is applicable to, for example, gaming systems, eSports systems, remote desktop systems, computer rental systems, and the like. [Explanation of symbols]

[0132] 1...information processing system, 2...delay control device, 3...computer base, 4...user base, 31...computer, 32...UI transmission / reception device, 33...allocation device, 34...switching device, 35, 35E, 35F, 35G, 35H, 35J...switch, 36...optical transmission device, 37...optical multiplexing device, 41...UI device, 42...sensor, 43...UI transmission / reception device, 44...Thunderbolt 3 dock, 301...monitoring control unit, 302...UI input / output unit, 303...compression / decompression unit, 304...mapping / demapping unit, 305...multiplexing / demultiplexing unit, 306...transmitting / receiving unit, 307...sensor input / output unit, 308...delay measurement unit, 321...GPU, 401...monitoring control unit, 402...UI input / output unit, 403...compression / decompression unit, 404...mapping / demapping unit, 405...multiplexing / demultiplexing unit, 406...transmitting / receiving unit, 407...sensor input / output unit, 408...delay measurement unit, NW1...first network, NW2...second network, Tm...transmission path

Claims

1. A computer installed at a computer base; a first transceiver connected to the computer, the first transceiver having a first mapping / demapping unit that converts between a user interface signal input / output by the computer and an ODU (Optical Data Unit) signal capable of long-distance transmission, and a first transceiver that transmits / receives an OTU (Optical-channel Transport Unit) signal including the ODU signal input / output by the first mapping / demapping unit; a second transceiver device that is installed at a user base used by a user and has a second mapping / demapping unit that converts between a user interface signal input / output by a user interface device and an ODU signal that can be transmitted over long distances, and a second transceiver unit that transmits and receives an OTU signal including the ODU signal input / output by the second mapping / demapping unit; A circuit switching network that connects the first transceiver and the second transceiver and transmits the OTU signal transmitted and received by the first transceiver and the OTU signal transmitted and received by the second transceiver; the user interface device connected to the second transceiver; a delay control device that measures a delay amount occurring between the first transmission / reception device and the second transmission / reception device and controls the measured delay amount to a predetermined delay time; An information processing system comprising:

2. The delay control device includes: When there are a plurality of connections between the first transmission / reception device and the second transmission / reception device, a delay amount of each connection is measured, and at least one of the plurality of delay amounts is adjusted to be equal to the plurality of delay amounts. The information processing system according to claim 1 .

3. The delay control device includes: When adjusting the delay amount, the delay amount is adjusted without interrupting a signal between the first transmission / reception device and the second transmission / reception device. The information processing system according to claim 1 .

4. encrypting signals between the first transceiver and the second transceiver; The information processing system according to any one of claims 1 to 3.

5. The delay control device includes: When the first transmission / reception device and the second transmission / reception device are connected to a plurality of devices, an increase or decrease in the number of users is detected, and the delay amount is readjusted in response to the increase or decrease in the number of users. The information processing system according to any one of claims 1 to 4.

6. 1. An information processing method in an information processing system having a computer installed at a computer site, a first transceiver connected to the computer and having a first mapping / demapping unit that converts between a user interface signal input / output by the computer and an ODU (Optical Data Unit) signal capable of long-distance transmission, and a first transceiver that transmits / receives an OTU (Optical-channel Transport Unit) signal including the ODU signal input / output by the first mapping / demapping unit, a second transceiver installed at a user site used by a user and having a second mapping / demapping unit that converts between a user interface signal input / output by a user interface device and an ODU signal capable of long-distance transmission, and a second transceiver that transmits / receives an OTU signal including the ODU signal input / output by the second mapping / demapping unit, the user interface device connected to the second transceiver, and a delay control device, a delay control device that measures a delay amount occurring between the first transmission / reception device and the second transmission / reception device, and controls the measured delay amount to a predetermined delay time; The first transceiver and the second transceiver are connected by a circuit-switched network that transmits the OTU signal transmitted and received by the first transceiver and the OTU signal transmitted and received by the second transceiver. Information processing methods.

Images