Information processing device, information processing system, and information processing method

Abstract

An information processing device (500) includes: a data classification unit (503); and a target transmission rate setting unit (504). The data classification unit (503) classifies a plurality of data items transmitted via a network (300) into one or more groups on the basis of the shared status of communication resources among the data items. The target transmission rate setting unit (504) sets, for each group, a target transmission rate for the data items belonging to the group, on the basis of a criterion for setting the target transmission rate prescribed for each group.

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing system, and an information processing method. [Background technology]

[0002] Advances in communications technology, such as the next-generation communications standard "5G," are enabling high-capacity, low-latency communications. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-026986 A Summary of the Invention [Problem to be solved by the invention]

[0004] In data communication, there is generally an upper limit to available communication resources, so it is necessary to transmit data by efficiently allocating the limited communication resources.

[0005] Therefore, the present disclosure proposes an information processing device, an information processing system, and an information processing method capable of efficiently allocating communication resources to transmit data. [Means for solving the problem]

[0006] According to the present disclosure, there is provided an information processing device having a data classification unit that classifies a plurality of data transmitted via a network into one or more groups based on a sharing state of communication resources between the data, and a target transmission rate setting unit that sets a target transmission rate for each of the data belonging to each group based on a setting criterion for a target transmission rate defined for each group. According to the present disclosure, there is also provided an information processing system having a plurality of transmitting devices and the information processing device that sets target transmission rates for each of a plurality of data transmitted from the plurality of transmitting devices. According to the present disclosure, there is also provided an information processing method in which information processing of the information processing device is executed by a computer. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram of an information processing system. [Diagram 2] FIG. 2 is a schematic diagram of a controller. [Diagram 3] 13 is a flowchart of a first classification process. [Figure 4] 13 is a flowchart illustrating an example of a comparison process of network management information. [Diagram 5] FIG. 2 is a diagram illustrating an example of network parameters. [Figure 6] 13 is a flowchart of a second classification process. [Figure 7] 13 is a flowchart illustrating an example of a bandwidth sharing estimation process. [Figure 8] 13 is a flowchart showing an example of a bandwidth allocation ratio control possibility estimation process. [Figure 9] FIG. 1 is a diagram showing a state in which a band is shared by a plurality of data. [Figure 10] FIG. 1 is a diagram showing a state in which a band is shared by a plurality of data. [Figure 11] FIG. 11 is a diagram showing a specific example of data classification processing. [Figure 12] 11 is a flowchart illustrating a method for controlling a transmission rate. [Figure 13]13 is a flowchart showing a method for determining a target transmission rate. [Figure 14] 13 is a flowchart showing a first bandwidth control. [Figure 15] FIG. 1 illustrates how data bandwidth is switched according to changes in the role of the data. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and duplicated descriptions will be omitted.

[0009] The explanation will be given in the following order. [1. Information processing system configuration] [2. Controller configuration] [3. Bandwidth sharing group determination process] [3-1. Identifying Bandwidth Sharing Groups Using Network Management Information] [3-2. Determining the bandwidth sharing group type by bandwidth sharing estimation process] [4. Transmission rate control according to bandwidth sharing group type] [5. Effects]

[0010] [1. Information processing system configuration] FIG. 1 is a schematic diagram of an information processing system 1.

[0011] In the following, an example in which the information processing system 1 is applied to live video production will be described. The information processing system 1 includes multiple devices. When there are multiple devices of the same type, the devices are given the same reference numerals. When devices are to be distinguished from one another, numbers are given after the reference numerals indicating the devices.

[0012] In addition, in this specification, "bandwidth" refers to the amount of data that can be transmitted per unit time. "Sharing a bandwidth" refers to multiple data sharing a communication resource with a fixed total bandwidth. In other words, "sharing a bandwidth" refers to allocating a communication resource to multiple data for transmission. In this case, "bandwidth" has the same meaning as communication resource.

[0013] The information processing system 1 includes, for example, a plurality of cameras 100, a plurality of transmitting devices 200, a plurality of receiving devices 400, a controller 500, and a switcher 600.

[0014] One transmitting device 200 and one receiving device 400 are provided for each camera 100. In the example of Fig. 1, N cameras 100, N transmitting devices 200, and N receiving devices 400 are provided (N is an integer of 2 or more).

[0015] The transmitting device 200 includes a video encoder 201 and a transmitting module 202. The video encoder 201 encodes and compresses the video signal output from the camera 100. The transmitting module 202 transmits the video data (video packets) obtained by the compression to the network 300. The transmitting module 202 monitors the state of the network 300 and obtains the current transmission rate. The transmitting module 202 instructs the video encoder 201 on the encoding and transmission rate so that the data can be sent within a certain delay.

[0016] The receiving device 400 includes a receiving module 401 and a video decoder 402. The receiving module 401 receives data (video packets) transmitted from the transmitting device 200 via the network 300. The video decoder 402 extracts and decodes the video encoded data from the video packets to restore a video signal. The video decoder 402 outputs the restored video signal to the switcher 600. The receiving module 401 performs error correction and retransmission instructions, and corrects errors to the extent possible.

[0017] The switcher 600 acquires a plurality of video signals output from a plurality of receiving devices 400. Video signals output from other devices (not shown) may be input to the switcher 600. The switcher 600 switches between the input video signals and broadcasts or distributes them. The switcher 600 can also mix two or more video signals and broadcast or distribute them. The switcher 600 can also perform processes such as effect and caption multiplexing on the output video.

[0018] Conventionally, when live video was produced, the video captured by the camera 100 was transmitted to broadcast video production equipment such as the switcher 600 using dedicated wiring, and the video was then switched and captioned. In recent years, advances in communication technology, such as the next-generation communication standard "5G," have made it possible to achieve high-capacity, low-latency communications. With the increase in capacity and low latency of wireless communication, it is now possible to transmit video wirelessly using low-latency video streaming, instead of the traditional method of transmitting video using dedicated wiring. This enables highly mobile, low-cost production.

[0019] Furthermore, by enabling high-capacity, low-latency communications, whether wired or wireless, it is becoming possible to transmit video footage shot by a camera 100 in a remote location over a network 300 to a production studio with production facilities or a data center providing cloud services, enabling remote live video production at low cost.

[0020] When producing live video, multiple cameras 100 are generally used to capture video from various angles, and these are then appropriately switched for broadcast or distribution. When capturing video using multiple cameras 100, a larger bandwidth is required as the number of videos to be transmitted increases. However, the bandwidth available is often limited. Therefore, it becomes necessary to increase the compression rate in order to transmit a large amount of video within the limited bandwidth. However, a high compression rate can result in a decrease in image quality.

[0021] Therefore, in the information processing system 1, a group of data that passes through the same transmission path and shares a bandwidth is detected. In the information processing system 1, the group of data that shares a bandwidth is grouped, and a bandwidth is allocated to each data in the same group according to the role of the data. Then, the data is encoded and transmitted at a transmission rate according to the allocated bandwidth. This reduces deterioration of the image quality of the video broadcast or distributed, and produces high-quality live video.

[0022] That is, in the information processing system 1, the multiplexing rate of a plurality of videos is controlled, so that the transmission rate of important videos currently being broadcast or distributed is set higher than that of other videos. This reduces deterioration of the image quality of the videos being broadcast or distributed. What is important in this case is to grasp the connection state of the network 300 and to switch control depending on whether multiplexing rate control is possible, and this function is performed by the controller 500.

[0023] [2. Controller configuration] FIG. 2 is a schematic diagram of the controller 500.

[0024] The controller 500 is an information processing device that processes information acquired from the transmitting device 200 and the switcher 600 and controls various devices constituting the information processing system 1. The controller 500 sets target transmission rates for each of a plurality of data transmitted from the plurality of transmitting devices 200 based on the acquired information. The controller 500 has, for example, an information acquiring unit 501, a sharing state determining unit 502, a data classifying unit 503, and a target transmission rate setting unit 504.

[0025] The information acquisition unit 501 acquires information necessary for bandwidth sharing estimation from the transmission device 200. The sharing state determination unit 502 determines the bandwidth sharing state (communication resource sharing state) between data in the network 300 based on the acquired information. The data classification unit 503 classifies a plurality of data transmitted via the network 300 into one or more groups based on the bandwidth sharing state between the data.

[0026] The target transmission rate setting unit 504 sets the target transmission rate of each data belonging to each group for each group based on the setting criteria of the target transmission rate defined for each group. For example, the target transmission rate setting unit 504 determines the role assigned to each of a plurality of data belonging to the same group based on the On Air information from the switcher 600. The target transmission rate setting unit 504 determines the size of the band assigned to each data according to the role of each data. The target transmission rate setting unit 504 sets the target transmission rate of each transmitting device 200 based on the size of the band determined for each data. Each transmitting device 200 transmits data according to the state of the network 300, using the specified target transmission rate as a target value.

[0027] Below, each process executed by the controller 500 will be explained.

[0028] [3. Bandwidth sharing group determination process] The N pieces of data transmitted from the N pieces of transmitting devices 200 are classified into a plurality of groups by the data classification unit 503. In this embodiment, for example, the plurality of pieces of data are classified into a bandwidth sharing group and a bandwidth non-sharing group according to the bandwidth sharing state. The bandwidth sharing group is a group in which the bandwidth is shared among the data. The bandwidth non-sharing group is a group in which the bandwidth is not shared among the data. The bandwidth sharing group is classified into two types according to whether the bandwidth allocation ratio among the data is controllable (whether the bandwidth can be lent and borrowed).

[0029] As a result, the multiple data are classified into three groups (group 1, group 2, and group 3). Group 1 is a group in which bandwidth is shared between data, and the bandwidth allocation ratio between data can be controlled (bandwidth sharing / controllable). Group 2 is a group in which bandwidth is shared between data, but the bandwidth allocation ratio between data cannot be controlled (bandwidth sharing / uncontrollable). Group 3 is a group in which bandwidth is not shared with any other data (no bandwidth sharing).

[0030] The target transmission rate setting unit 504 sets the transmission rate in a different manner depending on the type of bandwidth sharing group. For example, for the first group, the target transmission rate setting unit 504 determines the bandwidth to be allocated to each data depending on the role of each data. The target transmission rate setting unit 504 dynamically changes the size of the bandwidth to be allocated to each data depending on the change in the role of each data (first bandwidth control). For the second group, the target transmission rate setting unit 504 assigns a fixed bandwidth to each data according to the video profile (second bandwidth control). For the third group, the target transmission rate setting unit 504 sets the transmission rate of each data individually (third bandwidth control).

[0031] Which group a piece of data belongs to is determined, for example, by two classification processes.

[0032] First, as the first classification process, a bandwidth sharing group is identified based on the network management information. The network management information includes, for example, information on the data transmission path within the network 300. Specifically, the type of the network 300, parameters of the network 300, etc. are included in the network management information.

[0033] For example, the sharing state determination unit 502 determines the sharing state of the bandwidth between data in the network 300 based on the transmission path of each data in the network 300. The sharing state determination unit 502 determines that a plurality of data having the same type of the network 300 and the same parameters of the network 300 share a bandwidth. The data classification unit 503 classifies a plurality of data determined by the sharing state determination unit 502 to share a bandwidth into the same group.

[0034] Next, as the second classification process, a type of bandwidth sharing group is determined by a bandwidth sharing estimation process. The bandwidth sharing estimation process is a process for observing the effect of data transmission of a certain transmitting device 200 on data transmission of another transmitting device 200, and estimating the bandwidth sharing state between data based on the observation result. The bandwidth sharing estimation process aims to detect information on the bandwidth sharing state that cannot be found by network management information alone.

[0035] For example, when there is a correlation in the change in the bandwidth used among a plurality of pieces of data that do not match the type of network 300 and the parameters of network 300, the sharing state determination unit 502 determines that the plurality of pieces of data share a bandwidth. The data classification unit 503 classifies a plurality of pieces of data that belong to the same group and have a correlation in the change in the bandwidth used into a first group. The data classification unit 503 classifies a plurality of pieces of data that belong to the same group and have no correlation in the change in the bandwidth used into a second group.

[0036] [3-1. Identifying Bandwidth Sharing Groups Using Network Management Information] FIG. 3 is a flowchart of the first classification process.

[0037] In step S1, the information acquisition unit 501 acquires, from a certain transmitting device 200, network management information of the network 300 used for transmission.

[0038] In step S2, the sharing state determination unit 502 compares the network management information acquired from a certain transmitting device 200 with the network management information acquired from another transmitting device 200. The other transmitting device 200 to be compared is a transmitting device 200 for which it is known whether the transmitted data belongs to a bandwidth sharing group or a bandwidth non-sharing group.

[0039] FIG. 4 is a flow chart showing an example of the comparison process of the network management information shown in step S2.

[0040] In step S11, the sharing state determination unit 502 selects one transmission device 200 from the N transmission devices 200. The sharing state determination unit 502 determines whether or not the type of the network 300 to which the selected transmission device 200 is connected is the same as the type of the network 300 to which the other transmission devices 200 are connected. Examples of the type of the network 300 include a mobile network (LTE / 5G), WiFi, an Internet access line, a dedicated line, and a closed network.

[0041] In step S11, if it is not determined that the types of the networks 300 are the same (step S11: No), the process proceeds to step S12. In step S12, the sharing state determination unit 502 determines that no bandwidth sharing is found, and ends the process.

[0042] In step S11, if it is determined that the types of the networks 300 are the same (step S11: Yes), the process proceeds to step S13. In step S13, the sharing state determination unit 502 determines whether the parameters of the network 300 to which the selected transmitting device 200 is connected are the same as the parameters of the networks 300 to which the other transmitting devices 200 are connected.

[0043] Examples of parameters of the network 300 include those shown in FIG. 5. For example, parameters of a mobile network include the Cell ID and Channel ID of the mobile network, Internet connection point information from the mobile core network, and Network Slice information (for 5G). Parameters of Wifi include the SSID of an access point. Parameters of an Internet access line include information on the line used. Parameters of a dedicated line include information on the line used. Parameters of a closed network include network information (such as data route information).

[0044] 4, if it is not determined in step S13 that the parameters are the same (step S13: No), the process proceeds to step S14. In step S14, the sharing state determination unit 502 determines that no bandwidth sharing is found, and ends the process.

[0045] In step S13, if it is determined that the parameters are the same (step S13: Yes), the process proceeds to step S 15. In step S15, the sharing state determination unit 502 determines that a bandwidth share has been found, and ends the process.

[0046] Returning to FIG. 3, in step S3, the sharing state determining unit 502 determines whether or not sharing of a bandwidth between the data transmitted from the selected transmitting device 200 and the data transmitted from another transmitting device 200 has been found.

[0047] In step S3, if it is determined that a shared bandwidth is found (step S3: Yes), the process proceeds to step S4. In step S4, the data classification unit 503 classifies the data transmitted from the selected transmitting device 200 into the same group as the group to which the data transmitted from the other transmitting devices 200 belongs.

[0048] In step S3, if it is determined that a shared bandwidth is not found (step S3: No), the process proceeds to step S5. In step S5, the data classification unit 503 registers the data transmitted from the selected transmitting device 200 in a new group. Note that, if there is no classified data when step S2 is performed, the determination result in step S3 is No.

[0049] When the processes in steps S4 and S5 are completed, the process proceeds to step S6. In step S6, the data classification unit 503 determines whether the above-mentioned evaluation has been performed for all the transmission devices 200 or not.

[0050] In step S6, if it is determined that the above-mentioned evaluation has been performed for all the transmitting devices 200 (step S6: Yes), the process ends. In step S4, if it is determined that the above-mentioned evaluation has not been performed for all the transmitting devices 200 (step S6: No), the process returns to step S1. Then, the process is repeated until the above-mentioned evaluation has been performed for all the transmitting devices 200.

[0051] [3-2. Determining the bandwidth sharing group type by bandwidth sharing estimation process] FIG. 6 is a flowchart of the second classification process.

[0052] In step S21, the controller 500 performs a bandwidth sharing estimation process. The purpose of the bandwidth sharing estimation process is to detect information on the bandwidth sharing state that could not be detected in the first classification process (identification of the bandwidth sharing group based on the network management information).

[0053] FIG. 7 is a flowchart illustrating an example of a bandwidth sharing estimation process.

[0054] In step S31, the sharing state determination unit 502 selects one transmission device 200 from the N transmission devices 200. The sharing state determination unit 502 increases the transmission rate of the selected transmission device 200.

[0055] In step S32, the sharing state determination unit 502 checks whether the transmission bandwidth of the other (N-1) transmitting devices 200 has decreased. The decrease in the transmission bandwidth is detected based on an increase in the packet loss rate, a decrease in the receiving side throughput, an increase in delay, and the like.

[0056] In step S33, the sharing state determination unit 502 determines whether or not a bandwidth reduction has been found in one or more of the other (N-1) transmitting devices 200, the data of which belongs to a different group from that of the selected transmitting device 200.

[0057] If it is determined in step S33 that a bandwidth reduction has been found (step S33: Yes), the process proceeds to step S34. In step S34, the data classification unit 503 determines that a sharing of bandwidth has been found between the data of the selected transmitting device 200 and the data of the group in which a bandwidth reduction has occurred in conjunction with an increase in the transmission rate of this transmitting device 200. Then, the data classification unit 503 registers the groups in which a sharing of bandwidth has been found as the same group, and ends the process.

[0058] If it is determined in step S33 that no bandwidth reduction has been found (step S33: No), the data classification unit 503 maintains the data classification result.

[0059] 6, when the bandwidth sharing estimation process in step S21 is completed, the process proceeds to step S22. In step S22, the controller 500 performs a bandwidth allocation ratio controllability estimation process. The bandwidth allocation ratio controllability estimation process is performed for the purpose of confirming whether the bandwidth allocation ratio can be controlled for multiple data in the same group that shares the bandwidth.

[0060] 9 and 10 are diagrams showing a state in which a band is shared by a plurality of data.

[0061] In the example of Fig. 9, data transmitted from the transmitting device 200-1, the transmitting device 200-2, and the transmitting device 200-3 are transmitted along the same transmission route R. The transmission route R is configured by the node ND and the link LK of the network 300. A plurality of data that are partly or entirely the same on the transmission route R share a bandwidth. Therefore, in Fig. 9, the data transmitted from the transmitting device 200-1, the transmitting device 200-2, and the transmitting device 200-3 share a bandwidth.

[0062] The data transmitted from the transmitting device 200-1, the transmitting device 200-2, and the transmitting device 200-3 does not share a bandwidth with data from other devices. Therefore, the bandwidth allocation ratio can be controlled between the data transmitted from the transmitting device 200-1, the transmitting device 200-2, and the transmitting device 200-3.

[0063] In the example of Fig. 10, data transmitted from the transmitting device 200-1, the transmitting device 200-2, and the transmitting device 200-3 overlap with data transmitted from other devices in the transmission path R in the section R0. In this case, even if the bandwidth of the data of a certain transmitting device 200 is reduced, the reduced amount may be taken by other devices, and the bandwidth of the other transmitting devices 200 may not increase. Therefore, it is not possible to control the bandwidth allocation ratio between the data of the selected transmitting device 200 and the data of the other transmitting devices 200.

[0064] As described above, even if multiple data share a bandwidth, there are cases where the bandwidth allocation ratio between the data cannot be controlled. The controller 500 estimates whether the bandwidth allocation ratio between multiple data in the same bandwidth sharing group can be controlled by a bandwidth allocation ratio controllability estimation process.

[0065] FIG. 8 is a flowchart showing an example of a bandwidth allocation ratio control possibility estimation process.

[0066] In step S41, the sharing state determining unit 502 selects one transmission device 200 from the N transmission devices 200, and reduces the transmission rate of the selected transmission device 200.

[0067] In step S42, the sharing state determination unit 502 checks whether the data bandwidth of the other (N-1) transmitting devices 200 that have not lowered the transmission rate has increased. The increase in bandwidth is detected based on a decrease in the packet loss rate, an increase in the receiving side throughput, a decrease in delay, etc.

[0068] In step S43, the sharing state determining unit 502 determines whether the bandwidth of all data belonging to the same group as the data of the selected transmitting device 200 has increased.

[0069] In step S43, if it is determined that the bandwidth of all other data in the same group has increased (step S43: Yes), the process proceeds to step S44. In step S44, the data classification unit 503 estimates that the group to which the data of the selected transmitting device 200 belongs is a first group in which the bandwidth allocation ratio is controllable, and ends the process.

[0070] In step S43, if it is not determined that the bandwidth of all other data in the same group has increased (step S43: No), the process proceeds to step S45. In step S45, the data classification unit 503 estimates that the group to which the data of the selected transmitting device 200 belongs is a second group in which the bandwidth allocation ratio is uncontrollable, and ends the process.

[0071] Fig. 11 is a diagram showing a specific example of the data classification process, in which the above-mentioned classification process is applied to a system having eight transmitting devices.

[0072] The data transmitted from the eight transmitting devices is classified into two bandwidth sharing groups (Group#1, Group#3) and one bandwidth non-sharing group (Group#2) based on network management information.

[0073] After classification based on the network management information is performed, a bandwidth sharing estimation process is performed on the two bandwidth sharing groups (Group #1, Group #3). As a result of the bandwidth sharing estimation process, it is estimated that the two bandwidth sharing groups (Group #1, Group #3) share a bandwidth. Therefore, Group #3 is re-registered as Group #1.

[0074] Thereafter, in order to determine the type of bandwidth sharing group, a bandwidth allocation ratio controllability estimation process is performed on Group#1. As a result of the bandwidth allocation ratio controllability estimation process, Group#1 is determined to be a group whose bandwidth allocation ratio is controllable. As a result, the data transmitted from the eight transmitting devices is classified into Group#1 (a group in which data shares a bandwidth with each other and whose bandwidth allocation ratio between data is controllable) and Group#2 (a group in which the bandwidth is not shared with any other data).

[0075] [4. Transmission rate control according to bandwidth sharing group type] Fig. 12 is a flow chart explaining a method for controlling a transmission rate. In Fig. 12, for example, for a group whose bandwidth allocation ratio is controllable, a process is performed in which more of the group's total bandwidth is allocated to "On Air video" data and "Next video" data scheduled to be aired next. This process improves the image quality of the video being broadcast or distributed.

[0076] In step S51, the target transmission rate setting unit 504 sets a transmission rate at which the expected image quality can be obtained for each data (video) as a basic target transmission rate. The basic target transmission rates of each data may all be set to the same value. If the transmission rate required to obtain the expected image quality differs for each data due to the video profile such as the video size (HD, 4K, etc.) and the camera arrangement, the basic target transmission rate may differ for each data.

[0077] In step S52, the sharing state determination unit 502 calculates, for each group, the total bandwidth of the network shared by multiple data in the group (total group bandwidth). For example, the sharing state determination unit 502 can identify the transmission path of each data from the network management information and calculate the total group bandwidth from the specifications of the transmission path of each data. Alternatively, the sharing state determination unit 502 may obtain the available transmission rates detected in each transmitting device 200 and calculate the total group bandwidth based on each obtained available transmission rate. The target transmission rate setting unit 504 obtains the total group bandwidth of each group from the sharing state determination unit 502.

[0078] In step S53, the target transmission rate setting unit 504 acquires information from the switcher 600 as to which video data has been selected as "On Air video" and "Next video." The "On Air video" refers to video that is currently being output from the switcher 600 and broadcast or distributed. The "Next video" refers to video that is scheduled to be output from the switcher 600 next and broadcast or distributed.

[0079] In step S54, the target transmission rate setting unit 504 determines whether the situation has changed. Examples of situation changes detected by the target transmission rate setting unit 504 include changes in the role information of the video and changes in the group total bandwidth. The target transmission rate setting unit 504 checks the situation at regular intervals.

[0080] In step S54, if it is determined that the situation has changed (step S54: Yes), the process proceeds to step S55. In step S55, the target transmission rate setting unit 504 determines the target transmission rate of each video. The target transmission rate setting unit 504 sets the transmission rate of each transmitting device 200 using the determined target transmission rate.

[0081] FIG. 13 is a flowchart showing a method for determining a target transmission rate.

[0082] In step S61, the target transmission rate setting unit 504 obtains data classification information (information indicating which group each data belongs to) from the data classification unit 503. The target transmission rate setting unit 504 selects one group from the multiple groups classified by the data classification unit 503, and determines whether the selected group corresponds to a first group for which the bandwidth allocation ratio is controllable.

[0083] In step S61, if it is determined that the selected group corresponds to the first group (step S61: Yes), the process proceeds to step S62. In step S62, the target transmission rate setting unit 504 sets a target transmission rate for each data based on the first bandwidth control. Each transmitting device 200 performs transmission using the target transmission rate set based on the first bandwidth control as a target value. Each transmitting device 200 monitors the state of the network 300, and if the transmission bandwidth cannot be secured, the transmission rate is lowered to an appropriate rate as necessary and transmission is performed.

[0084] FIG. 14 is a flowchart showing the first bandwidth control.

[0085] In step S71, the target transmission rate setting unit 504 determines whether or not there is "On Air video" in the group.

[0086] In step S71, if it is determined that "On Air video" exists in the group (step S71: Yes), the process proceeds to step S72. In step S72, the target transmission rate setting unit 504 sets a target transmission rate for "On Air video".

[0087] Here, first, the target transmission rate setting unit 504 determines the maximum transmission rate (allocable rate) that can be allocated to "On Air video". The allocable rate for "On Air video" is the total group bandwidth minus the minimum rate for the remaining data (allocable rate = total group bandwidth - minimum rate x number of remaining data in the group). The minimum rate is set in advance by the user as the minimum bandwidth to prevent the bandwidth for the remaining data from becoming zero. Next, the target transmission rate setting unit 504 sets the smaller of the basic target transmission rate and the allocable rate for "On Air video" as the target transmission rate for "On Air video".

[0088] After the target transmission rate for the "On Air video" is set in step S72, or if it is determined in step S71 that there is no "On Air video" in the group (step S71: No), the process proceeds to step S73. In step S73, the target transmission rate setting unit 504 determines whether there is a "Next video" in the group.

[0089] In step S73, if it is determined that the "Next video" exists in the group (step S73: Yes), the process proceeds to step S74. In step S74, the target transmission rate setting unit 504 sets a target transmission rate for the "Next video".

[0090] Here, first, the target transmission rate setting unit 504 finds the allocatable rate for the "Next video". The allocatable rate for the "Next video" is the total group bandwidth minus the target transmission rate for the "On Air video" and the minimum rate for the remaining data (allocatable rate = total group bandwidth - target transmission rate for "On Air video" - minimum rate x number of remaining data in the group). Next, the target transmission rate setting unit 504 sets the smaller of the basic target transmission rate and the allocatable rate for the "Next video" as the target transmission rate for the "Next video".

[0091] After the target transmission rate for the "Next video" is set in step S74, or if it is determined in step S73 that the "Next video" is not present in the group (step S73: No), the process proceeds to step S75. In step S75, target transmission rate setting unit 504 sets a target transmission rate for the remaining data in the group.

[0092] Here, first, the target transmission rate setting unit 504 obtains the allocatable rate of the remaining data other than "On Air video" and "Next video". The allocatable rate of the remaining data is obtained by subtracting the target transmission rate of "On Air video" and the target transmission rate of "Next video" from the total group bandwidth (allocable rate = total group bandwidth - target transmission rate of "On Air video" - target transmission rate of "Next video"). Next, the target transmission rate setting unit 504 divides the allocatable rate of the remaining data by the number of pieces of remaining data. The target transmission rate setting unit 504 sets the divided allocatable rate as the target transmission rate of each piece of remaining data. For example, the target transmission rate setting unit 504 can proportionally distribute the allocatable rate based on the basic target transmission rate of each piece of data (target transmission rate = basic target transmission rate x remaining total group bandwidth / sum of basic target transmission rates).

[0093] The target transmission rate setting unit 504 dynamically changes the target transmission rate of each piece of data belonging to the first group in accordance with the role of each piece of data.

[0094] 13, if it is not determined in step S61 that the selected group corresponds to the first group (step S61: No), the process proceeds to step S64. In step S64, the target transmission rate setting unit 504 determines whether the selected group corresponds to the second group, the bandwidth allocation ratio of which is uncontrollable.

[0095] If it is determined in step S64 that the selected group corresponds to the second group (step S64: Yes), the process proceeds to step S65. In step S65, the target transmission rate setting unit 504 sets a target transmission rate for each data based on the second bandwidth control. Each transmitting device 200 performs transmission using the target transmission rate set based on the second bandwidth control as a target value. Each transmitting device 200 monitors the state of the network 300, and if the transmission bandwidth cannot be secured, the transmission rate is lowered to an appropriate rate as necessary and transmission is performed.

[0096] In the second bandwidth control, the target transmission rate setting unit 504 allocates a fixed bandwidth to each data based on a basic target transmission rate set in advance. The target transmission rate setting unit 504 sets the target transmission rates of all data belonging to the second group based on a fixed ratio regardless of the role of each data. However, if the sum of the basic target transmission rates of each data in the group exceeds the total bandwidth of the group, the data may compete with each other for the bandwidth, resulting in unstable operation. Therefore, if the sum of the basic target transmission rates of each data in the group exceeds the total bandwidth of the group, the target transmission rate setting unit 504 proportionally allocates the total bandwidth of the group based on the basic target transmission rate of each data. The target transmission rate setting unit 504 sets the bandwidth obtained by proportionally allocating the total bandwidth of the group to each data as the target transmission rate of each data (target transmission rate = basic target transmission rate x total bandwidth of group / sum of basic target transmission rates).

[0097] In step S64, if it is not determined that the selected group corresponds to the second group (step S64: No), the process proceeds to step S66. In step S66, the target transmission rate setting unit 504 sets a target transmission rate for each data based on the third bandwidth control. In the third bandwidth control, the target transmission rate setting unit 504 sets a basic target transmission rate set in advance as the target transmission rate. Each transmitting device 200 performs transmission using the target transmission rate set based on the third bandwidth control as a target value. Each transmitting device 200 monitors the state of the network 300, and if the transmission bandwidth cannot be secured, the transmission rate is lowered to an appropriate rate as necessary and transmission is performed.

[0098] When the setting of the target transmission rate by the first bandwidth control in step S62, the second bandwidth control in step S65, or the third bandwidth control in step S66 is completed, the process proceeds to step S63. In step S63, the target transmission rate setting unit 504 determines whether the target transmission rate has been set for all the groups classified by the data classification unit 503.

[0099] In step S63, if it is determined that the target transmission rates have been set for all groups (step S63: Yes), the process ends. In step S63, if it is determined that the target transmission rates have not been set for all groups (step S63: No), the process returns to step S61, and the processes from step S61 onwards are repeated until the target transmission rates have been set for all groups.

[0100] Returning to FIG. 12, if the target transmission rate is set in step S55, or if it is not determined in step S54 that the situation has changed (step S54: No), the process proceeds to step S56. In step S56, the target transmission rate setting unit 504 determines whether or not the video transmission has ended based on the data acquired from each transmitting device 200. If it is determined in step S56 that the video transmission has ended (step S56: Yes), the target transmission rate setting unit 504 ends the process. If it is not determined in step S56 that the video transmission has ended (step S56: No), the process returns to step S52, and the processes from step S52 onwards are repeated. In this manner, the target transmission rates for the multiple data transmitted from the multiple transmitting devices 200 are set, respectively.

[0101] FIG. 15 is a diagram showing how data bandwidth is switched in response to a change in the role of the data.

[0102] In the example of Fig. 15, the number of cameras is four. The video data output from the four cameras (Cam#0, Cam#1, Cam#2, Cam#3) is transmitted through the same transmission path. The bandwidth allocation ratio of each data is arbitrarily adjusted based on the first bandwidth control.

[0103] At time t0, the data of Cam#0 is “On Air video,” and the data of Cam#1 is “Next video.” A larger bandwidth is allocated to the data of Cam#0 and the data of Cam#1 than to the other data.

[0104] After that, at time t1, the role of each data is changed, and the data of Cam#1 becomes "On Air video" and the data of Cam#3 becomes "Next video." As the role of each data is changed, a larger bandwidth is allocated to the data of Cam#1 and Cam#3 than to the other data.

[0105] After that, at time t2, the role of each data is changed again, and the data of Cam#3 becomes "On Air video" and the data of Cam#2 becomes "Next video." As the role of each data changes, a larger bandwidth is allocated to the data of Cam#3 and the data of Cam#2 than to the other data.

[0106] This process reduces degradation of the image quality of the broadcasted or distributed images when multiple image data are transmitted over a limited transmission band, producing high-quality live images.

[0107] [5. Effects] The controller 500 has a data classification unit 503 and a target transmission rate setting unit 504. The data classification unit 503 classifies a plurality of data transmitted via the network 300 into one or more groups based on a sharing state of communication resources between the data. The target transmission rate setting unit 504 sets a target transmission rate for each data belonging to each group, based on a setting criterion for a target transmission rate defined for each group. In the information processing method of this embodiment, the information processing of the controller 500 described above is executed by a computer.

[0108] According to this configuration, the communication resources are efficiently allocated to a plurality of data based on the sharing state of the communication resources, and therefore the communication resources are effectively utilized.

[0109] The controller 500 has a sharing state determination unit 502. The sharing state determination unit 502 determines a sharing state of communication resources between data in the network 300 based on the transmission path of each data in the network 300. The data classification unit 503 classifies a plurality of data determined by the sharing state determination unit 502 to share communication resources into the same group.

[0110] According to this configuration, the sharing state of communication resources between data is determined with high accuracy.

[0111] The sharing state determination unit 502 determines that a plurality of data sets having the same type of network 300 and the same parameters of the network 300 share a communication resource.

[0112] According to this configuration, the sharing state of communication resources between data can be easily determined.

[0113] If there is a correlation in the change in the communication resources used among a plurality of data that do not match the type of network 300 and the parameters of the network 300, the sharing state determining unit 502 determines that the plurality of data share communication resources.

[0114] According to this configuration, information regarding the sharing state of communication resources that cannot be found only from information regarding the type of network 300 and parameters of network 300 is detected.

[0115] The data classification unit 503 classifies a plurality of data that belong to the same group and have a correlation in the change of the communication resource to be used into a first group in which the allocation ratio of the communication resource between the data can be controlled. The target transmission rate setting unit dynamically changes the target transmission rate of each data belonging to the first group according to the role of each data.

[0116] According to this configuration, communication resources are efficiently allocated according to the role of the data.

[0117] The data classification unit classifies a plurality of data belonging to the same group and having no correlation in changes in the communication resources used into a second group in which the allocation ratio of the communication resources between the data is uncontrollable. The target transmission rate setting unit sets the target transmission rates of all the data belonging to the second group based on a fixed ratio, regardless of the role of each data.

[0118] According to this configuration, even in a situation where the allocation of communication resources cannot be controlled, the necessary communication resources are secured for each data.

[0119] The information processing system 1 includes a plurality of transmitting devices 200 and a controller 500. The controller 500 sets target transmission rates for a plurality of pieces of data transmitted from the plurality of transmitting devices 200, respectively.

[0120] This configuration allows necessary data to be transmitted at a high transmission rate, making it possible to produce high-quality video using limited communication resources.

[0121] It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0122] The present technology can also be configured as follows.

[0123] (1) a data classification unit that classifies a plurality of data transmitted through a network into one or more groups based on a sharing state of communication resources between the data; a target transmission rate setting unit that sets, for each group, a target transmission rate for each data item belonging to the group based on a target transmission rate setting criterion defined for each group; An information processing device having the above configuration. (2) a sharing state determination unit that determines a sharing state of the communication resources between data in the network based on a transmission path of each data in the network, The data classification unit classifies a plurality of data items that are determined by the sharing state determination unit to share the communication resource into the same group. The information processing device according to (1) above. (3) The sharing state determination unit determines that a plurality of data items having the same network type and the same network parameters share the communication resource. The information processing device according to (2) above. (4) The sharing state determination unit determines that the plurality of data share the communication resource when there is a correlation in a change in a communication resource used among the plurality of data having the different network types and the different network parameters. The information processing device according to (3) above. (5) The data classification unit classifies a plurality of data items that belong to the same group and are correlated with a change in the communication resources to be used into a first group in which an allocation ratio of the communication resources between the data items can be controlled. The information processing device according to (2) above. (6) The target transmission rate setting unit dynamically changes the target transmission rate of each piece of data belonging to the first group in accordance with the role of each piece of data. The information processing device according to (5) above. (7) The data classification unit classifies a plurality of data that belong to the same group and have no correlation in changes in the communication resources used into a second group in which an allocation ratio of the communication resources between the data is uncontrollable. The information processing device according to (2) above. (8) The target transmission rate setting unit sets the target transmission rates of all the data belonging to the second group based on a fixed ratio regardless of the role of each data. The information processing device according to (7) above. (9) A plurality of transmitting devices; The information processing device according to any one of (1) to (8) above, which sets a target transmission rate for each of a plurality of data transmitted from the plurality of transmitting devices; An information processing system having the above configuration. (10) classifying a plurality of data transmitted through the network into one or more groups based on a sharing state of communication resources between the data; setting a target transmission rate for each of the data belonging to each of the groups based on a setting criterion for the target transmission rate defined for each of the groups; 23. A computer-implemented information processing method comprising: (11) The step of classifying the plurality of data includes determining a sharing state of the communication resources between the data in the network based on a transmission path of each data in the network, and classifying the plurality of data determined to share the communication resources into the same group. The information processing method according to (10) above. (12) The step of determining a sharing state determines that a plurality of data items having the same network type and the same network parameters share the communication resource. The information processing method according to (11) above. (13) The step of determining the sharing state includes determining that the plurality of data share the communication resource when there is a correlation between changes in the communication resource used among the plurality of data whose network types and parameters of the network are not identical. The information processing method according to (12) above. (14) The step of classifying the plurality of data includes classifying the plurality of data that belong to the same group and are correlated with a change in the communication resources to be used into a first group in which an allocation ratio of the communication resources between the data can be controlled. The information processing method according to (11) above. (15) The step of setting the target transmission rate dynamically changes the target transmission rate of each piece of data belonging to the first group according to a role of each piece of data. The information processing method according to (14) above. (16) The step of classifying the plurality of data includes classifying the plurality of data that belong to the same group and have no correlation with changes in the communication resources used into a second group in which the allocation ratio of the communication resources between the data is uncontrollable. The information processing method according to (11) above. (17) The step of setting the target transmission rate includes setting the target transmission rate of all the data belonging to the second group based on a fixed ratio regardless of the role of each data. The information processing method according to (16) above. [Explanation of symbols]

[0124] 1. Information Processing Systems 200 Transmitting device 300 Network 500 Controller (information processing device) 502 Shared status determination unit 503 Data Classification Department 504 Target transmission rate setting unit

Claims

1. a data classification unit that classifies a plurality of data transmitted through a network into one or more groups based on a sharing state of communication resources between the data; a target transmission rate setting unit that sets, for each group, a target transmission rate for each data item belonging to the group based on a target transmission rate setting criterion defined for each group; having a sharing state determination unit that determines a sharing state of the communication resources between data in the network based on a transmission path of each data in the network, the data classification unit classifies a plurality of data items determined by the sharing state determination unit to share the communication resource into the same group; the sharing state determination unit determines that a plurality of data items having the same network type and the same network parameters share the communication resource; Information processing device.

2. The sharing state determination unit determines that the plurality of data share the communication resource when there is a correlation in a change in a communication resource used among the plurality of data having the different network types and the different network parameters. The information processing device according to claim 1 .

3. A data classification unit that classifies multiple data transmitted via a network into one or more groups based on a sharing state of communication resources between the data; a target transmission rate setting unit that sets, for each group, a target transmission rate for each data item belonging to the group based on a target transmission rate setting criterion defined for each group; having a sharing state determination unit that determines a sharing state of the communication resources between data in the network based on a transmission path of each data in the network, the data classification unit classifies a plurality of data items determined by the sharing state determination unit to share the communication resource into the same group; the data classification unit classifies a plurality of data items that belong to the same group and have no correlation with changes in the communication resources to be used into a second group in which an allocation ratio of the communication resources between the data items is uncontrollable; Information processing device.

4. The target transmission rate setting unit sets the target transmission rates of all the data belonging to the second group based on a fixed ratio regardless of the role of each data. The information processing device according to claim 3 .

5. A plurality of transmitting devices; 2. The information processing device according to claim 1, further comprising: a transmission device for receiving a plurality of data from the plurality of transmitting devices; An information processing system having the above configuration.

6. classifying a plurality of data transmitted through the network into one or more groups based on a sharing state of communication resources between the data; setting a target transmission rate for each of the data belonging to each of the groups based on a setting criterion for the target transmission rate defined for each of the groups; Having said that, The step of classifying the plurality of data includes determining a sharing state of the communication resources between data in the network based on a transmission path of each data in the network, and classifying the plurality of data determined to share the communication resources into the same group; The step of determining a sharing state includes determining that a plurality of data items having the same network type and the same network parameters share the communication resource. A computer-implemented information processing method.

7. The step of determining the sharing state includes determining that the plurality of data share the communication resource when there is a correlation between changes in the communication resource used among the plurality of data whose network types and parameters of the network are not identical. The information processing method according to claim 6.

8. Classifying a plurality of data transmitted through a network into one or more groups based on a sharing state of communication resources between the data, setting a target transmission rate for each of the data belonging to each of the groups based on a setting criterion for the target transmission rate defined for each of the groups; Having said that, The step of classifying the plurality of data includes determining a sharing state of the communication resources between data in the network based on a transmission path of each data in the network, and classifying the plurality of data determined to share the communication resources into the same group; The step of classifying the plurality of data includes classifying the plurality of data that belong to the same group and have no correlation with changes in the communication resources to be used into a second group in which an allocation ratio of the communication resources between the data is uncontrollable. A computer-implemented information processing method.

9. The step of setting the target transmission rate includes setting the target transmission rate of all the data belonging to the second group based on a fixed ratio regardless of the role of each data. The information processing method according to claim 8.

Images