Information processing device, information processing method, and information processing system

Abstract

To suppress the stringency of a band when each of a plurality of imaging devices transmits captured data by radio.SOLUTION: An information processing device 2 comprises: a reception unit 231 which receives encoded data, which is captured data encoded by each an imaging-side device 1 from each of a plurality of imaging-side devices 1; a decoding unit 232 which restores the plurality of captured data by decoding a plurality of encoded data received from each of the plurality of imaging-side devices 1; a selection unit 234 which selects one captured data among a plurality of restored captured data; and a setting unit 235 which sets the imaging-side device 1 so that the imaging-side device 1 corresponding to the captured data generates encoded data of first quality according to the selection of captured data and also sets the imaging-side device 1 so that the imaging-side device 1 corresponding to unselected captured data generates encoded data of second quality lower than first quality.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing system. [Background technology]

[0002] Conventionally, in the production of television broadcast programs, filming is performed using multiple camera devices, and the filming data generated by each of the multiple camera devices is transmitted to a switcher, and the switcher selects one of the multiple filming data as the filming data to be aired (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2005-295431 A Summary of the Invention [Problem to be solved by the invention]

[0004] When each of the multiple image capture devices transmits captured image data to the switcher via wireless communication, a problem occurs in that the transmission of the captured image data causes a strain on the wireless communication band.

[0005] The present invention has been made in consideration of these points, and has an object to prevent bandwidth congestion when multiple image capturing devices each transmit image capturing data wirelessly. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention includes a receiving unit that receives encoded data, which is the shooting data encoded by each of a plurality of shooting side devices, from each of the plurality of shooting side devices; a decoding unit that decodes the plurality of encoded data received from each of the plurality of shooting side devices to restore the plurality of shooting data; a selection unit that selects one of the plurality of shooting data restored by the decoding unit; and a setting unit that, in response to the selection of shooting data by the selection unit, sets the shooting side device corresponding to the shooting data to generate encoded data of a first quality, and sets the shooting side device corresponding to the shooting data not selected by the selection unit to generate encoded data of a second quality lower than the first quality.

[0007] The setting unit may use a notification signal to notify the multiple shooting side devices of whether or not they are the shooting side devices corresponding to the shooting data selected by the selection unit, to set the shooting side devices corresponding to the shooting data selected by the selection unit so that the shooting side devices generate encoded data of the first quality, and may also set the shooting side devices corresponding to the shooting data not selected by the selection unit so that they generate encoded data of the second quality.

[0008] Each of the multiple shooting side devices is provided with a tally lamp indicating that the shooting data generated by that device has been selected by the selection unit, and the setting unit may use a tally signal for changing the lighting state of the tally lamp of each of the multiple shooting side devices to set the shooting side device corresponding to the shooting data selected by the selection unit to generate encoded data of the first quality, and set the shooting side device corresponding to the shooting data not selected by the selection unit to generate encoded data of the second quality.

[0009] The setting unit may set the shooting side device corresponding to the shooting data selected by the selection unit to generate encoded data of the first quality at the time when the selection unit selects the shooting data, and may also set the shooting side device corresponding to the shooting data not selected by the selection unit to generate encoded data of the second quality after a first time has elapsed from the time when the selection unit selects the shooting data.

[0010] The information processing device may further include an output unit that outputs the shooting data selected by the selection unit to an external device as broadcast shooting data to be used for television broadcast or distribution shooting data to be used for data distribution.

[0011] The output unit may output the restored shooting data to the external device after a time period from when the selection unit selects the shooting data to when the output unit receives encoded data of a first quality from the shooting side device corresponding to the shooting data and when the decoding unit is able to output the shooting data restored from the encoded data.

[0012] The output unit may output the restored shooting data to the external device on condition that the decoding unit has restored the shooting data from encoded data of a first quality received from the shooting side device corresponding to the shooting data selected by the selection unit.

[0013] When the output unit detects that the decoding unit has restored an I frame corresponding to the first quality as shooting data from the encoded data received from the shooting side device corresponding to the shooting data selected by the selection unit, the output unit may output the restored shooting data to the external device.

[0014] The receiving unit may receive data from the imaging side device via wireless communication, and the setting unit may determine a data transfer rate as a first quality and a data transfer rate as a second quality depending on a reception strength of radio waves corresponding to the wireless communication. The reception strength may be based on information indicating the quality of radio waves acquired by the photographing device.

[0015] The selection unit may perform control so as not to select the imaging data corresponding to a specific imaging side device when there is no response from the specific imaging side device. When a predetermined communication bandwidth can be occupied for the transmission of shooting data from a plurality of shooting side devices, the setting unit may set a data transfer rate as a first quality and a data transfer rate as a second quality based on partial bandwidths obtained by dividing the occupied bandwidth by the shooting side devices.

[0016] When a predetermined communication bandwidth can be occupied for the transmission of shooting data from a plurality of shooting side devices, the setting unit sets all of the shooting side devices so that all of the shooting side devices generate encoded data of the first quality, and the information processing device may have an output unit that, in response to the selection of the shooting data by the selection unit, outputs the selected shooting data to an external device as broadcast shooting data to be used for television broadcast or distribution shooting data to be used for data distribution at the timing when the selection unit selects the shooting data.

[0017] An information processing method according to a second aspect of the present invention includes the steps of receiving, executed by a computer, encoded data from each of a plurality of shooting side devices, which is the shooting data encoded by each of the plurality of shooting side devices; decoding the encoded data received from each of the plurality of shooting side devices to restore the plurality of shooting data; selecting one of the restored plurality of shooting data; and, in response to the selection of the shooting data, setting the shooting side device corresponding to the shooting data to generate encoded data of a first quality, and setting the shooting side device corresponding to the unselected shooting data to generate encoded data of a second quality lower than the first quality.

[0018] An information processing system according to a third aspect of the present invention is an information processing system having an information processing device and a plurality of shooting side devices, each of which has an imaging unit that generates shooting data by taking images, an encoding unit that encodes the shooting data generated by the imaging unit, and a transmitting unit that transmits encoded data, which is the encoded shooting data. The information processing device has a receiving unit that receives the encoded data from each of the plurality of shooting side devices, a decoding unit that decodes the plurality of encoded data received from each of the plurality of shooting side devices to restore the plurality of shooting data, a selection unit that selects one of the plurality of shooting data restored by the decoding unit, and a setting unit that, in response to the selection of shooting data by the selection unit, sets the shooting side device corresponding to the shooting data to generate encoded data of a first quality, and sets the shooting side device corresponding to the shooting data not selected by the selection unit to generate encoded data of a second quality lower than the first quality. Effect of the Invention

[0019] According to the present invention, it is possible to suppress the bandwidth from becoming congested when each of a plurality of image capturing devices wirelessly transmits captured image data. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a diagram illustrating an overview of an information processing system. [Diagram 2] FIG. 2 is a diagram illustrating a functional configuration of an imaging side device. [Diagram 3] FIG. 2 is a diagram illustrating a functional configuration of an information processing device. [Figure 4] 10 is a flowchart showing an example of a processing flow relating to setting of the photographing side device by the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] [Outline of Information Processing System S] Fig. 1 is a diagram for explaining the outline of an information processing system S. The information processing system S is a system having a plurality of imaging side devices 1 for performing imaging and an information processing device 2, selecting one of the imaging data generated in the plurality of imaging side devices 1, and outputting the selected imaging data as broadcast imaging data to be used for, for example, television broadcasting. Note that, in Fig. 1, two imaging side devices 1 are shown as the plurality of imaging side devices 1, but this is not limiting, and three or more imaging side devices 1 may be provided.

[0022] The information processing device 2 is communicably connected to each of the multiple photographing side devices 1 via a wireless communication network N such as a mobile phone line. The information processing device 2 receives encoded data, which is data obtained by encoding photographing data, from each of the multiple photographing side devices 1. The information processing device 2 decodes the received encoded data to restore the multiple photographing data.

[0023] The information processing device 2 selects the captured image data to be output as broadcasting image data from among the multiple restored captured image data. The information processing device 2 outputs the selected captured image data to an external device for television broadcasting, for example.

[0024] However, when the information processing device 2 receives the photographing data from each of the multiple photographing side devices 1 by wireless communication, a problem occurs in that the wireless communication band becomes congested. In response to this, the information processing device 2 sets the photographing side device 1 that transmits the encoded data corresponding to the selected photographing data to generate encoded data of a first quality, and sets the photographing side device 1 that transmits the encoded data corresponding to the unselected photographing data to generate encoded data of a second quality lower than the first quality. In this way, the information processing system S can prevent the band from becoming congested when each of the multiple photographing side devices 1 transmits the photographing data by wireless communication.

[0025] [Functional configuration of the imaging device 1] Next, the functional configuration of the information processing system S will be described. First, the functional configuration of the photographing side device 1 will be described. Fig. 2 is a diagram showing the functional configuration of the photographing side device 1. It is assumed that each of the multiple photographing side devices 1 has the configuration shown in Fig. 2. Also, the photographing side device 1 is realized by one device as shown in Fig. 2, but is not limited to this and may be realized by multiple devices.

[0026] As shown in FIG. 2, the photographing side device 1 includes a photographing unit 11, a communication unit 12, a notification unit 13, a storage unit 14, and a control unit 15. The photographing unit 11 generates photographed data by photographing the surroundings. The photographing unit 11 outputs the generated photographed data to the control unit 15. The communication unit 12 is a communication interface for transmitting and receiving data to and from the information processing device 2 and the like via the wireless communication network N.

[0027] The notification unit 13 is, for example, a tally lamp, and notifies the surroundings that the shooting data generated by the own device, which is the shooting side device 1 corresponding to itself, has been selected as broadcast shooting data to be used for television broadcast, for example. The notification unit 13 notifies the surroundings whether the shooting data shot by the own device has been selected as broadcast shooting data to be used for television broadcast by changing the lighting state. For example, when the tally lamp is lit in red, it indicates that the shooting data shot by the own device has been selected as broadcast shooting data, and when it is lit in green, it indicates that the shooting data shot by the own device has not been selected as broadcast shooting data.

[0028] The storage unit 14 is a storage medium that stores various data, and includes a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, an SSD (Solid State Drive), a flash memory, etc. The storage unit 14 stores a program executed by the control unit 15. The storage unit 14 stores a program that causes the control unit 15 to function as a setting unit 151, an encoding unit 152, a transmitting unit 153, a receiving unit 154, and a notification control unit 155.

[0029] The control unit 15 is, for example, a CPU (Central Processing Unit). The control unit 15 executes a program stored in the storage unit 14 to function as a setting unit 151, an encoding unit 152, a transmitting unit 153, a receiving unit 154, and a notification control unit 155.

[0030] The setting unit 151 sets the quality of encoded data generated by the encoding unit 152 in response to an instruction from the information processing device 2. Upon receiving a setting instruction signal from the information processing device 2, the setting unit 151 sets encoding parameters to be referred to when the encoding unit 152 performs encoding based on the setting instruction signal, thereby causing the encoding unit 152 to generate encoded data of a first quality or encoded data of a second quality.

[0031] When the setting unit 151 receives a first setting instruction signal from the information processing device 2 to cause the encoding unit 152 to generate encoded data of a first quality, the setting unit 151 sets the encoding parameters to encoding parameters that cause the encoding unit 152 to generate encoded data of a first quality. Also, when the setting unit 151 receives a second setting instruction signal from the information processing device 2 to cause the encoding unit 152 to generate encoded data of a second quality, the setting unit 151 sets the encoding parameters to encoding parameters that cause the encoding unit 152 to generate encoded data of a second quality.

[0032] Here, the quality of the encoded data is changed, for example, by changing the data transfer rate. For example, the data transfer rate of the encoded data of the first quality is higher than the data transfer rate of the encoded data of the second quality. Note that, although the quality of the encoded data is changed by changing the data transfer rate, it is not limited to this, and the quality of the encoded data may be changed by changing the resolution, frame rate, or codec of the captured data.

[0033] The encoding unit 152 encodes the shooting data generated by the shooting unit 11 to generate encoded data. The encoding unit 152 encodes the shooting data using, for example, an encoder of H.265, which is a video compression standard, to generate encoded data. The encoding unit 152 generates encoded data of a quality corresponding to the encoding parameters set by the setting unit 151. Note that, although the video compression standard used to generate the encoded data is H.265, this is not limiting, and various video compression standards such as mpeg-ts, H.264, VC-1, VC-2, and V-PCC (Video-based point cloud compression) may also be used.

[0034] The transmission unit 153 transmits the encoded data generated by the encoding unit 152 to the information processing device 2 via the communication unit 12. The receiving unit 154 receives a notification signal indicating whether or not the shooting data shot by the device itself has been selected as data for broadcast in response to a switcher (not shown) that is a device for selecting shooting data for broadcast selecting the shooting data for broadcast. The notification signal is, for example, a tally signal for changing the lighting color of a tally lamp. The receiving unit 154 receives, as the tally signal, a red lighting instruction signal for lighting the tally lamp in red, or a green lighting instruction signal for lighting the tally lamp in green. Here, the receiving unit 154 receives the tally signal from the switcher, but is not limited thereto, and may receive the tally signal from the information processing device 2.

[0035] The notification control unit 155 notifies the surroundings whether or not the shooting data shot by the shooting unit 11 has been selected as broadcast shooting data to be used for television broadcasting by controlling the lighting state of the notification unit 13 based on the tally signal received by the receiving unit 154. For example, when the receiving unit 154 receives a red lighting instruction signal as a tally signal, the notification control unit 155 lights up the tally lamp serving as the notification unit 13 in red. Also, when the receiving unit 154 receives a green lighting instruction signal as a tally signal, the notification control unit 155 lights up the tally lamp serving as the notification unit 13 in green.

[0036] [Functional configuration of information processing device 2] Next, a description will be given of the functional configuration of the information processing device 2. Fig. 3 is a diagram showing the functional configuration of the information processing device 2. The information processing device 2 has a communication unit 21, a storage unit 22, and a control unit 23.

[0037] The communication unit 21 is a communication interface for transmitting and receiving data to and from each of the multiple photographing side devices 1. The storage unit 22 is a storage medium that stores various data, and includes a ROM, a RAM, a hard disk, an SSD, a flash memory, etc. The storage unit 22 stores a program executed by the control unit 23. The storage unit 22 stores a program that causes the control unit 23 to function as a receiving unit 231, a decoding unit 232, a display control unit 233, a selecting unit 234, a setting unit 235, and an output unit 236.

[0038] The control unit 23 is, for example, a CPU. The control unit 23 executes a program stored in the storage unit 22 to function as a receiving unit 231, a decoding unit 232, a display control unit 233, a selecting unit 234, a setting unit 235, and an output unit 236.

[0039] The receiving unit 231 receives the encoded data by wireless communication from the photographing side device 1. Specifically, the receiving unit 231 receives the encoded data, which is the photographing data encoded by each photographing side device 1, from each of the multiple photographing side devices 1 via the wireless communication network N.

[0040] The decoding unit 232 decodes the multiple encoded data received by the receiving unit 231 from the multiple shooting side devices 1, respectively, to restore the multiple shooting data. The decoding unit 232 decodes the multiple encoded data using, for example, an H.265 decoder, to restore the multiple shooting data.

[0041] The display control unit 233 causes one or more display devices (not shown) to display the multiple pieces of shooting data restored by the decoding unit 232 via the communication unit 21. Here, the display devices are used by a person in charge of selecting the broadcast shooting data to be used for television broadcasting to check the multiple pieces of shooting data. Note that the information processing device 2 may have a display unit, and the display control unit 233 may cause the display unit of the information processing device 2 to display the multiple pieces of shooting data.

[0042] The selection unit 234 selects one piece of shooting data from among the multiple pieces of shooting data restored by the decoding unit 232. For example, the information processing device 2 is communicably connected to a switcher, which is a device for selecting broadcast shooting data to be used for television broadcasting from among the multiple pieces of shooting data. The selection unit 234 receives shooting data identification information for identifying the selected shooting data from the switcher, and selects one piece of shooting data corresponding to the received shooting data identification information from among the multiple pieces of shooting data.

[0043] In response to the selection of one piece of shooting data, the selection unit 234 transmits a tally signal to the shooting side device 1 as a notification signal indicating whether or not the shooting data shot by itself has been selected as broadcast data. For example, the selection unit 234 transmits a red light indication signal as a tally signal to the shooting side device 1 corresponding to the selected shooting data, indicating that the shooting data has been selected as broadcast shooting data to be used for television broadcast. In response to the selection of one piece of shooting data, the selection unit 234 transmits a green light indication signal as a tally signal to the shooting side device 1 corresponding to the shooting data selected immediately before the selection of the shooting data, indicating that the shooting data has not been selected as broadcast shooting data to be used for television broadcast.

[0044] When there is no response from a specific imaging side device 1, the selection unit 234 may perform control via a switcher (not shown) or the display control unit 233 so as not to select imaging data corresponding to the imaging side device 1. In this way, it is possible to prevent imaging data corresponding to an imaging side device 1 that is not responding from being selected during television broadcasting.

[0045] In response to the selection of the imaging data by the selection unit 234, the setting unit 235 sets the imaging side device 1 corresponding to the imaging data so that the imaging side device 1 generates encoded data of the first quality. Also, the setting unit 235 sets the imaging side device 1 corresponding to the imaging data not selected by the selection unit 234 so that the imaging side device 1 generates encoded data of the second quality.

[0046] First, the shooting device 1 corresponding to the shooting data selected as broadcast shooting data to be used for television broadcast is set to generate encoded data of a first quality, and the shooting device 1 corresponding to the shooting data not selected as broadcast shooting data is set to generate encoded data of a second quality.

[0047] Then, in response to the selection of the imaging data by the selection unit 234, the setting unit 235 transmits a first setting instruction signal to one of the imaging side devices 1 corresponding to the selected imaging data, which instructs the imaging side device 1 to generate encoded data of the first quality, thereby setting the imaging side device 1. Also, in response to the selection of the imaging data by the selection unit 234, the setting unit 235 transmits a second setting instruction signal to one of the imaging side devices 1 corresponding to the imaging data selected immediately before the selection unit 234 selected the imaging data, which instructs the imaging side device 1 to generate encoded data of the second quality, thereby setting the imaging side device 1.

[0048] Here, the setting unit 235 may make the timing at which the shooting side device 1 corresponding to the shooting data selected by the selection unit 234 starts generating encoded data of the first quality different from the timing at which the shooting side device 1 corresponding to the shooting data selected immediately before the selection unit 234 selected the shooting data switches from generating encoded data of the first quality to generating encoded data of the second quality.

[0049] For example, the setting unit 235 sets the imaging side device 1 corresponding to the imaging data selected by the selection unit 234 so that the imaging side device 1 generates encoded data of a first quality at the timing when the selection unit 234 selects the imaging data. Also, the setting unit 235 sets the imaging side device 1 corresponding to the imaging data not selected by the selection unit 234, i.e., the imaging side device 1 corresponding to the imaging data selected immediately before the selection unit 234 selects the imaging data, so that the imaging side device 1 generates encoded data of a second quality after a first time has elapsed from the timing when the selection unit 234 selects the imaging data.

[0050] Here, the first time is a time longer than the time from when the selection unit 234 selects the shooting data to when the quality of the encoded data received from the shooting side device 1 corresponding to the shooting data is switched to the first quality and when the output unit 236 outputs the shooting data based on the encoded data of the first quality. In this manner, when the output unit 236 outputs the shooting data based on the encoded data of the first quality, the information processing device 2 can switch the encoded data corresponding to the shooting data that the output unit 236 has output up to that point to the second quality. In this manner, the information processing device 2 can prevent the shooting data restored from the encoded data of the second quality from being used for broadcasting.

[0051] Note that the setting unit 235 sets the imaging side device 1 to generate encoded data of the first quality or the second quality by transmitting the setting instruction signal, but this is not limited to this. The setting unit 235 may set each of the imaging side devices 1 so that the imaging side device 1 corresponding to the imaging data selected by the selection unit 234 generates encoded data of the first quality, using a notification signal indicating whether or not the imaging side device 1 is the imaging side device corresponding to the imaging data selected by the selection unit 234. Similarly, the setting unit 235 may set the imaging side device 1 so that the imaging side device 1 corresponding to the imaging data not generated by the selection unit 234 generates encoded data of the second quality, using the notification signal.

[0052] In this case, for example, when the selection unit 234 selects shooting data, the setting unit 235 sets the shooting side device 1 to generate encoded data of the first quality or the second quality in the shooting side device 1 by transmitting a tally signal to each of the multiple shooting side devices 1 as a notification signal indicating whether or not the shooting side device itself is the shooting side device corresponding to the shooting data selected by the selection unit 234.

[0053] The setting unit 151 of the photographing side device 1 sets the encoding parameters based on the tally signal received by the receiving unit 154 from the information processing device 2. For example, the setting unit 151 sets the encoding parameters so that the encoding unit 152 generates encoded data of the first quality when the receiving unit 154 receives a red light indication signal as a tally signal. The setting unit 151 also sets the encoding parameters so that the encoding unit 152 generates encoded data of the second quality when the receiving unit 154 receives a green light indication signal as a tally signal. In this way, the information processing device 2 can set whether to generate encoded data of the first quality or the second quality in the photographing side device 1 in conjunction with the tally signal. Note that the tally signal does not have a first time delay. Therefore, the encoding unit 152 may set the encoding parameters so that the encoded data of the second quality is generated in response to the passage of the first time from the timing of receiving the green light indication signal.

[0054] Furthermore, the setting unit 235 may determine the data transfer rate as the first quality and the data transfer rate as the second quality according to the reception strength of radio waves corresponding to wireless communication when the receiving unit 231 receives the encoded data from the photographing side device 1 via wireless communication. In this case, the reception strength of radio waves corresponding to wireless communication is based on radio wave quality information indicating the quality of radio waves acquired by the photographing side device 1. The radio wave quality information is, for example, at least one of the field strength, the amount of resource blocks allocated to the wireless communication of the photographing side device 1, and MCS (Modulation and Coding Scheme) indicating the modulation method and the coding rate.

[0055] For example, the receiving unit 231 receives encoded data and acquires radio wave quality information from the multiple photographing side devices 1. The setting unit 235 specifies the reception strength of radio waves corresponding to wireless communication for each of the multiple photographing side devices 1 based on the acquired radio wave quality information.

[0056] The range of radio wave reception strength corresponding to wireless communication, a data transfer rate as a first quality, and a data transfer rate as a second quality are associated with each other and stored in advance in the storage unit 22. The setting unit 235 specifies, for each of the multiple photographing side devices 1, a data transfer rate as the first quality and a data transfer rate as the second quality that are associated with the range of radio wave reception strength corresponding to the specified radio wave reception strength.

[0057] The setting unit 235 sets the imaging side device 1 corresponding to the imaging data selected by the selection unit 234 so that the imaging side device 1 generates encoded data at a data transfer rate as the specified first quality. Also, the setting unit 235 sets the imaging side device 1 corresponding to the imaging data not selected by the selection unit 234 so that the imaging side device 1 generates encoded data at a data transfer rate as the specified second quality.

[0058] Furthermore, when a predetermined communication band can be occupied for transmission of imaging data from a plurality of imaging side devices 1, the setting unit 235 may set the data transfer rate as the first quality and the data transfer rate as the second quality based on a partial band obtained by dividing the occupied band by the number of imaging side devices 1. In this way, the information processing device 2 can determine the first quality and the second quality to be qualities corresponding to the communication status with the imaging side device 1.

[0059] In response to the selection of the shooting data by the selection unit 234, the output unit 236 transmits the shooting data selected by the selection unit 234 to an external device for television broadcasting, for example, as broadcast shooting data to be used for television broadcasting.

[0060] For example, the output unit 236 outputs the restored shooting data to an external device after a switching delay time, which is the time from when the selection unit 234 selects the shooting data to when the decoding unit 232 acquires encoded data of the first quality from the shooting side device 1 corresponding to the shooting data and becomes able to output the shooting data restored from the encoded data.

[0061] Here, the switching delay time is a time measured in advance, and delay time information indicating the switching delay time is stored in the storage unit 22. Then, when the selection unit 234 selects the shooting data, the output unit 236 refers to the delay time information stored in the storage unit 22, and outputs the shooting data restored from the encoded data acquired from the shooting side device 1 corresponding to the selected shooting data at a timing when the switching delay time indicated by the delay time information has elapsed since the selection unit 234 selected the shooting data. In this way, the information processing device 2 can prevent the shooting data corresponding to the encoded data of the second quality from being used for broadcasting.

[0062] Note that the output unit 236 refers to the delay time information and outputs the imaging data restored from the encoded data acquired from the imaging side device 1 corresponding to the selected imaging data, but is not limited to this. The output unit 236 may output the restored imaging data to an external device on the condition that the decoding unit 232 restores the imaging data from the encoded data of the first quality received from the imaging side device 1 corresponding to the imaging data selected by the selection unit 234.

[0063] In this case, when the output unit 236 detects that the decoding unit 232 has restored an I frame corresponding to the first quality as shooting data from the encoded data received from the shooting side device 1 corresponding to the shooting data selected by the selection unit 234, the output unit 236 outputs the restored shooting data to an external device. For example, the output unit 236 detects that the decoding unit 232 has restored an I frame corresponding to the first quality based on the data amount of the I frame restored by the decoding unit 232 from the encoded data received from the shooting side device 1 corresponding to the shooting data selected by the selection unit 234. In this way, the information processing device 2 can prevent shooting data corresponding to encoded data of the second quality from being used for broadcast.

[0064] Here, the output unit 236 may transmit a signal to an internal or external switcher indicating that the shooting data is being switched during the time until the encoded data of the first quality from the shooting side device 1 corresponding to the shooting data selected by the selection unit 234 can be output to an external device, and may prevent the switcher from accepting further switching of the shooting data during the switching of the shooting data. In this way, it is possible to operate a video switching system that makes it easy to grasp the video delay situation according to the communication state.

[0065] [Operation flow] Next, a description will be given of a process flow related to the information processing device 2. Fig. 4 is a flowchart showing an example of a process flow related to the setting of the photographing side device 1 by the information processing device 2. In parallel with this flowchart, it is assumed that the receiving unit 231 receives encoded data from each of the multiple photographing side devices 1, the decoding unit 232 decodes the multiple encoded data to restore multiple photographing data, and the output unit 236 outputs the already selected photographing data to an external device.

[0066] First, the selection unit 234 judges whether or not one piece of photographic data has been newly selected from among a plurality of photographic data (S1). If the selection unit 234 judges that one piece of photographic data has been newly selected (YES in S1), the process proceeds to S2, and if the selection unit 234 judges that no new photographic data has been selected (NO in S1), the process re-executes S1.

[0067] Next, in response to the selection of the shooting data, the setting unit 235 identifies the shooting side device 1 corresponding to the shooting data, and transmits a first setting instruction signal to the shooting side device 1 instructing it to generate encoded data of the first quality (S2).

[0068] Next, the setting unit 235 determines whether or not a first time has elapsed since the shooting data was selected (S3). If the setting unit 235 determines that the first time has elapsed (YES in S3), it proceeds to S4, and if it determines that the first time has not elapsed (NO in S3), it executes S3 again.

[0069] In S4, the setting unit 235 identifies the imaging side device 1 corresponding to the unselected imaging data, and transmits a second setting instruction signal to the imaging side device 1 instructing it to generate encoded data of the second quality.

[0070] Next, the output unit 236 determines whether or not a switching delay time for switching the photographic data to be output to the external device to the photographic data selected in S1 has elapsed (S5). If the output unit 236 determines that the switching delay time has elapsed (YES in S5), it proceeds to S6, and if it determines that the switching delay time has not elapsed (NO in S5), it executes S5 again. Next, the output unit 236 switches the captured data to be output to an external device for television broadcast to the captured data selected in S1 (S6).

[0071] Next, the setting unit 235 determines whether or not an instruction to end the process related to the setting of the photographing side device 1 has been received from a management device (not shown) that manages the setting of the photographing side device 1 (S7). If the setting unit 235 determines that an instruction to end has been received (YES in S7), it ends the process related to this flowchart, and if it determines that an instruction to end has not been received (NO in S7), it proceeds to S1.

[0072] [Variation 1] In the above embodiment, the output unit 236 outputs the shooting data selected by the selection unit 234 to an external device as broadcast shooting data to be used for television broadcasting, but this is not limited to this. The output unit 236 may output the shooting data selected by the selection unit 234 to an external device as distribution shooting data to be used for data distribution, such as a video conference system or a live video distribution service.

[0073] [Variation 2] In addition, when a predetermined communication bandwidth can be occupied for the transmission of shooting data from multiple shooting side devices 1, the setting unit 235 may set the data transfer rate as the first quality and the data transfer rate as the second quality based on a partial bandwidth obtained by dividing the occupied bandwidth by the number of shooting side devices 1, but this is not limited to this.

[0074] When the setting unit 235 can occupy a predetermined communication band for the transmission of the shooting data from the multiple shooting side devices 1 and the receiving unit 231 can simultaneously receive the encoded data of the first quality from all the shooting side devices 1, the setting unit 235 may set all the shooting side devices 1 so that all the shooting side devices 1 generate the encoded data of the first quality. In this case, in response to the selection of the shooting data by the selection unit 234, the output unit 236 may output the selected shooting data to the external device as the shooting data for broadcast at the timing when the selection unit 234 selects the shooting data. In this way, the information processing device 2 can suppress the delay from the selection of the shooting data by the selection unit 234 to the output of the shooting data to the external device as the shooting data for broadcast.

[0075] [Effects of information processing device 2] As described above, the information processing device 2 according to the present embodiment receives encoded data from each of the multiple photographing side devices 1, and restores the multiple photographing data by decoding the multiple encoded data received from each of the multiple photographing side devices 1. Then, in response to selecting one photographing data from the restored multiple photographing data, the information processing device 2 sets the photographing side device 1 corresponding to the selected photographing data to generate encoded data of a first quality, and sets the photographing side device 1 corresponding to the unselected photographing data to generate encoded data of a second quality lower than the first quality. In this way, the information processing device 2 can prevent the bandwidth from becoming congested when each of the multiple photographing side devices 1 wirelessly transmits photographing data.

[0076] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote industry, innovation and infrastructure."

[0077] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0078] 1. Imaging device 2. Information processing equipment 11. Photography Department 12 Communications Department 13 Notification Department 14 Storage section 15 Control section 21 Communications Department 22 Memory section 23 Control Unit 151 Setting section 152 Encoding section 153 Transmitter 154 Receiving unit 155 Notification control section 231 Receiving unit 232 Decoder 233 Display control section 234 Selection Section 235 Setting section 236 Output section S Information Processing System

Claims

1. a receiving unit that receives encoded data, which is the imaging data encoded by each of the imaging side devices, from each of the imaging side devices; a decoding unit that decodes the encoded data received from each of the imaging side devices to restore the imaging data; a selection unit that selects one piece of photographic data from among the plurality of pieces of photographic data restored by the decoding unit; a setting unit which, in response to the selection of the photographing data by the selection unit, sets the photographing side device corresponding to the photographing data to generate encoded data of a first quality, and sets the photographing side device corresponding to the photographing data not selected by the selection unit to generate encoded data of a second quality lower than the first quality; An information processing device having the above configuration.

2. the setting unit uses a notification signal notifying the plurality of imaging side devices of whether or not the imaging side devices are imaging side devices corresponding to the imaging data selected by the selection unit to set the imaging side devices corresponding to the imaging data selected by the selection unit so as to generate the encoded data of the first quality, and sets the imaging side devices corresponding to the imaging data not selected by the selection unit so as to generate the encoded data of the second quality. The information processing device according to claim 1 .

3. each of the plurality of imaging side devices is provided with a tally lamp for indicating that imaging data generated by the imaging side device is selected by the selection unit; the setting unit uses a tally signal for changing the lighting state of the tally lamp of each of the plurality of imaging side devices to set the imaging side device corresponding to the imaging data selected by the selection unit so as to generate the encoded data of the first quality, and sets the imaging side device corresponding to the imaging data not selected by the selection unit so as to generate the encoded data of the second quality. The information processing device according to claim 2 .

4. the setting unit sets an imaging side device corresponding to the imaging data selected by the selection unit so as to generate the encoded data of the first quality at a timing when the selection unit selects the imaging data, and sets an imaging side device corresponding to the imaging data not selected by the selection unit so as to generate the encoded data of the second quality after a first time has elapsed from a timing when the selection unit selects the imaging data. The information processing device according to claim 1 .

5. An output unit outputs the photographed data selected by the selection unit to an external device as broadcast photographed data to be used for television broadcast or as distribution photographed data to be used for data distribution. The information processing device according to claim 1 .

6. the output unit receives encoded data of a first quality from the imaging side device corresponding to the imaging data after the selection unit has selected the imaging data and outputs the restored imaging data to the external device after a time period from when the selection unit has selected the imaging data to when the decoding unit is able to output the restored imaging data from the encoded data. The information processing device according to claim 5 .

7. the output unit outputs the restored photographing data to the external device on condition that the decoding unit has restored the photographing data from the encoded data of the first quality received from the photographing side device corresponding to the photographing data selected by the selection unit. The information processing device according to claim 6.

8. when detecting that the decoding unit has restored an I frame corresponding to the first quality as the shooting data from the encoded data received from the shooting side device corresponding to the shooting data selected by the selection unit, the output unit outputs the restored shooting data to the external device. The information processing device according to claim 7.

9. the receiving unit receives data from the photographing device via wireless communication; the setting unit determines a data transfer rate as a first quality and a data transfer rate as a second quality according to a reception strength of a radio wave corresponding to the wireless communication; The information processing device according to claim 1 .

10. The reception strength is based on information indicating the quality of radio waves acquired by the photographing device. The information processing device according to claim 9.

11. when there is no response from a specific imaging side device, the selection unit performs control so as not to select imaging data corresponding to the specific imaging side device. The information processing device according to claim 1 .

12. when a predetermined communication band can be occupied for transmission of the photographing data from a plurality of photographing side devices, the setting unit sets a data transfer rate as a first quality and a data transfer rate as a second quality based on partial bands obtained by dividing the occupied band by the photographing side devices; The information processing device according to claim 1 .

13. the setting unit sets all of the imaging side devices so as to generate the encoded data of the first quality when a predetermined communication band can be occupied for transmission of the imaging data from the plurality of imaging side devices; an output unit that outputs the selected photographed data to an external device as broadcast photographed data to be used for television broadcast or as distribution photographed data to be used for data distribution at the timing when the selection unit selects the photographed data in response to the selection unit selecting the photographed data, The information processing device according to claim 1 .

14. The computer executes receiving encoded data from each of the imaging side devices, the encoded data being imaging data encoded by each imaging side device; decoding the encoded data received from each of the imaging side devices to restore the imaging data; selecting one piece of photographic data from the plurality of restored photographic data; in response to the selection of the photographing data, setting the photographing side device corresponding to the photographing data to generate encoded data of a first quality, and setting the photographing side device corresponding to the unselected photographing data to generate encoded data of a second quality lower than the first quality; An information processing method comprising the steps of:

15. An information processing system having an information processing device and a plurality of imaging side devices, Each of the plurality of imaging side devices includes an imaging unit that captures images to generate imaging data; an encoding unit that encodes the photographic data generated by the photographing unit; A transmission unit that transmits encoded data, which is encoded photographic data; having The information processing device includes: a receiving unit that receives encoded data from each of the plurality of image capturing side devices; a decoding unit that decodes the encoded data received from each of the imaging side devices to restore the imaging data; a selection unit that selects one piece of photographic data from among the plurality of pieces of photographic data restored by the decoding unit; a setting unit which, in response to the selection of the photographing data by the selection unit, sets the photographing side device corresponding to the photographing data to generate encoded data of a first quality, and sets the photographing side device corresponding to the photographing data not selected by the selection unit to generate encoded data of a second quality lower than the first quality; having Information processing system.

Images