Information processing system, information processing device, and information processing method

Abstract

To suppress a delay in distributing a return video to an imaging device side.SOLUTION: An information processing device 2 comprises: a reception unit 231 which receives encoded data, which is video data encoded by each first imaging-side device 1, from each of a plurality of first imaging-side devices 1; a decoding unit 232 which restores a plurality of video data by decoding a plurality of encoded data received from each of the plurality first imaging-side devices 1; a selection unit 235 which selects one video data among the plurality of video data restored by the decoding unit 232; and a distribution unit 236 which distributes encoded data corresponding to the video data selected by the selection unit 235 and received by the reception unit 231 to each first imaging-side device.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing device, and an information processing method. [Background technology]

[0002] Conventionally, in the production of television broadcast programs, filming is performed using multiple camera devices, and one of the video data generated by each of the multiple camera devices is selected using a switcher as the video data to be aired (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2005-295431 A Summary of the Invention [Problem to be solved by the invention]

[0004] When multiple imaging devices are FPUs (Field Pickup Units) or wireless cameras and video data is transmitted to a switcher via wireless communication, the video data is encoded using an encoder to reduce communication capacity before being transmitted to the switcher, and the encoded video data is decoded. In this case, when on-air video data is distributed to multiple imaging devices as return video, the video data is encoded to reduce communication capacity before being distributed to the imaging devices, which causes a problem of delay.

[0005] Therefore, the present invention has been made in consideration of these points, and has an object to reduce delays when distributing return video to the imaging device side. [Means for solving the problem]

[0006] An information processing system according to a first aspect of the present invention is an information processing system having an information processing device and a plurality of first imaging side devices, each of which includes a first imaging unit that generates video data by capturing an image, a first encoding unit that encodes the video data generated by the first imaging unit, a first imaging side transmitting unit that transmits encoded data, which is the encoded video data, to the information processing device, a first imaging side receiving unit that receives the encoded data distributed from the information processing device, and a first imaging side receiving unit that decodes the encoded data received by the first imaging side receiving unit to restore the video data. The information processing device has a first shooting side decoding unit and a first display control unit that displays the video data restored by the first shooting side decoding unit on a display unit, and the information processing device has a receiving unit that receives encoded data from each of the multiple first shooting side devices, a decoding unit that decodes the multiple encoded data received from each of the multiple first shooting side devices and restores the multiple video data, a selection unit that selects one video data from the multiple video data restored by the decoding unit, and a distribution unit that distributes encoded data corresponding to the video data selected by the selection unit to the multiple first shooting side devices.

[0007] The information processing device may be capable of communicating with a second photographing side device different from the first photographing side device, and the second photographing side device may have a second photographing unit that generates video data by photographing, a second photographing side transmitting unit that transmits the video data generated by the second photographing unit to the information processing device, a second photographing side receiving unit that receives encoded data distributed from the information processing device, a second photographing side decoding unit that decodes the encoded data received by the second photographing side receiving unit to restore the video data, and a second display control unit that displays the video data restored by the second photographing side decoding unit on a display unit, wherein the receiving unit receives the video data from the second photographing side device, and the information processing device may have an encoding unit that encodes the video data received by the receiving unit, the selection unit selects one of the multiple video data restored by the decoding unit and the video data received from the second photographing side device, and the distribution unit distributes the encoded data corresponding to the video data selected by the selection unit to the multiple first photographing side devices and the second photographing side device.

[0008] The distribution unit may identify a delay time that is a time from when the encoded data is distributed to the multiple first imaging side devices to when each of the multiple first imaging side devices starts displaying video data corresponding to the encoded data, and distribute the encoded data to the multiple first imaging side devices so that each of the multiple first imaging side devices starts displaying the video data corresponding to the encoded data is the same time based on the delay time identified for each of the multiple first imaging side devices.

[0009] The information processing device may have a memory control unit that stores in a memory unit the multiple encoded data received by the receiving unit from each of the multiple first imaging side devices, and when the distribution unit receives a retransmission request for the encoded data from at least one of the multiple first imaging side devices, it may redistribute the encoded data stored in the memory unit to the first imaging side device that sent the retransmission request.

[0010] The memory control unit stores encoded data from the current time to a predetermined time ago in the memory unit, and when the distribution unit receives a request for re-distribution of encoded data corresponding to the predetermined time from at least one of the multiple first imaging side devices, if the encoded data corresponding to the predetermined time is not stored in the memory unit, it may obtain the encoded data corresponding to the predetermined time from the first imaging side device that is the source of the encoded data, and re-distribute the obtained encoded data to the first imaging side device that sent the re-transmission request.

[0011] The first imaging side transmitting section may transmit the encoded data to the information processing device by wireless communication, and the receiving section may receive the encoded data from each of the first imaging side devices by wireless communication. The first image capturing side transmitting section may transmit the encoded data to the information processing device via a communication network of a mobile phone.

[0012] The first photographing side receiving unit of the first photographing side device may receive a notification signal indicating whether or not the video data generated by the first photographing side device is the photographing side device corresponding to the video data selected by the selection unit, and the first display control unit of the first photographing side device may cause the display unit to display the video data generated by the first photographing unit when it determines, based on the notification signal received by the first photographing side receiving unit, that the video data corresponding to the first photographing side device has been selected by the selection unit.

[0013] The first shooting side receiving unit may receive data for image synthesis, and the first display control unit may synthesize the acquired data for image synthesis with image data decoded from encoded data distributed from the information processing device, and display the result on the display unit.

[0014] An information processing device according to a second aspect of the present invention includes a receiving unit that receives encoded data from each of a plurality of shooting side devices, the encoded data being video data encoded by each of the plurality of shooting side devices; a decoding unit that decodes the encoded data received from each of the plurality of shooting side devices to restore the plurality of video data; a selection unit that selects one of the plurality of video data restored by the decoding unit; and a distribution unit that distributes the encoded data received by the receiving unit, which corresponds to the video data selected by the selection unit, to each shooting side device.

[0015] An information processing method according to a third aspect of the present invention includes a computer-executed step of receiving encoded data from each of a plurality of shooting side devices, the encoded data being video data encoded by each of the plurality of shooting side devices; a step of decoding the encoded data received from each of the plurality of shooting side devices to restore the plurality of video data; a step of selecting one of the restored plurality of video data; and a distribution unit that distributes the received encoded data, which is encoded data corresponding to the selected video data, to each shooting side device. Effect of the Invention

[0016] According to the present invention, it is possible to suppress delays in distributing return video to the image capture device side. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is a diagram illustrating an overview of an information processing system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing a functional configuration of a first imaging side device. [Diagram 3] FIG. 2 is a diagram illustrating a functional configuration of an information processing device according to a first embodiment. [Figure 4] 10 is a flowchart illustrating an example of a process flow in an information processing device. [Diagram 5] FIG. 2 is a diagram showing a functional configuration of a second imaging side device. [Figure 6] FIG. 11 is a diagram illustrating a functional configuration of an information processing device according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] <First embodiment> [Outline of Information Processing System S] FIG. 1 is a diagram for explaining an overview of an information processing system S according to a first embodiment. The information processing system S has a plurality of first imaging side devices 1 that perform imaging, and an information processing device 2. The information processing system S is a system that selects one of the video data generated in the plurality of first imaging side devices 1, and outputs the selected video data as broadcast video data that is video data for on-air television broadcasting. Note that, although FIG. 1 shows two first imaging side devices 1 as the plurality of first imaging side devices 1, the present invention is not limited to this, and three or more first imaging side devices 1 may be provided.

[0019] The information processing device 2 is communicably connected to each of the first imaging side devices 1 via a wireless communication network such as a mobile phone line. The information processing device 2 receives encoded data, which is data obtained by encoding video data generated by the first imaging side devices 1, from each of the first imaging side devices 1. The information processing device 2 decodes the received encoded data to restore the video data.

[0020] The information processing device 2 selects video data to be output as broadcast video data to be used for television broadcasting from among the multiple restored video data, and outputs the selected video data to the external device 3 as the broadcast video data.

[0021] The information processing device 2 also displays the selected video data as return video on the first imaging device 1. In a conventional information processing device, in order to display the selected video data on the first imaging device 1, the selected video data is encoded to generate encoded data, and the generated encoded data is distributed to a plurality of imaging devices. This causes a problem of a delay in generating the encoded data.

[0022] In response to this, the information processing device 2 directly distributes the encoded data corresponding to the selected video data from among the plurality of received encoded data to the plurality of first imaging side devices 1 without undergoing a decoding process or an encoding process in the information processing device 2. In this manner, the information processing system S can suppress a delay in distributing the return video to the imaging device side.

[0023] [Functional configuration of the first photographing side device 1] Next, the functional configuration of the information processing system S will be described. First, the functional configuration of the first photographing side device 1 will be described. Fig. 2 is a diagram showing the functional configuration of the first photographing side device 1. It is assumed that each of the multiple first photographing side devices 1 has the configuration shown in Fig. 2. In the example shown in Fig. 2, the first photographing side device 1 is realized by one device, but this is not limited to this and may be realized by multiple devices.

[0024] As shown in FIG. 2, the first photographing side device 1 has a first photographing unit 11, a first communication unit 12, a first notification unit 13, a first display unit 14, a first memory unit 15, and a first control unit 16. The first photographing unit 11 generates video data by photographing the surroundings. The first photographing unit 11 outputs the generated video data to the first control unit 16. The first communication unit 12 is a communication interface for transmitting and receiving data to and from the information processing device 2 and the like via a wireless communication network.

[0025] The first notification unit 13 is, for example, a tally lamp, and notifies the surroundings that the video data generated by the first imaging side device 1 corresponding to itself has been selected as video data to be used for television broadcast. The first notification unit 13 notifies the surroundings whether the video data generated by the first imaging side device 1 has been selected as broadcast shooting data to be used for television broadcast by changing the lighting state. For example, when the tally lamp is lit in red, it indicates that the video data generated by the first imaging side device 1 has been selected as broadcast data, and when it is lit in green, it indicates that the video data generated by the first imaging side device 1 has not been selected as broadcast data.

[0026] The first display unit 14 is a display device that displays an image represented by the video data selected by the information processing device 2 as a return image. The first storage unit 15 is a storage medium that stores various data, and includes a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, an SSD (Solid State Drive), a flash memory, etc. The first storage unit 15 stores a program executed by the first control unit 16. The first storage unit 15 stores a program that causes the first control unit 16 to function as a first encoding unit 161, a first imaging side transmitting unit 162, a first imaging side receiving unit 163, a first notification control unit 164, a first imaging side decoding unit 165, and a first display control unit 166.

[0027] The first control unit 16 is, for example, a CPU (Central Processing Unit). The first control unit 16 executes a program stored in the first storage unit 15 to function as a first encoding unit 161, a first imaging side transmitting unit 162, a first imaging side receiving unit 163, a first notification control unit 164, a first imaging side decoding unit 165, and a first display control unit 166.

[0028] The first encoding unit 161 generates encoded data by encoding the video data generated by the first shooting unit 11. The first encoding unit 161 encodes the video data using, for example, an encoder of H.265, which is a video compression standard, to generate encoded data.

[0029] The first imaging side transmission unit 162 transmits the encoded data, which is the video data encoded by the first encoding unit 161, to the information processing device 2 by wireless communication via the first communication unit 12. For example, the first imaging side transmission unit 162 transmits the encoded data to the information processing device 2 via a communication network of a mobile phone.

[0030] The first imaging side receiving unit 163 receives encoded data distributed from the information processing device 2 corresponding to the video data selected by a switcher (not shown). The switcher is a device for selecting broadcast video data from among a plurality of pieces of video data generated by the plurality of first imaging side devices 1, respectively.

[0031] The first image capturing side receiving unit 163 also receives video compositing data such as subtitles to be combined with the video data and computer graphic images for compositing. The first image capturing side receiving unit 163 receives the video compositing data from an external device 3 that is used in a switcher or a broadcasting station and generates the video compositing data. The external device 3 may be provided in the broadcasting station or on a cloud.

[0032] In response to the switcher selecting the broadcast video data, the first imaging side receiving unit 163 receives a notification signal indicating whether or not the video data generated by the first imaging side device 1 owned by the first imaging side receiving unit 163 has been selected as the broadcast video data. The notification signal is, for example, a tally signal for changing the lighting color of a tally lamp. The first imaging side receiving unit 163 receives, as the tally signal, a red lighting instruction signal for lighting the tally lamp in red, or a green lighting instruction signal for lighting the tally lamp in green. Here, the first imaging side receiving unit 163 receives the tally signal from the switcher, but is not limited thereto, and may receive the tally signal from the information processing device 2.

[0033] The first notification control unit 164 notifies the surroundings whether or not the video data captured by the first imaging unit 11 has been selected as video data for broadcast by controlling the tally lamp serving as the first notification unit 13 based on the tally signal received by the first imaging side receiving unit 163. For example, when the first imaging side receiving unit 163 receives a red light instruction signal as a tally signal, the first notification control unit 164 turns on the tally lamp red. Also, when the first imaging side receiving unit 163 receives a green light instruction signal as a tally signal, the first notification control unit 164 turns on the tally lamp green.

[0034] The first imaging side decoding unit 165 restores the video data by decoding the encoded data received by the first imaging side receiving unit 163. The first imaging side decoding unit 165 decodes the received encoded data using, for example, an H.265 decoder, and restores the video data.

[0035] The first display control unit 166 displays the image indicated by the image data restored by the first image capturing side decoding unit 165 on the first display unit 14. The first display control unit 166 generates a composite image by combining the image combining data acquired by the first image capturing side receiving unit 163 with the image data decoded from the encoded data, and displays the generated composite image on the first display unit 14. The first image capturing side device 1 generates a composite image based on the image combining data and the encoded data separately acquired by the first image capturing side receiving unit 163, thereby displaying an image indicating a telop or the like corresponding to the image combining data on the first display unit 14. In this way, the image combining data is combined with the encoded data without encoding and decoding, so that an image such as a telop indicated by the image combining data can be displayed on the first display unit 14 with high definition.

[0036] [Functional configuration of information processing device 2] Next, a description will be given of the functional configuration of the information processing device 2. Fig. 3 is a diagram showing the functional configuration of the information processing device 2 according to the first embodiment. The information processing device 2 has a communication unit 21, a storage unit 22, and a control unit 23.

[0037] The communication unit 21 is a communication interface for transmitting and receiving data to and from each of the first photographing side devices 1. The storage unit 22 is a storage medium that stores various data, and includes a ROM, a RAM, a hard disk, an SSD, a flash memory, etc. The storage unit 22 stores a program executed by the control unit 23. The storage unit 22 stores a program that causes the control unit 23 to function as a receiving unit 231, a decoding unit 232, an output unit 233, a storage control unit 234, a selecting unit 235, and a distributing unit 236.

[0038] The control unit 23 is, for example, a CPU. The control unit 23 executes the programs stored in the storage unit 22 to function as a receiving unit 231, a decoding unit 232, an output unit 233, a storage control unit 234, a selecting unit 235, and a distributing unit 236.

[0039] The receiving unit 231 receives the encoded data by wireless communication from each of the multiple first imaging side devices 1. Specifically, the receiving unit 231 receives the encoded data, which is video data encoded by each of the multiple first imaging side devices 1, from each of the multiple first imaging side devices 1 by wireless communication via a wireless communication network.

[0040] The decoding unit 232 decodes the multiple pieces of encoded data received by the receiving unit 231 from the multiple first imaging side devices 1, respectively, to restore multiple pieces of video data. The decoding unit 232 decodes the multiple pieces of encoded data received using, for example, an H.265 decoder, to restore multiple pieces of video data.

[0041] The output unit 233 outputs the multiple pieces of video data restored by the decoding unit 232. For example, the output unit 233 outputs the multiple pieces of video data restored by the decoding unit 232 to one or more display devices (not shown) via the communication unit 21, thereby causing the display device to display images indicated by each of the multiple pieces of video data. Here, the display device is used by a person in charge of selecting broadcast video data to be used for television broadcasting to check images indicated by each of the multiple pieces of video data. Note that the information processing device 2 may have a display unit, and the output unit 233 may cause the display unit of the information processing device 2 to display images indicated by the multiple pieces of video data.

[0042] The storage control unit 234 stores the multiple encoded data received by the receiving unit 231 from each of the multiple first imaging side devices 1 in the storage unit 22. For example, the storage control unit 234 stores the encoded data from the current time to a predetermined time ago in the storage unit 22. For example, the storage control unit 234 associates the multiple encoded data corresponding to each time that the receiving unit 231 receives consecutively from the first imaging side device 1 with the time at which the encoded data was received, and stores them in the storage unit 22. The encoded data stored in the storage unit 22 is used to retransmit to the first imaging side device 1.

[0043] The selection unit 235 selects one piece of video data from among the multiple pieces of video data restored by the decoding unit 232. For example, the information processing device 2 is communicably connected to a switcher, which is a device for selecting broadcast video data. The selection unit 235 receives video data identification information for identifying the selected video data from the switcher, and selects one piece of video data corresponding to the received video data identification information from among the multiple pieces of video data.

[0044] In response to the selection of one piece of video data, the selection unit 235 transmits a tally signal to the first imaging side device 1 as a notification signal indicating whether or not the video data captured by itself has been selected as broadcast data. For example, the selection unit 235 transmits a red light indication signal as a tally signal to the first imaging side device 1 corresponding to the selected video data, indicating that the video data has been selected as broadcast video data to be used for television broadcast. In response to the selection of one piece of video data, the selection unit 235 transmits a green light indication signal as a tally signal to the first imaging side device 1 corresponding to the video data selected immediately before the selection of the selected video data, indicating that the video data has not been selected as broadcast video data to be used for television broadcast.

[0045] When there is no response from a specific first imaging side device 1, the selection unit 235 may perform control via a switcher or display device (not shown) so as not to select video data corresponding to the first imaging side device 1. In this case, the selection unit 235 may perform control so as not to select video data corresponding to the unresponsive first imaging side device 1. In this way, it is possible to prevent video data corresponding to the unresponsive first imaging side device 1 from being selected during a television broadcast.

[0046] The distribution unit 236 distributes the encoded data corresponding to the video data selected by the selection unit 235 from among the multiple encoded data received by the reception unit 231 to the multiple first imaging side devices 1. Here, the distribution unit 236 may specify a delay time that is a time from when the encoded data corresponding to the video data selected by the selection unit 235 is distributed to the multiple first imaging side devices 1 to when the first display control unit 166 of each of the multiple first imaging side devices starts displaying the video data corresponding to the encoded data.

[0047] For example, the distribution unit 236 specifies a distribution start time, which is the time when the encoded data corresponding to the video data selected by the selection unit 235 is distributed to each of the multiple first imaging side devices 1. The distribution unit 236 also receives, via the receiving unit 231, from each of the multiple first imaging side devices 1, time information indicating a display start time, which is the time when each of the multiple first imaging side devices 1 causes the first display unit 14 to display a video represented by the video data restored by decoding the encoded data, and specifies the display start time. Then, the distribution unit 236 specifies a delay time corresponding to each of the multiple first imaging side devices 1 based on the distribution start time and the display start time corresponding to each of the multiple first imaging side devices 1.

[0048] The distribution unit 236 adjusts the distribution time of the encoded data for each of the multiple first imaging side devices 1 based on the delay time identified for each of the multiple first imaging side devices 1. As a result, the distribution unit 236 distributes the encoded data to the multiple first imaging side devices 1 so that the times at which the first display control units 166 of each of the multiple first imaging side devices 1 start displaying the video data corresponding to the encoded data are the same. In this way, the information processing device 2 can display the video data corresponding to the encoded data at the same timing in each of the multiple first imaging side devices 1, taking into account the delay time and the like related to the decoding of the encoded data in each of the multiple first imaging side devices 1.

[0049] The delivery unit 236 also receives a retransmission request for the encoded data from at least one of the multiple first imaging side devices 1 via the receiving unit 231. The delivery request includes a shooting time corresponding to the encoded data requested to be retransmitted by the first imaging side device 1. When the delivery unit 236 receives a retransmission request for the encoded data, the delivery unit 236 retransmits the encoded data from the shooting time onward, which is stored in the storage unit 22, to the first imaging side device 1 that sent the retransmission request, based on the shooting time included in the delivery request.

[0050] When the distribution unit 236 receives a re-distribution request for encoded data corresponding to a predetermined shooting time from at least one of the multiple first imaging side devices 1, if the encoded data corresponding to the shooting time is not stored in the storage unit 22, the distribution unit 236 transmits an acquisition request for the encoded data corresponding to the shooting time to the first imaging side device 1 that is the transmission source of the encoded data. The acquisition request includes the shooting time corresponding to the encoded data requested to be resent.

[0051] When the first photographing side transmitting unit 162 of the first photographing side device 1 acquires the acquisition request for the encoded data, it retransmits the encoded data stored in the first storage unit 15 after the photographing time included in the acquisition request to the information processing device 2 based on the photographing time included in the acquisition request. The distributing unit 236 acquires the encoded data corresponding to the photographing time included in the distribution request from the first photographing side device 1, and redistributes the acquired encoded data to the first photographing side device 1 that transmitted the retransmission request.

[0052] The first display control unit 166 of the first photographing side device 1 that has transmitted the retransmission request causes the first display unit 14 to display the redistributed video data restored by the first photographing side decoding unit 165. In this case, the first display control unit 166 causes the first display unit 14 to display, for example, the video represented by the redistributed video data while skipping some of the frames corresponding to the video. In this way, the first photographing side device 1 can quickly eliminate delays in displaying the video data.

[0053] [Operation flow] Next, a description will be given of a process flow related to the information processing device 2. Fig. 4 is a flowchart showing an example of the process flow in the information processing device 2. It is assumed that, before the process related to this flowchart is performed, the output unit 233 of the information processing device 2 outputs the video data selected by the selection unit 235 to the external device 3, and the distribution unit 236 distributes the encoded data corresponding to the video data to the multiple first imaging side devices 1.

[0054] First, the receiving unit 231 receives encoded data from each of the first image capturing side devices 1 via wireless communication (S1). Next, the decoding unit 232 decodes the encoded data received from each of the first image capturing side devices 1 to restore a plurality of video data (S2).

[0055] Next, the output unit 233 outputs the multiple pieces of video data restored by the decoding unit 232 to a display device (S3). Next, the selection unit 235 determines whether or not new video data has been selected (S4). If the selection unit 235 determines that new video data has been selected (YES in S4), the process proceeds to S5, and if the selection unit 235 determines that new video data has not been selected (NO in S4), the process returns to S1.

[0056] In S5, the selection unit 235 switches the video data to be output to the external device 3 to the newly selected video data. Next, the distribution unit 236 switches the encoded data to be output to the first image capturing side devices 1 to the newly selected encoded data (S6).

[0057] Next, the distribution unit 236 determines whether or not an instruction to end the process related to the first photographing side device 1 has been received from a management device (not shown) that manages the settings of the first photographing side device 1 (S7). If the distribution unit 236 determines that an instruction to end has been received (YES in S7), it ends the process related to this flowchart, and if it determines that an instruction to end has not been received (NO in S7), it proceeds to S1.

[0058] [Variation 1] In the above embodiment, the output unit 233 outputs the video data selected by the selection unit 235 to the external device 3 as broadcast video data to be used for television broadcasting, but this is not limited to the above. The output unit 233 may also output the video data selected by the selection unit 235 to the external device 3 as distribution video data to be used for data distribution.

[0059] [Variation 2] In the above embodiment, the first display control unit 166 causes the first display unit 14 to display the video data restored by the first imaging side decoding unit 165, but this is not limited to the above. When the first display control unit 166 determines, based on the notification signal received by the first imaging side receiving unit 163, that the video data corresponding to the first imaging side device 1 owned by the first display control unit 166 has been selected by the selection unit 235, the first display control unit 166 may cause the first display unit 14 to display the video data generated by the first imaging unit 11.

[0060] The delivery unit 236 may also be configured not to deliver the encoded data corresponding to the video data to the first imaging side device 1 corresponding to the video data selected by the selection unit 235 among the multiple first imaging side devices 1. In this manner, the information processing device 2 can reduce the communication capacity required for delivering the encoded data.

[0061] [Effects of information processing device 2] As described above, the information processing device 2 according to the first embodiment receives encoded data from each of the multiple first imaging side devices 1, decodes the received encoded data, restores the multiple video data, selects one video data from the restored multiple video data, and distributes the received encoded data, which corresponds to the selected video data, to each first imaging side device 1. In this way, the information processing device 2 can reduce delays in distributing return video to the imaging device side.

[0062] <Second embodiment> Next, a second embodiment will be described. Among the photographing side devices, there are second photographing side devices such as wired cameras and analog cameras that transmit video data to the information processing device 2 without encoding it. In contrast, the information processing device 2 according to the second embodiment differs from the first embodiment in that the video data received from the second photographing side device is encoded. The information processing device 2 according to the second embodiment will be described below. Note that the description of the same parts as in the first embodiment will be omitted as appropriate.

[0063] [Functional configuration of the second imaging side device 4] Fig. 5 is a diagram showing a functional configuration of the second imaging side device 4. Note that, although the second imaging side device 4 is realized by one device as shown in Fig. 5, it is not limited thereto and may be realized by a plurality of devices.

[0064] 5, the second photographing side device 4 has a second photographing section 41, a second communication section 42, a second notification section 43, a second display section 44, a second storage section 45, and a second control section 46. The functions of the second photographing section 41, the second communication section 42, the second notification section 43, the second display section 44, and the second storage section 45 are similar to the functions of the first photographing section 11, the first communication section 12, the first notification section 13, the first display section 14, and the first storage section 15, and therefore the description thereof will be omitted.

[0065] The second control unit 46 is, for example, a CPU. The second control unit 46 executes a program stored in the second storage unit 45 to function as a second imaging side transmitting unit 462, a second imaging side receiving unit 463, a second notification control unit 464, a second imaging side decoding unit 465, and a second display control unit 466.

[0066] The second imaging side transmission unit 462 transmits the video data generated by the second imaging unit 41 to the information processing device 2 via the second communication unit 42. For example, the second imaging side transmission unit 462 transmits the video data to the information processing device 2 via a communication network for wired communication.

[0067] The functions of the second photographing side receiving unit 463, the second notification control unit 464, the second photographing side decoding unit 465, and the second display control unit 466 are similar to the functions of the first photographing side receiving unit 163, the first notification control unit 164, the first photographing side decoding unit 165, and the first display control unit 166, and therefore will not be described.

[0068] [Functional configuration of information processing device 2] Next, a functional configuration of the information processing device 2 according to the second embodiment will be described. Fig. 6 is a diagram showing the functional configuration of the information processing device 2 according to the second embodiment.

[0069] As shown in FIG. 6, the control unit 23 of the information processing device 2 according to the second embodiment has an encoding unit 237. The encoding unit 237 encodes the video data received by the receiving unit 231 from the second image capturing side device 4 to generate encoded data.

[0070] The distribution unit 236 distributes the video data selected by the selection unit 235, that is, the encoded data corresponding to the broadcast video data used for television broadcasting, to the first image capturing side devices 1 and the second image capturing side devices 4.

[0071] Specifically, when the video data selected by the selection unit 235 is video data generated by any of the multiple first imaging side devices 1, the distribution unit 236 distributes encoded data corresponding to the video data to the multiple first imaging side devices 1 and the second imaging side device 4. When the video data selected by the selection unit 235 is video data generated by the second imaging side device 4, the distribution unit 236 distributes encoded data generated by the encoding unit 237 encoding the video data to the multiple first imaging side devices 1 and the second imaging side device 4.

[0072] In this way, even if video data received from a second photographing side device 4 that does not have an encoding function is selected, the information processing device 2 can distribute the encoded data obtained by encoding the video data to multiple first photographing side devices 1 and second photographing side devices 4.

[0073] Although the encoding unit 237 unconditionally encodes the video data received by the receiving unit 231 from the second imaging side device 4 to generate the encoded data, this is not limiting. The encoding unit 237 may encode the video data received from the second imaging side device 4 in response to the selection by the selection unit 235 of the video data generated by the second imaging side device 4. In this manner, the information processing device 2 does not encode the video data received from the second imaging side device 4 when the selection unit 235 has not selected the video data generated by the second imaging side device 4, thereby reducing the load associated with encoding.

[0074] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote industry, innovation and infrastructure."

[0075] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0076] 1. First imaging device 2. Information processing equipment 3 External device 4 Second imaging device 11 First Filming Section 12 First Communications Department 13 First Notification Department 14 1st display section 15 1st memory section 16 First Control Section 21 Communications Department 22 Memory section 23 Control Unit 41 2nd Filming Division 42 2nd Communications Department 43 Second Notification Department 44 2nd display section 45 2nd memory section 46 Second Control Section 161 First Encoding Section 162 First imaging side transmitter 163 First imaging side receiving unit 164 First notification control section 165 First imaging side decoding unit 166 First display control unit 231 Receiving unit 232 Decoder 233 Output section 234 Memory control unit 235 Selection Section 236 Distribution Department 237 Encoding section 462 Second imaging side transmitter 463 Second imaging receiver 464 Second notification control section 465 Second imaging side decoding unit 466 Second display control unit S Information Processing System

Claims

1. An information processing system having an information processing device and a plurality of first imaging side devices, Each of the plurality of first imaging side devices a first imaging unit that captures images to generate video data; a first encoding unit that encodes the video data generated by the first imaging unit; a first image capturing side transmitting unit configured to transmit encoded data, which is encoded video data, to the information processing device; a first image capturing side receiving unit for receiving encoded data distributed from the information processing device; a first image capture side decoding unit that decodes the encoded data received by the first image capture side receiving unit to restore video data; a first display control unit that causes a display unit to display the video data restored by the first image capture side decoding unit; having The information processing device includes: a receiving unit that receives encoded data from each of the first image capturing side devices; a decoding unit that decodes the encoded data received from each of the first image capturing devices to restore a plurality of video data; a selection unit that selects one of the plurality of video data restored by the decoding unit; a distribution unit that distributes encoded data corresponding to the video data selected by the selection unit to the first imaging side devices; having Information processing system.

2. the information processing device is capable of communicating with a second image capturing device different from the first image capturing device, The second imaging side device is A second imaging unit that captures images to generate video data; a second image capturing side transmitting unit that transmits the image data generated by the second image capturing unit to the information processing device; a second image capturing side receiving unit for receiving the encoded data distributed from the information processing device; a second image capturing side decoding unit that decodes the encoded data received by the second image capturing side receiving unit to restore video data; a second display control unit that causes a display unit to display the video data restored by the second image capturing side decoding unit; having The receiving unit receives video data from the second image capturing device, the information processing device includes an encoding unit that encodes the video data received by the receiving unit, the selection unit selects one of the plurality of pieces of video data restored by the decoding unit and the video data received from the second imaging side device; the distribution unit distributes encoded data corresponding to the video data selected by the selection unit to the first image capture side device and the second image capture side device. The information processing system according to claim 1 .

3. the distribution unit specifies a delay time that is a time from when the encoded data is distributed to the multiple first imaging side devices to when each of the multiple first imaging side devices starts displaying video data corresponding to the encoded data, and distributes the encoded data to the multiple first imaging side devices based on the delay time specified for each of the multiple first imaging side devices so that each of the multiple first imaging side devices starts displaying the video data corresponding to the encoded data at the same time. The information processing system according to claim 1 .

4. the information processing device includes a storage control unit that causes a storage unit to store the plurality of encoded data received by the receiving unit from the plurality of first imaging side devices, when the distribution unit receives a retransmission request for the encoded data from at least one of the plurality of first imaging side devices, the distribution unit retransmits the encoded data stored in the storage unit to the first imaging side device that has transmitted the retransmission request. The information processing system according to claim 1 .

5. The storage control unit stores encoded data from a current time to a predetermined time ago in the storage unit, when the distribution unit receives a re-distribution request for the encoded data corresponding to a predetermined time from at least one of the plurality of first imaging side devices, and if the encoded data corresponding to the predetermined time is not stored in the storage unit, the distribution unit acquires the encoded data corresponding to the predetermined time from the first imaging side device that is a transmission source of the encoded data, and re-distributes the acquired encoded data to the first imaging side device that has transmitted the re-distribution request.

5. The information processing system according to claim 4.

6. the first image capturing side transmitting unit transmits the encoded data to the information processing device by wireless communication; the receiving unit receives encoded data from each of the first imaging side devices via wireless communication; The information processing system according to claim 1 .

7. the first image capturing side transmitting unit transmits the encoded data to the information processing device via a communication network of a mobile phone; 7. The information processing system according to claim 6.

8. the first photographing side receiving unit of the first photographing side device receives a notification signal indicating whether the video data generated by the first photographing side device is the photographing side device corresponding to the video data selected by the selection unit; when determining, based on the notification signal received by the first imaging side receiving unit, that the video data corresponding to the first imaging side device having the first display control unit is selected by the selection unit, the first display control unit of the first imaging side device causes the video data generated by the first imaging unit to be displayed on the display unit. The information processing system according to claim 7.

9. The first image capturing side receiving unit receives image synthesis data, the first display control unit combines the acquired image combining data with image data decoded from the encoded data distributed from the information processing device and displays the combined image on a display unit; The information processing system according to claim 1 .

10. a receiving unit that receives encoded data, which is video data encoded by each of the imaging side devices, from each of the imaging side devices; a decoding unit that decodes the encoded data received from each of the image capturing devices to restore the video data; a selection unit that selects one of the plurality of video data restored by the decoding unit; a distribution unit that distributes the encoded data corresponding to the video data selected by the selection unit and received by the reception unit to each of the imaging side devices; An information processing device having the above configuration.

11. The computer executes receiving encoded data from each of the plurality of image capturing devices, the encoded data being video data encoded by each of the image capturing devices; decoding the encoded data received from each of the plurality of image capturing devices to restore a plurality of video data; selecting one image data from the plurality of restored image data; a distribution unit that distributes the received encoded data, which is encoded data corresponding to the selected video data, to each of the image capturing devices; An information processing method comprising the steps of:

Images