Communication control device, communication control method, and program

Abstract

To provide a technique of communication control, capable of determining data to be preferentially transmitted in accordance with a situation.SOLUTION: A communication control device controls a communication with an external device such as a terminal 200 or a decorder 300 with a camera 100 via a network 150. The communication control device performs a communication including a transmission of first imaging data and a transmission of second imaging data that are obtained by photography of the camera with respect to the external device, determines whether or not a change of transmission control is required on the basis of a situation of a communication band of the network, and determines whether or not control to the camera is performed via the network from the external device. Then, the communication control device changes the transmission control of the first imaging data in the case where it is determined that the control to the camera is performed, and changes the transmission control of the second imaging data when it is determined that the control to the camera is not performed.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present disclosure relates to a technique for communicating imaging data performed via a network.

Background Art

[0002] Conventionally, in the distribution of streaming video via a network, a device that receives video captured by an imaging device often sends a control signal to the imaging device to remotely control the imaging device. The receiving device is, for example, a smartphone, a tablet device, a PC, or the like. When these devices are configured to receive the live view (LV) of the imaging device, in addition to the streaming video, the received LV can be displayed on a display. Then, the user can perform an operation on the device to remotely control the imaging device while viewing the displayed LV.

[0003] When performing real-time streaming distribution of video via a network, the use of the same network as the network used for the above remote control may limit the network bandwidth and cause video distortion or stoppage. A technique called Adaptive Bitrate (ABR) can suppress video distortion and continue video distribution without stopping for a long time by dynamically controlling the transfer rate according to the network situation. As one method for realizing ABR, for example, Secure Reliable Transport (SRT), which is one of the video transmission protocols, realizes high security, reliability, and connectivity by acquiring network statistical information.

[0004] Patent Document 1 discloses a video transmission system including a camera device and a server communicably connected via a network, which detects fluctuations in network bandwidth and changes the transmission bit rate of video data based on the detection result. Specifically, when the camera device is transmitting video data to the server and the server is transmitting firmware to the camera device, the camera device reduces the transmission bit rate to transmit the video data in order to prioritize the transmission of the firmware. Also, when the camera device is transmitting the first video data out of two pieces of video data to the server and is about to transmit the second video data, the camera device reduces the transmission bit rate of the first video data to preferentially transmit the second video data over the first video data.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, the system of Patent Document 1 merely communicates based on a fixed rule that data transmitted later is preferentially transmitted over data transmitted earlier. It is desirable that the data to be preferentially transmitted be determined according to the situation.

[0007] Therefore, the present disclosure provides a communication control technique capable of determining data to be preferentially transmitted according to the situation.

Means for Solving the Problems

[0008] A communication control device according to an aspect of the present disclosure controls communication between an imaging device and an external device via a network. The communication control device includes communication means for performing communication including transmission of first imaging data obtained by shooting of the imaging device and transmission of second imaging data to the external device, first determination means for determining whether it is necessary to change transmission control based on the status of the communication bandwidth of the network by the communication means, second determination means for determining whether control has been performed on the imaging device from the external device via the network, and control means for controlling the communication of the communication means based on the determination result of whether control has been performed on the imaging device when it is determined that it is necessary to change the transmission control. When it is determined that control has been performed on the imaging device, the control means changes the transmission control of the first imaging data, and when it is determined that control has not been performed on the imaging device, the control means changes the transmission control of the second imaging data.

Effect of the Invention

[0009] According to the present disclosure, it is possible to determine data to be preferentially transmitted according to the situation.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the drawings, those having the same configuration or function are denoted by the same reference numerals, and repeated descriptions thereof are omitted. The configurations shown in the following embodiments are merely examples, and the present disclosure is not limited to the illustrated configurations.

[0012] <Video distribution system> FIG. 1 is a diagram showing the configuration of a video distribution system according to an embodiment. The video distribution system includes a camera 100, a terminal 200, and a decoder 300. The terminal 200 and the decoder 300 are connected to the camera 100 via a network 150. The video distribution system is a system that distributes the streaming video captured by the camera 100 mainly to the decoder 300 via the network 150.

[0013] The network 150 may be composed of a public network (e.g., the Internet) or a LAN (e.g., an intranet), or may be composed of both of them.

[0014] As the camera 100, in addition to a still camera or a video camera mainly having a photographing function, a mobile phone with a camera (e.g., a smartphone) or a so-called tablet terminal can be used. The camera 100 is an example of an imaging device.

[0015] As the terminal 200 and the decoder 300, in addition to a general personal computer, a mobile phone such as a so-called smartphone, a so-called tablet terminal, or a television can be used. The terminal 200 and the decoder 300 are examples of external devices that can be connected to the camera 100 via the network 150. The external device is not limited to a form physically separated into two devices like the terminal 200 and the decoder 300, and may be composed of one device. In the following description, an example will be described in which the terminal 200 is a tablet terminal and the decoder 300 is a personal computer.

[0016] FIG. 2 is a block diagram showing the hardware configuration of the camera 100. As shown in FIG. 1, the camera 100 includes an internal bus 120, a CPU 101, a volatile memory 102, a non-volatile memory 103, a camera unit 104, a camera signal processing unit 105, a communication I / F 106, and a connector / antenna 107. The camera 100 also includes a recording medium I / F 108, a recording medium 109, an input I / F 110, an operation unit 111, an output I / F 112, a display 113, a microphone 114, and an audio signal processing unit 115. These components connected to the internal bus 120 are controlled by a program operating on the CPU 101 and are configured to be able to exchange data with each other via the internal bus 120.

[0017] The volatile memory 102 appropriately stores programs, variables, temporary working data, etc. required by the CPU 101 during operation. The non-volatile memory 103 stores various programs for the operation of the CPU 101. The non-volatile memory 103 may also include a flash memory or the like.

[0018] The CPU 101 controls each part of this camera 100 by using the volatile memory 102 as a work memory according to a program stored in the non-volatile memory 103 or the recording medium 109.

[0019] The camera unit 104 forms an optical image of the subject, converts the optical image into an analog electrical signal, and then converts it into a digital signal. The camera signal processing unit 105 compresses and encodes the digital signal converted by the camera unit 104 in a predetermined bit rate and a predetermined format based on the control of the CPU 101. The camera signal processing unit 105 also decodes the video compression-encoded data.

[0020] The communication I / F 106 communicates with the terminal 200 via the connector / antenna 107 under the control of the CPU 101. Also, the communication I / F 106 transmits (streaming transmission) the video signal for streaming generated by the camera unit 104 and the camera signal processing unit 105 to the decoder 300 via the connector / antenna 107. Hereinafter, the video signal for streaming is referred to as the streaming video. Note that the streaming video is basically video-audio data in which the video obtained by the processing of the camera signal processing unit 105 and the audio processed by the audio signal processing unit 115 via the microphone 114 are combined. However, the streaming video may be video data without synthesized audio.

[0021] The recording medium I / F 108 has a recording medium 109 such as an HDD or a non-volatile memory connected thereto, and reads data from the connected recording medium 109 and writes data to the recording medium 109 under the control of the CPU 101. Note that the recording medium 109 may be a detachable non-volatile memory such as a memory card attached to a socket (not shown).

[0022] The input I / F 110 receives a user operation at the operation unit 111, generates a control signal corresponding to the operation, and supplies it to the CPU 101. For example, the operation unit 111 includes, as an input device for receiving a user operation, a zoom operation lever, an input device for character information such as a keyboard, a pointing device such as a mouse, a touch panel, and / or a posture sensor for acquiring posture information. The operation unit 111 may also include a remotely controllable input device such as an infrared remote controller. Note that the touch panel is an input device configured to output coordinate information corresponding to a position where it is touched with respect to, for example, a flat input unit. Thereby, the user can cause the camera 100 to perform an operation corresponding to his / her operation.

[0023] The output I / F 112 outputs a display signal for causing the display 113 to display based on display data such as a GUI generated by the CPU 101 according to a program and a live view (LV) image composed of a digital signal obtained from the camera unit 104. The LV image is an image generated based on, for example, a video signal acquired by the camera unit 104 and / or the camera signal processing unit 105. The LV image is, for example, an image in JPEG format, but is not limited thereto, and may be in other formats such as PNG or GIF. The output I / F 112 outputs this LV image to the display 113 at a predetermined frame rate to display the subject image almost in real time.

[0024] When a touch panel is used as the operation unit 111, the operation unit 111 and the display 113 can be integrally configured. For example, the touch panel is configured so that the light transmittance does not interfere with the display of the display 113 and is attached to the upper layer of the display surface of the display 113. Then, the input coordinates on the touch panel and the display coordinates on the display 113 are associated with each other. Thereby, a GUI can be configured as if the user can directly operate the screen displayed on the display 113.

[0025] The microphone 114 converts the vibration of sound into an electrical signal. The audio signal processing unit 115 digitizes the electrical signal converted by the microphone 114 and performs various correction processes and the like.

[0026] In the camera 100, mainly, the CPU 101, the communication I / F 106, and the program for the CPU 101 to perform predetermined processing are an example of a communication control device that controls communication between the camera 100 and an external device (the terminal 200 or the decoder 300) via a network. The predetermined processing is mainly the processing shown in FIG. 4 described later.

[0027] FIG. 3 is a block diagram showing the hardware configurations of the terminal 200 and the decoder 300. The terminal 200 includes a CPU 201, a volatile memory 202, a non-volatile memory 203, a communication I / F 204, a connector / antenna 205, a recording medium I / F 206, and a recording medium 207. The terminal 200 also includes an input I / F 208, an operation unit 209, an output I / F 210, a display 211, an audio signal processing unit 212, and a speaker 213. Since the configurations other than the speaker 213 are the same as those of the camera 100 in FIG. 1, their descriptions are omitted. The speaker 213 converts the digitized electrical signal into sound vibrations.

[0028] Note that not only the CPUs 101 and 201, but also a PLD (Programmable Logic Device) such as an FPGA (Field Programmable Gate Array) may be used. Alternatively, an ASIC (Application Specific Integrated Circuit) may be used, or a DSP (Digital Signal Processor) may be used.

[0029] <Basic Operations of the Video Distribution System> The outline of the basic operations of the video distribution system described above will be explained. When the user performs a predetermined operation on the camera 100 via the operation unit 111, the camera 100 sets the communication I / F 106 to a communicable state under the control of the CPU 101.

[0030] Furthermore, the user operates the operation unit 209 on the terminal 200 to start programs such as applications and browsers necessary for communication connection processing and remote control. Remote control is the control performed on the camera 100 from the terminal 200 via the network 150. When the above program is started, the CPU 201 of the terminal 200 controls the communication I / F 204 according to the program stored in the non-volatile memory 203 or the recording medium 207, starts communication with the camera 100, and performs connection processing. When the connection processing between the camera 100 and the terminal 200 is completed, the camera 100 and the terminal 200 start processing necessary for remote control.

[0031] Similar to the terminal 200, the user operates the operation unit 209 in the decoder 300 to start programs such as applications and browsers necessary for communication connection processing and remote control. Then, the CPU 201 of the decoder 300 controls the communication I / F 204 according to the program stored in the non-volatile memory 203 or the recording medium 207, starts communication with the camera 100, and performs connection processing.

[0032] The CPU 101, the communication I / F 106, and the program (here, the program for the camera 100 to perform communication) are an example of communication means for the camera 100 to communicate with the terminal 200 or the decoder 300.

[0033] When the connection process between the camera 100 and the decoder 300 is completed, the camera 100 and the decoder 300 respectively start the processes necessary for streaming transmission and its reception.

[0034] Here, in the video distribution system shown in FIG. 1, an example will be described in which the camera 100 transmits the LV image 121 and the streaming video 125 to the decoder 300 and the terminal 200 respectively. Specifically, the camera 100 transmits the LV image 121 stored in the volatile memory 102 to the terminal 200 under the control of the CPU 101, and at the same time, transmits the streaming video 125 to the decoder 300 using, for example, the video transmission protocol SRT. The streaming video is an example of the first imaging data obtained by shooting with the camera 100. The LV image is an example of the second imaging data different from the first imaging data.

[0035] The basic transmission rate (transfer rate) of the streaming video from the camera 100 to the decoder 300 is set higher than the transmission rate (transfer rate) of the LV image 121 from the camera 100 to the terminal 200. However, it is not limited to such a setting, and they may be the same, or the transfer rate of the LV image 121 may be set higher. Note that the above "basic transmission rate" is the transmission rate based on the normal setting (the setting when there is no bandwidth limitation) described in step S401 of FIG. 4 later.

[0036] The CPU 101 performs control according to the network situation by using the network information obtained by the communication I / F 106. Under the control of the CPU 201, the terminal 200 displays the LV image 121 received from the camera 100 in the image display area 122 within the touch panel display configured as, for example, the operation unit 209 and the display 211.

[0037] The icon group 123 arranged in the operation unit 209 is a plurality of icons for performing remote control. The icon group 123 includes, for example, a start / stop button for recording, buttons related to various settings of the captured image and its image quality, etc. The on / off switch button 124 is an icon for turning on / off the display of the LV image 121. When the user operates these icon groups 123 and the on / off switch button 124, the CPU 201 of the terminal 200 generates a control signal corresponding to the operation and transmits the control signal to the camera 100 via the network 150. The camera 100 receives this control signal by the communication I / F 106. In this way, the terminal 200 performs remote control on the camera 100.

[0038] The CPU 201 of the terminal 200 normally displays the LV image 121. However, depending on the processing ability and communication load state of the terminal 200, when the user operates the on / off switch button 124, the CPU 201 can turn off the display of the LV image 121, giving priority to operability. That is, when the LV image 121 is not displayed in the image display area 122, the area of the operation area of the icon group 123 is expanded by the area of that area 122, or icons for other remote operations are further displayed.

[0039] The display state of the LV image 121 displayed on the display 211 of the terminal 200 does not have to be the same as the display state of the LV image 121 displayed on the display 113 of the camera 100. Also, the camera 100 can stop transmitting the LV image 121 under the control of the CPU 101.

[0040] Basically, by a single operation by the user on one of the icons in the icon group 123 or the on / off switch button 124, the CPU 201 generates a control signal corresponding to the operation and transmits it to the camera 100. A single operation means, for example, when the operation unit 209 is a touch panel, a tap (touch), double tap, swipe, etc. For example, when the operation unit 209 is a physical operation key or the like, a single operation means pressing the operation key once, or the operation of releasing it after it has been pressed.

[0041] The decoder 300 displays the streaming video 125 received from the camera 100 in the image display area 126 of the display 211 in FIG. 3 under the control of the CPU 201.

[0042] <Communication control process of the camera> FIG. 4 is a flowchart showing the process of communication control mainly by the camera 100 in the video distribution system. This process operates based on a program stored in the non-volatile memory 103 or the recording medium 109 by the CPU 101, and is realized by controlling each part of the camera 100. Hereinafter, this process will be described with the CPU 101 as the operating entity.

[0043] In step S401, when the connection process between the camera 100 and the terminal 200 and the connection process between the camera 100 and the decoder 300 are completed, the CPU 101 operates the functions of the camera 100 with normal settings (normal communication settings). Normal settings mean communication settings when there is no bandwidth limitation (step S402) in the communication band on the network 150. Specifically, normal settings are the settings when the camera 100 is powered on, default settings, or user settings.

[0044] When the camera 100 starts operating, the CPU 101 transmits, for example, the LV image 121 (Fig. 1) captured by the camera unit 104 to the terminal 200 and transmits the streaming video to the decoder 300. Taking the use of SRT as an example of the communication protocol when transmitting the streaming video, an explanation will be given. Note that depending on the above-described settings at the time of power-on of the camera 100 and user settings in step S401, the LV image may not be transmitted.

[0045] In step S402, the CPU 101 determines whether it is necessary to change the transmission control by determining whether the communication bandwidth of the network 150 is being compressed (the status of the communication bandwidth). If the communication bandwidth is being compressed, it is determined that a change in transmission control is necessary. As the determination of whether the communication bandwidth is being compressed, for example, the CPU 101 determines whether a bandwidth limit has occurred based on the statistical information obtained by SRT at the communication I / F 106. In this case, mainly the CPU 101 and the program that performs the determination process in step S402 are an example of the first determination means.

[0046] For the determination process of whether a bandwidth limit has occurred, various known methods can be used. For example, the CPU 101 may estimate the available communication bandwidth of the network 150 (obtain the estimated available bandwidth) and detect the occurrence of a bandwidth limit based on the comparison between the current communication bandwidth and the estimated available bandwidth. The estimated available bandwidth is the maximum capacity of data that can be transmitted per unit time.

[0047] If a bandwidth limit has occurred, in step S403, the CPU 101 determines whether the user has controlled the camera 100 from the terminal 200 within a certain period. That is, the CPU 101 determines whether it has received a control signal corresponding to a user operation from the terminal 200 a predetermined number of times or more within a certain period. The certain period may be a fixed value such as 5 minutes, but may also be changeable according to the user's settings, or may be a value calculated based on other conditions. The predetermined number of times may be once or multiple times. On the other hand, if no bandwidth limitation has occurred, the CPU 101 proceeds to step S401.

[0048] As described above, the program mainly performing the determination process of the CPU 101 and step S403 is an example of the second determination means. Also, the program mainly performing the determination process of the CPU 101 and step S403 is an example of the control means for controlling the communication with the terminal 200 or the decoder 300 when it is determined in step S402 that a bandwidth limitation has occurred (a change in transmission control is necessary).

[0049] If it is determined in step S403 that the control of the camera 100 has not been performed for a certain period (in the case of a No determination), in step S404, the CPU 101 checks whether the LV image is currently being transmitted from the camera 100 to the terminal 200. If it is determined Yes in step S404, in step S405, the CPU 101 stops the transmission of the LV image from the camera 100 to the terminal 200. Alternatively, the CPU 101 may change the size of the LV image (for example, make it smaller) and then transmit it. Thereby, the communication bandwidth used is reduced. Both stopping the transmission of the LV image and changing the size of the LV image and then transmitting it are examples of changing the transmission control of the LV image.

[0050] Thus, when a No determination is made in step S403, the CPU 101 can maintain the transfer rate of the streaming video even when a bandwidth limitation has occurred by stopping the transmission of the LV image or making its size smaller and then transmitting it.

[0051] On the other hand, if the determination in step S404 is No, that is, if a bandwidth restriction occurs even though the LV image has not been transmitted, in step S406, the CPU 101 changes the transfer rate of the streaming video to be transmitted to the decoder 300. In this way, when a bandwidth restriction occurs, if the CPU 101 cannot reduce the use of the bandwidth by stopping (or not transmitting) the LV image to the terminal 200, it copes with the bandwidth restriction by changing the transfer rate of the current streaming video.

[0052] In step S406, the CPU 101, for example, reduces the transfer rate to the lowest value that can be set. The lowest value that can be set varies depending on the performance and specifications of the camera 100. However, even when a bandwidth restriction occurs, if the transfer rate of the current streaming video is below the estimated available bandwidth, the CPU 101 determines that the transfer rate has a margin with respect to the bandwidth and may increase the transfer rate. As a method for determining the value for increasing the transfer rate, for example, a method of gradually increasing it while considering the possibility that the bandwidth will be restricted again may be used, or other methods may be used.

[0053] If it is determined in step S403 that the control of the camera 100 has not been performed for a certain period (Yes determination), in step S407, the CPU 101 determines whether the control signal received from the terminal 200 is an instruction to transmit the LV image. If it is an instruction to transmit the LV image (Yes determination), in step S408, the CPU 101 transmits the LV image from the camera 100 to the terminal 200. Then, the process of step S406 is executed. In this way, even when a bandwidth restriction occurs, if the user intentionally gives an instruction to transmit the LV image by touching the on / off switch 124 or the like, the transmission of the LV image 121 is given priority over the streaming transmission. If it is not an instruction to transmit the LV image 121 in step S407 (No determination), the process proceeds to step S406.

[0054] In step S409, the connection process between the camera 100, the terminal 200, and the decoder 300 is completed, and the CPU 101 determines whether the streaming function of the camera 100 is continuing. When the operation of the streaming function ends, the process ends; when it does not end, the process returns to step S402. Thereafter, when the bandwidth restriction is lifted (No in step S402), the CPU 101 returns to step S401, restores the settings to the original normal settings, and operates the functions of the camera 100. That is, when the bandwidth restriction is lifted, the CPU 101 communicates with the camera 100 using the settings at the time when the camera 100 started communicating with the terminal 200 and the decoder 300.

[0055] As described above, in this embodiment, when a bandwidth restriction occurs, the transmission of the streaming video and the LV image 121 is controlled based on the determination result of whether or not the camera 100 is being controlled. That is, it is possible to determine the imaging data to be preferentially transmitted according to the situation. For example, when the camera 100 is transmitting both the streaming video and the LV image 121 at the same time, if no control is performed on the camera 100 within a certain period, the transmission of the streaming video can be prioritized over the LV image 121. This makes it possible to cope with the occurrence of a bandwidth restriction without reducing the transfer rate of the streaming video that the user wants to prioritize. On the other hand, if control is performed on the camera 100 within a certain period, the camera 100 reduces the transfer rate of the streaming video and maintains the previous transmission state of the LV image 121. This makes it possible to maintain the functions of the terminal 200 that the user wants to prioritize (especially the reception and display of the LV image 121).

[0056] <Other Embodiments> In the process of FIG. 4, the transmission confirmation of the LV image was performed in step S404, and the confirmation of the transmission instruction of the LV image was performed in step S407. However, in the normal setting of step S401, if the LV image 121 is set to be transmitted, for example, as in the flowchart shown in FIG. 5, steps S404, S407, and S408 in FIG. 4 may be unnecessary. In this case, in the determination of step S403, if the camera 100 is not controlled, the process by the CPU 101 may proceed to step S405, and if the camera 100 is controlled, it may proceed to step S406.

[0057] In the above embodiment, SRT is used as the video transmission protocol, but other protocols may also be used.

[0058] In the above embodiment, in step S406 of FIGS. 4 and 5, the transfer rate of the streaming video was set to the lowest value that can be set. However, the transfer rate may be gradually decreased according to the estimated available bandwidth.

[0059] In the above embodiment, an example in which the streaming video and the LV image are transmitted from the camera 100 was shown. However, instead of the streaming video and / or the LV image, for example, one or more other imaging data that were captured by the camera 100 in the past and recorded on the recording medium 207 may be used.

[0060] As described above, the present disclosure has been described in detail based on its preferred embodiments. However, the present disclosure is not limited to these specific embodiments, and various forms within the scope not departing from the gist of the present invention are also included in the present disclosure. Some of the above-described embodiments may be appropriately combined. In addition, supplying a software program that realizes the functions of the above-described embodiments directly from a recording medium or to a system or device having a computer capable of executing the program using wired / wireless communication and executing the program is also included in the present disclosure. Therefore, in order to implement the functional processing of the present disclosure on a computer, the program code itself supplied to and installed on the computer also implements the present disclosure. That is, the computer program itself for implementing the functional processing of the present disclosure is also included in the present disclosure. In that case, as long as the program has the required functions, the form of the program is not limited, such as object code, a program executed by an interpreter, or script data supplied to the OS. As a recording medium for supplying the program, for example, a magnetic recording medium such as a hard disk or magnetic tape, an optical / photo-magnetic storage medium, or a non-volatile semiconductor memory may be used. Also, as a method for supplying the program, a method may be considered in which a computer program forming the present disclosure is stored in a server on a computer network, and a connected client computer downloads and programs the computer program.

[0061] The disclosure of this embodiment includes the following configurations, methods, and programs. (Configuration 1) A communication control device that controls communication between an imaging device and an external device via a network, communication means for performing communication including transmission of first imaging data obtained by photographing of the imaging device and transmission of second imaging data to the external device; first determination means for determining whether it is necessary to change transmission control based on the status of the communication bandwidth of the network by the communication means; second determination means for determining whether control has been performed from the external device to the imaging device via the network; control means for controlling the communication of the communication means based on the determination result of whether control has been performed on the imaging device when it is determined that the change of the transmission control is necessary; When it is determined that control has been performed on the imaging device, the control means changes the transmission control of the first imaging data, and when it is determined that control has not been performed on the imaging device, the control means changes the transmission control of the second imaging data A communication control device characterized by the following. (Configuration 2) As a change in the transmission control of the first imaging data, the control means changes the transfer rate of the first imaging data. The communication control device according to Configuration 1, characterized by the above. (Configuration 3) As a change in the transmission control of the second imaging data, the control means stops the transmission of the second imaging data or changes the size of the second imaging data and transmits it. The communication control device according to Configuration 1, characterized by the above. (Configuration 4) The second determination means determines that the imaging device has been controlled when a control signal from the imaging device is received by the communication means. The communication control device according to Configuration 1, characterized by the above. (Configuration 5) The second determination means determines that the imaging device has been controlled by receiving the control signal corresponding to the user operation to the external device a predetermined number of times or more within a certain period. The communication control device according to Configuration 4, characterized by the above. (Configuration 6) The control signal includes an instruction to transmit the second imaging data. The communication control device according to Configuration 4, characterized by the above. (Configuration 7) When it is determined that the imaging device is not being controlled and the second imaging data has not been transmitted to the external device, the control means changes the transmission control of the first imaging data. The communication control device according to Configuration 1, characterized by the above. (Configuration 8) The first determination means acquires the estimated available bandwidth of the network by the communication means and determines whether a bandwidth restriction has occurred in the communication bandwidth based on the acquired estimated available bandwidth. The communication control device according to Configuration 1, characterized by the above. (Configuration 9) After it is determined that the bandwidth limitation has occurred, when the bandwidth limitation is resolved, communication is performed with the settings at the time when communication with the external device was started. The communication control device according to Configuration 1, characterized by the above. (Configuration 10) The first imaging data is streaming video, The second imaging data is a live view image generated from the first imaging data The communication control device according to Configuration 1, characterized by the above. (Method) A communication control method for controlling communication between an imaging device and an external device via a network, A communication step of performing communication including transmission of first imaging data obtained by photographing with the imaging device and transmission of second imaging data to the external device; A first determination step of determining whether it is necessary to change transmission control based on the status of the communication bandwidth of the network in the communication step; A second determination step of determining whether control has been performed from the external device to the imaging device via the network; When it is determined that it is necessary to change the transmission control, a control step of controlling the communication in the communication step based on the determination result of whether control has been performed on the imaging device; In the control step, when it is determined that control has been performed on the imaging device, the transmission control of the first imaging data is changed, and when it is determined that control has not been performed on the imaging device, the transmission control of the second imaging data is changed The communication control method characterized by the above. (Program) A program for operating a computer as the communication control device according to any one of Configurations 1 to 10.

Description of Signs

[0062] 100: Camera 106: Communication I / F 121: LV Image 125: Streaming Video 150: Network 200: Terminal 209: Operation unit 300: Decoder

Claims

1. A communication control device for controlling communication between an imaging device and an external device via a network, comprising: communication means for performing communication including transmission of first imaging data obtained by shooting with the imaging device and transmission of second imaging data to the external device; first determination means for determining whether it is necessary to change transmission control based on the status of the communication bandwidth of the network by the communication means; second determination means for determining whether control has been performed on the imaging device from the external device via the network; control means for controlling the communication of the communication means based on a determination result as to whether control has been performed on the imaging device when it is determined that it is necessary to change the transmission control; and when it is determined that control has been performed on the imaging device, the control means changes the transmission control of the first imaging data, and when it is determined that control has not been performed on the imaging device, the control means changes the transmission control of the second imaging data A communication control device characterized by the above.

2. The control means changes the transfer rate of the first imaging data as a change in the transmission control of the first imaging data. The communication control device according to claim 1, characterized by the above.

3. The control means stops the transmission of the second imaging data or changes the size of the second imaging data and transmits it as a change in the transmission control of the second imaging data. The communication control device according to claim 1, characterized by the above.

4. The second determination means determines that control has been performed on the imaging device when a control signal from the imaging device is received by the communication means. The communication control device according to claim 1, characterized by the above.

5. The second determination means determines that control has been performed on the imaging device by receiving the control signal corresponding to a user operation to the external device a predetermined number of times or more within a certain period. The communication control device according to claim 4, characterized by the above.

6. The control signal includes an instruction to transmit the second imaging data. The communication control device according to claim 4, characterized by the above.

7. When it is determined that control has not been performed on the imaging device and the second imaging data has not been transmitted to the external device, the control means changes the transmission control of the first imaging data. The communication control device according to claim 1, characterized by the above.

8. The first determination means acquires an estimated available bandwidth of the network by the communication means, and determines whether or not a bandwidth restriction has occurred in the communication bandwidth based on the acquired estimated available bandwidth. The communication control device according to claim 1, characterized in that.

9. After it is determined that the bandwidth restriction has occurred, when the bandwidth restriction is eliminated, the communication means performs communication with the external device in the settings at the time of starting the communication. The communication control device according to claim 1, characterized in that.

10. The first imaging data is streaming video, The second imaging data is a live view image generated from the first imaging data. The communication control device according to claim 1, characterized in that.

11. A communication control method for controlling communication between an imaging device and an external device via a network, comprising: A communication step of performing communication including transmission of first imaging data obtained by photographing of the imaging device and transmission of second imaging data to the external device; A first determination step of determining whether or not it is necessary to change transmission control based on the status of the communication bandwidth of the network in the communication step; A second determination step of determining whether or not control has been performed from the external device to the imaging device via the network; When it is determined that it is necessary to change the transmission control, a control step of controlling the communication in the communication step based on the determination result of whether or not control has been performed on the imaging device. In the control step, when it is determined that control has been performed on the imaging device, the transmission control of the first imaging data is changed, and when it is determined that control has not been performed on the imaging device, the transmission control of the second imaging data is changed. A communication control method characterized by the above.

12. A program for operating a computer as the communication control device according to any one of claims 1 to 10.

Images