Control system, imaging apparatus, method for controlling the same, and program

Abstract

To provide a control system capable of suppressing degradation of operability even while reducing a communication amount, when controlling a plurality of imaging apparatuses by a control device.SOLUTION: The control system controls the plurality of imaging apparatuses by the control device. The control device includes: a display control part which can control a display part so as to respectively display live-view videos transmitted from the plurality of imaging apparatuses in a plurality of display areas respectively corresponding to the plurality of imaging apparatuses on the display part and can change a display method for each of the plurality of display areas; and a first communication part which requests the live-view videos to the imaging apparatuses. The imaging apparatus includes: an imaging part which generates the live-view videos with different image quality, in response to a transmission request of the live-view videos from the control device; and a second communication part which transmits the live-view videos generated by the imaging part to the control device.SELECTED DRAWING: Figure 6B

Description

[Technical field]

[0001] The present invention relates to a control system for controlling a plurality of cameras to perform imaging. [Background technology]

[0002] 2. Description of the Related Art In recent years, at sporting events such as the Olympic Games, photographers have been taking pictures of a wide variety of competitive scenes, and many of these pictures have been distributed in news media.

[0003] In these types of competitions, multiple digital cameras are installed at various angles, and systems are being used that allow these cameras to be remotely controlled by a portable control device. In such systems, a small number of photographers can operate a control device, typically a tablet or laptop computer, connected to the cameras via a network, and control multiple digital cameras at once.

[0004] As software capable of remotely controlling the shooting of multiple digital cameras, existing technologies such as "NX Field" by Nikon Corporation and "Remote Camera Tool" by Sony Corporation are sometimes used. Non-Patent Documents 1 and 2 disclose how to use these software.

[0005] Multiple news agencies and other media are participating in the network at the competition venue, and it is necessary to allocate a communication environment to each media. Therefore, the network allocated to each media may be limited. Furthermore, the digital cameras and control devices to which these multiple media are connected are constantly communicating, such as sending live view images, sending release instructions for shooting, and sending instructions for transferring images. Therefore, the large amount of data communication causes communication bandwidth congestion and increases the processing load of the control devices.

[0006] For this reason, in an environment in which such a remote photographing system is used, it is desirable to avoid unnecessary communication as much as possible when transferring live view video or images.

[0007] Patent Document 1 discloses a technique for transmitting an image of appropriate image quality from a photographing camera to a control device in accordance with the processing capacity of the control device. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] JP 2014-176016 A [Non-patent literature]

[0009] [Non-Patent Document 1] Nikon "NX Field System User Manual", [online], [searched on August 15, 2023], Internet<URL:https: / / nps.nikonimaging.com / technical_info / nx_field / pdf / NXFieldUM_Jp_ver.1.3.pdf> [Non-Patent Document 2] Sony "How to use Remote Camera Tool", [online], [Searched on August 15, 2023], Internet<URL:https: / / support.d-imaging.sony.co.jp / app / remotecameratool / ja / instruction / 1_connection.php> Summary of the Invention [Problem to be solved by the invention]

[0010] In competitions such as the Olympics, multiple types of events are held in one stadium, so it is necessary to shoot each event in various compositions. For example, in a situation where track and field events are held simultaneously in a stadium, remote shooting is performed while displaying live view images from multiple digital cameras side by side on a control device. In this case, if all live view images are displayed at high resolution and high frame rate, the communication bandwidth is strained and the processing load of the control device increases. On the other hand, if all live view images are displayed at low resolution and low frame rate, operability will be reduced, such as delayed reaction to changes in the situation, and there is a risk of missing the decisive moment of shooting.

[0011] As described above, there is a trade-off between the image quality of the live view image and operability, so it is necessary to select and display the optimal image quality depending on the shooting conditions and the operating conditions of the control device.

[0012] However, with existing technologies such as the above-mentioned "NX Field" and "Remote Camera Tool," while it is possible to set in advance the resolution and frame rate of the live view image transmitted from the digital camera, it is not possible to change the image quality settings of the live view image in response to changes in the situation.

[0013] In addition, the technology described in Patent Document 1 makes it possible to change the image quality settings for multiple images collectively depending on the processing power of the control device, but it is not possible to change the image quality of the live view image for each individual image.

[0014] The present invention has been made in consideration of the above-mentioned problems, and its object is to provide a control system that can reduce communication volume while suppressing deterioration in operability when multiple imaging devices are controlled by a control device. [Means for solving the problem]

[0015] The control system of the present invention is a control system that controls a plurality of imaging devices using a control device, wherein the control device is capable of controlling the display means to display live view images transmitted from the plurality of imaging devices in a plurality of display areas in a display means corresponding to each of the plurality of imaging devices, and is characterized in that the control device is equipped with a display control means that is capable of changing the display method for each of the plurality of display areas, a first communication means that requests the live view images from the imaging devices, and the imaging devices are equipped with an imaging means that generates live view images of different image quality in response to a request from the control device to transmit the live view images, and a second communication means that transmits the live view images generated by the imaging means to the control device. Effect of the Invention

[0016] According to the present invention, when a plurality of imaging devices are controlled by a control device, it is possible to suppress a decrease in operability while reducing the amount of communication. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is a hardware configuration diagram showing the configuration of a digital camera. [Diagram 2] FIG. 2 is a hardware configuration diagram showing the configuration of a control device. [Diagram 3] FIG. 1 is a diagram showing the configuration of a camera control system. [Figure 4] FIG. 1 is a diagram showing the relationship between multiple digital cameras and control devices at a competition venue. [Figure 5A] FIG. 13 is a diagram showing a state in which live view images from a plurality of digital cameras are displayed on a control device. [Figure 5B] FIG. 13 is a diagram showing a state in which live view images from a plurality of digital cameras are displayed on a control device. [Figure 5C] FIG. 4 is a diagram showing a configuration example of an individual camera control member. [Figure 5D] FIG. 4 is a diagram showing a configuration example of an individual camera control member. [Figure 5E] FIG. 4 is a diagram showing a configuration example of an individual camera control member. [Figure 5F]FIG. 13 is a diagram showing an individual camera registration setting screen. [Figure 6A] 5 is a flowchart showing the operation of the control device in the first embodiment. [Figure 6B] 5 is a flowchart showing the operation of the control device in the first embodiment. [Figure 7] 5 is a flowchart showing the operation of the digital camera according to the first embodiment. [Figure 8] 11 is a diagram showing a state in which live view images from a plurality of digital cameras are displayed side by side on a multi-remote shooting screen. [Figure 9] 10 is a flowchart showing the operation of a digital camera according to a second embodiment. [Figure 10] FIG. 13 is a diagram showing the configuration of a camera control system according to a third embodiment. [Figure 11A] FIG. 13 is a diagram showing a state in which multiple remote photography is being performed for the same event using different control devices. [Figure 11B] FIG. 13 is a diagram showing a state in which multiple remote photography is being performed for the same event using different control devices. [Figure 12] 10 is a flowchart showing the operation of a digital camera according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0019] (First embodiment) <Configuration of Digital Camera 100> 1(a) is a hardware configuration diagram showing an example of the configuration of a digital camera (imaging device) 100 in a camera control system according to a first embodiment of the present invention. Note that, although a case where a smartphone is used as an example of a control device constituting the camera control system will be described here, the control device is not limited to this. For example, the control device may be an information processing device such as a portable media player, a so-called tablet device, or a personal computer.

[0020] In camera 100, control unit 101 controls each unit of digital camera 100 in accordance with input signals and programs described below. Note that instead of control unit 101 controlling the entire device, the entire device may be controlled by multiple pieces of hardware sharing the processing.

[0021] The imaging unit 102 is composed of, for example, an optical lens unit, a photographing optical system that controls the aperture, zoom, focus, etc., and an imaging element for converting an optical image formed through the optical lens unit into an electrical image signal. As the imaging element, a CMOS sensor (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is generally used.

[0022] Under the control of the control unit 101, the imaging unit 102 converts subject light formed by a lens included in the imaging unit 102 into an electrical signal using an imaging element, performs noise reduction processing, and outputs digital image data. In the digital camera 100 of this embodiment, the image data is recorded on the recording medium 110 in accordance with the DCF (Design Rule for Camera File System) standard.

[0023] The non-volatile memory 103 is an electrically erasable and recordable non-volatile memory, and stores programs, etc., which are described below, executed by the control unit 101. The working memory 104 is used as a buffer memory for temporarily storing image data captured by the imaging unit 102, an image display memory for the display unit 106, a working area for the control unit 101, etc.

[0024] The operation unit 105 is used to accept instructions from the user to the digital camera 100. The operation unit 105 includes, for example, a power button for the user to instruct to power on / off the digital camera 100, a release switch to instruct to shoot, and a playback button to instruct to play back image data. It also includes operation members such as a dedicated connection button for starting communication with an external device via a communication unit 111 described later. The operation unit 105 also includes a touch panel 105d arranged on a display unit 106 described later.

[0025] The release switch has a switch SW1 and a switch SW2. When the release switch is pressed halfway, switch SW1 turns ON. This causes preparations for shooting, such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing, to be performed. When the release switch is pressed all the way, switch SW2 turns ON. This causes shooting to be performed.

[0026] The display unit 106 displays a viewfinder image during shooting, displays captured image data, displays characters for interactive operations, etc. Note that the display unit 106 does not necessarily have to be built into the digital camera 100. The digital camera 100 can be connected to an internal or external display unit 106, and it is sufficient that the digital camera 100 has at least a display control function for controlling the display of the display unit 106.

[0027] The RTC 107 performs time management. It manages the time based on the time setting input by the user via the operation unit 105, the time information acquired via the communication unit 111, or the time information captured by a radio clock. It is sufficient if the time can be managed regardless of the time input method.

[0028] The recording medium 110 records the image data output from the imaging unit 102. The recording medium 110 may be configured to be detachable from the digital camera 100, or may be built into the digital camera 100. In other words, it is sufficient that the digital camera 100 has at least a means for accessing the recording medium 110.

[0029] The communication unit 111 is an interface for connecting to an external device. The digital camera 100 of this embodiment can exchange data with the external device via the communication unit 111. For example, image data generated by the imaging unit 102 can be transmitted to the external device via the communication unit 111. In this embodiment, the communication unit 111 includes an interface for communicating with the external device via a so-called wireless LAN in accordance with the IEEE802.11 standard. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 111. The communication method is not limited to wireless LAN, and also includes, for example, an infrared communication method.

[0030] The communication unit 112 is an interface for connecting to an external device. The digital camera 100 of this embodiment can exchange data with the external device via the communication unit 112. For example, image data generated by the imaging unit 102 can be transmitted to the external device via the communication unit 112. Note that in this embodiment, the communication unit 112 includes an interface for communicating with the external device via so-called Bluetooth (registered trademark) in accordance with the IEEE802.15.1 standard. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 112. Note that the communication method is not limited to Bluetooth, and can also include, for example, a wireless LAN known as the IEEE802.11 standard or an infrared communication method.

[0031] The communication unit 113 is an interface for connecting to an external device. The digital camera 100 of this embodiment can exchange data with the external device via the communication unit 113. For example, image data generated by the imaging unit 102 can be transmitted to the external device via the communication unit 113. Note that in this embodiment, the communication unit 113 includes an interface for communicating with the external device via a wired LAN (Ethernet) in accordance with the IEEE802.3 standard. The control unit 101 realizes communication with the external device by controlling the communication unit 113. Note that the communication method is not limited to a wired LAN, and also includes, for example, a USB communication method.

[0032] The communication unit 112 of the digital camera 100 in this embodiment has a peripheral mode and a central mode as operation modes. By operating the communication unit 112 in the peripheral mode, the digital camera 100 in this embodiment can operate as a client device in Bluetooth. When the digital camera 100 operates as a client device, it can communicate by connecting to an external device in central mode. For authentication of the external device to be connected, pairing is performed in advance, and unique information of the external device to be connected is stored in the non-volatile memory 103. Even if the power switch of the digital camera 100 is OFF, the digital camera 100 can make a call if power is supplied to the Bluetooth module.

[0033] The near-field communication unit 114 is composed of, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, a communication controller, etc. The near-field communication unit 114 outputs a modulated wireless signal from the antenna and demodulates a wireless signal received by the antenna to realize non-contact near-field communication in accordance with the ISO / IEC 18092 standard (so-called NFC: Near Field Communication). The near-field communication unit 114 of this embodiment is disposed on the side of the digital camera 100.

[0034] The digital camera 100 starts communication and is connected to the control device 200 described later by bringing the close proximity wireless communication units 114 and 214 into close proximity to each other. When connecting to the control device 200 using the close proximity wireless communication unit 114, it is not necessary to bring the close proximity wireless communication units 114 and 214 into contact with each other. Since the close proximity wireless communication units 114 and 214 can communicate with each other even if they are apart by a certain distance, in order to connect the devices to each other, it is sufficient to bring them into close proximity to a range where close proximity wireless communication is possible. In the following description, bringing them into close proximity to a range where close proximity wireless communication is possible is also referred to as bringing them into close proximity.

[0035] Next, the appearance of the digital camera 100 will be described. FIG. 1(b) and FIG. 1(c) are diagrams showing an example of the appearance of the digital camera 100. The release switch 105a, the playback button 105b, the directional keys 105c, and the touch panel 105d are operation members included in the operation unit 105 described above. The display unit 106 displays an image obtained as a result of imaging by the imaging unit 102. The digital camera 100 of this embodiment also has an antenna portion of the power supply unit 116 on the side of the camera housing. Power can be supplied by bringing these power supply units 116 close to each other at a certain distance. This allows power to be supplied contactlessly without using a cable or the like, and allows the start and end of power supply to be controlled.

[0036] In the following description, the digital camera 100 may be described as being the subject of processing, but in reality, the control unit 101 of the digital camera 100 reads programs stored in the non-volatile memory 103 and realizes various processes.

[0037] The above is a description of the digital camera 100.

[0038] <Configuration of control device 200> 2 is a hardware configuration diagram showing an example of the configuration of the control device 200 of this embodiment. Note that, although a case where the control device 200 is used as an example of a control device constituting a camera control system will be described here, the control device is not limited to this. For example, the control device may be a digital camera with a wireless function, a tablet device, a personal computer, or the like.

[0039] In the control device 200, the control unit 201 controls each unit of the control device 200 in accordance with input signals and a program described later. Note that instead of the control unit 201 controlling the entire device, the entire device may be controlled by multiple hardware devices sharing the processing.

[0040] The non-volatile memory 203 is an electrically erasable and recordable non-volatile memory. In the non-volatile memory 203, an OS (operating system) which is basic software executed by the control unit 201 and applications which cooperate with the OS to realize applied functions are recorded. In this embodiment, the non-volatile memory 203 also stores an application (hereinafter, an app) for communicating with the digital camera 100.

[0041] The work memory 204 is used as an image display memory for the display unit 206, a work area for the control unit 201, and the like.

[0042] The operation unit 205 is used to receive instructions from a user for the control device 200. The operation unit 205 includes operation members such as a power button for the user to instruct the control device 200 to be powered on / off, an operation member for setting the RTC 207, and a touch panel 206d disposed on the display unit 206.

[0043] The display unit 206 displays image data, characters for interactive operations, etc. The display unit 206 does not necessarily have to be included in the control device 200. The control device 200 only needs to be able to connect to the display unit 206 and have at least a display control function for controlling the display of the display unit 206.

[0044] The RTC 207 performs clock management. It manages the time based on the time setting input by the user via the operation unit 205, time information acquired via the communication unit 212 or the public network connection unit 213, or time information captured by a radio-controlled clock. It is sufficient if it can manage the time regardless of the time input method. It may also be possible to obtain the time from a mechanical mechanism such as an analog clock by a detection mechanism. In this case, the RTC 207 is considered to include a detection mechanism from the analog clock.

[0045] The recording medium 210 can record image data transferred from the digital camera 100 to the control unit 201 via the communication unit 211. The recording medium 210 may be configured to be detachable from the control device 200, or may be built into the control device 200. In other words, it is sufficient for the control device 200 to have at least a means for accessing the recording medium 210.

[0046] The communication unit 211 is an interface for connecting to an external device. The control device 200 of this embodiment can exchange data with the external device via the communication unit 211. In this embodiment, the communication unit 211 is an antenna, and the control unit 201 can connect to the digital camera 100 via the antenna. In this embodiment, the communication unit 211 includes an interface for communicating with the external device via a so-called wireless LAN in accordance with the IEEE802.11 standard. The control unit 201 realizes wireless communication with the external device by controlling the communication unit 211. The communication method is not limited to wireless LAN, and also includes, for example, an infrared communication method.

[0047] The communication unit 212 is an interface for connecting to an external device. The control device 200 of this embodiment can exchange data with the external device via the communication unit 212. For example, image data generated by the digital camera 100 can be received via the communication unit 212. Note that in this embodiment, the communication unit 212 includes an interface for communicating with the external device via so-called Bluetooth (registered trademark) in accordance with the IEEE802.15.1 standard. The control unit 201 realizes wireless communication with the external device by controlling the communication unit 212. Note that the communication method is not limited to Bluetooth, and can also include, for example, a wireless LAN known as the IEEE802.11 standard or an infrared communication method.

[0048] The communication unit 213 is an interface for connecting to an external device. The control device 200 of this embodiment can exchange data with the external device via the communication unit 213. For example, image data generated by the digital camera 100 can be received via the communication unit 213. Note that in this embodiment, the communication unit 213 includes an interface for communicating with the external device via a wired LAN (Ethernet) in accordance with the IEEE802.3 standard. The control unit 201 realizes communication with the external device by controlling the communication unit 213. Note that the communication method is not limited to a wired LAN, and also includes, for example, a USB communication method.

[0049] The communication unit 212 of the control device 200 in this embodiment has a peripheral mode and a central mode as operation modes. By operating the communication unit 212 in the central mode, the control device 200 in this embodiment can operate as a server device in Bluetooth. When the control device 200 operates as a server device, it is possible to communicate by connecting to an external device in the peripheral mode. For authentication of the external device to be connected, pairing is performed in advance, and unique information of the external device to be connected is stored in the non-volatile memory 203.

[0050] The near field communication unit 214 is composed of, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, a communication controller, etc. The near field communication unit 214 outputs a modulated wireless signal from the antenna and demodulates a wireless signal received by the antenna to realize non-contact near field communication in accordance with the ISO / IEC 18092 standard (so-called NFC: Near Field Communication). The near field communication unit 214 of this embodiment is disposed on the side of the control device 200.

[0051] In addition, in the following description, the control device 200 may be described as being the main processing unit, but in reality, the control unit 201 of the control device 200 loads the program of the application (or the application's function, or the OS or OS services, etc.) deployed in the working memory 204 and performs various processes.

[0052] <System configuration> Next, the configuration of the camera control system in this embodiment will be described.

[0053] FIG. 3 is a diagram showing the configuration of a system in which a control device 200 and a plurality of digital cameras 100 are connected via a network device 300, and the control device 200 can remotely control the digital cameras 100. As shown in FIG.

[0054] Digital camera 100 is mounted on tripod 303 or the like and set up at each shooting position. Note that, although in this embodiment digital camera 100 is set up on tripod 303, it may be set up on a remote platform that allows remote control of pan, tilt and zoom operations.

[0055] The following are examples of connection forms for communication between the digital camera 100 and the control device 200. First, the digital camera 100 connects to the network device 300 by wireless communication using radio waves 302 via the communication unit 112, and communicates with the control device 200. Another form is where the digital camera 100 connects to the network device 300 by wired LAN via the communication unit 113, and communicates with the control device 200.

[0056] In still another embodiment, the control device 200 connects to the network device 300 by wireless communication using radio waves 302 via the communication unit 212, and communicates with the digital camera 100. In still another embodiment, the control device 200 connects to the network device 300 by wired LAN via the communication unit 213, and communicates with the digital camera 100.

[0057] In this embodiment, an example in which communication is performed via the network device 300 has been described, but the digital camera 100 and the control device 200 may be directly connected.

[0058] 3, in a state in which multiple installed digital cameras 100 and the control device 200 can communicate with each other, the control device 200 can issue commands to each digital camera 100 to shoot and commands to drive focus associated with the shot. In other words, shooting instructions can be issued remotely. Furthermore, the control device 200 can issue commands to obtain setting information for the digital cameras 100, commands to change the settings, and commands to request live view images (transmission requests), and can display the obtained information on the display unit 206 or the like.

[0059] With this configuration, it becomes possible for the control device 200 to control the photography and autofocus of the digital camera 100.

[0060] <Multiple camera placement in a sports stadium and live view video viewing> Next, a case in which live view images captured by a plurality of digital cameras 100 installed in a sports stadium are viewed as a list on the control device 200 in this embodiment will be described.

[0061] FIG. 4 is a schematic diagram showing an example in which a plurality of digital cameras 100 installed according to the events at an athletics venue transmit live view images to a control device 200, and the control device 200 displays the images side-by-side.

[0062] The live view video data 400 shown in Fig. 4(a) indicates high-quality data with a large amount of communication, and is displayed on the control device 200 as a video 401 with a higher resolution than a predetermined value. On the other hand, the live view video data 402 shown in Fig. 4(b) indicates low-quality data with a resolution equal to or lower than a predetermined value and a small amount of communication, and is displayed on the control device 200 as a low-resolution video 403.

[0063] As shown in Fig. 4(a), if the live view images of all the digital cameras 100 are transmitted to the control device 200 at high image quality, which requires a large amount of communication, and displayed, this can lead to congestion of the communication bandwidth and an increase in the processing load on the application. On the other hand, if all the live view images are displayed at low resolution / low frame rate, as shown in Fig. 4(b), the reaction to changes in the situation is delayed, operability deteriorates, and there is a risk of missing the decisive moment of shooting.

[0064] As described above, there is a trade-off between the image quality of the live view image and the user's operability, so it is preferable to select and display the optimal image quality depending on the shooting conditions and the operation conditions of the control device.

[0065] <Multi remote shooting control screen> 5A to 5F are diagrams showing a state in which a plurality of digital cameras 100 are connected to the control device 200, and live view images of the plurality of digital cameras 100 are respectively displayed in each display area of ​​the display unit 206 of the control device 200. The control device 200 can use this screen to control the shooting operations of the plurality of digital cameras 100 (hereinafter referred to as "multiple remote shooting").

[0066] The multi-remote photography screen 500 shown in Fig. 5A has an individual camera control member 501 for making settings related to photography and issuing focus commands and photography commands to individual digital cameras 100. It also has a multi-camera control member 502 for issuing settings, commands, and other commands to multiple digital cameras 100 at once (hereinafter, control for issuing commands to multiple cameras at once will be referred to as "multi-camera control"). Note that Fig. 5A shows an example in which the screens of multiple cameras are displayed in three columns, but this is not limiting. It is also possible to display fewer or more than three columns. In this case, the size of the display area is changed according to the columns.

[0067] 5B, 5C, and 5D, the individual camera control components 501 can be switched to different display methods individually in response to a user's operation (the display method can be changed). The individual camera control components 501 are displayed side by side on the multi-remote shooting screen 500 in correspondence with a plurality of connected digital cameras 100.

[0068] The multi-camera control member 502 can issue commands to multiple digital cameras 100 at once. Specifically, the multi-camera control member 502 has an operation member 503 for instructing the setting of shooting parameters at once, an operation member 504 for instructing a shooting command at once, and an operation member 505 for instructing an autofocus command at once. It also has an operation member 506 for selecting a group of digital cameras to which the commands of the operation members 503, 504, and 505 are to be transmitted. It also has a display operation member 507 for displaying the setting states of autofocus and manual focus in the shooting command and for switching between them.

[0069] 5B shows a screen when there are so many digital cameras connected that they cannot all fit on the multi-remote shooting screen, and individual cameras that are not displayed on the screen can be checked by scrolling the screen using screen scroll member 508. As is clear from FIG 5B, the display position of multi-camera control member 502 does not change even if the screen is scrolled.

[0070] <Configuration of individual camera control components> 5C, 5D, and 5E show examples of configurations of the individual camera control member 501. FIG.

[0071] The individual camera control member 501 shown in FIG. 5C has an operation member 510 for controlling the connection state with the digital camera 100, a display member 511 for indicating the power state and recording member state of the digital camera 100, and a name display member 512 for identifying individual cameras and shooting groups. The display member 511 displays the remaining battery level with an icon resembling a battery. In addition, in the case of a digital camera 100 in which multiple recording media can be inserted at the same time, the information on the recording member state indicates which recording medium an image captured by the digital camera 100 is in a state in which it is recorded. In addition, the individual camera control member 501 has a display operation member 513 for switching between auto and manual focus state display and focus setting, a display member 514 for indicating the network address of the digital camera 100, and a setting member 515 for performing various settings for individual camera control. In addition, the individual camera control member 501 has a group of members 516 for changing the shooting settings of the digital camera 100, and an operation member 517 for performing remote shooting control of each individual digital camera 100 (hereinafter referred to as "remote shooting"). Further, it has a display member 518 that indicates the number of remaining shots and the number of shots that the digital camera 100 has taken, and an operation member 519 that controls the live view display of the digital camera 100 .

[0072] The user can switch the display mode of the individual camera control member 501 by using an operation member 519 for controlling the live view display shown in FIG. 5C.

[0073] In Fig. 5D, a live view image display unit 520 is arranged in place of component group 516 for changing shooting settings. A live view size switching component 521 is arranged inside live view image display unit 520, and the display size can be switched as shown in Fig. 5E.

[0074] In Fig. 5E, a live view image display section 530 is disposed over the entire area of ​​individual camera control member 501. A live view size switching member 531 and a name display member 532 for identifying the shooting group are disposed inside live view image display section 530. The display size can be switched by live view size switching member 531, as shown in Fig. 5D.

[0075] Note that the display form of the live view video display unit in remote shooting shown in this embodiment is just one example, and any form may be used as long as the live view video display is conveyed to the user.

[0076] <Individual camera registration setting screen> FIG. 5F shows an individual camera registration setting screen 540 for performing individual camera registration settings starting with connection to digital camera 100.

[0077] The individual camera registration setting screen 540 has an operation member 541 for setting the IP address of the digital camera 100, and an operation member 542 for checking whether the digital camera 100 is on the network by sending a PING command from the control device 200. It also has an operation member 543 for setting the port number of the digital camera 100, a user name setting operation member 545 for logging in to the digital camera 100, and a password setting operation member 546. It also has an operation member 547 for setting which group the digital camera 100 belongs to, an operation member 548 for canceling the setting, and an operation member 549 for confirming the setting.

[0078] <Flowchart of multi live view video display processing by the control device 200> 6A and 6B are flowcharts showing operations when the control device 200 controls multiple remote shooting for multiple digital cameras 100. Here, the control device 200 displays live view images of each individual digital camera 100 on a multi-remote shooting screen. Note that the operations of these flowcharts are realized by the control unit 201 of the control device 200 expanding a control program stored in the non-volatile memory 203 into the work memory 204 and executing it.

[0079] FIG. 6A is a flowchart showing the operation of control device 200 from connecting to multiple digital cameras 100 to displaying live view images from the multiple cameras on the multi-remote shooting screen until completion.

[0080] When the control device 200 is started, in step S600, the control unit 201 registers the connection settings of the multiple digital cameras 100 to be connected.

[0081] In step S601, the control unit 201 performs detection processing for the digital camera 100 and determines whether or not the control unit 201 has detected the digital camera 100. If the control unit 201 has detected the digital camera 100, the process proceeds to step S602, and if the control unit 201 has not detected the digital camera 100, the control unit 201 repeats step S601.

[0082] In step S602, the control unit 201 determines whether or not the user has performed a connection operation for the digital camera 100. If a connection operation has been performed, the control unit 201 advances the process to step S603, and if there has been no connection request, the control unit 201 repeats step S602.

[0083] In step S603, the control unit 201 performs a connection process with the detected digital camera 100 to establish a connection with the digital camera 100.

[0084] In step S604, the control unit 201 determines whether there is a second or subsequent digital camera 100 to be connected that was registered for connection in step S600. If there is no digital camera 100 to be connected and multiple remote shooting can be started, the control unit 201 proceeds to step S605, and if there is still a digital camera 100 to be connected, the control unit 201 returns to step S601.

[0085] In step S605, the control unit 201 performs the multi live view video display process shown in FIG. 6B.

[0086] In step S606, the control unit 201 determines whether or not the connection with the multiple digital cameras 100 has ended. If the connection has not ended, the control unit 201 determines that the user has not ended the multi-remote shooting, and returns the process to step S605. If the connection has ended, the operation of this flow ends.

[0087] Fig. 6B is a flowchart showing the operation of the multiple live view video display processing that the control device 200 performs on the multiple digital cameras 100. This operation starts when the connection between the control device 200 and the multiple digital cameras 100 is established in step S604 in Fig. 6A.

[0088] In step S610, the control unit 201 displays the multi-remote photography screen shown in FIG. 5A.

[0089] In step S611, the control unit 201 determines whether or not there is a connection to the registered digital camera 100. If there is a connection, the control unit 201 proceeds to step S612, and if there is no connection, the control unit 201 proceeds to step S621 since there is no need to display the live view video on the multi-remote shooting screen.

[0090] In step S612, the control unit 201 checks whether the operation member 519 for controlling the live view display shown in FIG. 5C is pressed. If the operation member 519 is pressed, the control unit 201 advances the process to step S613. If the operation member 519 is not pressed, the control unit 201 advances the process to step S621. Note that, although it is checked here whether the operation member 519 is pressed (operated), the present invention is not limited thereto. For example, it may be determined whether the current display mode is a state in which the component group 516 is displayed as shown in FIG. 5C. In this case, if the component group 516 is displayed, the process advances to step S617, and if the component group 516 is not displayed, the process advances to step S614. That is, it is sufficient here to know whether the state transitions to a state in which the live view video display unit 520 is displayed as shown in FIG. 5D.

[0091] In step S613, the control unit 201 determines whether or not the live view video display portion is maximized as in 530 of Fig. 5E. If it is maximized, the control unit 201 proceeds to step S614, and if it is not maximized as in 520 of Fig. 5D, the control unit 201 proceeds to step S617.

[0092] In step S614, the control unit 201 determines whether or not the individual camera control member 501 is entirely displayed without any missing parts on the multi remote shooting screen 500. If the individual camera control member 501 is not missing, the control unit 201 proceeds to step S615, and if the individual camera control member 501 is missing, the control unit 201 proceeds to step S617.

[0093] The case where the individual camera control member 501 is missing is a case where a part of the individual camera control member 501 does not fit in the multi-remote shooting screen 500 and is not displayed, for example, as in the upper and lower parts of FIG. 5B. The case where the individual camera control member 501 is not missing is a case where the entire individual camera control member 501 is displayed, for example, as in the case of FIG. 5A or the middle part of FIG. 5B. Note that, for example, when the display mode of the individual camera control member 501 is as shown in FIG. 5D, even if a part of the upper end of the individual camera control member 501 is not displayed, the entire live view video display section 520 is displayed in a visible state. In this case, it may be determined that the individual camera control member 501 is not missing. In this case, for example, it may be determined that the individual camera control member 501 is missing when a predetermined ratio or more of the display area of ​​the individual camera control member 501 is not displayed. Alternatively, since it is considered that the shooting contents can be understood even if the live view video is not visible to some extent, it may be determined that the individual camera control member 501 is not missing even if the live view video display section 520 is not visible to some extent. In this case, it may be determined that the individual camera control member 501 is missing when a predetermined ratio or more of the live view video display section 520 is not displayed.

[0094] In step S615, control unit 201 determines whether the group name set by operation member 506 for selecting a group shown in Fig. 5A is the same as the group name of display member 512 or 532 shown in Fig. 5C, 5D, or 5E. If they are the same group, control unit 201 proceeds to step S616, and if they are different, control unit 201 proceeds to step S617.

[0095] In step S616, the control unit 201 determines the image quality of the live view video that is to be requested of the digital camera 100 to be high image quality with a resolution higher than a predetermined value.

[0096] In step S617, the control unit 201 determines that the image quality of the live view video that is requested of the digital camera 100 is to be low image quality with a resolution equal to or lower than a predetermined value.

[0097] In step S618, the control unit 201 transmits to the digital camera 100 a command requesting a live view image with the image quality determined in steps S616 and S617.

[0098] In step S619, the control unit 201 receives the live view image from the digital camera 100.

[0099] In step S 620 , the control unit 201 displays the live view image received from the digital camera 100 on the live view image display unit 520 or 530 of the individual camera control member 501 .

[0100] In step S621, the control unit 201 determines whether or not the live view image display process has been completed for all of the digital cameras 100 displayed on the multi remote shooting screen 500. If completed, the control unit 201 proceeds to step S606 in Fig. 6A, and if not completed, the control unit 201 returns to step S611 and repeats the process for the other live view image display units.

[0101] <Flowchart of live view video transmission process of digital camera 100> 7 is a flowchart showing the operation of the digital camera 100 from receiving a command from the connected control device 200 to transmitting a live view video. Note that the operation of this flowchart is realized by the control unit 101 of the digital camera 100 expanding a control program stored in the non-volatile memory 103 into the work memory 104 and executing it.

[0102] When digital camera 100 is placed in a shooting position and the user turns on the power of digital camera 100, the process of FIG. 7 begins.

[0103] First, in step S701, the control unit 101 performs network settings for connection to the control device 200.

[0104] In step S702, the control unit 101 enables the network setting and waits for connection with the control device 200.

[0105] In step S703, the control unit 101 determines whether or not there has been a connection request from the control device 200. If there has been a connection request, the control unit 101 advances the process to step S704, and if there has not been a connection request, the control unit 101 repeats step S703.

[0106] In step S704, the control unit 101 determines whether or not there has been a live view video request command from the control device 200. If there has been a live view video request command, the control unit 101 proceeds to step S705, and if not, repeats step S704. In step S705, the control unit 101 determines whether the image quality of the requested live view video in the live view video request command received from the control device 200 is high image quality. If the image quality is high, the control unit 101 proceeds to step S706, and if the image quality is low, the control unit 101 proceeds to step S707.

[0107] In step S706, the control unit 101 executes a process of generating a high-quality live view image.

[0108] In step S707, the control unit 101 executes a process of generating a low-image-quality live view video.

[0109] In step S708, the control unit 101 transmits the live view video to the control device 200, and the operation of this flow ends.

[0110] As described above, according to the above embodiment, in the individual live view video display on the multi-remote shooting screen, it is possible to select an appropriate live view video image quality (for example, two types of image quality) depending on the size of the live view video display section, the missing part, the presence or absence of group setting, etc. Also, as described above, even if a part of the live view video display section is missing, the live view display does not stop. Therefore, even if the image quality is slightly degraded, it is possible to grasp the movement of the subject to a certain extent, thereby making it difficult to miss a shutter opportunity.

[0111] Second embodiment In the first embodiment, it was described that when displaying individual live view images on a multi-remote shooting screen, appropriate live view image quality is selected depending on the size of the live view image display area, the missing parts, the presence or absence of group settings, etc.

[0112] In the second embodiment, a method for selecting appropriate image quality for individual live view images on a multi-remote shooting screen based on the automatic subject detection function (subject detection result) of each digital camera 100 connected to the control device 200 will be described.

[0113] <Determining live view image quality by subject detection> FIG. 8 is a diagram showing a state in which a plurality of digital cameras 100 are connected to the control device 200, and live view images of the plurality of digital cameras 100 are displayed side by side on the multi-remote shooting screen (display unit 206) of the control device 200.

[0114] 8, in the case of track and field events 802 where no competition is being held, the subject is not shown in the live view image, so the user is unlikely to perform a shooting operation. However, if the live view image display is switched off, it may not be possible to respond to changes in the situation when an event is being held, and the user may miss a shooting opportunity.

[0115] Therefore, in this embodiment, it is determined whether or not the subject to be photographed is captured in the live view image, and the image quality of the live view image to be displayed on the multi-remote shooting screen is determined.

[0116] Fig. 9 is a flowchart showing the operation of digital camera 100, from receiving a command from connected control device 200, determining whether a subject is captured in the image, to transmitting a live view video. Since the flowchart in Fig. 9 has many parts in common with the flowchart in Fig. 7, the same step numbers are used for the common parts and a description thereof will be omitted.

[0117] In step S704 of FIG. 7, if a live view video request command is received from the control device 200, the control unit 101 of the digital camera 100 advances the process to step S900.

[0118] In step S900, the control unit 101 determines whether or not a preset subject, such as a person, animal, or car, has been detected within the range captured by the digital camera 100 via the image sensor. If the control unit 101 detects a subject, the process proceeds to step S901, and if the control unit 101 cannot detect a subject, the process proceeds to step S902.

[0119] In step S901, the control unit 101 executes a process of generating a high-quality live view image having a resolution higher than a predetermined resolution.

[0120] In step S902, the control unit 101 executes a process of generating a low-quality live view video having a resolution equal to or lower than a predetermined value, and the process proceeds to step S903.

[0121] In step S903, the control unit 101 transmits a live view video to the control device 200, and the operation of this flow ends.

[0122] In the present embodiment, an example has been described in which the function of the digital camera 100 is used to detect a subject, but the present invention is not limited to this. For example, a specific subject may be detected using an AI processing technique of the control device 200.

[0123] (Third embodiment) <Evaluation of live view image quality by remote shooting operation using multiple control devices> In the first and second embodiments, examples of optimization of individual live view image displays on the multi-remote shooting screen of the control device 200 and optimization of live view image displays by the detection function of the digital camera 100 have been described.

[0124] In the third embodiment, a method for displaying a live view image with optimal image quality for each individual camera on a multi-remote photography screen in a multi-remote photography system in which a plurality of control devices 200 are connected will be described.

[0125] FIG. 10 is a diagram showing a system configuration in which a plurality of control devices 200 and a plurality of digital cameras 100 are connected via a network device 300, and the control devices remotely control the digital cameras.

[0126] The following are examples of situations where multiple users perform multiple remote shooting using their respective control devices: For example, one control device may be used by a regular cameraman to shoot near the event, while the other control device may be used somewhere in the event venue, such as the main press center, to check shot images, transfer data, perform auxiliary shooting tasks, etc. In such a situation, the live view image of a digital camera operated from one control device may be of interest to the user operating the other control device.

[0127] 11A and 11B show a state in which multiple remote photography is being performed on the same athletics event at the same time using different control devices. Fig. 11A shows a multiple remote photography screen 1100 of the control device 200A, and Fig. 11B shows a multiple remote photography screen 1101 of the control device 200B.

[0128] Live view images of all the digital cameras are displayed on a multi-remote photography screen 1100 of the control device 200A. Also, an individual camera control member 1102 that can perform individual photography operations and an individual camera control member 1103 that cannot perform photography operations because the connection with the individual cameras is cut off are displayed on a multi-remote photography screen 1101 of the control device 200B.

[0129] At this time, a live view image is displayed on the individual camera control member 1104 of the multi-remote photography screen 1100 of the control device 200A, but this camera is a digital camera that is not connected to and is not operated by the control device 200B. Therefore, if the image does not need attention from the user operating the control device 200A, it is sufficient to display a low-quality live view image on the multi-remote photography screen of the control device 200A.

[0130] On the other hand, for a digital camera connected and operated by another control device 200B, if the image is noteworthy even for the control device 200A, it is preferable to display a high-quality live view image.

[0131] Therefore, in this embodiment, a determination is made as to whether or not there is an image capturing or setting operation for the digital camera from any of the connected control devices, and the image quality of the live view image to be displayed on the multi-remote shooting screen is determined.

[0132] Fig. 12 is a flowchart showing the operation of digital camera 100, receiving a command from connected control device 200, determining whether or not the camera has been operated to take a picture or set a setting, and transmitting a live view image. The flowchart in Fig. 12 has many parts in common with the flowchart in Fig. 7, so the same step numbers are used for the common parts and their explanations are omitted.

[0133] In step S704 of FIG. 7, if a live view video request command is received from the control device 200, the control unit 101 of the digital camera 100 advances the process to step S1200.

[0134] In step S1200, the control unit 101 determines whether or not an operation such as a shooting operation or a setting operation has been performed for a certain period of time on the digital camera 100. If an operation has been performed, the control unit 101 advances the process to step S1201, and if no operation has been performed, the control unit 101 advances the process to step S1202.

[0135] In step S1201, the control unit 101 executes a process of generating a high-quality live view image having a resolution higher than a predetermined resolution.

[0136] In step S1202, the control unit 101 executes a process of generating a low-quality live view video having a resolution equal to or lower than a predetermined value.

[0137] In step S1203, the control unit 101 transmits a live view video to the control device 200, and the operation of this flow ends.

[0138] In this embodiment, when one control device is performing shooting or setting operations on a camera, the other control device is also determined to be worthy of attention, and the image quality of the live view image is displayed in high quality. However, the present invention is not limited to this. For example, when multiple users perform remote shooting operations, the image quality of the live view image of the camera that is not being operated may be set to high quality in order to compensate for the shooting operation of a camera that one user is not paying attention to.

[0139] The disclosure of this specification includes the following control system, imaging device, control method thereof, and program.

[0140] (Item 1) A control system for controlling a plurality of imaging devices by a control device, The control device, a display control means for controlling the display means so as to display live view images transmitted from the plurality of image capture devices in a plurality of display areas in the display means corresponding to the plurality of image capture devices, and for changing a display method for each of the plurality of display areas; a first communication means for requesting a live view image from the imaging device; The imaging device, an imaging means for generating live view images of different image quality in response to a request for transmission of the live view images from the control device; and a second communication means for transmitting the live view image generated by the imaging means to the control device.

[0141] (Item 2) The control system described in item 1, characterized in that the first communication means requests a live view image of an image quality suitable for each imaging device according to the display method of the multiple display areas from the imaging device, and the imaging means generates a live view image of the image quality requested by the control device.

[0142] (Item 3) The control system described in item 2, wherein the first communication means requests the imaging device to transmit a low-quality live view image having a resolution equal to or lower than a predetermined value when the display control means does not maximize the live view image.

[0143] (Item 4) The control system described in item 2, characterized in that the first communication means requests the imaging device to transmit a live view image with a lower image quality having a resolution equal to or lower than a predetermined value when the live view image displayed in the display area is missing.

[0144] (Item 5) The control system described in item 1, characterized in that the imaging device further includes a subject detection means for detecting a subject, and the imaging means changes the image quality of the live view image generated depending on the detection result by the subject detection means.

[0145] (Item 6) 6. The control system according to item 5, wherein when the subject is detected by the subject detection means, the imaging means generates a live view image with a higher image quality than a predetermined resolution.

[0146] (Item 7) 7. The control system according to item 5 or 6, wherein the subject detection means detects subjects including people, animals, and cars.

[0147] (Item 8) The control system described in item 1, characterized in that when a command for a shooting operation or a setting operation is sent from the control device to the imaging device, the imaging means generates a live view image with a high image quality having a resolution higher than a predetermined value.

[0148] (Item 9) 9. The control system according to any one of items 1 to 8, wherein the imaging means generates live view images with two different image qualities.

[0149] (Item 10) 10. The control system according to item 9, wherein the imaging means generates a high-quality live view image having a resolution higher than a predetermined level and a low-quality live view image having a resolution equal to or lower than a predetermined level.

[0150] (Item 11) 11. The control system according to any one of items 1 to 10, wherein the display control means is capable of changing the size of the live view image for each of the plurality of display areas.

[0151] (Item 12) The control system described in any one of items 1 to 11, characterized in that the display control means controls the display means to simultaneously display, in the display area, a live view image transmitted from an imaging device corresponding to the display area and an operation unit for operating the imaging device.

[0152] (Item 13) The control system according to any one of items 1 to 10, characterized in that the display control means is capable of controlling the display area so as not to display a live view image transmitted from an imaging device corresponding to the display area.

[0153] (Item 14) 14. The control system according to any one of items 1 to 13, wherein the display means is built into the control device.

[0154] (Item 15) An imaging device controlled by a control device, an imaging means for generating live view images of different image quality in response to a transmission request for live view images from the control device; a communication unit that transmits a live view image generated by the imaging unit to the control device.

[0155] (Item 16) 1. A method for controlling an imaging device controlled by a control device, comprising: an imaging step of generating live view images of different image quality in response to a request for transmission of the live view images from the control device; and a communication step of transmitting the live view image generated in the imaging step to the control device.

[0156] (Item 17) Item 17. A program for causing a computer to execute each step of the control method according to item 16. (Other embodiments) The present invention can also be realized by a process in which a program for realizing one or more functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for realizing one or more functions.

[0157] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0158] 100: digital camera, 101, 201: control unit, 102, 202: imaging unit, 103, 203: non-volatile memory, 104, 204: working memory, 105, 205: operation unit, 106, 206: display unit, 200: control device

Claims

1. A control system for controlling a plurality of imaging devices by a control device, The control device, a display control means for controlling the display means so as to display live view images transmitted from the plurality of image capture devices in a plurality of display areas in the display means corresponding to the plurality of image capture devices, and for changing a display method for each of the plurality of display areas; a first communication means for requesting a live view image from the imaging device; The imaging device, an imaging means for generating live view images of different image quality in response to a request for transmission of the live view images from the control device; and second communication means for transmitting the live view image generated by the imaging means to the control device.

2. The control system according to claim 1, characterized in that the first communication means requests the imaging device to provide a live view image of an image quality suitable for each imaging device in accordance with a display method of the plurality of display areas, and the imaging means generates a live view image of the image quality requested by the control device.

3. The control system according to claim 2, characterized in that the first communication means requests the imaging device to transmit a low-quality live view image having a resolution equal to or lower than a predetermined value when the display control means is not maximizing the live view image.

4. The control system according to claim 2, characterized in that the first communication means requests the imaging device to transmit a live view image with a low image quality having a resolution equal to or lower than a predetermined value when the live view image displayed in the display area is missing.

5. The control system according to claim 1 , wherein the imaging device further comprises a subject detection means for detecting a subject, and the imaging means changes the image quality of the live view image generated according to a detection result by the subject detection means.

6. 6. The control system according to claim 5, wherein, when the subject is detected by the subject detection means, the imaging means generates a live view image having a higher image quality than a predetermined resolution.

7. 6. The control system according to claim 5, wherein said object detection means detects objects including people, animals, and cars.

8. The control system according to claim 1, characterized in that when a command for a shooting operation or a setting operation is transmitted from the control device to the imaging device, the imaging means generates a live view image having a high image quality having a resolution higher than a predetermined value.

9. 2. The control system according to claim 1, wherein the image capturing means generates live view images having two different image qualities.

10. 10. The control system according to claim 9, wherein the imaging means generates a high-quality live view image having a resolution higher than a predetermined resolution, and a low-quality live view image having a resolution equal to or lower than the predetermined resolution.

11. 2. The control system according to claim 1, wherein the display control means is capable of changing a size of the live view image for each of the plurality of display areas.

12. The control system according to claim 1, characterized in that the display control means controls the display means so as to simultaneously display, in the display area, a live view image transmitted from an imaging device corresponding to the display area and an operation unit for operating the imaging device.

13. 2. The control system according to claim 1, wherein the display control means is capable of performing control so as not to display, in the display area, a live view image transmitted from an imaging device corresponding to the display area.

14. 2. The control system according to claim 1, wherein said display means is built into said control device.

15. An imaging device controlled by a control device, an imaging means for generating live view images of different image quality in response to a request for transmission of the live view images from the control device; a communication unit that transmits a live view image generated by the imaging unit to the control device.

16. 1. A method for controlling an imaging device controlled by a control device, comprising: an imaging step of generating live view images of different image quality in response to a request for transmission of the live view images from the control device; and a communication step of transmitting the live view image generated in the imaging step to the control device.

17. A program for causing a computer to execute each step of the control method according to claim 16.

Images