Control devices, control methods, programs, and systems

Abstract

The control device operated by the photographer allows for the simultaneous control of the movement of the AF frame positions of multiple digital cameras through a single operation. [Solution] A control device that remotely controls multiple imaging devices via a network connection, comprising: acquisition means for acquiring LV images from each of the multiple imaging devices; display means for displaying each LV image acquired by the acquisition means; and control means, wherein when a touch is made on a first LV image displayed on the display means, the control means transmits movement instruction information for an AF frame specified with first coordinate information corresponding to the touched position on the first LV image to a first imaging device corresponding to the first LV image, and transmits movement instruction information for an AF frame specified with second coordinate information based on the first coordinate information to a second imaging device different from the first imaging device.

Description

Technical Field

[0001] The present invention relates to a control device, a control method, a program, and a system.

Background Art

[0002] In recent years, in event venues such as weddings and concerts, and conference venues such as press conferences, shooting with multiple digital cameras has been carried out for the purpose of taking photos with a more reliable and optimal composition. However, in order to shoot with multiple digital cameras simultaneously, multiple cameramen are required, which incurs costs such as a large amount of labor costs. In addition, shooting by a cameraman is impossible in places where entry is restricted.

[0003] Therefore, in such a scene, a system for controlling each camera from a control device connected to a plurality of cameras via a network is known (Patent Document 1). For example, a plurality of digital cameras are installed at various places in a venue, and a small number of photographers remotely connect a control device represented by a tablet or a notebook personal computer to the digital cameras via a network. And a system that can shoot a plurality of digital cameras at once by operating the control device has been used. To give a specific example, existing technologies such as Nikon's "NX Field" (trademark) and Sony's "Remote Camera Tool" (trademark) are sometimes used as a remote shooting system that can control the shooting of a plurality of digital cameras remotely.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When taking still images with a digital camera, the photographer refers to the digital camera's live view image and a display (hereinafter referred to as the "AF frame") corresponding to the area within the digital camera's imaging area that acquires the signal for autofocus (AF) focus detection. The photographer moves the AF frame in accordance with the subject's movement by operating the digital camera. Then, the camera focuses on the subject using autofocus and takes a photograph.

[0006] In still image capture using a remote shooting system that controls multiple digital cameras from a single control unit, the control unit receives live view images from the multiple digital cameras and displays them side-by-side on the screen.

[0007] The photographer sends a command from the control unit to the digital camera to move the AF frame's position from its current coordinates to the coordinates on the live view image corresponding to the touched position, by touching the screen on the live view image display area of ​​each digital camera controlled by the control unit. This allows the AF frame of the digital camera to be moved to any coordinate on the live view image.

[0008] However, in a comparative example, consider a scenario where the AF frame position needs to be moved to match the subject for multiple digital cameras connected to a control device. In this case, the user must individually touch the screen on the live view image display area of ​​each digital camera on the control device, repeating this operation for each camera. This presents the challenge of requiring extra effort and time from the photographer. Furthermore, this operation may delay the photographer's preparation for shooting, potentially causing them to miss a photo opportunity. [Means for solving the problem]

[0009] Therefore, in order to solve the above problems, the present invention provides a control device that remotely controls a plurality of imaging devices via a network connection, the control device comprising: acquisition means for acquiring LV images from each of the plurality of imaging devices; display means for displaying each LV image acquired by the acquisition means; and control means, wherein when a touch is made on a first LV image displayed on the display means, the control means transmits movement instruction information for an AF frame specified with first coordinate information corresponding to the position touched on the first LV image to a first imaging device corresponding to the first LV image, and transmits movement instruction information for an AF frame specified with second coordinate information based on the first coordinate information to a second imaging device different from the first imaging device. [Effects of the Invention]

[0010] According to the present invention, it is possible to control the movement of the AF frame positions of multiple digital cameras from a control device operated by the photographer, all at once through a single operation. [Brief explanation of the drawing]

[0011] [Figure 1] This is a hardware configuration diagram showing the configuration of digital camera 100. [Figure 2] This is a hardware configuration diagram showing the configuration of the control device 200. [Figure 3] This is a system configuration diagram showing a system consisting of multiple digital cameras 100 and a control device 200, where the control device 200 and the multiple digital cameras 100 are connected via a network device 300 for remote control. [Figure 4] This diagram illustrates the application of multi-remote shooting by a photographer, using filming at a press conference venue as an example. [Figure 5] This is an example screen showing multi-remote shooting of multiple digital cameras 100, displayed on the display unit 206 of the control unit 200, with three digital cameras 100 connected to a control unit 200. [Figure 6]This flowchart illustrates the process by which the control device 200 controls the AF frame position movement of multiple digital cameras 100 during multi-remote shooting for multiple connected digital cameras 100 in the first embodiment. [Figure 7] This is an example screen for the control device 200 to configure the linked movement control of the digital camera 100. [Figure 8] This flowchart illustrates the process in the first embodiment where a digital camera 100 receives a command from a connected control device 200 to control the AF frame position. [Figure 9] This flowchart illustrates the process by which the control device 200 controls the AF frame position movement of multiple digital cameras 100 during multi-remote shooting for multiple connected digital cameras 100 in the second embodiment. [Figure 10] This flowchart illustrates the process in the third embodiment where the digital camera 100 receives a command from the connected control device 200 to perform AF frame position movement control. [Figure 11] This flowchart illustrates the process by which the control device 200 controls the AF frame position movement of multiple digital cameras 100 during multi-remote shooting for multiple connected digital cameras 100 in the third embodiment. [Modes for carrying out the invention]

[0012] The embodiments for carrying out the present invention will be described in detail below with reference to the attached drawings.

[0013] The embodiments described below are merely examples of means for realizing the present invention, and may be modified or changed as appropriate depending on the configuration of the apparatus to which the present invention is applied and various conditions. Furthermore, the embodiments can be combined as appropriate.

[0014] [First Embodiment] <Configuration of Digital Camera 100> FIG. 1(a) is a hardware configuration diagram showing a configuration example of a digital camera 100, which is an example of the communication device according to the present embodiment. Here, the digital camera is described as an example of the communication device, but the communication device is not limited thereto. For example, the communication device may be an information processing device such as a portable media player, a so-called tablet device, or a personal computer.

[0015] The control unit 101 controls each part of the digital camera 100 according to the input signal and the program described later. Instead of the control unit 101 controlling the entire device, the entire device may be controlled by a plurality of hardware sharing the processing.

[0016] The imaging unit 102 is composed of, for example, an optical lens unit and an optical system for controlling an aperture, zoom, focus, etc., and an imaging element for converting the light (video) introduced through the optical lens unit into an electrical video signal. As the imaging element, generally, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is used. The imaging unit 102 is controlled by the control unit 101 to convert the subject light imaged by the lens included in the imaging unit 102 into an electrical signal by the imaging element, perform noise reduction processing, etc., and output the digital data as image data. In the digital camera 100 of the present embodiment, the image data is recorded on the recording medium 110 according to the DCF (DeSign Rule for CamerAFile SyStem) standard.

[0017] The non-volatile memory 103 is a non-volatile memory that can be electrically erased and recorded, and stores a program and the like described later that is executed by the control unit 101.

[0018] The working memory 104 is used as a buffer memory for temporarily holding the image data captured by the imaging unit 102, an image display memory for the display unit 106, a working area of the control unit 101, and the like.

[0019] The control unit 105 is used to receive instructions from the user for the digital camera 100. The control unit 105 includes, for example, a power button for the user to turn the digital camera 100 on or off, a shutter release switch for taking a picture, and a playback button for playing back image data. Furthermore, it includes operating elements such as a dedicated connection button for starting communication with an external device via the communication unit 111, which will be described later. The touch panel formed on the display unit 106, which will be described later, is also included in the control unit 105.

[0020] The release switch has two switches, SW1 and SW2. When the release switch is half-pressed, SW1 turns ON. This allows the camera to receive instructions for shooting preparation operations such as AF (autofocus), AE (automatic exposure), AWB (auto white balance), and EF (flash pre-flash), which will be described later. When the release switch is fully pressed, SW2 turns ON. This allows the camera to receive instructions for taking a picture.

[0021] The control unit 105 also includes an AF-ON button that activates only the AF processing, which is included in the shooting preparation operation and will be described later. When the AF-ON button is pressed, the control unit 101 outputs a command to start AF operation, and the AF processing begins.

[0022] In AF processing, automatic focus detection is performed on the area of ​​the image sensor of the imaging unit 102 that acquires a signal for focus detection (hereinafter referred to as the "focus detection area"). By moving the focus lens included in the shooting lens to the focal position according to the amount of defocus detected in the focus detection area, it is possible to focus on the subject.

[0023] Furthermore, the user can operate the control unit 101 via the operation unit 105 to change the position of the reference area for the focus detection area on the viewfinder screen displayed on the display unit 106 (hereinafter referred to as the "AF frame"). The display area of ​​the AF frame corresponds to the focus detection area, and the focus detection area is also changed in accordance with the change in the display area of ​​the AF frame. As for the means of changing the position of the AF frame, for example, when an operation is made on the touch panel of the operation unit 105, the position of the AF frame is newly set (moved) to the operated position, but the present invention is not limited to these.

[0024] Furthermore, the user can select and set one of several AF frame selection modes, including at least the following two, through operation via the control unit 105. • Single-point AF: A mode in which the user specifies one AF frame of their choice. Focus detection is performed within the focus detection area corresponding to the selected AF frame. • Multi-point AF: A mode in which the user specifies multiple AF frames. Possible forms of specification include classifying multiple AF frames into multiple zones, and the user specifying one of the zones based on the touch position to specify multiple AF frames (hereinafter referred to as "zone AF"). Subsequently, in multi-point AF including zone AF, the control unit 101 performs automatic selection using all selected AF frames. In automatic selection, from the multiple AF frames specified by the user, the control unit 101 selects the AF frame that should be focused on based on the automatic selection conditions and performs focus detection. The automatic selection conditions basically select the AF frame that will focus on the closest subject, but conditions such as the position and size of the subject on the screen and the subject distance are also taken into consideration. Various methods of determination are possible, but the present invention is not limited to these.

[0025] The display unit 106 displays the viewfinder image and AF frame during shooting, displays captured image data, and displays text for interactive operation. The display unit 106 does not necessarily need to be built into the digital camera 100. The digital camera 100 can connect to an internal or external display unit 106 and only needs to have a display control function to control the display of the display unit 106.

[0026] The RTC107 manages the clock. The time may be set by the user via the operation unit 105, or it may be set by acquiring time information via the communication unit 111, or it may be set using a clock acquired by a radio-controlled clock. The only requirement is that it can manage the time.

[0027] The recording medium 110 can record image data output from the imaging unit 102. The recording medium 110 may be configured to be detachable from the digital camera 100, or it may be built into the digital camera 100. In other words, the digital camera 100 only needs to have means to access the recording medium 110.

[0028] The communication unit 111 is an interface for connecting to an external device. The digital camera 100 of this embodiment can exchange data with an external device via the communication unit 111. For example, image data generated by the imaging unit 102 can be transmitted to an external device via the communication unit 111. In this embodiment, the communication unit 111 includes an interface for communicating with an external device using a so-called wireless LAN in accordance with the IEEE 802.11 standard. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 111. Note that the communication method is not limited to wireless LAN, and includes, for example, infrared communication. The communication unit 111 is an example of a first wireless communication means.

[0029] The communication unit 112 is an interface for connecting to an external device. The digital camera 100 of this embodiment can exchange data with an external device via the communication unit 112. For example, image data generated by the imaging unit 102 can be transmitted to an external device via the communication unit 112. In this embodiment, the communication unit 112 includes an interface for communicating with an external device using Bluetooth®, which conforms to the IEEE 802.15.1 standard. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 112. Note that the communication method is not limited to Bluetooth®, and includes, for example, wireless LAN known by the IEEE 802.11 standard, or infrared communication methods. Furthermore, the communication unit 112 is an example of a first wireless communication means.

[0030] The communication unit 113 is an interface for connecting to an external device. In this embodiment, the digital camera 100 can exchange data with an external device via the communication unit 112. For example, image data generated by the imaging unit 102 can be transmitted to an external device via the communication unit 112. In this embodiment, the communication unit 113 includes an interface for communicating with an external device via a wired LAN (Ethernet) in accordance with the IEEE 802.3 standard. The control unit 101 realizes communication with the external device by controlling the communication unit 112. Note that the communication method is not limited to a wired LAN, and includes, for example, a USB communication method. Furthermore, the communication unit 113 is an example of a first wired communication means.

[0031] In this embodiment, the communication unit 112 of the digital camera 100 has either peripheral mode or central mode. By operating the communication unit 112 in peripheral mode, the digital camera 100 in this embodiment can operate as a Bluetooth® client device. When the digital camera 100 operates as a client device, it can communicate by connecting to an external device that is in central mode. For authentication with the external device to be connected, the unique information of the external device to be connected is stored in the non-volatile memory 103 by performing pairing in advance. Furthermore, even when the power switch is OFF, the digital camera 100 can transmit if power is supplied to the Bluetooth® module.

[0032] The proximity wireless communication unit 114 consists of, for example, an antenna for wireless communication, a modulation / demodulation circuit, and a communication controller for processing the wireless signal. The proximity wireless communication unit 114 outputs a modulated wireless signal from the antenna. The proximity wireless communication unit 114 then demodulates the wireless signal received by the antenna to realize contactless proximity communication in accordance with the ISO / IEC 18092 standard (so-called NFC: Near Field Communication). In this embodiment, the proximity wireless communication unit 114 is located on the side of the digital camera 100.

[0033] The control device 200, described later, is connected to the devices by bringing the proximity wireless communication units 114 and 214 close together to initiate communication. However, when connecting to the control device 200 using the proximity wireless communication unit 114, it is not always necessary for the proximity wireless communication units 114 and 214 to be in contact. Since the proximity wireless communication units 114 and 214 can communicate even when separated by a certain distance, it is sufficient to bring them within the proximity wireless communication range to connect them. In the following explanation, this bringing within the proximity wireless communication range will also be referred to as "bringing them close together."

[0034] Next, the appearance of the digital camera 100 will be described. Figures 1(b) and 1(c) show examples of the appearance of the digital camera 100. The release switch 105a, playback button 105b, directional keys 105c, and touch panel 105d are operating components included in the aforementioned operating unit 105. The display unit 106 displays the image obtained as a result of imaging by the imaging unit 102. The communication unit 113 is the interface unit for wired LAN and USB.

[0035] Furthermore, although the following description may sometimes suggest that the digital camera 100 is the main unit performing the processing, in reality, the control unit 101 reads the program stored in the non-volatile memory 103 and performs the various processes.

[0036] The above is a description of the Digital Camera 100.

[0037] <Configuration of control device 200> Figure 2 is a hardware configuration diagram showing an example of the configuration of a control device 200, which is an example of an information processing device in this embodiment. While the control device is described here as an example of an information processing device, the information processing device is not limited to this. For example, the information processing device may be a digital camera with wireless functionality, a smartphone, a tablet device, or a personal computer.

[0038] The control unit 201 controls each part of the control device 200 according to the input signals and the program described later. Alternatively, instead of the control unit 201 controlling the entire device, multiple hardware components may share the processing to control the entire device.

[0039] The non-volatile memory 203 is an electrically erasable and recordable non-volatile memory. The non-volatile memory 203 stores the operating system (OS), which is the basic software executed by the control unit 201, and applications that work in cooperation with the OS to realize advanced functions. In this embodiment, the non-volatile memory 203 also stores an application (hereinafter referred to as "app") for communicating with the digital camera 100.

[0040] The working memory 204 is used as the image display memory for the display unit 206, the working area for the control unit 201, and so on.

[0041] The operation unit 205 is used to receive instructions from the user for the control device 200. The operation unit 205 includes, for example, a power button for the user to instruct the control device 200 to turn on or off, an operating member for setting the RTC 207, and an operating member such as a touch panel formed on the display unit 206.

[0042] The control unit 201 can detect the following operations on the touch panel included in the operation unit 205 (hereinafter referred to as "touch operations"): Touching the touch panel with a finger or pen (hereinafter referred to as "touch down"); Being in a state where a finger or pen is touching the touch panel (hereinafter referred to as "touch on"); Moving while touching the touch panel with a finger or pen (hereinafter referred to as "touch move"); Lifting the finger or pen that was touching the touch panel (hereinafter referred to as "touch up"); Not touching the touch panel (hereinafter referred to as "touch off"). These operations and the position coordinates of the finger or pen touching the touch panel are notified to the control unit 201, and the control unit 201 determines what operation was performed on the touch panel based on the notified information. For moves, the direction of movement of the finger or pen moving on the touch panel can also be determined for each vertical and horizontal component on the touch panel based on the change in position coordinates. Furthermore, when a touch up occurs after a certain move from a touch down on the touch panel, it is considered that a stroke has been drawn. An operation to draw a stroke quickly is called a flick. A flick is an operation in which a finger is quickly moved a certain distance while keeping it in contact with the touch panel, and then released. In other words, it is an operation in which the finger is quickly swiped across the touch panel. A flick can be determined to have occurred if a movement of more than a predetermined distance and at a predetermined speed or faster is detected, and a touch-up is then detected. Conversely, if a movement of more than a predetermined distance but at a speed less than the predetermined speed is detected, it will be determined to have occurred as a drag. Any type of touch panel can be used, including resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor types.

[0043] The display unit 206 displays image data, text for interactive operation, etc. Note that the display unit 206 does not necessarily need to be provided by the control device 200. The control device 200 can be connected to the display unit 206 and only needs to have at least a display control function to control the display of the display unit 206.

[0044] The RTC207 manages the time. The time may be set by the user via the operation unit 205, or it may be set by acquiring time information via the communication unit 211, communication unit 212, or public network connection unit 213, or it may be set using a time setting captured by a radio-controlled clock. The only requirement is that it can manage the time. It may also be able to obtain the time from a mechanical mechanism such as an analog clock via a detection mechanism (in this case, the RTC207 shall include a detection mechanism from an analog clock).

[0045] The recording medium 210 can record image data transferred by the digital camera 100 to the control unit 201 via the communication unit 211. The recording medium 210 may be configured to be detachable from the control unit 200, or it may be built into the control unit 200. In other words, the control unit 200 only needs to have means to access the recording medium 210.

[0046] The communication unit 211 is an interface for connecting to an external device. In this embodiment, the control device 200 can exchange data with an external device via the communication unit 211. In this embodiment, the communication unit 211 is an antenna, and the control unit 201 can connect to the digital camera 100 via the antenna. In this embodiment, the communication unit 211 includes an interface for communicating with an external device using a so-called wireless LAN in accordance with the IEEE 802.11 standard. The control unit 201 realizes wireless communication with the external device by controlling the communication unit 211. Note that the communication method is not limited to wireless LAN, and includes, for example, infrared communication. The communication unit 211 is an example of a first wireless communication means.

[0047] The communication unit 212 is an interface for connecting to an external device. The control device 200 in this embodiment can exchange data with an external device via the communication unit 212. For example, image data generated by the digital camera 100 can be received via the communication unit 212. In this embodiment, the communication unit 212 includes an interface for communicating with an external device using Bluetooth®, which conforms to the IEEE 802.15.1 standard. The control unit 201 realizes wireless communication with the external device by controlling the communication unit 212. Note that the communication method is not limited to Bluetooth®, and includes, for example, wireless LAN known by the IEEE 802.11 standard, or infrared communication methods. Furthermore, the communication unit 212 is an example of a first wireless communication means.

[0048] The communication unit 213 is an interface for connecting to an external device. In this embodiment, the digital camera 100 can exchange data with an external device via the communication unit 112. For example, image data generated by the imaging unit 102 can be transmitted to an external device via the communication unit 112. In this embodiment, the communication unit 113 includes an interface for communicating with an external device via a wired LAN (Ethernet) in accordance with the IEEE 802.3 standard. The control unit 101 realizes communication with the external device by controlling the communication unit 112. Note that the communication method is not limited to a wired LAN, and includes, for example, a USB communication method. Furthermore, the communication unit 213 is an example of a first wired communication means.

[0049] In this embodiment, the communication unit 212 of the control device 200 has either peripheral mode or central mode. By operating the communication unit 212 in central mode, the control device 200 in this embodiment can operate as a Bluetooth (registered trademark) server device. When the control device 200 operates as a server device, it can communicate by connecting to an external device that is in peripheral mode. For authentication with the external device to be connected, the unique information of the external device to be connected is stored in the non-volatile memory 103 by performing pairing in advance.

[0050] The proximity wireless communication unit 214 consists of, for example, an antenna for wireless communication and a modulation / demodulation circuit and a communication controller for processing the wireless signal. The proximity wireless communication unit 214 outputs a modulated wireless signal from the antenna. The proximity wireless communication unit 214 then demodulates the wireless signal received by the antenna to realize contactless proximity communication in accordance with the ISO / IEC 18092 standard (so-called NFC: Near Field Communication). In this embodiment, the proximity wireless communication unit 214 is located on the side of the digital camera 100.

[0051] Furthermore, in the following description, the control device 200 may be described as if it were the main unit of processing. However, in reality, the control unit 201 reads the application (or application functions, or the OS or OS services, etc.) program deployed in the working memory 204 and implements various processes.

[0052] <System Configuration> Next, the system configuration diagram for this embodiment will be described.

[0053] Figure 3 is a system configuration diagram showing a configuration of multiple digital cameras 100 and a control device 200, where the control device 200 and the multiple digital cameras 100 are connected via a network device 300 and remotely controlled.

[0054] The digital camera 100 is mounted on a tripod 303 or the like and positioned at each shooting location. In this embodiment, the digital camera 100 is mounted on a tripod 303, but it may also be mounted on a remote pan / tilt / zoom head that allows for remote control of pan, tilt, and zoom.

[0055] As an example of connection configurations for communication between the digital camera 100 and the control device 200, the digital camera 100 may communicate with the control device 200 via wireless communication using radio waves 302 through the communication unit 112, relaying the communication to the network device 300. Furthermore, it may communicate with the control device 200 via the network device 300 using a wired LAN cable 301 through the communication unit 113.

[0056] Furthermore, the control device 200 may communicate with the digital camera 100 via wireless communication using radio waves 302 through the communication unit 212, relaying the network equipment 300. In addition, it may communicate with the digital camera 100 via the network equipment 300 through a wired LAN cable 301 via the communication unit 213.

[0057] In this embodiment, an example of communication via network device 300 is shown, but the digital camera 100 and the control device 200 may also be directly connected.

[0058] As shown in Figure 3, when multiple installed digital cameras 100 and the control device 200 are in a state where they can communicate with each other, the control device 200 can obtain the setting information of each digital camera 100 and issue commands to change the settings of each digital camera 100.

[0059] In particular, the control device 200 transmits a command (hereinafter referred to as the "AF frame position movement command") to each digital camera 100 requesting that the position of the AF frame of the digital camera 100 be moved to a specified coordinate. It is then possible to control the movement of the AF frame position of the digital camera 100 (hereinafter referred to as "AF frame position movement control"). The digital camera 100 changes the position of the AF frame not only in response to instructions from the control unit 101 via the operation unit 105 described above, but also in response to the AF frame position movement command received from the control device 200.

[0060] Furthermore, it is possible to issue shooting commands and corresponding commands regarding focus drive, allowing for remote shooting instructions.

[0061] This configuration makes it possible to control the shooting of multiple digital cameras 100 from the control device 200 (hereinafter referred to as "multi-remote shooting").

[0062] <Multi-remote shooting at events such as press conferences> Next, in this embodiment, using filming at a press conference venue as an example, we will show the subject composition and filming conditions when performing multi-remote filming with multiple digital cameras 100 installed in the venue.

[0063] Figure 4 shows the configuration for setting up multiple digital cameras 100 in a multi-remote shooting setup at a press conference venue.

[0064] As shown in Figure 4(a), in a scene at the press conference venue 400 with two speakers 401 who are the subjects of the photograph, speakers 401 mainly sit near the podium 403 on the stage 402 and give speeches or engage in dialogue. However, their positions on the stage 402 are often changed. For example, Figure 4(a) shows an example where one speaker 401 moves away from the podium 403 to the center of the stage 402 for the purpose of filming. Other possibilities include speakers 401 communicating with each other by shaking hands, or presenting awards or documents.

[0065] As shown in Figure 4(b), when photographing a scene in such a press conference venue 400, the main camera is first positioned in a location where it is expected to be able to take stable and good photographs. For example, the first digital camera 410 is positioned in front of the press seats 404 where the journalists are seated, with a composition that captures the two speakers 401 from the front.

[0066] However, with only the first digital camera 410, there are cases where the decisive moment cannot be captured because the press members 405 in the press seats 404 come and go and appear in the camera's frame, or even overlap with the subject. To ensure that a photograph is always taken even in such cases, a second digital camera 411 is placed next to the first digital camera 410, in a composition that captures the two speakers 401 almost head-on. The angles and distances to the speakers 401 are similar for the first digital camera 410 and the second digital camera 411, so the compositions are similar, but the second digital camera 411 can capture the decisive moment more reliably.

[0067] Furthermore, when speakers 401 answer questions from the press seating area 404, they often turn their faces and bodies to face the reporters asking the questions. In such cases, it is desirable to photograph speakers 401 from an angled position to obtain a better composition. Therefore, we consider a scenario where the third digital camera 412 is positioned to the left of the press seating area 404 where the press 405 are seated, capturing both speakers 401 from an angled left-hand angle. In this embodiment, the camera is positioned only on the left side of the press seating area 404, but if the number of digital cameras is increased further, it is possible to add another digital camera 100 to the right side in a similar configuration.

[0068] Next, we will explain the control screen for multi-remote shooting as presented in this proposal.

[0069] <Multi-remote shooting control screen> Figure 5 shows a screen configuration for multi-remote shooting, connecting three digital cameras 100 and a control device 200.

[0070] Figure 5(a) shows the multi-remote shooting screen 500.

[0071] The multi-remote shooting screen 500 is arranged with individual digital cameras 100 and individual camera control members 501 that control shooting settings, focus commands, and shooting from the connected control device 200. Furthermore, individual camera control members 502 are arranged to control a second and third digital camera 100 connected to the control device 200. In addition, a multi-camera control member 503 is arranged to control multiple digital cameras 100 at once (hereinafter, the control of multiple cameras will be referred to as "multi-camera control").

[0072] When the connection settings for the digital camera 100 are registered with the control device 200, the first individual camera control member 501 is added to the main camera display member 504, and the second and subsequent individual camera control members 502 are added to the sub-camera display member 505. The first individual camera control member 501 added to the main camera display member 504 and the second and subsequent individual camera control members 502 added to the sub-camera display member 505 differ in size and arrangement. In particular, the live view display operation member 520, described later, is displayed larger for the first individual camera control member 501 and smaller for the second and subsequent individual camera control members 502 compared to the first individual camera control member 501. However, the first individual camera control member 501 and the second and subsequent individual camera control members 502 are assumed to have the same function. Furthermore, if there are many digital cameras connected and the individual camera control members 502 do not fit on the sub-camera display member 505, the scroll member 508 can be used to scroll and display the individual camera control members 502 that are not currently displayed on the screen.

[0073] Furthermore, in the case of multi-remote shooting at the press conference venue 400 in Figure 4, a first digital camera 410, which is expected to be able to take stable and good photographs, is added to the main camera display member 504. Then, it is assumed that a second digital camera 411 and a third digital camera 412 are added to the sub-camera display member 505. Hereafter, the digital camera 100 corresponding to the first individual camera control member 501 added to the main camera display member 504 will be referred to as the "main camera." Also, the digital cameras 100 corresponding to the second and subsequent individual camera control members 502 added to the sub-camera display member 504 will be collectively referred to as "sub-cameras."

[0074] <Configuration of individual camera control components> Figure 5(b) shows the configuration of the individual camera control member 501.

[0075] The individual camera control member 501 consists of an operating member 510 for controlling the connection status with the digital camera 100, a display member 511 for indicating the power status and recording member status of the digital camera 100, and a name display member 512 for identifying individual cameras and shooting groups. Furthermore, it consists of an operating member 513 for controlling the autofocus of the individual digital camera 100, a display member 514 for indicating the network address of the digital camera 100, and a setting member 515 for making various settings for individual camera control. Furthermore, it consists of a group of members 516 for displaying and controlling the shooting settings of the digital camera 100, and an operating member 517 for remote shooting of the individual digital camera 100. Furthermore, it consists of a display member 518 for indicating the remaining number of shots and the number of shots taken by the digital camera 100, and a member 519 for controlling the live view display of the digital camera 100. Furthermore, it consists of a live view display operating member 520 for displaying the live view image (also called an LV image) of the digital camera 100, and an AF frame display member 521 for indicating the AF frame of the digital camera 100.

[0076] Furthermore, the AF frame display operation member 521 is displayed superimposed on the live view display operation member 520. This allows the live view display operation member 520 and the AF frame display member 521 to be displayed in a format similar to the display of the live view image and AF frame on the display unit 106 when taking a picture with the digital camera 100.

[0077] Furthermore, the AF frame display member 521 switches the display format according to the current AF frame selection mode of the digital camera 100. When the AF frame selection mode is 1-point AF, as shown in Figure 5(c), the AF frame display member 521 displays the AF frame set by the user using a rectangular frame 522. On the other hand, in the case of multi-point AF, the AF frame display member 521 displays multiple AF frames selected by the user in a visible manner. For example, in the case of zone AF, as shown in Figure 5(d), the zone containing multiple AF frames is displayed as a region 523 enclosed in brackets `` to make it visible. Other display methods for multi-point AF include displaying the selected multiple AF frames using multiple rectangular frames, but the present invention is not limited to these.

[0078] Furthermore, the user controls the movement of the AF frame position of the digital camera, as indicated by the AF frame display member 521, by operating the live view display operation member 520. For example, as shown in Figure 5(e), when the control device 200 detects that the live view display operation member 520 has been touched by the user's finger 524, it sends an AF frame position movement command. Specifically, the coordinates in the coordinate system on the live view image corresponding to the position where the touch operation was detected are calculated for the digital camera 100 corresponding to the individual camera control member 501 or 502 of the live view display operation member 520 that detected the touch operation. Then, an AF frame position movement command is sent. Subsequently, the digital camera 100 changes the position of the AF frame in accordance with the AF frame position movement command received from the control device 200. As a result, the display position of the AF frame shown on the AF frame display member 521 of the control device 200 moves to the position where the user touched the camera.

[0079] Note that the form of the display operation member in the multi-remote shooting shown in this embodiment is just one example, and may be modified or changed as appropriate.

[0080] <Configuration of the multi-camera control component> Figure 5(f) shows the configuration of the multi-camera control member 503.

[0081] The multi-camera control component 503 consists of components that issue commands to multiple digital cameras 100 at once. Specifically, the multi-camera control component 503 consists of an operating component 531 that sets and controls shooting parameter settings at once, and an operating component 532 that performs multi-remote shooting control. Furthermore, it consists of an operating component 533 that performs autofocus control to multiple digital cameras 100 at once, and an operating component 534 that selects and displays the group to which the digital cameras to which the instruction commands from the control components 531, 532, and 533 belong. It also consists of an operating component 535 that has the function of activating a screen for performing various other settings that span multiple digital cameras 100.

[0082] <Individual camera registration settings screen> Figure 5(g) shows the individual camera registration settings screen 540, which allows for individual camera registration settings, starting with the connection to the digital camera 100.

[0083] The individual camera registration settings screen 540 consists of an operating component 541 for setting the IP address of the digital camera 100, and an operating component 542 for checking whether the digital camera 100 is on the network by sending a PING command from the control device 200. Furthermore, it consists of an operating component 543 for setting the port number of the digital camera 100, an operating component 544 for setting the username for logging into the digital camera 100, and an operating component 545 for setting the password. In addition, it consists of an operating component 546 for setting which group the digital camera 100 belongs to, an operating component 547 for canceling the setting, and an operating component 548 for confirming the setting.

[0084] The above is a description of the control screen for multi-remote shooting.

[0085] <System Challenges> However, in the case of controlling the movement of the AF frame position of multiple digital cameras 100 connected from the control device 200 in the system according to this embodiment, there is a problem that a time-consuming operation is required.

[0086] For example, consider a scenario in the press conference venue 400 shown in Figure 4, where speaker 401 was seated at the podium 403 and then moved away from the podium 403 to the center of the stage 402. Assume that the photographer set the AF frame positions of multiple digital cameras 100 to be near the podium 403 on the live view image in order to take a photograph of speaker 401. In this case, as speaker 401 moves as described above, it would be desirable to immediately move the AF frame positions of the multiple digital cameras 100 to the area around speaker 401's face, now that they have moved to the center of the stage 402.

[0087] However, in the system according to this embodiment, in order to control the movement of the AF frame positions of multiple digital cameras 100, it is necessary to repeat the touch operation multiple times. Specifically, it is necessary to repeat the touch operation on the live view display operation member 520 of each individual camera control member 501 or 502 of the control device 200 as many times as there are digital cameras 100. As a result, it incurs extra effort and time costs for the photographer. Furthermore, there is a problem that the photographer's preparation for shooting may be delayed during this time, potentially causing the photographer to miss a photo opportunity.

[0088] <Features of the control device 200 related to this disclosure> Therefore, in this embodiment, ingenuity is employed in controlling the movement of the AF frame positions of multiple digital cameras 100 connected to the control device 200.

[0089] This section describes the case when the control device 200 detects a touch operation on the live view display operation member 520 of either individual camera control member 501 or 502. In this case, the control device 200 sends an AF frame position movement command (also called movement instruction information) to the first digital camera 100 corresponding to the live view display operation member 520 that detected the touch operation, specifying the coordinates on the live view image corresponding to the position where the touch operation was detected. Furthermore, it also sends an AF frame position movement command to any number of other digital cameras 100 connected to the control device 200, specifying the destination coordinates based on the destination coordinates of the first digital camera 100. Here, the destination coordinates of the first digital camera 100 are an example of the first coordinate information. The destination coordinates calculated based on the destination coordinates of the first digital camera 100 (i.e., the destination coordinates of any number of other digital cameras 100) are an example of the second coordinate information.

[0090] This allows users to control the movement of the AF frame positions of multiple digital cameras 100 with a single touch operation.

[0091] The operation of the control device 200 and the digital camera 100 for solving the problems realized in the first embodiment will be described below.

[0092] Figure 6 shows an example of the operation processing performed by the control device 200 in this embodiment when multiple digital cameras 100 are being used for multi-remote shooting. The operation processing here includes the operation processing to display the live view images of the multiple digital cameras 100 on the multi-remote shooting screen. Furthermore, it includes the operation of controlling the movement of the AF frame positions of the multiple digital cameras 100.

[0093] Figure 6(a) shows a series of operations from when the control device 200 establishes a connection with multiple digital cameras 100 until the connection is terminated.

[0094] This series of operations begins when the control device 200 is activated.

[0095] In S600, the control device 200 registers the connection settings for the multiple digital cameras 100 to be connected, and then proceeds to S601.

[0096] In S601, the control device 200 detects the digital camera 100, determines whether or not it has been detected, proceeds to S602 if it has been detected, and repeats S601 if it has not been detected.

[0097] In S602, the control device 200 determines whether a connection request has been made by the user. If it determines that a connection request has been made, it proceeds to S603. If it determines that there is no connection request, it repeats S602.

[0098] In S603, the control device 200 performs a connection process with the detected digital camera 100 to establish a connection with the digital camera 100, and then proceeds to S604.

[0099] In S604, the system determines whether there are no additional digital cameras 100 registered for connection in S600, and whether remote shooting and multi-remote shooting can be started. If it is possible to start, the system proceeds to S605. If it determines that there are still multiple digital cameras 100 connected, the system returns to S601.

[0100] In S605, the multi-remote shooting screen is displayed, and then proceed to S606.

[0101] In S606, the control device 200 performs the multi-live view image display processing shown in Figure 4(b), and then proceeds to S607.

[0102] In step S607, the system determines that the connection with multiple digital cameras 100 has been completed and that the user has completed multi-remote shooting. If completion is determined, this series of operations is terminated. If completion is not determined, the system returns to step S607.

[0103] Figure 6(b) shows the series of operations of the multi-live view image display processing performed by the control device 200 for multiple digital cameras 100 in S606 of Figure 6(a). Note that this series of operations begins when the control device 200 displays the multi-remote shooting screen in S605.

[0104] In S610, the system determines whether or not the digital camera 100, which is registered with the control unit 200, is connected. If it is determined that it is connected, the system proceeds to S611. If it is determined that it is not connected, the system proceeds to S616, as there is no need to display the live view image on the multi-remote shooting screen.

[0105] In S611, it is checked whether the component 519 that controls the live view display is pressed or not. If it is pressed, the process proceeds to S612. If it is not pressed, there is no need to display the live view image on the multi-remote shooting screen, so the process proceeds to S616.

[0106] In S612, a command is sent to the digital camera 100 requesting a live view image (hereinafter referred to as the live view image request command), and the process proceeds to S613.

[0107] In step S613, the system receives the live view image from the digital camera 100 and proceeds to step S614.

[0108] In S614, the AF frame information, described later, is read from the additional information of the live view image received from the digital camera 100. Then, the process proceeds to S615.

[0109] In step S615, the live view image received from the digital camera 100 in step S613 is displayed on the live view display operating member 520, and based on the AF frame information read out in step S614, the AF frame is displayed on the AF frame display member 521. Then the process proceeds to step S615.

[0110] In S616, it is determined whether the live view image display processing described in S610~S615 has been completed for all digital cameras 100 displayed on the multi-remote shooting screen 500. If it has been completed, this series of operations is terminated. If it has not been completed and there is still live view image display processing remaining for multiple digital cameras 100, the process returns to S610.

[0111] Figure 6(c) shows a series of operations performed by the control device 200 when it controls the movement of the AF frame position for multiple digital cameras 100. This series of operations is initiated when a touch operation is detected on a predetermined component on the multi-remote shooting screen 500 in Figure 5, where the live view image is displayed by the multi-live view image display processing in Figure 6(a). The predetermined component here includes the live view display operation component 520 of the main camera's individual camera control component 501 or the live view display operation component 520 of the sub-camera's individual camera control component 502. Hereafter, the digital camera 100 corresponding to the live view display operation component 520 that detected the touch operation will be referred to as the "camera being operated," and other digital cameras 100 that are displaying live view images will be referred to as "cameras not being operated."

[0112] In S620, the control device 200 detects a touch operation on the camera being operated and calculates the coordinates in the coordinate system of the live view image corresponding to the touch operation detection position on the live view display operating member 520 as the destination coordinates of the AF frame. Then, the process proceeds to S621. The touch operation detection position on the live view display operating member 520 is the position coordinates of the live view display operating member 520 in the X-axis and Y-axis directions. The destination coordinates of the AF frame may hereafter be referred to as "destination coordinates".

[0113] In S621, the control device 200 sends an AF frame position movement command to the camera being operated, instructing it to move to the destination coordinates calculated in S620, and then proceeds to S622.

[0114] In S622, the control device 200 determines whether to perform movement control of the AF frame position (hereinafter referred to as "AF frame linked movement control") on the non-operating camera based on the touch operation on the operating camera, based on a predetermined condition. The predetermined condition in the determination of S622 may be determined by the program of the application developed in the working memory 204 of the control device 200. Further, the predetermined condition may be stored in the non-volatile memory 203, the working memory 204, or the recording medium 210 as a variable that can be set by the user by some means. Further, as the predetermined condition, it may be a fixed condition that is always true, that is, always performs AF frame linked movement control, or a condition in which the determination is switched according to various settings of the application and combinations thereof.

[0115] In this embodiment, a form of making a determination based on a condition based on the setting state set by the user on the setting screen for AF frame linked movement control is shown. Here, the setting screen for AF frame linked movement control will be described using FIG. 7.

[0116] <Setting screen for AF frame linked movement control> FIG. 7 shows a screen configuration for setting a predetermined condition for determining whether to perform AF frame linked movement control in S622 of FIG. 6(c). By operating the operation member 535 of the multi-camera control member 503 shown in FIG. 5, the setting screen 700 for AF frame linked movement control is transitioned to.

[0117] The setting screen 700 for AF frame linked movement control has an AF frame linked movement activation setting area 701 for setting the activation of AF frame linked movement control, and has an AF frame linked movement activation selection member 702 for selecting whether to enable AF frame linked movement.

[0118] Furthermore, when the AF frame linkage movement activation selection member 702 is set to "enabled," various additional conditions can be assumed as conditions for the decision in S622. For example, there is an AF frame linkage movement activation target camera setting area 703 for setting which type of camera being operated triggers the AF frame linkage movement control. There is also an AF frame linkage movement activation target camera selection member 704 for selecting the type of camera being operated to which the AF frame linkage movement will be activated. In this embodiment, the method for selecting the type of camera being operated is such that the user can choose from "all cameras (main camera and sub-camera)," "main camera only," or "sub-camera only," but the selection method is not limited to these.

[0119] Furthermore, for each type of camera selected by the AF frame linkage movement activation target camera selection member 704, there is an operating member for setting the type of operation to activate AF frame linkage movement. First, there is a main camera AF frame linkage movement activation operation setting area 705 and a main camera AF frame linkage movement activation operation selection member 706 for setting the type of operation to activate AF frame linkage movement when the camera being operated is the main camera. Also, there is a sub-camera AF frame linkage movement activation operation setting area 707 and a sub-camera AF frame linkage movement activation operation selection member 708 for setting the type of operation to activate AF frame linkage movement when the camera being operated is a sub-camera.

[0120] In this embodiment, the method for selecting the type of operation is such that the user can choose between "simple operation" and "complex operation". The definitions of "simple operation" and "complex operation" are explained below. For example, if the control device 200 detects a touch operation and the time from touch-down to touch-up is shorter than a predetermined time, it may be classified as a "simple operation". Alternatively, if the time from touch-down to touch-up is longer than a predetermined time, it may be classified as a "complex operation". Or, the number of fingers or pens that touched the touch panel when the touch operation was performed, that is, the number of points on the touch panel where the control device 200 detected the touch operation, may be classified as a "simple operation" if it is 1 point, and as a "complex operation" if it is 2 or more points. Furthermore, if the control device 200 detects a touch operation and the number of touch-downs is 1, it may be classified as a "simple operation", and if it is 2, it may be classified as a "complex operation". As such, various ways of defining "simple operation" and "complex operation" are possible, but the present invention is not limited to these. Furthermore, the method for selecting the AF frame linked movement activation operation is not limited to the "simple operation" and "complex operation" selection methods.

[0121] Furthermore, the control device 200 consists of an operating member 709 for canceling the settings on the AF frame linked movement control setting screen 700, and an operating member 710 for confirming the settings. When the operating member 710 for confirming the settings is operated, the control device 200 records the setting state selected by each selection member on the AF frame linked movement control setting screen 700 described above.

[0122] The above is an explanation of the settings screen for AF frame position movement control.

[0123] Returning to the explanation of Figure 6.

[0124] In S622, it is determined whether or not to perform linked movement of the AF frame position of digital cameras that have not detected a touch. Specifically, it is assumed that the determination is made based on conditions based on the settings of the AF frame linked movement control setting screen shown in Figure 7. The first condition is that the enabled or disabled state selected in the AF frame linked movement enablement selection member 702 is enabled. The second condition is that the type of camera currently being operated is included in the type of camera selected in the AF frame linked movement activation target camera selection member 704. The third condition is that the type of touch operation at the start of this flow is the operation method selected in the AF frame linked movement activation operation selection member 706 or 708. If all of the first to third conditions are met, the process proceeds to S623 to perform AF frame linked movement control. If even one of the conditions is not met, there is no need to perform AF frame linked movement, and this series of processes is terminated.

[0125] In S623, the control device 200 sends an AF frame position movement command to the non-operating camera, instructing it to move to coordinates equivalent to the destination coordinates calculated in S620, and proceeds to S624. If the size and aspect ratio of the live view images of the operating camera and the non-operating camera are different, a conversion process may be performed. Here, information regarding the size and aspect ratio of the live view images is just one example of size information. Specifically, the coordinates may be converted from the coordinate system of the operating camera's live view image to the coordinate system of the non-operating camera's live view image through scaling or aspect ratio conversion, thereby making them equivalent to the destination coordinates of the operating camera.

[0126] In S624, it is determined whether the AF frame linkage movement control described in S623-S624 has been completed for all inactive cameras. If it has been completed, this series of operations ends. If it has not been completed and there are still AF frame linkage movement controls remaining for multiple inactive cameras, the process returns to S623.

[0127] The above describes the series of operations performed by the control device 200 when it controls the movement of the AF frame position for multiple digital cameras 100 in the first embodiment, from the time the control device 200 performs the operations until it is completed.

[0128] In the embodiment described above, a method was shown in which AF frame linked movement control is performed on all cameras that are not currently being operated. However, it is also possible to configure the system to perform AF frame linked movement control only on cameras that are not currently being operated and belong to the same group as the main camera. That is, in S623 of Figure 6, it is possible to determine whether the group name shown on the name display member 512 of the camera being operated is the same as the group name shown on the name display member 512 of the camera that is not being operated. Then, if they belong to the same group, an AF frame position movement command is sent, and if they belong to different groups, the system proceeds to S624 without sending an AF frame position movement command.

[0129] Figure 8 shows an example of the operation processing performed by the digital cameras 100 when multiple digital cameras 100 are used for multi-remote shooting in the control device 200 in this embodiment. The operation processing here includes the process of displaying the live view images of multiple digital cameras 100 on the multi-remote shooting screen. Furthermore, it includes operation processing for controlling the movement of the AF frame positions of the multiple digital cameras 100.

[0130] Figure 8 shows a series of operations from the time the digital camera 100 establishes a connection with the control device 200 until the operation is completed. This series of operations begins with the digital camera 100 positioned in the shooting position.

[0131] In step S800, the user turns on the digital camera 100, and once the digital camera 100 is powered up and ready to start shooting, the process proceeds to step S801.

[0132] In S801, network settings are configured to connect to the control device 200, and the process proceeds to S802.

[0133] In S802, the network settings are enabled, and the system waits for a connection with the control unit 200 before proceeding to S803.

[0134] In S803, it is determined whether or not a connection request has been received from the control device 200. If a connection request has been received, the connection process is performed. After that, it is determined whether or not a connection has been established with the control device 200. If a connection has been established with the control device, the process proceeds to S804.

[0135] In S804, the digital camera 100 determines whether or not a live view image request command has been received from the control device 200. If a live view image request command has been received, the process proceeds to S805. If no live view image request command has been received, S804 is repeated to check for a live view image request command from the control device 200 again.

[0136] In S805, the digital camera 100 generates a live view image from the image data captured by the imaging unit 102, which is stored in the working memory 104, and then proceeds to S806.

[0137] In the S806, the digital camera 100 generates AF frame information as additional information related to the live view image.

[0138] AF frame information refers to information regarding the display of the AF frame when the AF frame information is superimposed on the live view image. As an example of AF frame information in this embodiment, it includes at least information indicating the position and size of the AF frame (position and size information), which is indicated by the coordinate positions of the X and Y axes in the coordinate system of the live view image. Furthermore, it may also include information indicating whether or not the subject is in focus (focus / out of focus information) and information indicating the current AF frame selection mode. The control device 200 reads and refers to the AF frame information from the live view image and displays the AF frame superimposed on the live view image. This makes it possible to display an image similar to the live view image and AF frame display on the display unit 106 when shooting with the digital camera 100, which can improve the user's operability during remote shooting.

[0139] In S807, the imaging device 100 transmits the live view image generated in S805 to the control device 200 along with additional information including AF frame information generated in S806.

[0140] In S808, it is determined whether or not an AF frame position movement command has been issued from the control device 200. If an AF frame position movement command has been issued, the process proceeds to S809. If no AF frame position movement command has been issued, the process proceeds to S810.

[0141] In S809, the destination coordinates indicated in the AF frame position movement command received from the control device 200 in S808 are read, and the AF frame is moved to the destination coordinates. This allows the control unit 101 to issue an instruction to change the position of the AF frame on the viewfinder screen displayed on the display unit 106, similar to user operation via the operation unit 105. As mentioned earlier, the display position of the AF frame corresponds to the focus detection area, so the focus detection area is also changed along with the change in the AF frame position.

[0142] In S810, the digital camera 100 determines whether it has completed connections with all control devices 200 that it established connections with in S803. If it determines that it has completed connections, it terminates this series of operations. If it has not completed connections, it returns to S803. Note that if the AF frame position is moved in S809, the determination in S810 returns to S803. Next, in S807, the live view image and AF frame information after the AF frame movement may be sent to the control device 200 again. In this case, it is possible to send the AF frame information after the AF frame position movement in S809 to the control device 200.

[0143] The above is an example of a series of operation processes performed by the digital camera 100 when multiple digital cameras 100 are used for multi-remote shooting by the control device 200 in the first embodiment.

[0144] In the embodiment described above, the AF frame linked movement control only involves moving the AF frame position for a camera that is not being operated. However, in addition to moving the AF frame position for a camera that is not being operated, the system may also perform additional control to change the AF selection mode to one that specifies a wider AF frame if the AF frame in the AF frame selection mode of the camera that is not being operated is narrow. For example, after sending the command to move the AF frame position to the camera that is not being operated in S623 of Figure 6(c), the system may determine whether the current AF frame selection mode of the digital camera 100 is 1-point AF or not. If it is 1-point AF, the control device 200 may send a command to the digital camera 100 to change the AF frame selection mode to multi-point AF. By additionally implementing the process of changing the AF frame selection mode of the camera that is not being operated, even if the angle of view of the camera being operated and the camera that is not being operated are slightly different, that is, even if the position of the subject on the live view image of the camera that is not being operated is slightly different from the position of the subject on the live view image of the camera that is being operated, the subject can still be placed within the AF frame area of ​​the camera that is not being operated in the AF frame linked movement control.

[0145] Furthermore, in AF frame linked movement control, an additional highlighting process may be implemented to display the movement of the AF frame position of a camera that is not being operated in a different way than the display for the camera being operated. For example, after performing the AF frame linked movement control in Figure 6(c), when the AF frame is displayed on the AF frame display member 521 in S615 in Figure 6(b), a method can be considered in which only the AF frame of the camera that is not being operated is blinked for a certain period of time. Furthermore, a method can be considered in which the AF frame position before the movement is also displayed in a way that can be distinguished from the AF frame after the movement by drawing color or the like during that period of time. This highlighting process has the advantage of making it easier for the user to see that the AF frame of a camera that is not being operated has also moved.

[0146] [Second Embodiment] In the first embodiment described above, a method was shown in which the AF frames of the camera being operated and the camera not being operated are moved to equivalent coordinates on the live view image by AF frame linked movement control.

[0147] Therefore, for example, in the press conference venue 400 shown in Figure 4, when controlling the linked movement of the AF frame between digital cameras 100 where the angle, distance to the subject, and composition are similar, it is expected that the subject will be brought within the AF frame area even with the camera that is not being operated. Note that this assumes that the first digital camera 410 is the camera being operated and the second digital camera 411 is the camera that is not being operated.

[0148] However, the angle and distance to the subject differ between the third digital camera 100 and the first digital camera 410. Furthermore, if a digital camera 100 with a different composition is used as the camera that is not being operated, it may not be possible to expect the subject to be placed within the AF frame area with the camera that is not being operated.

[0149] Therefore, in the second embodiment, the control device 200 may have a subject detection process so that when the AF frame of the camera being operated is moved, a subject is detected from the area around the position of the AF frame on the live view image of the camera being operated. The configuration described below moves the position of the AF frame of the camera not being operated to a position where the same subject as the subject on the live view image of the camera not being operated is detected.

[0150] Note that components similar to those in the first embodiment described above are denoted by the same reference numerals, and their descriptions are omitted or simplified. In this case, only the subject detection process of the control device 200 and a portion of the operation of the process performed by the control device 200 shown in Figure 6(c) differ, so only these differing parts will be described.

[0151] The object detection processing of the control device 200 includes detection processing of feature regions (for example, faces and bodies of living things such as people and animals, or vehicles, etc.), as well as recognition processing of specific people or animals registered in the control device 200.

[0152] For example, in face detection processing, subject information (size, position, and reliability of the face of a person in the captured image) is detected by applying detection processing to the image signal. As for face recognition processing, for example, a method is known in which skin-color regions are extracted from the grayscale color of each pixel represented by image data, and faces are detected by the degree of matching with a pre-prepared face contour plate. There are also methods that use well-known pattern recognition techniques to extract facial feature points such as eyes, noses, and mouths to detect faces, but the present invention is not limited to faces or any other subject, and any method may be used for recognition processing.

[0153] Figure 9 shows a series of operations performed by the control device 200 when it controls the movement of the AF frame position for multiple digital cameras 100 in the second embodiment. Figure 9(a) corresponds to the part shown in Figure 6(c) in the first embodiment.

[0154] If it is determined in S622 to perform AF frame linked movement control, the process proceeds to S900.

[0155] In the S900, the control device 200 performs subject detection processing on a predetermined detection target area in the live view image displayed on the live view display operating member 520 of the camera during operation, which has detected a touch operation.

[0156] One way to define the detection target area is to define it as an area within a predetermined interval with the destination coordinates calculated in S620 as the center coordinate. This predetermined interval may be a fixed value determined by the application program deployed in the working memory 204 of the control device 200. Alternatively, it may be a variable that can be set by the user by some means and stored in the non-volatile memory 203, working memory 204, or recording medium 210.

[0157] Furthermore, let's explain another example of defining the detection target area. For example, before performing the subject detection processing in the S900 shown in Figure 6(b), the system waits for the live view image and AF frame update processing in the multi-live view image display processing to be completed. Then, a method can be considered that uses the position, width, and height of the AF frame after movement by the AF frame position movement command in S621 as the basis. As such, various definitions of the detection target area are possible, but the present invention is not limited to these.

[0158] Furthermore, in S900, after performing the subject detection process, the detected subject is newly registered as a target for detection in the next subject detection process of the control device 200 for processing in S902, which will be described later. If two or more subjects are detected in S900, the subject closest to the center coordinates of the detection target area is registered. Then, the process proceeds to S901.

[0159] In S901, if no subjects are detected as a result of the subject detection process in S900, this series of operations is terminated. If one or more subjects are detected, the process proceeds to S902.

[0160] In S902, subject detection processing is performed on the entire area of ​​the live view image displayed on the live view display operating element 520 of the camera when it is not being operated. The subject detected by the subject detection processing is the same subject as the subject registered in S900.

[0161] In S903, if no subject was detected as a result of the subject detection process in S902, the process proceeds to S624. If a subject is detected, the process proceeds to S904.

[0162] In S904, based on the subject detection process in S902, the coordinates of the detected subject on the live view image of the camera (which is not being operated) are calculated as the destination coordinates, and the process proceeds to S623.

[0163] In S623, the control device 200 sends an AF frame position movement command to the camera that is not currently being operated, instructing it to move to the destination coordinates calculated in S904, and then proceeds to S624.

[0164] In S624, the system determines whether AF frame linked movement control has been completed for all inactive cameras. If it has been completed, this series of operations ends. If it has not been completed and AF frame linked movement control remains for multiple inactive cameras, the system returns to S902.

[0165] The above describes the series of operations performed by the control device 200 when it controls the movement of the AF frame position for multiple digital cameras 100 in the second embodiment. Through the above-described operations, even if the composition of the camera being operated and the camera not being operated are different, and the positions of the subjects on the live view images are not similar, the camera not being operated can be moved to a position where the subject is within the area of ​​the AF frame.

[0166] In the embodiment described above, if no subjects are detected in the live view image of the camera being operated in S900, the AF frame is not moved to any of the inactive cameras. However, in combination with the first embodiment, if no subjects are detected in the live view image of the camera being operated in S901, the processing in S623 to S624 in Figure 6(c) may be performed. Then, an AF frame position movement command is sent to all inactive cameras instructing them to move to coordinates equivalent to the destination coordinates of the camera being operated, calculated in S620, before ending this series of operations.

[0167] Furthermore, in the embodiment described above, if no subjects are detected in the subject detection process on the live view image of the non-operating camera in S902, the AF frame is not moved to the non-operating camera. However, in combination with the first embodiment, there may be cases in S903 where no subjects are detected on the live view image of the non-operating camera. In this case, the non-operating camera may be instructed to move to coordinates equivalent to the destination coordinates of the operating camera, calculated in S620, before proceeding to S624.

[0168] [Third Embodiment] In the second embodiment described above, the control device 200 has a subject detection process in the AF frame linked movement control. It detects a subject from the area around the AF frame position on the live view image of the camera being operated. Subsequently, the configuration shows that the position of the AF frame of the camera not being operated is moved to the position where the same subject as the subject detected on the live view image of the camera not being operated is located.

[0169] However, in situations where the subject is constantly moving, the subject will immediately move out of the AF frame's area after the AF frame has been moved. Therefore, the digital camera 100 may have a detection means and a tracking means. As a result, the digital camera 100 may have a function to constantly move the AF frame to match the subject through a subject detection processing function and a tracking processing that tracks the detected subject.

[0170] Therefore, in the third embodiment, not only the control device 200 but also the digital camera 100 may have subject detection processing and move the AF frame through tracking processing. When the control device 200 moves the AF frame of the camera being operated, and the camera being operated starts tracking an arbitrary subject, a configuration is shown in which the camera not being operated also starts tracking the same subject as the camera being operated.

[0171] Note that components similar to those in the first and second embodiments described above are denoted by the same reference numerals, and their descriptions are omitted or simplified. In this case, only the subject detection processing and tracking processing of the digital camera 100, some of the operations of the processing performed by the digital camera 100 shown in Figure 8, and some of the operations of the processing performed by the control device 200 shown in Figure 9 differ, so only these differing parts will be described.

[0172] The subject detection processing implemented in the digital camera 100 in this embodiment is equivalent to the subject detection processing implemented in the control device 200 described in the second embodiment. That is, it includes the detection of feature regions (for example, faces and bodies of living things such as people and animals, or vehicles, etc.), and the recognition processing of specific people or animals registered in the digital camera 100. Furthermore, the present invention is not limited by the method of recognition processing for any subject, and any method may be used.

[0173] Furthermore, the tracking process installed in the digital camera 100 in this embodiment includes a process that continuously moves the AF frame so that the subject detected in the subject detection process is always kept within the area of ​​the AF frame.

[0174] Furthermore, the AF frame selection mode installed in the digital camera 100 in this embodiment can be set to a tracking AF mode, in addition to the single-point AF and multi-point AF modes shown in the first and second embodiments. As mentioned above, single-point AF and multi-point AF are AF selection modes in which the user selects an AF frame. However, in tracking AF mode, the user selects a subject of their choice from among the subjects detected in the subject detection process using the method described later. As a result, the digital camera 100 starts tracking the subject selected by the user.

[0175] Note that the AF frame selection mode is assumed to be pre-set to either single-point AF mode or multi-point / zone AF mode via the setting switches or shooting menu settings (not shown).

[0176] Furthermore, the method for changing the AF frame selection mode to tracking AF mode and for the user to select a subject in tracking AF mode involves operating the touch panel of the operation unit 105 as described above. Alternatively, when the AF frame is moved by an AF frame position movement command received from the control device 200, and a subject is detected at the new AF frame position, the system can quickly switch from single-point AF mode or multi-point / zone AF mode to tracking AF mode with a touch operation. The system can then track the detected subject.

[0177] Furthermore, in this embodiment, the AF frame information includes information (tracking information) indicating whether the digital camera 100 is tracking a subject, that is, whether the AF frame is continuously moving in accordance with the subject.

[0178] Figure 10 shows a series of operations performed by the digital cameras 100 when multiple digital cameras 100 are used for multi-remote shooting by the control device 200 in a third embodiment. The processing here includes the process of displaying the live view images of the multiple digital cameras 100 on the multi-remote shooting screen. Furthermore, it shows a series of operations performed by the digital cameras 100 when controlling the movement of the AF frame positions of the multiple digital cameras 100.

[0179] Figure 10 is the part corresponding to Figure 8 shown in the first embodiment.

[0180] In S808, it is determined whether or not an AF frame position movement command has been issued from the control device 200. If an AF frame position movement command has been issued, the process proceeds to S1000. If no AF frame position movement command has been issued, the process proceeds to S810.

[0181] In S1000, the destination coordinates indicated in the AF frame movement command received from the control device 200 in S808 are read. If the distance from the position indicated by the destination coordinates to the position of the subject detected by the subject detection process is less than a predetermined interval, it is assumed that the user has selected to track the subject, and the process proceeds to S1001. If the distance is greater than or equal to the predetermined interval, it is assumed that the user is attempting to change the position of the AF frame to the destination coordinates, and the process proceeds to S809. This predetermined interval is determined by a fixed value, etc., which is set by a program or the like stored in the non-volatile memory 103 of the digital camera 100.

[0182] On the S1001, change the AF frame selection mode to tracking AF mode.

[0183] In S1002, tracking of the selected subject is initiated at S1000, and the process proceeds to S810. As a result, the digital camera 100 continuously moves the AF frame to keep the detected subject within the AF frame's area at all times.

[0184] The above describes the series of operations performed by the digital camera 100 when the control device 200 enables multi-remote shooting of multiple digital cameras 100 in the third embodiment.

[0185] Figure 11 shows a series of operations performed by the control device 200 when it controls the movement of the AF frame position for multiple digital cameras 100 in the third embodiment.

[0186] Figure 11 is the part corresponding to Figure 9 shown in the second embodiment.

[0187] In S1100, it is determined whether the live view image and AF frame update process shown in Figure 6(b) has been performed in the multi-live view image display process after the transmission of the AF frame position movement command to the camera 100 in operation in S622. If an update has been performed, the process proceeds to S1101. If no update has been performed, S1100 is repeated to check the update process of the live view image and AF frame information again.

[0188] In S1101, AF frame information is read from the additional information of the live view image received from the camera being operated, and the tracking information stored in the AF frame information is used to determine whether the camera is tracking a subject. If it is determined that the subject is being tracked, the process proceeds to S900. If the camera is not tracking a subject, this series of operations is terminated.

[0189] In the S900, as in the second embodiment, subject detection processing is performed on the detection target area in the live view image of the camera during operation. However, the definition of the detection target area is determined based on the position and size information of the AF frame that was confirmed to be tracking in S1101.

[0190] The above describes the third embodiment, which is a series of operations performed by the control device 200 when it controls the movement of the AF frame position for multiple digital cameras 100. Through the above-described operations, even if the composition of the camera being operated and the camera not being operated are different, and the positions of the subjects on the live view images are not similar, the camera not being operated can be moved to a position where the subject is within the AF frame area. Furthermore, by starting the subject tracking process on both the camera being operated and the camera not being operated in response to the AF frame position movement command from the control device 200, the subject can always be kept within the AF area, even if the subject is constantly moving.

[0191] In the embodiment described above, if the camera being operated is not in tracking mode in S1101, the AF frame is not moved to any of the idle cameras. However, in combination with the first embodiment, if the camera being operated is not in tracking mode in S1101, the processing in S623 to S624 in Figure 6(c) may be performed. Alternatively, the system may be configured to send an AF frame position movement command to all idle cameras, instructing them to move to coordinates equivalent to the destination coordinates of the camera being operated, calculated in S620, before ending this series of operations.

[0192] Furthermore, in the second and third embodiments described above, a method was shown in which all idle cameras start tracking the same subject as the active camera in AF frame linked movement control. However, it is also possible to configure the system so that only idle cameras belonging to the same group as the main camera track the same subject as the active camera. Moreover, it is also possible to configure the system so that idle cameras belonging to a different group than the main camera track an arbitrary subject different from the active camera. That is, in S902 shown in Figure 9, it is possible to determine whether the group name shown on the name display member 512 of the active camera and the group name shown on the name display member 512 of the idle camera are the same. If they belong to the same group, the system may be configured to detect the same subject as the subject registered in S900 during the subject detection process. If they belong to different groups, the system may be configured to detect a different subject than the subject registered in S900.

[0193] [Differentiation] In the third embodiment described above, the control device 200 has a subject detection process to detect a subject from the area around the AF frame position on the live view image of the camera being operated. Then, tracking is started by sending an AF frame position movement command to the position where the same subject as the subject was detected on the live view image of the camera that is not being operated. However, it is also possible to have a configuration in which the control device 200 does not have a subject detection process function, and only the digital camera 100 side has a subject detection process function as shown in the third embodiment, and the digital camera 100 shares the results of the subject detection process with the control device 200.

[0194] For example, the digital camera 100 may be configured to include detection frame information as additional information to the live view image. The detection frame information includes information (position and size information) indicating the position and size of the subject detected by the subject detection process of the digital camera 100, and is indicated by the X-axis, Y-axis coordinate position, etc., in the coordinate system of the live view image. Furthermore, in the processing of the control device 200, at S902 in Figure 11, the destination coordinates are calculated from the live view image of the camera when it is not being operated by the subject detection process. It is also conceivable to have a different configuration instead of this one. For example, it is conceivable to have a configuration in which the detection frame information is read from the additional information of the live view image of the camera when it is not being operated, and the coordinates of the detection frame position closest to the position of the AF frame during subject tracking of the camera in operation, calculated at S900, are calculated as the destination coordinates.

[0195] Furthermore, as mentioned above, there are cases where only cameras that are not being operated and belong to the same group as the main camera are made to track the same subject as the camera being operated. In this case, in S902, it may be determined whether the group name indicated on the camera's name display member 512 is the same as the group name indicated on the name display member 512 of the camera that is not being operated. If they belong to the same group, it is conceivable that the system may be configured to calculate the destination coordinates as the position of the detection frame closest to the position of the AF frame of the camera being operated while it is tracking a subject. If they belong to different groups, it is conceivable that the system may be configured to calculate the destination coordinates as the position of any other detection frame.

[0196] Furthermore, in each of the embodiments described above, the multi-remote shooting screen 500 was shown to be divided into a main camera display member 504 and a sub-camera display member 505. The first individual camera control member 501 was added to the main camera display member 504, and the second and subsequent individual camera control members 502 were added to the sub-camera display member 505. In addition, the first individual camera control member 502 was shown to be displayed larger than the second individual camera control member 502, and the third individual camera control member 502 was shown to be displayed larger than the first individual camera control member 501.

[0197] However, the display configuration of the multi-remote screen 500 of the control device 200 is not limited to this. For example, the multi-remote screen 500 does not need to be divided into a main camera display member 504 and a sub-camera display member 505. Furthermore, a display configuration in which all individual camera control members 501 and live view display operation members 520 for all digital cameras 100 are arranged in the same configuration is also acceptable.

[0198] Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of its gist.

[0199] (Other embodiments) Furthermore, the present invention can also be realized by performing the following process: that is, supplying software (program) that realizes the functions of the above-described embodiment to a system or device via a network or various storage media, and having the computer (or control unit or MPU, etc.) of the system or device read and execute the program code. In this case, the program and the storage medium storing the program constitute the present invention.

[0200] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Some of the above embodiments may be combined as appropriate.

[0201] Furthermore, each functional unit in each of the above embodiments (each modified example) may or may not be individual hardware. The functions of two or more functional units may be implemented by common hardware. Each of the multiple functions of a single functional unit may be implemented by individual hardware. Two or more functions of a single functional unit may be implemented by common hardware. In addition, each functional unit may or may not be implemented by hardware such as an ASIC, FPGA, or DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. The functions of at least some of the functional units of the device may be implemented by the processor reading and executing the control program from the memory.

[0202] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0203] [Configuration 1] A control device that connects to multiple imaging devices via a network and remotely controls them, Acquisition means for acquiring LV images from each of the aforementioned plurality of imaging devices, A display means for displaying each LV image acquired by the acquisition means, Equipped with control means, The control means is When a touch is made on the first LV image displayed on the display means, movement instruction information for the AF frame, which is specified by first coordinate information corresponding to the touched position on the first LV image, is transmitted to the first imaging device corresponding to the first LV image. Movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information, is transmitted to a second imaging device different from the first imaging device. Control device.

[0204] [Configuration 2] The second coordinate information is the same coordinate information as the first coordinate information. The control device described in Configuration 1.

[0205] [Configuration 3] The second coordinate information is different from the first coordinate information. The control device described in Configuration 1.

[0206] [Structure 4] The control means is When the size information of the first LV image and the second LV image corresponding to the second imaging device are different, the second coordinate information is calculated by performing a transformation process on the first coordinate information. The control device described in configuration 3.

[0207] [Composition 5] A detection means for detecting a subject based on the position touched on the first LV image, Furthermore, The control means is The coordinates where the subject detected by the detection means is located are designated as the first coordinate information. The control device described in Configuration 1.

[0208] [Composition 6] The detection means is Based on the information of the subject detected based on the first coordinate information, the same subject is detected on the LV image of the second imaging device. The second coordinate information specifies the coordinates where the same subject exists as the second coordinate information. The control device described in configuration 5.

[0209] [Composition 7] The detection means is The system detects the subject closest to the touched position on the first LV image. The control device according to claim 5 or claim 6.

[0210] [Structure 8] The control means is To an imaging device belonging to the same group as the first imaging device, the second coordinate information based on the first coordinate information is transmitted as movement instruction information for the AF frame. A control device as described in any one of configurations 5 through 7.

[0211] [Composition 9] The control means is To an imaging device belonging to a different group from the first imaging device, movement instruction information for an AF frame is transmitted, where the second coordinate information, which is the coordinate of a subject different from the subject indicated by the first coordinate information, is specified. A control device as described in any one of configurations 5 through 7.

[0212] [Configuration 10] The control means is When the setting for linked movement of the AF frame is enabled, the second image sensor, which is different from the first image sensor, transmits movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information. A control device as described in any one of Configuration 1 to Configuration 9.

[0213] [Composition 11] A control method for remotely controlling multiple imaging devices via a network connection, Acquiring LV images from each of the aforementioned multiple imaging devices, The acquired LV images are displayed on the display device, When a touch is made on the first LV image displayed on the display means, movement instruction information for the AF frame, which is specified by first coordinate information corresponding to the touched position on the first LV image, is transmitted to the first imaging device corresponding to the first LV image. To transmit movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information, to a second imaging device different from the first imaging device, A control method including

[0214] [Composition 12] Computers, This program functions as a control device that connects to multiple imaging devices via a network and controls them remotely. The control device is Acquisition means for acquiring LV images from each of the aforementioned plurality of imaging devices, A display means for displaying each LV image acquired by the acquisition means, Equipped with control means, The control means is When a touch is made on the first LV image displayed on the display unit, movement instruction information for the AF frame, which is specified by the first coordinate information corresponding to the touched position on the first LV image, is transmitted to the first imaging device corresponding to the first LV image. Movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information, is transmitted to a second imaging device different from the first imaging device. program.

[0215] [Composition 13] A system comprising multiple imaging devices and a control device that remotely controls the multiple imaging devices via a network connection, The control device is Acquisition means for acquiring LV images from each of the aforementioned plurality of imaging devices, A display means for displaying each LV image acquired by the acquisition means, Equipped with control means, The control means is When a touch is made on the first LV image displayed on the display means, movement instruction information for the AF frame, which is specified by first coordinate information corresponding to the touched position on the first LV image, is transmitted to the first imaging device corresponding to the first LV image. Movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information, is transmitted to a second imaging device different from the first imaging device. The plurality of imaging devices, A detection means for detecting a subject based on coordinate information included in the movement instruction information of the AF frame received from the control device, Equipped with, system.

[0216] [Composition 14] The plurality of imaging devices, Tracking means for tracking the subject detected by the aforementioned detection means, It also has, The system described in Configuration 13.

Claims

1. A control device that connects to multiple imaging devices via a network and remotely controls them, Acquisition means for acquiring LV images from each of the aforementioned plurality of imaging devices, A display means for displaying each LV image acquired by the acquisition means, Equipped with control means, The control means is When a touch is made on the first LV image displayed on the display means, movement instruction information for the AF frame, which is specified by the first coordinate information corresponding to the touched position on the first LV image, is transmitted to the first imaging device corresponding to the first LV image. Movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information, is transmitted to a second imaging device different from the first imaging device. Control device.

2. The second coordinate information is the same coordinate information as the first coordinate information. The control device according to claim 1.

3. The second coordinate information is different from the first coordinate information. The control device according to claim 1.

4. The control means is When the size information of the first LV image and the second LV image corresponding to the second imaging device are different, the second coordinate information is calculated by performing a conversion process on the first coordinate information. The control device according to claim 3.

5. A detection means for detecting a subject based on the position touched on the first LV image, Furthermore, The control means is The coordinates where the subject detected by the detection means is located are designated as the first coordinate information. The control device according to claim 1.

6. The detection means is Based on the information of the subject detected based on the first coordinate information, the same subject on the LV image of the second imaging device is detected, The second coordinate information specifies the coordinates where the same subject exists as the second coordinate information. The control device according to claim 5.

7. The detection means is The system detects the subject closest to the touched position on the first LV image. The control device according to claim 5.

8. The control means is To an imaging device belonging to the same group as the first imaging device, movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information, is transmitted. The control device according to claim 5.

9. The control means is To an imaging device belonging to a different group from the first imaging device, movement instruction information for the AF frame is transmitted, where the second coordinate information is the coordinates where a subject different from the subject indicated by the first coordinate information exists. The control device according to claim 5.

10. The control means is When the setting for linked movement of the AF frame is enabled, the second imaging device, which is different from the first imaging device, transmits movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information. A control device according to any one of claims 1 to 9.

11. A control method for remotely controlling multiple imaging devices via a network connection, Acquiring LV images from each of the aforementioned multiple imaging devices, The acquired LV images are displayed on the display device, When a touch is made on the first LV image displayed on the display means, movement instruction information for the AF frame, which is specified by the first coordinate information corresponding to the touched position on the first LV image, is transmitted to the first imaging device corresponding to the first LV image. To a second imaging device different from the first imaging device, the second coordinate information based on the first coordinate information is transmitted as movement instruction information for the AF frame specified. A control method including

12. Computers, This program functions as a control device that connects to multiple imaging devices via a network and controls them remotely. The control device is Acquisition means for acquiring LV images from each of the aforementioned plurality of imaging devices, A display means for displaying each LV image acquired by the acquisition means, Equipped with control means, The control means is When the first LV image displayed on the display unit is touched, the movement instruction information for the AF frame, which is specified by the first coordinate information corresponding to the touched position on the first LV image, is transmitted to the first imaging device corresponding to the first LV image. Movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information, is transmitted to a second imaging device different from the first imaging device. program.

13. A system comprising multiple imaging devices and a control device that remotely controls the multiple imaging devices via a network connection, The control device is Acquisition means for acquiring LV images from each of the aforementioned plurality of imaging devices, A display means for displaying each LV image acquired by the acquisition means, Equipped with control means, The control means is When a touch is made on the first LV image displayed on the display means, movement instruction information for the AF frame, which is specified by the first coordinate information corresponding to the touched position on the first LV image, is transmitted to the first imaging device corresponding to the first LV image. Movement instruction information for the AF frame, which is specified by the second coordinate information based on the first coordinate information, is transmitted to a second imaging device different from the first imaging device. The plurality of imaging devices, A detection means for detecting a subject based on coordinate information included in the movement instruction information of the AF frame received from the control device, Equipped with, system.

14. The plurality of imaging devices, Tracking means for tracking the subject detected by the aforementioned detection means, It also has, The system according to claim 13.

Images