Control apparatus, control method, storage medium, and system for controlling plurality of imaging devices

Abstract

The present invention provides a control apparatus, a control method, a storage medium, and a system for controlling a plurality of imaging devices, the control apparatus remotely controlling the plurality of imaging devices connected to the control apparatus via a network, the control apparatus comprising: an acquisition unit for acquiring an LV image from the plurality of imaging devices; the display unit is used for displaying the acquired LV image; the operation unit is used for receiving touch operation; and a processor executing the program stored in the memory, in a case where a first LV image displayed on the display unit is touched, transmitting, to a first imaging device associated with the first LV image, movement instruction information about an AF frame specifying first coordinate information corresponding to a position where the first LV image is touched; and transmit, to a second imaging device different from the first imaging device, movement instruction information on an AF frame in which second coordinate information based on the first coordinate information is specified.

Description

Technical Field

[0001] This disclosure relates to control devices, control methods, storage media, and systems. Background Technology

[0002] In recent years, multiple digital cameras have been used in event venues such as weddings or concerts, and conference venues such as press conferences, to capture photos with optimal composition. However, shooting with multiple digital cameras simultaneously requires multiple photographers, thus leading to personnel costs and other expenses and challenges.

[0003] For example, photographers cannot take pictures in restricted areas.

[0004] In this context, in such scenarios, a control device connected to multiple cameras via a network controls cameras in a known system (Japanese Patent Application Laid-Open No. 2023-9896). For example, multiple digital cameras are installed at various locations in a field, and some photographers remotely connect control devices, typically tablets or laptops, to the digital cameras via a network. A system is used that allows multiple digital cameras to simultaneously take photos by operating the control device. In some specific examples, existing technologies such as Nikon's "NX Field" (trademark) or Sony's "Remote Camera Tool" (trademark) are used as remote shooting systems capable of controlling remote shooting using multiple digital cameras.

[0005] When shooting still images with a digital camera, the photographer refers to the live view image displayed on the screen and a corresponding area (hereinafter referred to as the "AF frame") in which a signal for focus detection for autofocus (AF) with respect to the imaging area of ​​the digital camera is acquired. The photographer operates the digital camera and moves the AF frame to follow the movement of the subject. Subsequently, the subject is autofocused, and a photograph is taken.

[0006] For still image capture in a remote shooting system that uses a single control device to remotely control multiple digital cameras, the control device receives live view images from the multiple digital cameras and displays the live view images side by side on the screen.

[0007] Photographers can, for example, control the live view image display area of ​​each digital camera via a touch control device, and send instructions from the control device to each digital camera to move the AF frame from its current coordinates to coordinates on the live view corresponding to the touch operation position. This allows for the control of moving the AF frame of each digital camera to freely determined coordinates on the live view image.

[0008] Suppose we use the technique in the comparative example to move the AF frames of multiple digital cameras connected to a control device to follow a subject. In this case, there are problems: the live view image display areas of each digital camera on the control device need to be touched an equal number of times as the number of digital cameras, requiring additional time and effort from the photographer. Furthermore, there is a risk that the photographer's shooting preparation is delayed during this operation, thus causing the photographer to miss shooting opportunities. Summary of the Invention

[0009] According to one aspect of this disclosure, a control device is provided that remotely controls a plurality of imaging devices connected to the control device via a network, and includes: an acquisition unit configured to acquire real-time view (LV) images from the plurality of imaging devices; a display unit configured to display the LV images acquired by the acquisition unit; an operation unit configured to receive a touch operation performed by a user; at least one memory storing a program; and at least one processor configured, when executing the stored program, to: in the event that a first LV image displayed on the display unit is touched, send to a first imaging device associated with the first LV image movement instruction information regarding an autofocus (AF) frame specifying first coordinate information corresponding to the position where the first LV image is touched; and send to a second imaging device different from the first imaging device movement instruction information regarding an AF frame specifying second coordinate information based on the first coordinate information.

[0010] The features of this disclosure will become apparent from the following description of embodiments with reference to the accompanying drawings. The following description of embodiments is given by way of example. Attached Figure Description

[0011] Figure 1A This is a hardware construction diagram showing the structure of a digital camera. Figure 1B and Figure 1C This is an example of what a digital camera looks like.

[0012] Figure 2 This is a hardware configuration diagram showing the structure of the control device.

[0013] Figure 3 The diagram shows multiple digital cameras and control devices, and is a system configuration diagram showing remote control, wherein the control devices and multiple digital cameras are connected to each other through a network device in between.

[0014] Figure 4A and Figure 4B This shows an example of a photographer taking multiple remote shots at a press conference venue.

[0015] Figures 5A to 5GThis illustrates an example of a portion of the screen displayed on the control unit's display when three digital cameras and a control unit are connected to each other via a network and multiple remote shots are taken using live view images from the three digital cameras displayed on the control unit's display unit.

[0016] Figure 6A , Figure 6B and Figure 6C The diagram illustrates a process, according to a first embodiment, of controlling the movement of the AF frame by a control device on multiple digital cameras connected to the control device via a network during multiple remote shooting.

[0017] Figure 7 An example of a screen showing settings related to controlling the linked movement of a digital camera via a control device.

[0018] Figure 8 The flowchart illustrates the process of controlling the movement of the AF frame by a digital camera that receives instructions from a connected control device, according to a first embodiment.

[0019] Figure 9 The diagram illustrates a process, according to a second embodiment, of controlling the movement of the AF frame by a control device on multiple digital cameras connected to the control device via a network during multiple remote shooting.

[0020] Figure 10 The flowchart illustrates the process of controlling the movement of the AF frame by a digital camera that receives instructions from a connected control device, according to a third embodiment.

[0021] Figure 11 The diagram illustrates a process, according to a third embodiment, of controlling the movement of the AF frame by a control device on multiple digital cameras connected to the control device via a network during multiple remote shooting. Detailed Implementation

[0022] The embodiments for implementing this disclosure will now be described in detail with reference to the accompanying drawings.

[0023] The embodiments described later are examples for implementing this disclosure, and appropriate modifications or variations may be made depending on various conditions and the structure of the device to which this disclosure is applied. These embodiments may be appropriately combined.

[0024] First Embodiment

[0025] Structure of Digital Camera 100

[0026] Figure 1AThis is a hardware construction diagram illustrating an example of the structure of a digital camera 100, which is an example of a communication device according to this embodiment. The digital camera is described herein as an example of a communication device, but communication devices are not limited thereto. For example, a communication device may be an information processing device such as a mobile media player, a so-called tablet device, or a personal computer.

[0027] The controller 101 controls the components of the digital camera 100 based on input signals or a program described later. The entire device can be controlled by multiple pieces of hardware sharing processing capabilities, instead of the controller 101.

[0028] For example, imaging unit 102 includes an optical system for controlling an optical lens unit, an aperture stop, zoom, and focus, and an imaging element for converting light (video) introduced via the optical lens unit into an electrical video signal. Typically, a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) is used as the imaging element. Controller 101 controls imaging unit 102. Therefore, the imaging element converts the subject light after it has formed an image through the lens included in imaging unit 102 into an electrical signal, and outputs digital data as image data, for example, after noise reduction processing. For the digital camera 100 according to this embodiment, image data is recorded on recording medium 110 according to the standard design rules of the camera file system (DCF).

[0029] The non-volatile memory 103 is an electrically erasable and recordable non-volatile memory, and stores programs, for example, executed by the controller 101 described later.

[0030] The working memory 104 is used, for example, as a buffer memory for temporarily storing image data imaged by the imaging unit 102, an image display memory of the display unit 106, or a working area of ​​the controller 101.

[0031] The operation unit 105 is used to receive instructions from the user to the digital camera 100. For example, the operation unit 105 includes a power button for the user to instruct the user to turn the digital camera 100 on or off, a release switch for instructing the user to take a picture, and a playback button for instructing the user to play image data. It also includes an operation component such as a dedicated connection button for initiating communication with an external device via the communication unit 111, which will be described later. The operation unit 105 also includes a touchscreen formed on the display unit 106, which will be described later.

[0032] The release switches include SW1 and SW2. When the release switch is half-pressed, SW1 is turned on. Therefore, a command is received to prepare for shooting, such as autofocus (AF) processing, auto exposure (AE) processing, auto white balance (AWB) processing, or pre-flash (EF) processing, as described later. When the release switch is fully pressed, SW2 is turned on. Therefore, a command is received to take the picture.

[0033] The operation unit 105 also includes an AF-ON button, which is used only for performing the AF processing described later in the preparation for shooting. When the AF-ON button is pressed, the controller 101 outputs a command to start the AF operation, and the AF processing begins.

[0034] AF processing includes automatic focus detection of the region (hereinafter referred to as the "focus detection region") in which the imaging element of imaging unit 102 has acquired a signal for focus detection. The subject can be focused in such a way that, based on the amount of defocus detected in the focus detection region, the focusing lens included in the shooting lens is moved to the focus position.

[0035] User operation via operation unit 105 enables controller 101 to instruct a change in the position of an area (hereinafter referred to as the "AF frame") corresponding to the focus detection area indicated on the viewfinder screen displayed on display unit 106, which will be described later. The display area of ​​the AF frame corresponds to the focus detection area, and the focus detection area changes when the display area of ​​the AF frame changes. As an example of changing the position of the AF frame, when the touchscreen of operation unit 105 is operated, the position of the AF frame is changed (moved) to the operation position, but this disclosure is not limited thereto.

[0036] User operation via operation unit 105 enables the selection and setting of an AF box selection mode among multiple AF box selection modes, including at least two AF box selection modes described below.

[0037] • Single-point AF • The user sets the AF frame pattern at a freely selected single point. Focus detection is performed in the focus detection area corresponding to the set AF frame.

[0038] • Multi-point AF • A mode in which the user sets AF frames at multiple points. For example, multiple AF frames are categorized into multiple regions, and the user specifies any one of the regions based on the location of the touch, and sets multiple AF frames using the specified region (hereinafter referred to as "regional AF"). For multi-point AF including regional AF, the controller 101 then performs automatic selection of the multiple AF frames, as described later. In automatic selection, the AF frame to be focused is selected from the multiple AF frames set by the user based on automatic selection conditions, and focus detection is performed using the selected AF frame. Although the AF frame is generally selected to focus on the nearest subject, the automatic selection conditions include conditions such as the position of the subject on the screen, the size of the subject, or the distance to the subject. Various determination methods can be used, but this disclosure is not limited thereto.

[0039] Display unit 106 displays the viewfinder image, the AF frame during shooting, image data after shooting, and characters for interactive operation. Display unit 106 is not necessarily included in the digital camera 100. The digital camera 100 can be connected to the internal or external display unit 106 and at least has the function of controlling the display of display unit 106.

[0040] The real-time clock (RTC) 107 manages the clock. Users can set the clock time by using the operation unit 105, by obtaining time information via the communication unit 111, or by using a radio clock, as long as time can be managed.

[0041] The recording medium 110 can record image data output from the imaging unit 102.

[0042] The recording medium 110 can be attached to and detached from the digital camera 100, or it can be included in the digital camera 100. That is, the digital camera 100 includes at least a unit for accessing the recording medium 110.

[0043] The communication unit 111 is an interface for connecting to external devices. According to this embodiment, the digital camera 100 can send data to and receive data from external devices via the communication unit 111. For example, image data generated by the imaging unit 102 can be sent to an external device via the communication unit 111. According to this embodiment, the communication unit 111 includes an interface conforming to the IEEE 802.11 standard for communicating with external devices via a wireless LAN. The controller 101 controls the communication unit 111 to wirelessly communicate with external devices. The communication method is not limited to wireless LAN, and examples include infrared communication methods.

[0044] Communication unit 111 is an example of a first wireless communication unit.

[0045] The communication unit 112 is an interface for connecting to an external device. According to this embodiment, the digital camera 100 can send data to and receive data from the external device via the communication unit 112. For example, image data generated by the imaging unit 102 can be sent to the external device via the communication unit 112. According to this embodiment, the communication unit 112 includes an interface conforming to the IEEE 802.15.1 standard for Bluetooth (registered trademark) communication with the external device. The controller 101 controls the communication unit 112 to wirelessly communicate with the external device. The communication method is not limited to Bluetooth (registered trademark), and examples include wireless LAN or infrared communication methods conforming to the IEEE 802.11 standard. The communication unit 112 is an example of a second wireless communication unit.

[0046] The communication unit 113 is an interface for connecting to external devices. According to this embodiment, the digital camera 100 can send data to and receive data from external devices via the communication unit 113. For example, image data generated by the imaging unit 102 can be sent to an external device via the communication unit 113. According to this embodiment, the communication unit 113 includes an interface conforming to the IEEE 802.3 standard for communicating with external devices via a wired LAN (Ethernet). The controller 101 controls the communication unit 113 to communicate with external devices. The communication method is not limited to wired LAN, and examples include USB communication. The communication unit 113 is an example of a wired communication unit.

[0047] The communication unit 112 of the digital camera 100 according to this embodiment has a peripheral mode or a central mode. When the communication unit 112 operates in peripheral mode, the digital camera 100 according to this embodiment can operate as a client device via Bluetooth (registered trademark). When the digital camera 100 operates as a client device, operation in central mode enables communication with external devices. For authentication of the external device to be connected, after previous pairing, unique information about the external device to be connected is stored in non-volatile memory 103. When the Bluetooth (registered trademark) module is powered, the digital camera 100 can transmit signals even when the power is off.

[0048] For example, the near-field wireless communication unit 114 includes a wireless communication antenna, modulation and demodulation circuitry for processing wireless signals, and a communication controller. The near-field wireless communication unit 114 outputs a modulated wireless signal from the antenna. The near-field wireless communication unit 114 demodulates the wireless signal received by the antenna to perform contactless near-field communication (so-called near-field communication (NFC)) conforming to the ISO / IEC 18092 standard. According to this embodiment, the near-field wireless communication unit 114 is disposed on the side of the digital camera 100.

[0049] Near-field wireless communication unit 114 and near-field wireless communication unit 214 approach each other and thus begin communication, connecting to the control device 200, which will be described later. When connecting the control device 200 using near-field wireless communication unit 114, near-field wireless communication unit 114 and near-field wireless communication unit 214 do not need to be in contact with each other. Near-field wireless communication unit 114 and near-field wireless communication unit 214 can communicate even when spaced apart, therefore, they are close to each other within the range capable of performing near-field wireless communication for connecting the control device 200. Approaching within the range capable of performing near-field wireless communication is also described as near-field.

[0050] The appearance of the digital camera 100 will now be described. Figure 1B and Figure 1C An example showing the appearance of the digital camera 100 is provided. The release switch 105a, play button 105b, directional keys 105c, and touchscreen 105d are operating components included in the aforementioned operating unit 105. The image acquired by imaging using the imaging unit 102 is displayed on the display unit 106. The communication unit 113 is a wired LAN or USB interface.

[0051] In some of the cases described below, the digital camera 100 is described to perform processing, but in practice, the controller 101 reads the program stored in the non-volatile memory 103 and loaded into the working memory 104 and performs various processes according to the program instructions.

[0052] The above describes the digital camera 100.

[0053] Structure of control device 200

[0054] Figure 2 This is a hardware construction diagram illustrating an example of the structure of a control device 200, which is an example of an information processing apparatus according to this embodiment. The control device will be described as an example of an information processing apparatus, but the information processing apparatus is not limited thereto. For example, the information processing apparatus may be a digital camera with wireless capabilities, a smartphone, a tablet device, or a personal computer.

[0055] The controller 201 controls the components of the control device 200 based on input signals or a program described later. The entire device can be controlled by multiple pieces of hardware sharing processing capabilities, instead of the controller 201.

[0056] The non-volatile memory 203 is an electrically erasable and recordable non-volatile memory. Recorded in the non-volatile memory 203 are: the operating system (OS), which is the basic software executed by the controller 201, and applications that cooperate with the OS to implement application functions. According to this embodiment, applications for communicating with the digital camera 100 are stored in the non-volatile memory 203.

[0057] The working memory 204 may be used, for example, as the image display memory of the display unit 206 or as the working area of ​​the controller 201.

[0058] The operation unit 205 is used to receive instructions from the user for the control device 200. For example, the operation unit 205 includes: a power button for the user to instruct the user to turn the power supply of the control device 200 on or off, an operation component for setting the RTC, and an operation component such as a touch screen formed on the display unit 206.

[0059] The controller 201 can detect the following operations (hereinafter referred to as "touch operations") on the touchscreen included in the operation unit 205. The operation of touching the touchscreen with a finger or pen is hereinafter referred to as "touch on". The operation of bringing a finger or pen to the touchscreen before it has touched it is hereinafter referred to as "touch down". The operation of moving a finger or pen while it is in contact with the touchscreen is hereinafter referred to as "touch move". The operation of separating a finger or pen from the touchscreen is hereinafter referred to as "touch up". The state where neither the finger nor the pen is touching the touchscreen is hereinafter referred to as "touch off". These operations and the coordinates of the finger or pen's contact with the touchscreen are reported to the controller 201, and the controller 201 determines the operation performed on the touchscreen based on the reported information. Regarding movement, the vertical and horizontal components of the direction of movement of the finger or pen on the touchscreen can be detected based on changes in coordinates. When there is constant movement on the touchscreen between touch down and touch up, a stroke is drawn. The operation of quickly drawing a stroke is called a flick. A flick is an operation where a finger is quickly moved a certain distance while in contact with the touchscreen and then released; in other words, it's a quick touch on the touchscreen with a flicking finger. A flick is determined to have occurred when a movement of a predetermined speed or greater over a specific distance is detected, followed by a touch release. A drag is determined to have occurred when a movement of less than a predetermined speed over a specific distance is detected. The touchscreen can be any of various types, such as resistive touchscreens, capacitive touchscreens, surface acoustic wave touchscreens, infrared touchscreens, electromagnetic induction touchscreens, image recognition touchscreens, or optical sensor touchscreens.

[0060] Display unit 206 displays image data or characters for interactive operation. Display unit 206 is not necessarily included in control device 200. Control device 200 can be connected to internal or external display unit 206 and has at least the function of controlling the display of display unit 206.

[0061] The RTC manages the clock. Users can set the clock time by using the operation unit 205, by obtaining time information via the communication unit 211, the communication unit 212, or the public network connection unit 213, or by using a radio clock, as long as time can be managed. The time can be obtained from a mechanical mechanism such as an analog clock by a detection mechanism (in this case, the RTC includes a detection mechanism).

[0062] Recording medium 210 can record image data transmitted from digital camera 100 to controller 201 via communication unit 211. Recording medium 210 can be attached to and detached from control device 200, or it can be included in control device 200. That is, control device 200 includes at least a unit for accessing recording medium 210.

[0063] The communication unit 211 is an interface for connecting to an external device. According to this embodiment, the control device 200 can send data to and receive data from the external device via the communication unit 211. According to this embodiment, the communication unit 211 includes an antenna, and the controller 201 can connect to the digital camera 100 using the antenna inserted in the middle. According to this embodiment, the communication unit 211 includes an interface conforming to the IEEE 802.11 standard for communicating with the external device via a wireless LAN. The controller 201 controls the communication unit 211 to wirelessly communicate with the external device. The communication method is not limited to a wireless LAN, and examples include infrared communication methods. The communication unit 211 is an example of a first wireless communication unit.

[0064] The communication unit 212 is an interface for connecting to an external device. According to this embodiment, the control device 200 can send data to and receive data from the external device via the communication unit 212. For example, image data generated by the digital camera 100 can be received via the communication unit 212. According to this embodiment, the communication unit 212 includes an interface conforming to the IEEE 802.15.1 standard for communicating with the external device via so-called Bluetooth (registered trademark). The controller 201 controls the communication unit 212 to wirelessly communicate with the external device. The communication method is not limited to Bluetooth (registered trademark), and examples include wireless LAN conforming to the IEEE 802.11 standard and infrared communication methods. The communication unit 212 is an example of a first wireless communication unit.

[0065] The communication unit 213 is an interface for connecting to an external device. According to this embodiment, the control device 200 can send data to and receive data from the external device via the communication unit 213. For example, image data generated by the imaging unit 202 can be sent to the external device via the communication unit 213. According to this embodiment, the communication unit 213 is an interface conforming to the IEEE 802.3 standard for communicating with the external device via a wired LAN (Ethernet). The controller 201 controls the communication unit 213 to communicate with the external device. The communication method is not limited to a wired LAN, and examples include the USB communication method. The communication unit 213 is an example of a wired communication unit.

[0066] The communication unit 212 of the control device 200 according to this embodiment has a peripheral mode or a central mode. When the communication unit 212 operates in central mode, the control device 200 according to this embodiment can operate as a server device according to Bluetooth (registered trademark). When the control device 200 operates as a server device, communication is enabled by connecting to an external device in peripheral mode. Regarding the authentication of the external device to be connected, after previous pairing, unique information about the external device to be connected is stored in non-volatile memory 203.

[0067] For example, the near-field wireless communication unit 214 includes a wireless communication antenna, modulation and demodulation circuitry for processing wireless signals, and a communication controller. The near-field wireless communication unit 214 outputs a modulated wireless signal from the antenna. The near-field wireless communication unit 214 demodulates the wireless signal received by the antenna for use in contactless near-field communication (so-called near-field communication (NFC)) conforming to the ISO / IEC 18092 standard. According to this embodiment, the near-field wireless communication unit 214 is disposed on the side of the control device 200.

[0068] In some of the following cases, the control device 200 is described as performing processing. However, in practice, the controller 201 reads application programs (such as application functions, OS, or OS services) stored in non-volatile memory 203 and loaded into working memory 204, and performs various processes according to application instructions.

[0069] System Structure

[0070] A system construction diagram according to this embodiment will now be described.

[0071] Figure 3 A system configuration diagram for remote control is shown, illustrating multiple digital cameras 100 and a control device 200, with the control device 200 and the multiple digital cameras 100 connected to each other via a network device 300 inserted between them.

[0072] The digital camera 100 is mounted on a tripod 303 and positioned at the shooting location. In this example, the digital camera 100 is mounted on a tripod 303, but it could also be mounted on a remote head that can be remotely controlled for panning, tilting, and zooming.

[0073] In some cases, the digital camera 100 uses wireless radio waves 302 relayed via network device 300 to communicate wirelessly with the control device 200 via communication unit 112. In other cases, communication with the control device 200 is established via wired LAN cable 301 through communication unit 113 and network device 300.

[0074] In some cases, the control device 200 uses wireless radio waves 302 relayed via network device 300 to wirelessly communicate with the digital camera 100 via communication unit 212. In other cases, a wired LAN cable 301 is used to establish communication with the digital camera 100 via communication unit 213 and network device 300.

[0075] In this example, communication is established via network device 300, but the individual digital cameras 100 and control devices 200 can be directly connected to each other.

[0076] like Figure 3 As shown, when multiple digital cameras 100 are installed and the control device 200 can communicate with each other, the control device 200 can obtain information about the settings of each digital camera 100 and can instruct each digital camera 100 to change its settings.

[0077] Specifically, the control device 200 sends instructions to each digital camera 100 to move the AF frame of the digital camera to a specified coordinate (hereinafter referred to as "instructions regarding AF frame movement"). The movement of the AF frame of the digital camera 100 can be controlled (hereinafter referred to as "AF frame movement control"). The digital camera 100 changes the position of its AF frame not only in response to instructions from the controller 101 via the aforementioned operation unit 105, but also in response to the instructions regarding AF frame movement received from the control device 200.

[0078] Additionally, shooting can be remotely instructed by sending commands regarding shooting and commands regarding activating or deactivating the focus drive.

[0079] Using this structure, the control device 200 can control shooting using multiple digital cameras 100 (hereinafter referred to as "multi-remote shooting").

[0080] Multi-remote shooting, such as at press conferences

[0081] The following description includes subject composition and shooting status during multi-remote shooting using multiple digital cameras 100 installed at the venue, as an example of shooting at a press conference venue according to this embodiment.

[0082] Figure 4A and Figure 4B This illustrates a scenario where multiple digital cameras 100 are installed in the venue of a press conference for multi-remote shooting.

[0083] like Figure 4A As shown, speaker 401 primarily sits near the podium 403 on platform 402, and delivers a speech or engages in conversation within a scene where there are two speakers 401 as subjects in the press conference venue 400. However, their positions on platform 402 change frequently. For example, Figure 4A This example illustrates one speaker 401 leaving the podium 403 and moving to the center of the platform 402 to take a picture. In another example, consider speakers 401 communicating with each other, for example, shaking hands or giving a reward or document.

[0084] like Figure 4B As shown, when photographing a scene in a press conference venue 400, the setup is determined to ensure the most stable and good photographs can be expected. For example, the composition is such that the two speakers 401 are viewed from the front, and the first digital camera 410 is positioned behind the press seating area 404 where the press corps is seated.

[0085] However, in some situations, the first digital camera 410 misses the decisive moment, for example, because the press corps 405 in the press box 404 moves and is captured by the camera, thus obscuring the subject. In these cases, the second digital camera 411 is positioned next to the first digital camera 410, with a composition that allows both speakers 401 to be viewed roughly from the front, ensuring a consistently accurate photograph. The first and second digital cameras 410 and 411 are positioned at similar angles and distances from the speakers 401, resulting in similar compositions, but with a more definitive capture of the decisive moment.

[0086] In many cases, when answering questions from the press corps 405 seated in the press box 404, speaker 401 will turn their face and body to the left or right to face the reporter asking the question. In this situation, it is preferable to photograph speaker 401 at a certain angle for better composition. Therefore, a third digital camera 412 is positioned to the left of the press box 404 where the press corps 405 is seated, ensuring the composition allows for a shot of both speakers 401 from the left. According to this embodiment, the arrangement is limited to the left side of the press box 404, but if the number of digital cameras is increased, one or more digital cameras 100 can be additionally positioned on the right side in the same manner.

[0087] The proposed control screen for multi-remote shooting will now be described.

[0088] Control screen for multiple remote shooting

[0089] Figures 5A to 5G The diagram shows the structure for multiple remote shooting when three digital cameras 100 and a control device 200 are connected to each other.

[0090] Figure 5A The multi-remote shooting screen 500 is shown in the control device 200 connected to the digital camera 100.

[0091] On the multi-remote shooting screen 500, a camera control component 501 is displayed. This camera control component 501 configures shooting-related settings and controls focus commands, shooting, etc., from the digital camera 100 of the control device 200. Additionally, a camera control component 502 is displayed that controls the second and third digital cameras 100 connected to the control device 200. Furthermore, a multi-camera control component 503 (hereinafter referred to as "multi-camera control") that jointly controls multiple digital cameras 100 is displayed.

[0092] When the connection settings with the digital camera 100 are registered in the control device 200, a first camera control member 501 is added to the main camera display member 504, and a second and additional camera control member 502 is added to the secondary camera display member 505. The first camera control member 501 added to the main camera display member 504 and the second and additional camera control members 502 added to the secondary camera display member 505 have different sizes and arrangements. Specifically, the live view display operation member 520, described later, is displayed in a large size in the first camera control member 501, and in a smaller size in the second and additional camera control members 502 than in the first camera control member 501. However, the first camera control member 501 and the second and additional camera control members 502 have the same function. When the number of digital cameras to be connected is large and all camera control members 502 cannot be included in the secondary camera display member 505 at the same time, the camera control members 502 not displayed on the screen can be displayed by scrolling using the scroll member 508.

[0093] exist Figure 4A and Figure 4BIn the case of multiple remote shooting in the press conference venue 400 shown, a first digital camera 410, which can be expected to capture the most stable and good photos, is added to the main camera display member 504. A second digital camera 411 and a third digital camera 412 are added to the secondary camera display member 505. The digital camera 100 corresponding to the first camera control member 501 added to the main camera display member 504 is hereinafter referred to as the "main camera". The digital cameras 100 corresponding to the second and additional camera control members 502 added to the secondary camera display member 505 are collectively referred to as the "secondary cameras".

[0094] Structure of camera control components

[0095] Figure 5B The structure of the camera control component 501 is shown.

[0096] The camera control component 501 includes: an operation component 510 for controlling the connection status with the digital camera 100; a display component 511 for displaying the power status and recording component status of the digital camera 100; and a name display component 512 for identifying the camera and shooting group. It also includes: an operation component 513 for controlling the autofocus of the digital camera 100; a display component 514 for displaying the network address of the digital camera 100; and a setting component 515 for camera control settings. Furthermore, it includes: a component group 516 for controlling the display and changing of shooting settings of the digital camera 100; and an operation component 517 for remote shooting with the digital camera 100. Additionally, it includes: a display component 518 for displaying the remaining number of photos and the number of photos taken with the digital camera 100; and a live view display control component 519 for the digital camera 100. Finally, it includes: a live view display operation component 520 for displaying the live view image (also known as a LV image) of the digital camera 100; and an AF frame display component 521 for displaying the AF frame of the digital camera 100.

[0097] The display of the AF frame display component 521 is superimposed on the live view display operation component 520. This allows the display of the live view display operation component 520 and the AF frame display component 521 to resemble the display of the live view image and AF frame on the display unit 106 during shooting with the digital camera 100.

[0098] The AF frame display component 521 changes the display format of the AF frame according to the current AF frame selection mode of the digital camera 100. When the AF frame selection mode is single-point AF, such as... Figure 5C As shown, the AF frame display component 521 displays the AF frame at a single point set by the user as a rectangle 522. In the case of multi-point AF, the AF frame display component 521 displays visually recognized AF frames at multiple points selected by the user. For example, in the case of area AF, as... Figure 5DAs shown, the area containing multiple points of the AF frame is displayed as a region 523 with corners marked for visual identification. Another display method that can be used in the case of multi-point AF is to use multiple rectangles to display multiple selected AF frames, but this disclosure is not limited thereto.

[0099] Users control the movement of the digital camera's AF frame, as displayed on the AF frame display component 521, by operating the live view display operation component 520. For example, as... Figure 5E As shown, when a user's finger 524 is detected touching the live view display operation member 520, the control device 200 sends a command regarding the movement of the AF frame. Specifically, the digital camera 100, corresponding to the camera control member 501 or 502 of the live view display operation member 520 that detected the touch operation, calculates the coordinates in the coordinate system on the live view image corresponding to the position where the touch operation was detected. A command regarding the movement of the AF frame is then sent. Subsequently, the digital camera 100 changes the position of the AF frame in response to the command received from the control device 200 regarding the movement of the AF frame. Therefore, the AF frame displayed by the AF frame display member 521 of the control device 200 moves to the position where the user performed the touch operation.

[0100] The aspects of the display operation component for multiple remote shooting in this example are described by way of example and may be modified or varied as appropriate.

[0101] Structure of multi-camera control components

[0102] Figure 5F The structure of the multi-camera control component 503 is shown.

[0103] The multi-camera control component 503 includes components that jointly instruct multiple digital cameras 100. Specifically, the multi-camera control component 503 includes: an operation component 531 for jointly setting and controlling shooting parameter settings and an operation component 532 for controlling multiple remote shooting. Furthermore, it includes: an operation component 533 that jointly controls the autofocus of the multiple digital cameras 100; and an operation component 534 that selects and displays a group of digital cameras to which instructions are sent using the aforementioned operation components 531, 532, and 533. Additionally, it includes: an operation component 535 that has the function of activating a screen displaying various other settings of the multiple digital cameras 100.

[0104] Camera registration settings screen

[0105] Figure 5G The camera registration settings screen 540 is shown, on which the registration settings for each camera 100 are displayed.

[0106] The camera registration and setup screen 540 includes: an operation component 541 for setting the IP address of each digital camera 100; and an operation component 542 for checking whether the digital camera 100 is connected to the network by executing a PING command from the control device 200. It also includes: an operation component 543 for setting the port number of the digital camera 100, an operation component 544 for setting the username and password for logging into the digital camera 100, and an operation component 545 for setting the password. Furthermore, it includes: an operation component 546 for setting the group to which the digital camera 100 belongs, an operation component 547 for canceling the setting, and an operation component 548 for confirming the setting.

[0107] The above describes the control screen used for multiple remote shooting.

[0108] System problems

[0109] The system according to this embodiment controls the movement of the AF frame of a plurality of digital cameras 100 connected to the control device 200. However, in this case, there is a problem that the operation is time-consuming and laborious.

[0110] In the above Figure 4A and Figure 4B In the example of a press conference venue 400, the speaker 401, who was sitting near the podium 403, leaves the podium 403 and moves to the center of the platform 402. The AF frames of multiple digital cameras 100 are positioned in the live view image near the podium 403 for shooting, so that the photographer can take a picture of the speaker 401 as the subject. In this case, when the speaker 401 moves as described above, the AF frames of the multiple digital cameras 100 will immediately move to a position close to the face of the speaker 401 who has moved to the center of the platform 402.

[0111] However, the system according to this embodiment requires repeated touch operations to control the movement of the AF frames of multiple digital cameras 100. Specifically, touch operations on the live view display operation member 520 of the camera control member 501 or 502 of the control device 200 need to be repeated an equal number of times as the number of digital cameras 100. Therefore, the photographer needs more time and effort. In addition, there is a risk that the photographer will delay shooting preparation during this operation, thus missing shooting opportunities.

[0112] Features of the control device 200 according to the present disclosure

[0113] Therefore, according to this embodiment, a control for the movement of the AF frame of the multiple digital cameras 100 connected to the control device 200 is designed.

[0114] The description will cover the scenario where the control device 200 detects a touch operation on the live view display operation member 520 of the camera control member 501 or 502. In this case, the control device 200 specifies the coordinates on the live view image corresponding to the location where the touch operation was detected, and sends a command regarding AF frame movement (also called movement command information) to the first digital camera 100 corresponding to the live view display operation member 520 where the touch operation was detected. Additionally, destination coordinates are calculated and specified based on the destination coordinates of the first digital camera 100, and the command regarding AF frame movement is sent to one or more freely determined numbers of second and additional digital cameras 100 connected to the control device 200. The destination coordinates of the first digital camera 100 are an example of first coordinate information. The destination coordinates calculated based on the destination coordinates of the first digital camera 100 (i.e., the destination coordinates of one or more freely determined numbers of second and additional digital cameras 100) are an example of second coordinate information.

[0115] This allows users to control the movement of the AF frames of multiple digital cameras 100 by performing touch operations together.

[0116] The operation of the control device 200 and each digital camera 100 according to the first embodiment to solve this problem will now be described.

[0117] According to the operation sequence of the control device 200 in the first embodiment

[0118] Figure 6A , Figure 6B and Figure 6C An example of operation processing performed by the control device 200 during multi-telephoto shooting using multiple digital cameras 100, according to this embodiment, is shown. The operation processing described herein includes displaying live view images of the multiple digital cameras 100 on the multi-telephoto shooting screen. Additionally, it includes operations controlling the movement of the AF frames of the multiple digital cameras 100.

[0119] Figure 6A This illustrates a series of operations from the establishment to the termination of the connection between the control device 200 and the multiple digital cameras 100.

[0120] This series of operations begins when the control device 200 is activated.

[0121] In S600, the control device 200 registers the connection settings of the multiple digital cameras 100 to be connected, and then performs the processing in S601.

[0122] In S601, the control device 200 performs the process of detecting the digital camera 100, and determines whether the digital camera 100 is detected. If the digital camera 100 is detected, the process of S602 is performed, or if the digital camera 100 is not detected, the process of S601 is repeated.

[0123] In S602, the control device 200 determines whether to perform a user connection operation. If it is determined that a connection has been requested, the process in S603 is performed; otherwise, the process in S602 is repeated.

[0124] In S603, the control device 200 performs the process of establishing and detecting a connection with the digital camera 100, and then performs the process in S604.

[0125] In S604, it is determined whether the second and additional digital cameras 100 registered for connection in S600 are connected, and whether multi-remote shooting can begin. If it is determined that all registered digital cameras 100 are connected and multi-remote shooting can begin, then the process in S605 is performed. If it is determined that all registered digital cameras 100 are not connected and one or more digital cameras 100 are to be connected, then the process in S601 is performed again.

[0126] In S605, multiple remote shooting screens are displayed, and then S606 processing is performed.

[0127] In S606, the control device 200 displays, for example... Figure 4B The scene shown is depicted by multiple real-time view images, and then processed by S607.

[0128] In S607, it is determined whether the connection with the multiple digital cameras 100 has ended and whether the user has ended multi-remote shooting. If it is determined that these have ended, the series of operations ends. If it is determined that these have not ended, the process of step S606 is repeated.

[0129] Figure 6B Shown in Figure 6A S606 is a series of operations performed by the control device 200 on multiple digital cameras 100 to process and display multiple live view images. The control device 200 begins this series of operations after displaying multiple remote shooting images in S605.

[0130] In step S610, it is determined whether the digital camera 100 registered in the control device 200 is connected. If it is determined that the camera is connected, the process in step S611 is performed. If it is determined that the camera is not connected, it is not necessary to display the live view image on the multi-remote shooting screen, therefore, the process in step S616 is performed.

[0131] In step S611, check if the Live View display control member 519 is pressed. If it is pressed, proceed to step S612. If it is not pressed, there is no need to display the Live View image on the multi-remote shooting screen, therefore, proceed to step S616.

[0132] In S612, an instruction to request a live view image (hereinafter referred to as the instruction to request a live view image) is sent to the digital camera 100, and then processed in S613.

[0133] In S613, a live view image is received from the digital camera 100, and then processed in S614.

[0134] In S614, the AF frame information (described later) is read from the supplementary information of the live view image received from the digital camera 100. Then, processing is performed in S615.

[0135] In S615, based on the AF frame information read in S614, the live view image received from the digital camera 100 in S613 is displayed on the live view display operation member 520, and the AF frame is displayed on the AF frame display member 521. Then, processing in S616 is performed.

[0136] In S616, it is determined whether the live view image display processing for all digital cameras 100 displayed on the multi-telephoto shooting screen 500, as described in S610 to S615, has ended. If it has ended, the operation of this series ends. If the live view image display processing for all multiple digital cameras 100 has not ended, the processing in S610 is repeated.

[0137] Figure 6C This illustrates a series of processing operations performed by the control device 200 when it controls the movement of the AF frame of the multiple digital cameras 100. Figure 5A The multi-remote shooting screen detected on the 500 Figure 6A When a touch operation is performed on a predetermined component displaying a live view image during the processing of multiple live view images, this series of operations begins. The predetermined component described herein is either the live view display operation component 520 of the main camera's camera control component 501 or the live view display operation component 520 of the secondary camera's camera control component 502. The digital camera 100 corresponding to the live view display operation component 520 that detects the touch operation is referred to as an "operation camera," and other digital cameras 100 corresponding to other live view display operation components 520 are referred to as "non-operation cameras."

[0138] In step S620, when a touch operation related to camera operation is detected on the live view display operation member 520, the control device 200 calculates the coordinates in the coordinate system of the live view image, corresponding to the destination coordinates of the AF frame at the location where the touch operation was detected on the live view display operation member 520. The location where the touch operation was detected on the live view display operation member 520 corresponds to coordinates in the X-axis and Y-axis directions on the live view display operation member 520. In some cases, the destination coordinates of the AF frame are simply referred to as "destination coordinates" below.

[0139] In S621, the control device 200 sends an instruction for moving the AF frame of the operating camera to the destination coordinates calculated in S620, and then performs the processing in S622.

[0140] At S622, the control device 200 determines, based on predetermined conditions, whether to control the movement of the AF frame of a non-operating camera based on a touch operation on the operating camera (hereinafter referred to as "AF frame linkage movement control"). The predetermined conditions used for determination at S622 can be determined by an application loaded into the working memory 204 of the control device 200. The predetermined conditions can be stored as variables that can be set by the user in any way in the non-volatile memory 203, the working memory 204, or the recording medium 210. Examples of predetermined conditions can include fixed conditions that are always "true" (i.e., AF frame linkage movement is always performed) and conditions or combinations thereof that change according to various application settings.

[0141] According to this embodiment, the determination is based on the conditions set by the user on the settings screen used to control the linkage movement of the AF frame. Now, reference will be made to... Figure 7 This describes the settings screen used to control the coordinated movement of the AF frame.

[0142] Settings screen for controlling the AF frame's linked movement

[0143] Figure 7 The settings shown are used to determine whether implementation is achieved. Figure 6C The structure of the screen at S622, where the AF frame linkage movement is controlled by predetermined conditions. When operating... Figure 5F When the multi-camera control component 503 operates component 535, a setting screen 700 for controlling the linkage movement of the AF frame is displayed.

[0144] The settings screen 700 for controlling the AF frame linkage movement includes: an active AF frame linkage movement activation settings area 701 for setting the control of AF frame linkage movement and an AF frame linkage movement activation selection component 702 for selecting whether to activate AF frame linkage movement.

[0145] When the AF frame linkage movement activation selection member 702 is set to indicate activation, various conditions are considered as additional conditions for the determination at S622. For example, this includes: an AF frame linkage movement target camera setting area 703, which is used to set the type of operating camera that enables control of AF frame linkage movement. It also includes: an AF frame linkage movement target camera selection member 704, which selects the type of operating camera that causes AF frame linkage movement to occur. According to this embodiment, the method for selecting the type of operating camera is for the user to select from "All cameras (main camera and secondary camera)", "Main camera only", or "Secondary camera only", but the selection method is not limited to this.

[0146] Additionally, the system includes an operation component for setting the type of operation that causes the AF frame linkage movement to occur for each camera selected by the AF frame linkage moving target camera selection component 704.

[0147] It includes: an AF frame linkage movement operation setting area 705 for the main camera and an AF frame linkage movement operation selection member 706 for the main camera, which sets the type of operation that causes AF frame linkage movement when the operating camera is the main camera. It also includes: an AF frame linkage movement operation setting area 707 for the secondary camera and an AF frame linkage movement operation selection member 708 for the secondary camera, which sets the type of operation that causes AF frame linkage movement when the operating camera is one of the secondary cameras.

[0148] According to this embodiment, the method for selecting the operation type allows the user to select either a "simple operation" or a "complex operation." The definitions of "simple operation" and "complex operation" will be described. For example, in the case of a short tap where the time from touch landing to touch release is less than a predetermined time when the control device 200 detects a touch operation, the operation type can be determined to be a "simple operation." In the case of a long tap where the time from touch landing to touch release is longer than a predetermined time when the control device 200 detects a touch operation, the operation type can be determined to be a "complex operation." Alternatively, if the number of fingers or pens touching the touchscreen during the touch operation (i.e., the number of dots on the touchscreen when the control device 200 detects a touch operation) is 1, the operation type can be determined to be a "simple operation," and if the number is 2 or more, the operation type can be determined to be a "complex operation." In the case of a single tap where the number of touch landings when the control device 200 detects a touch operation is 1, the operation type can be determined to be a "simple operation," and in the case of a double tap where the number of touch landings is 2, the operation type can be determined to be a "complex operation."

[0149] Therefore, the definitions of "simple operation" and "complex operation" are determined in various ways, but this disclosure is not limited thereto. The method of selecting the type of operation that causes the AF box to move in tandem is not limited to the method of using "simple operation" or "complex operation".

[0150] Additionally, it includes an operation component 709 for canceling settings on the setting screen 700 used for AF frame linkage movement control and an operation component 710 for confirming settings. When the operation component 710 for confirming settings is operated, the control device 200 records the settings selected by each selection component on the setting screen 700 for use in the aforementioned AF frame linkage movement control.

[0151] Now we will continue the description Figure 6C The series of operations shown.

[0152] In S622, it is determined whether an undetected touch has occurred in the AF frame of the digital camera. Specifically, based on... Figure 7 The conditions for setting the AF frame linkage movement shown in the settings screen are determined. The first condition is that the AF frame linkage movement activation selection member 702 is set to active. The second condition is that the type of the currently operated camera is included in the type of camera selected by the AF frame linkage movement target camera selection member 704. The third condition is that the type of touch operation at the start of this series of operations is the operation method selected by the AF frame linkage movement operation selection member 706 or 708.

[0153] When all three conditions are met, process S623 is performed to control the AF frame to move in tandem.

[0154] If at least one of the conditions is not met, the AF frame does not need to move in tandem, and therefore, this series of processes ends.

[0155] In S623, the control device 200 sends a command regarding the movement of the AF frame, which instructs the non-operating camera's AF frame to be moved to the same coordinates as the destination coordinates calculated in S620, and then proceeds to the processing in S624.

[0156] When the live view images from the operational camera and the various non-operational cameras have different sizes and aspect ratios, conversion processing can be performed. Information regarding the size and aspect ratio of the live view images is an example of size information. Specifically, coordinates obtained by transforming the coordinate system of the live view image from the operational camera to the coordinate system of each non-operational camera's live view image through scaling or aspect ratio conversion are used to equalize the destination coordinates of the operational camera.

[0157] In S624, it is determined whether the control of the AF frame linkage movement of all non-operating cameras shown in S623 has ended. If it is determined that it has ended, the operation of this series ends. If it is determined that it has not ended, and the control of the AF frame linkage movement of some non-operating cameras has not ended, the process of S623 is repeated.

[0158] The above processing is a series of processing operations performed by the control device 200 when the control device 200 controls the movement of the AF frame of the plurality of digital cameras 100 according to the first embodiment.

[0159] In the processing according to the above embodiment, under the control of AF frame linked movement, the control of AF frame linked movement is implemented for all non-operating cameras. However, the control of AF frame linked movement can be implemented only for one or more non-operating cameras belonging to the same group as the main camera. That is, it can be determined that... Figure 6C In step S623, the group name displayed by the name display member 512 of the operating camera is the same as the group name displayed by the name display members 512 of each non-operating camera. Therefore, in S623, the command for AF frame movement can be sent only to the non-operating cameras belonging to the same group as the operating camera, and in the case of different groups, the command for AF frame movement can be not sent, and the process in S624 can then proceed.

[0160] A series of processes according to the digital camera 100 of the first embodiment

[0161] Figure 8 An example of operation processing performed by multiple digital cameras 100 receiving instructions from the control device 200 during multi-telephoto shooting according to this embodiment is shown. The operation processing described herein includes processing for displaying live view images of the multiple digital cameras 100 on the multi-telephoto shooting screen. Additionally, it includes operation processing when controlling the movement of the AF frames of the multiple digital cameras 100.

[0162] Figure 8 This illustrates a series of operations from the establishment to the termination of the connection between the digital camera 100 and the control device 200. This series of operations begins when the digital camera 100 is positioned at the shooting location.

[0163] In S800, the user turns on the power to each digital camera 100, the digital camera 100 starts up, enabling shooting to begin, and then the processing in step S801 is performed.

[0164] In S801, a network setup for connecting to the control device 200 is constructed, and then the processing in S802 is performed.

[0165] In S802, network settings are activated, digital camera 100 waits for connection with control device 200, and then processing proceeds to S803.

[0166] In S803, it is determined whether the control device 200 has requested a connection. If a connection request is determined, connection processing is performed. Subsequently, it is determined whether a connection with the control device 200 has been established. If it is determined that no connection has been established with the control device 200, the processing in S803 is repeated, and the connection request from the control device 200 is checked. If it is determined that a connection has been established with the control device 200, the processing in S804 is performed.

[0167] In step S804, the digital camera 100 determines whether it has received an instruction from the control device 200 regarding a request for a live view image. If it is determined that an instruction regarding a request for a live view image has been received, the process in step S805 is performed. If it is determined that no instruction regarding a request for a live view image has been received, the process in step S804 is repeated, and the instruction regarding a request for a live view image from the control device 200 is checked again.

[0168] In S805, the digital camera 100 performs the process of generating a real-time view image based on the image data captured by the imaging unit 102 and stored in the working memory 104, and then performs the processing in S806.

[0169] In S806, the digital camera 100 generates AF frame information as additional information related to the live view image.

[0170] AF frame information is information about the display of the AF frame when it is overlaid on and displayed on a live view image. Examples of AF frame information according to this embodiment include: information indicating at least the position and size of the AF frame, represented by, for example, X-axis and Y-axis coordinates in the coordinate system of the live view image (position and size information). Additionally, for example, it may include: information indicating whether the subject is in focus (focus and defocus information) and information indicating the current AF frame selection mode.

[0171] In S807, the digital camera 100 sends the live view image generated in S805 and additional information including the AF frame information generated in S806 to the control device 200. The control device 200 receives the AF frame information and the live view image from the digital camera 100 and overlays the AF frame onto the live view image for display via the live view display operation unit 520 and the AF frame display unit 521. This allows the image to be displayed on the multi-remote shooting screen 500 of the control device 200 in a manner similar to the AF frame and live view image on the display unit 106 during shooting with the digital camera 100, and improves user operability during remote shooting.

[0172] In S808, it is determined whether a command regarding the movement of the AF frame has been received from the control device 200. If it is determined that a command regarding the movement of the AF frame has been received, the process in S809 is performed. If it is determined that no command regarding the movement of the AF frame has been received, the process in S810 is performed.

[0173] In S809, the destination coordinates specified by the instruction regarding AF frame movement received from the control device 200 in S808 are read, and the AF frame is moved to the destination coordinates. Therefore, the controller 101 instructs the position of the AF frame on the viewfinder screen displayed on the display unit 106 to be changed as in user operation via the operation unit 105. As described above, the position of the displayed AF frame corresponds to the focus detection area; therefore, when the position of the AF frame changes, the focus detection area changes.

[0174] In S810, the digital camera 100 determines whether the connection established in S803 with the control device 200 has ended. If the connection has ended, the series of operations ends. If the connection has not ended, the processing in S803 is repeated. If the AF frame is moved in S809, the processing in S803 is repeated based on the determination in S810. Subsequently, after the AF frame is moved, in S807, the live view image and AF frame information are sent to the control device 200 again. In this case, the AF frame information can be sent to the control device 200 after the AF frame is moved in S809.

[0175] The above processing is an example of a series of processing operations performed by a plurality of digital cameras 100 connected to the control device 200 during multiple remote shooting according to the first embodiment described above.

[0176] In the method described according to the above embodiments, only the AF frame relative to the non-operating camera is moved under the control of the AF frame linkage movement. However, not only is the AF frame relative to the non-operating camera moved, but also, if the AF frame is narrow in the AF frame selection mode of the non-operating camera, the AF frame selection mode can be changed to an AF frame selection mode that specifies a wider AF frame as an additional control. For example, it is possible to... Figure 6CAfter sending the AF frame movement command to the non-operating camera at S623, it is determined whether the current AF frame selection mode of the digital camera 100 is single-point AF. In the case of single-point AF, the control device 200 sends a command to the digital camera 100 to change the AF frame selection mode to multi-point AF. Even when the AF frame selection mode of the non-operating camera is changed separately, and thus the operating camera and the non-operating camera have slightly different perspectives—that is, even if the position of the subject in the live view image of each non-operating camera is slightly different from the position of the subject in the live view image of the operating camera—the subject can be captured in the AF frame area of ​​the non-operating camera under the control of the AF frame linkage movement.

[0177] Regarding the control of AF frame movement, when the AF frame of a device not operating the camera moves, additional emphasis can be displayed in a different format than that used by the operating camera. For example, one possible approach is to... Figure 6C After the AF frame is moved in conjunction with the control, when the AF frame displays component 521 in... Figure 6B When the AF frame is displayed at S615, the moved AF frame flashes for a specific time only with respect to the non-operating camera. Additionally, the AF frame before the movement can be displayed for a specific time to distinguish it from the moved AF frame by using, for example, a different color. This emphasis display process offers the advantage of making it easier for users to visually identify the movement of the AF frame of a non-operating camera, which is different from the operating camera.

[0178] Second Embodiment

[0179] In the method according to the first embodiment described above, under the control of the AF frame linkage movement, the AF frame of the operating camera and the AF frame of the non-operating camera are moved to the same coordinates on the live view image.

[0180] Therefore, for example, it can be expected that in Figure 4A and Figure 4B Under the control of the coordinated movement of the AF frames of the digital cameras 100 in the press conference venue 400, each non-operating camera can capture the subject within the AF frame area, making the angle and distance of each digital camera 100 from the subject and the composition similar to each other. In this example, the first digital camera 410 is used as the operating camera, while the second digital camera 411 is used as the non-operating camera.

[0181] However, the third digital camera 412 and the first digital camera 410 have different angles and distances from the subject. In the case where the digital camera 100 with different compositions is a non-operating camera, there is a possibility that the non-operating camera cannot be expected to capture the subject within the AF frame area.

[0182] Therefore, according to the second embodiment, the control device 200 can detect a subject in the region near the position of the AF frame on the live view image of the operating camera by performing subject detection processing. The structure described below moves the AF frames of each non-operating camera to the position where the same subject is detected on the live view image of the non-operating camera.

[0183] Components similar to those according to the first embodiment described above are designated using the same reference numerals, and their descriptions are omitted or simplified. In this case, the difference lies only in... Figure 6C The subject detection processing of the control device 200 shown is part of the processing performed by the control device 200, and these differences will be described.

[0184] The subject detection processing of the control device 200 includes the processing of detecting characteristic areas (e.g., the face or body of a living being such as a person or animal, or a vehicle) and the processing of identifying, for example, a specific person, animal, or vehicle registered in the control device 200.

[0185] For example, in the processing of face detection, subject information (representing the reliability of the size and position of a person's face or the certainty of a face in the captured image) is detected by processing the image signal.

[0186] For example, known face recognition processing involves extracting skin tone regions from the grayscale colors of pixels represented by image data and detecting faces using the matching degree of a pre-prepared facial contour template. For instance, methods for detecting faces include extracting facial features such as eyes, nose, and mouth using known pattern recognition techniques. However, this disclosure is not limited to methods for recognizing not only faces but also any subject, and any method can be used.

[0187] A series of processes according to the control device 200 of the second embodiment

[0188] Figure 9 The diagram illustrates a series of processing operations performed by the control device 200 when it controls the movement of the AF frame of a plurality of digital cameras 100, according to the second embodiment. Figure 9 Corresponding to the description according to the first embodiment Figure 6C .

[0189] If it is determined in S622 that the control of AF frame linkage movement has been implemented, then the processing in S900 is performed.

[0190] In S900, the control device 200 performs subject detection processing on the predetermined area to be detected on the live view image displayed by the live view display operation member 520 of the operating camera that detects the touch operation.

[0191] In one example, the area to be detected is defined as an area with a predetermined size, the center of which is located at the destination coordinates calculated in S620. The predetermined size can have a fixed value, which is determined by an application loaded into the working memory 204 of the control device 200. Alternatively, it can be a variable stored in the non-volatile memory 203, the working memory 204, or the recording medium 210, and can be set by the user in any way.

[0192] Another example of the area to be detected will be described. In this example, before the subject detection processing at S900, the live view image and the AF frame are updated during the process of displaying multiple live view images. The height, width, and position of the AF frame, which are moved in response to the instruction at S621 regarding the movement of the AF frame, are used as a reference. Therefore, various definitions are used for the area to be detected, but this disclosure is not limited thereto.

[0193] In S900, the subjects detected as a result of the subject detection process are newly registered as subjects to be detected in the subsequent subject detection process performed by the control device 200, for use in the processing of S902, which will be described later. If two or more subjects are detected in S900, the subject closest to the center coordinates of the area to be detected is registered. Then, the processing of S901 is performed.

[0194] In S901, if no subject is detected as a result of the subject detection process in S900, the series of operations ends. If one or more subjects are detected, the process in S902 proceeds.

[0195] In S902, subject detection processing is performed on the entire area of ​​the live view image displayed by the live view display operation member 520 of the non-operational camera. The subject detected in the subject detection processing in S902 is the same as the subject registered in S900.

[0196] In S903, if no subject is detected as a result of the subject detection process in S902, the process in S624 is performed. If a subject is detected, the process in S904 is performed.

[0197] In S904, the coordinates of the detected subject on the live view image of the non-operating camera are calculated as the destination coordinates, which is the result of the subject detection processing in S902, and then the processing in S623 is performed.

[0198] In S623, the control device 200 sends an instruction to move the AF frame of the non-operating camera to the destination coordinates calculated in S904, and performs the processing in S624.

[0199] In S624, it is determined whether the control of AF frame linkage movement for all non-operating cameras has ended. If it is determined that it has ended, the series of operations ends. If it is determined that it has not ended, and the control of AF frame linkage movement for some non-operating cameras has not ended, then the process in S902 is repeated.

[0200] The above operation is a series of processing operations performed by the control device 200 when controlling the movement of the AF frame of the plurality of digital cameras 100, according to the second embodiment. This processing enables the AF frame of each non-operational camera to move to the area of ​​the AF frame to capture the position of the subject, even when the operating and non-operational cameras have different compositions and the positions of the subjects in the live view images are not similar.

[0201] According to the above embodiment, if no subject is detected as a result of the subject detection processing of the live view image of the operating camera at S900, the AF frames of all non-operating cameras are not moved. However, if no subject is detected in the live view image of the operating camera, the first embodiment can be combined at S901. Figure 6C The processing from S623 to S624 in the code. This series of operations can end after sending an instruction to move the AF frame of all non-operating cameras to the same coordinates as the destination coordinates of the operating camera calculated in S620.

[0202] According to the above embodiment, if no subject is detected as a result of the subject detection processing of the live view images of each non-operating camera in S902, the AF frame of the non-operating camera is not moved in S903. However, in conjunction with the first embodiment, there is a possibility that no subject is detected in the live view image of the non-operating camera in S903. In this case, the processing in S624 can be performed after sending an instruction to move the AF frame of the non-operating camera to the same coordinates as the destination coordinates of the operating camera calculated in S620.

[0203] Third Embodiment

[0204] According to the second embodiment described above, the control device 200 performs subject detection processing under the control of the AF frame linkage movement. The subject is detected in the area near the position of the AF frame on the live view image of the operating camera. Subsequently, the AF frames of each non-operating camera are moved to the position where the same subject is detected on the live view image of the non-operating camera.

[0205] However, if the subject continues to move, it may leave the area of ​​the AF frame immediately after the AF frame moves. Therefore, each digital camera 100 may include a detection unit and a tracking unit. Thus, the digital camera 100 has both a subject detection processing function and a function to continuously move the AF frame, enabling the AF frame to follow the subject in certain situations by performing tracking processing on the detected subject.

[0206] Therefore, according to the third embodiment, not only the control device 200 but also the digital camera 100 can have subject detection processing, and the AF frame can be moved by performing tracking processing. When the control device 200 moves the AF frame of the operating camera and the operating camera starts tracking a freely selected subject, the non-operating camera can track the same subject.

[0207] Components similar to those according to the first and second embodiments described above are indicated by the same reference numerals, and their descriptions are omitted or simplified. In this case, the difference lies in the subject detection processing and tracking processing of each digital camera 100, which are... Figure 8 The digital camera 100 shown performs some processing operations and is... Figure 9 The control device 200 shown performs some processing operations, and these differences will be described.

[0208] The subject detection processing performed by each digital camera 100 according to this embodiment is the same as the subject detection processing performed by the control device 200 according to the second embodiment.

[0209] In other words, the subject detection processing of each digital camera 100 includes the processing of detecting feature regions (e.g., the face or body of a living being such as a person or animal, or a vehicle) and the processing of identifying, for example, a specific person, animal, or vehicle registered in each digital camera 100. This disclosure is not limited to any method of subject identification, and any method may be used.

[0210] According to this embodiment, the tracking processing performed by each digital camera 100 includes a process of continuously moving the AF frame, so that the subject detected in the subject detection processing is always captured in the area of ​​the AF frame.

[0211] Regarding the AF frame selection modes of each digital camera 100 according to this embodiment, in addition to the single-point AF and multi-point AF described according to the first and second embodiments, a tracking AF mode can also be set. Single-point AF and multi-point AF are AF frame selection modes in which the user selects the AF frame as described above. However, in the tracking AF mode, the user selects a subject from those detected in the subject detection process using a method described later. Therefore, the digital camera 100 begins the process of tracking the subject selected by the user.

[0212] By using the shooting menu settings or setting switches (not shown), the AF frame selection mode is preset to single-point AF mode or multi-point / area AF mode.

[0213] Changing the AF frame selection mode to tracking AF mode and selecting a subject in tracking AF mode are performed by the user operating the touchscreen of the aforementioned operation unit 105. When the AF frame is moved in response to a command received from the control device 200 regarding AF frame movement, and a subject is detected at the new position of the AF frame, the touch operation allows for a quick change from single-point AF mode or multi-point / area AF mode to tracking AF mode. Furthermore, the detected subject can be tracked.

[0214] According to this embodiment, the AF frame information includes information indicating whether each digital camera 100 is tracking the subject (tracking information), that is, whether the AF frame moves continuously to follow the subject.

[0215] A series of processes according to the third embodiment of the digital camera 100

[0216] Figure 10 This illustration shows a series of operations performed by multiple digital cameras 100 connected to the control device 200 during multi-remote shooting according to a third embodiment. The processing performed here includes displaying live view images from the multiple digital cameras 100 on the multi-remote shooting screen. Furthermore, this illustration shows a series of operations performed by the digital cameras 100 when controlling the movement of the AF frames of the multiple digital cameras 100.

[0217] Figure 10 Corresponding to the description according to the first embodiment Figure 8 .

[0218] In S808, it is determined whether a command regarding the movement of the AF frame has been received from the control device 200. If it is determined that a command regarding the movement of the AF frame has been received, the process in S1000 is performed. If it is determined that no command regarding the movement of the AF frame has been received, the process in S810 is performed.

[0219] In S1000, the destination coordinates, represented by the AF frame movement instruction received from the control device 200 in S808, are read. If the distance from the destination coordinates to the subject detected in the subject detection process is less than a predetermined distance, it is determined that the user has selected to track the subject, and the process in S1001 is performed. If the distance is equal to or greater than the predetermined distance, it is determined that the user has selected not to track the subject, and the position of the AF frame is changed to the destination coordinates, and the process in S809 is performed. The predetermined distance is, for example, represented as a fixed value, which is determined, for example, by a program stored in the non-volatile memory 103 of each digital camera 100.

[0220] In S1001, the AF box selection mode is changed to the tracking AF mode.

[0221] In S1002, the tracking of the subject selected in S1000 begins, and the processing in S810 is performed. Therefore, each digital camera 100 continuously moves the AF frame so that the detected subject is always captured within the area of ​​the AF frame.

[0222] The above operations are a series of operations performed by each of the plurality of digital cameras 100 connected to the control device 200 during multiple remote shooting, according to the third embodiment.

[0223] A series of processes according to the control device 200 of the third embodiment

[0224] Figure 11 The diagram illustrates a series of processing operations performed by the control device 200 when it controls the movement of the AF frame of a plurality of digital cameras 100, according to the third embodiment.

[0225] Figure 11 Corresponding to the description according to the second embodiment Figure 9 .

[0226] In S1100, after sending the command regarding AF frame movement to the operating camera 100 in S621 and confirming in S622 that the AF frame linkage movement is activated, it is confirmed that the display... Figure 6B The process of processing multiple live view images is shown. It checks whether the live view image and AF frame have been updated. If it is determined that the live view image and AF frame have been updated, then process S1101 is performed. If it is determined that the live view image and AF frame have not been updated, then process S1100 is repeated, and the process is checked again to see if the live view image and AF frame have been updated.

[0227] In S1101, AF frame information is read from additional information received from the live view image of the self-operated camera, and it is determined whether the self-operated camera is tracking the subject based on the tracking information stored in the AF frame information. If it is determined that the subject is being tracked, the process in S900 is performed. If it is determined that the subject is not being tracked, the series of operations ends.

[0228] In S900, as in the second embodiment, subject detection processing is performed on the area to be detected in the live view image of the operating camera. However, the area to be detected is defined based on information about the size and position of the AF frame tracking the subject, which was determined in S1101.

[0229] The above operation, according to the third embodiment, is a series of processing operations performed by the control device 200 when controlling the movement of the AF frame of the plurality of digital cameras 100. This processing enables the AF frame of each non-operational camera to move to the area of ​​the AF frame to capture the position of the subject, even when the operating and non-operational cameras have different compositions and the positions of the subject on the live view image are not similar. Furthermore, in response to the digital camera 100 receiving a command from the control device 200 regarding the movement of the AF frame, it begins subject tracking processing with both the operating and non-operational cameras. Therefore, even when the subject is constantly moving, the subject can always be captured within the AF area.

[0230] According to the above embodiment, when the camera is not tracking anything in S1101, the AF frames of all non-operated cameras are not moved. However, when the camera is not tracking anything in S1101, it can be done in conjunction with the first embodiment. Figure 6C The processing in S623 to S624. This series of operations can end after sending a command to move the AF frame of all non-operating cameras to the same coordinates as the destination coordinates of the operating cameras calculated in S620.

[0231] In the methods according to the second and third embodiments described above, all non-operating cameras begin tracking the same subject as the operating camera under the control of the AF frame linkage movement. However, only one or more non-operating cameras belonging to the same group as the main camera may be able to track the same subject as the operating camera. One or more non-operating cameras belonging to a different group than the main camera may track a different subject than the one tracked by the operating camera. That is, in Figure 9At point S902, it can be determined whether the group name displayed by the name display member 512 of the operating camera is the same as the group name displayed by the name display members 512 of each non-operating camera. If they are in the same group, a subject identical to the subject registered in S900 can be detected in the subject detection process. If they are in different groups, another subject different from the subject registered in S900 can be detected.

[0232] Variation Example

[0233] According to the third embodiment described above, the control device 200 detects a subject in the region near the position of the AF frame on the live view image of the operating camera by performing subject detection processing. It sends a command to move the AF frame to the position where the detected subject is the same as the subject in the live view images of each non-operating camera, and thus begins tracking. However, the control device 200 may not have a subject detection processing function, while the digital camera 100 according to the third embodiment may have a subject detection processing function, and the digital camera 100 may share the results of the subject detection processing with the control device 200.

[0234] For example, the digital camera 100 has detection frame information as additional information in the live view image. The detection frame information includes information representing the position and size of the subject detected in the subject detection processing of the digital camera 100 (position and size information), and is represented, for example, by the X-axis and Y-axis coordinates in the coordinate system of the live view image. Figure 11 In step S902, the control device 200 calculates the destination coordinates in the subject detection process based on the live view images of each non-operating camera. Alternatively, it reads detection frame information from additional information in the live view images of the non-operating cameras and calculates the coordinates of the detection frame that is closest to the position of the AF frame of the subject tracked by the operating camera calculated in S900 as the destination coordinates.

[0235] In some cases, as described above, only one or more non-operating cameras belonging to the same group as the main camera track the same subject as the operating camera. In these cases, in S902, it can be determined whether the group name displayed by the name display member 512 of the operating camera is the same as the group name displayed by the name display members 512 of each non-operating camera. In the case of the same group, the position of the detection frame closest to the position of the AF frame tracking the subject of the operating camera is calculated as the destination coordinates. In the case of different groups, the position of another detection frame is calculated as the destination coordinates.

[0236] According to the above embodiment, multiple remote shooting views 500 are divided between the main camera display component 504 and the secondary camera display component 505. A first camera control component 501 is added to the main camera display component 504, and a second and additional camera control components 502 are added to the secondary camera display component 505. The second and third camera control components 502 are displayed at a smaller size than the first camera control component 501.

[0237] However, the display format of the multiple remote shooting screen 500 of the control device 200 is not limited to this. For example, the multiple remote shooting screen 500 may not be divided between the main camera display component 504 and the secondary camera display component 505. The camera control components 501 and 502 of all digital cameras 100 and the live view display operation component 520 may be displayed side by side in the same form.

[0238] The preferred embodiments of the present disclosure have been described above, but the present disclosure is not limited to these embodiments, and various modifications and variations can be made without departing from the spirit of the present disclosure.

[0239] Other embodiments

[0240] This disclosure is provided by performing the process described below. That is, in this process, software (programs) implementing the functions of the embodiments described above are distributed to a system or device via a network or various storage media, and the computer (or controller, MPU, etc.) of the system or device reads and runs the program code. In this case, the program and the storage medium storing the program provide this disclosure.

[0241] The present disclosure has been described in detail above based on preferred embodiments. However, the present disclosure is not limited to specific embodiments, and various embodiments are included in the present disclosure without departing from its spirit. The above embodiments can be appropriately combined in parts.

[0242] The functional units according to the above embodiments (variations) may or may not be implemented in separate hardware. The functions of two or more functional units may be implemented by common hardware. Multiple functions of a single functional unit may be implemented by corresponding hardware. Two or more functions of a single functional unit may be implemented by common hardware. The functional units may or may not be provided by hardware such as ASICs, FPGAs, or DSPs. For example, the device may include a processor and a memory (storage medium) containing a control program. The function of at least one functional unit included in the device may be implemented by the processor reading the control program from the memory and running the control program.

[0243] This disclosure can be provided through a process in which a program implementing one or more functions of the above embodiments is distributed to a system or device via a network or storage medium, and one or more processors of a computer of the system or device read and run the program. This disclosure can also be provided by circuitry (such as an ASIC) implementing one or more functions.

[0244] First aspect

[0245] A control device for remotely controlling multiple imaging devices connected via a network, and comprising:

[0246] An acquisition unit is configured to acquire LV images from the plurality of imaging devices;

[0247] A display unit configured to display the LV image acquired by the acquisition unit; and

[0248] Control unit

[0249] The control unit is configured as follows:

[0250] When the first LV image displayed on the display unit is touched, movement command information regarding the AF frame, which specifies first coordinate information corresponding to the position where the first LV image is touched, is sent to the first imaging device associated with the first LV image; and

[0251] Send a movement instruction message to a second imaging device, which is different from the first imaging device, regarding the AF frame that specifies second coordinate information based on the first coordinate information.

[0252] Second aspect

[0253] Regarding the control device described in the first aspect

[0254] The second coordinate information is the same as the first coordinate information.

[0255] Third aspect

[0256] Regarding the control device described in the first aspect

[0257] The second coordinate information is different from the first coordinate information.

[0258] Fourth aspect

[0259] Regarding the control device described in the third aspect

[0260] The control unit is configured as follows:

[0261] In cases where the size information of the first LV image differs from the size information of the second LV image associated with the second imaging device, the second coordinate information is calculated by transforming the first coordinate information.

[0262] Fifth aspect

[0263] The control device described in the first aspect also includes:

[0264] The detection unit is configured to detect the subject based on the location where the first LV image is touched; and

[0265] The control unit is configured to designate the coordinates of the subject detected by the detection unit as the first coordinate information.

[0266] Sixth aspect

[0267] Regarding the control device described in the fifth aspect

[0268] The detection unit is configured as follows:

[0269] Based on information about the subject detected using the first coordinate information, the same subject is detected in the LV image of the second imaging device, and

[0270] The coordinates of the same subject are designated as the second coordinate information.

[0271] Seventh aspect

[0272] Regarding the control device described in the fifth or sixth aspect

[0273] The detection unit is configured as follows:

[0274] Detect the subject closest to the location where the first LV image was touched.

[0275] Eighth aspect

[0276] For any of the control devices described in the fifth to seventh aspects

[0277] The control unit is configured as follows:

[0278] Send the movement instruction information about the AF frame that specifies the second coordinate information based on the first coordinate information to the imaging device belonging to the same group as the first imaging device.

[0279] Ninth aspect

[0280] For any of the control devices described in the fifth to seventh aspects

[0281] The control unit is configured as follows:

[0282] The movement instruction information is sent to an imaging device belonging to a different group than the first imaging device, regarding the AF frame which specifies second coordinate information indicating the coordinates of a subject that is different from the subject indicated by the first coordinate information.

[0283] Tenth aspect

[0284] For any of the control devices described in the first to ninth aspects

[0285] The control unit is configured as follows:

[0286] When the AF frame linkage movement setting is activated, the movement command information of the AF frame, which is different from the first imaging device, is sent to the second imaging device, which specifies the second coordinate information based on the first coordinate information.

[0287] Eleventh aspect

[0288] A control method for remotely controlling multiple imaging devices connected via a network, the control method comprising:

[0289] LV images are acquired from the plurality of imaging devices.

[0290] The acquired LV image is displayed on the display unit.

[0291] When the first LV image displayed on the display unit is touched, movement command information regarding the AF frame, which specifies first coordinate information corresponding to the position where the first LV image is touched, is sent to the first imaging device associated with the first LV image; and

[0292] Send a movement instruction message to a second imaging device, which is different from the first imaging device, regarding the AF frame that specifies second coordinate information based on the first coordinate information.

[0293] Twelfth aspect

[0294] A program that enables a computer to function as a control device for remotely controlling multiple imaging devices connected via a network.

[0295] The control device includes:

[0296] The acquisition unit is configured to acquire LV images from the plurality of imaging devices.

[0297] A display unit configured to display the LV image acquired by the acquisition unit; and

[0298] Control unit, and

[0299] The control unit is configured as follows:

[0300] When the first LV image displayed on the display unit is touched, a movement command message for an AF frame, specifying first coordinate information corresponding to the position where the first LV image is touched, is sent to the first imaging device associated with the first LV image.

[0301] Send a movement instruction message to a second imaging device, which is different from the first imaging device, regarding the AF frame that specifies second coordinate information based on the first coordinate information.

[0302] Thirteenth aspect

[0303] A system comprising multiple imaging devices and a control unit, the control unit remotely controlling the multiple imaging devices connected via a network.

[0304] The control device includes:

[0305] The acquisition unit is configured to acquire LV images from the plurality of imaging devices.

[0306] A display unit configured to display the LV image acquired by the acquisition unit; and

[0307] Control unit

[0308] The control unit is configured as follows:

[0309] When the first LV image displayed on the display unit is touched, a movement instruction message for an AF frame that specifies first coordinate information corresponding to the position where the first LV image is touched is sent to a first imaging device associated with the first LV image;

[0310] Send to a second imaging device, different from the first imaging device, movement command information about the AF frame specifying second coordinate information based on the first coordinate information, and

[0311] The plurality of imaging devices include a detection unit configured to detect a subject based on coordinate information included in the movement command information about the AF frame received from the control device.

[0312] Fourteenth aspect

[0313] Regarding the system described in aspect thirteen,

[0314] The plurality of imaging devices also include:

[0315] A tracking unit is configured to track the subject detected by the detection unit.

[0316] According to this disclosure, a control device operated by the photographer can be used to control the movement of the AF frames of multiple digital cameras through joint operation.

[0317] Other embodiments

[0318] The embodiments disclosed herein can also be implemented as follows: a computer of a system or apparatus that reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more fully referred to as a "non-transitory computer-readable storage medium") to perform one or more functions of the above-described embodiments, and / or, the system or apparatus includes one or more circuits (e.g., application-specific integrated circuits (ASICs)) for performing one or more functions of the above-described embodiments; and a method performed by the computer of the system or apparatus, for example, reading and executing the computer-executable instructions from the storage medium to perform one or more functions of the above-described embodiments, and / or, controlling the one or more circuits to perform one or more functions of the above-described embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessor unit (MPU)) and may include separate computers or a network of separate processors to read and execute the computer-executable instructions. The computer-executable instructions may be provided to the computer, for example, from a network or a storage medium. The storage medium may include, for example, a hard disk, random access memory (RAM), read-only memory (ROM), the memory of a distributed computing system, or an optical disc (such as a compact disc (CD), a digital versatile optical disc (DVD), or a Blu-ray disc (BD)). TM One or more of the following: flash memory devices and memory cards.

[0319] Although this disclosure has been described with reference to embodiments, it should be understood that this disclosure is not limited to the disclosed embodiments. The scope of the appended claims should be given the broadest interpretation to cover all such variations and equivalent structures and functions.

Claims

1. A control apparatus that remotely controls a plurality of imaging devices connected to the control apparatus via a network, the control apparatus comprising: an acquisition unit configured to acquire live view images from the plurality of imaging devices; a display unit configured to display the live view images acquired by the acquisition unit; an operation unit configured to receive a touch operation by a user; at least one memory that stores a program; and at least one processor configured to, upon a first live view image displayed on the display unit being touched, transmit, to a first imaging device associated with the first live view image, movement instruction information on an auto focus frame that specifies first coordinate information corresponding to a position at which the first live view image is touched, and transmit, to a second imaging device different from the first imaging device, movement instruction information on an auto focus frame that specifies second coordinate information based on the first coordinate information.

2. The control apparatus according to claim 1, the second coordinate information is the same coordinate information as the first coordinate information.

3. The control apparatus according to claim 1, the second coordinate information is different coordinate information from the first coordinate information. wherein, 4. The control apparatus according to claim 3, the at least one processor, when executing the stored program, is further configured to: wherein in a case where size information on the first live view image is different from size information on a second live view image associated with the second imaging device, calculate the second coordinate information by converting the first coordinate information.

5. The control apparatus according to claim 1, wherein wherein the at least one processor, when executing the stored program, is further configured to: detect a subject in the first live view image based on a position at which the first live view image is touched, and specify, as the first coordinate information, a coordinate at which the detected subject is located.

6. The control apparatus according to claim 5, the at least one processor, when executing the stored program, is further configured to: detect the same subject in a second live view image associated with the second imaging device based on information on a subject detected in the second live view image based on the first coordinate information, and specify, as the second coordinate information, a coordinate at which the detected same subject is located. wherein, 7. The control apparatus according to claim 5, the at least one processor, when executing the stored program, is further configured to: detect a subject in the first live view image that is closest to a position at which the first live view image is touched.

8. The control apparatus according to claim 1, wherein, the at least one processor, when executing the stored program, is further configured to: transmit, to imaging devices belonging to the same group as the first imaging device, the movement instruction information on the auto focus frame that specifies the second coordinate information based on the first coordinate information.

9. The control apparatus according to claim 5, wherein ​ ​ ​ wherein, The at least one processor is further configured to, when executing the stored program: transmit, to an imaging device belonging to a group different from the group of the first imaging device, the movement instruction information regarding the automatic focus frame for which the second coordinate information indicating a coordinate at which a subject different from the subject detected in the first live view image is specified is designated.

10. The control apparatus according to claim 1, wherein The at least one processor is further configured to, when executing the stored program: transmit, to the second imaging device different from the first imaging device, the movement instruction information regarding the automatic focus frame for which the second coordinate information based on the first coordinate information is designated, in a case where the setting of automatic focus frame linked movement is activated.

11. A control method of remotely controlling a plurality of imaging devices connected to a control apparatus via a network, the control method comprising: acquiring live view images from the plurality of imaging devices; displaying the acquired live view images on a display unit; receiving a touch operation performed on a user operation unit; transmitting, to a first imaging device associated with a first live view image displayed on the display unit, movement instruction information regarding an automatic focus frame for which first coordinate information corresponding to a position at which the first live view image is touched is designated, in a case where the first live view image displayed on the display unit is touched; and transmitting, to a second imaging device different from the first imaging device, movement instruction information regarding an automatic focus frame for which second coordinate information based on the first coordinate information is designated.

12. A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method, the method comprising: acquiring live view images from a plurality of imaging devices; displaying the acquired live view images on a display unit; receiving a touch operation performed on a user operation unit; transmitting, to a first imaging device associated with a first live view image displayed on the display unit, movement instruction information regarding an automatic focus frame for which first coordinate information corresponding to a position at which the first live view image is touched is designated, in a case where the first live view image displayed on the display unit is touched; and transmitting, to a second imaging device different from the first imaging device, movement instruction information regarding an automatic focus frame for which second coordinate information based on the first coordinate information is designated.

13. A system comprising: a plurality of imaging devices; and a control apparatus of remotely controlling a plurality of imaging devices connected to the control apparatus via a network, wherein the control apparatus includes: an acquisition unit configured to acquire live view images from the plurality of imaging devices; a display unit configured to display the live view images acquired by the acquisition unit; an operation unit configured to receive a touch operation performed by a user; at least one memory storing a program; and at least one processor configured to, when executing the stored program: In a case where a first live view image displayed on the display unit is touched, moving instruction information regarding an autofocus frame that specifies first coordinate information corresponding to a position at which the first live view image is touched is transmitted to a first imaging device associated with the first live view image; and Moving instruction information regarding an autofocus frame that specifies second coordinate information based on the first coordinate information is transmitted to a second imaging device different from the first imaging device, and wherein each of the plurality of imaging devices includes: at least one device memory that stores a device program; and at least one device processor configured to function as: a detection unit configured to detect a subject based on coordinate information included in the moving instruction information regarding the autofocus frame received from the control device.

14. The system according to claim 13, wherein the at least one processor of each of the plurality of imaging devices, when executing the stored program, is further configured to function as a tracking unit configured to track the subject detected by the detection unit.

Images