Control system, imaging device and control method for the same, and program

Abstract

To provide a control system that makes it difficult to miss a photo opportunity even when an imaging device is controlled by a plurality of control devices.SOLUTION: An imaging device (digital camera 100) includes: a plurality of communication units that communicate with a connection control device via a network device by wireless communication; an imaging unit 102 that performs an imaging operation; an imaging optical system that performs an autofocus operation; and a control unit that performs control so as to start an imaging operation when the control unit first receives an instruction to start the imaging operation from any one of the plurality of control devices, continue the imaging operation until the control unit receives an instruction to stop the imaging operation from all the control devices that have transmitted the instruction to start the imaging operation, start the autofocus operation when the control unit first receives the instruction to start the autofocus operation from any one of the plurality of control devices, and continue the autofocus operation until the control unit receives an instruction to stop the autofocus operation from all the control devices that have transmitted the instruction to start the autofocus operation.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a control system for controlling an imaging device by using a plurality of control devices. [Background technology]

[0002] 2. Description of the Related Art In recent years, at sporting events such as the Olympic Games, photographers have been taking pictures of a wide variety of competitive scenes, and many of these pictures have been distributed in news media.

[0003] In these types of competitions, multiple digital cameras are installed at various angles, and systems are being used that allow these cameras to be remotely controlled by a portable control device. In such systems, a small number of photographers can operate a control device, typically a tablet or laptop computer, connected to the cameras via a network, and control multiple digital cameras at once.

[0004] As software capable of remotely controlling the shooting of multiple digital cameras, existing technologies such as "NX Field" by Nikon Corporation and "Remote Camera Tool" by Sony Corporation are sometimes used. Non-Patent Documents 1 and 2 disclose how to use these software.

[0005] However, even with such software, it is difficult for a photographer to predict the movement of a subject when photographing a sporting event such as a soccer match, where the subject moves around in a large venue. Therefore, when one photographer operates one control device to control multiple digital cameras, the following problems arise. That is, the photographer needs to check whether the multiple digital cameras are capturing the subject within the angle of view, but may not pay attention to all the digital cameras and may miss a photo opportunity with one of the digital cameras.

[0006] Therefore, in order not to miss a photo opportunity, a remote photography system is desired in which a plurality of control devices are connected to a network so that a plurality of photographers can take pictures with a digital camera by operating their own control devices. [Prior art documents] [Non-patent literature]

[0007] [Non-Patent Document 1] Nikon "NX Field System User Manual", {online}, [Searched on August 15, 2023], Internet<URL:https: / / nps.nikonimaging.com / technical_info / nx_field / pdf / NXFieldUM_Jp_ver.1.3.pdf> [Non-Patent Document 2] Sony "How to use Remote Camera Tool", {online}, [Searched on August 15, 2023], Internet<URL:https: / / support.d-imaging.sony.co.jp / app / remotecameratool / ja / instruction / 1_connection.php> Summary of the Invention [Problem to be solved by the invention]

[0008] When taking still images with a digital camera, the photographer adjusts the focus by autofocus in accordance with the movement of the subject and takes the photograph.

[0009] In still image shooting using a remote photography system, the photographer can control the timing of the autofocus operation of the digital camera by sending autofocus start and stop commands from the control device. Similarly, the photographer can control the timing of the photography operation of the digital camera by sending photography start and stop commands.

[0010] However, with existing technologies such as the above-mentioned "NX Field" and "Remote Camera Tool," it may not be possible to control the autofocus or shooting operation timing of a digital camera from multiple control devices within the same period.

[0011] For example, in a system with a restriction that when a digital camera is already taking pictures in response to a shooting start command from a certain control device, it will not accept a shooting start command from another control device, the following problem occurs. Specifically, when a digital camera is taking pictures in response to a shooting start command already issued by a photographer, even if another photographer sends a shooting start command from another control device to take a picture, the digital camera will not accept the command. Therefore, after the digital camera has finished taking pictures, the photographer needs to send a start command again from the control device to make the digital camera start taking pictures. However, there is a risk that the photographer will miss the photo opportunity due to the time that has passed during this time.

[0012] Such problems also occur in autofocus control. For example, if there is a restriction that when a digital camera is already in autofocus operation due to an autofocus start command from a certain control device, the digital camera will not accept an autofocus start command from another control device, the following problem occurs. Specifically, when the digital camera is in autofocus operation due to an autofocus start command already issued by a photographer, even if another photographer transmits an autofocus start command from another control device to prepare before taking a picture, the command is not accepted by the digital camera. Therefore, after the digital camera has finished autofocusing, the photographer needs to transmit a start command from the control device again to make the digital camera start autofocusing. However, the time that passes during this time may delay preparation for taking a picture, and the photo opportunity may be missed.

[0013] The present invention has been made in consideration of the above-mentioned problems, and has as its object to provide a control system that makes it difficult to miss a photo opportunity even when an imaging device is controlled by a plurality of control devices. [Means for solving the problem]

[0014] The control system of the present invention is a control system that controls an imaging device using a plurality of control devices, wherein the control device comprises a first communication means for communicating with the imaging device, a first instruction means for outputting to the imaging device instructions to start and stop autofocus operation, which are instructions regarding autofocus operation, and a second instruction means for outputting to the imaging device instructions to start and stop photographing operation, which are instructions regarding shooting operation, and wherein the imaging device comprises a second communication means for communicating with the control device, an imaging means for performing a photographing operation, a photographing optical system for performing an autofocus operation, and a control means for controlling the imaging device to start the photographing operation when it first receives an instruction to start the photographing operation from any one of the plurality of control devices, and to continue the photographing operation until it receives an instruction to stop the photographing operation from all of the control devices that sent the instruction to start the photographing operation, and to start the autofocus operation when it first receives an instruction to start the autofocus operation from any one of the plurality of control devices, and to continue the autofocus operation until it receives an instruction to stop the autofocus operation from all of the control devices that sent the instruction to start the autofocus operation. Effect of the Invention

[0015] According to the present invention, it is possible to provide a control system that is unlikely to miss a photo opportunity even when an imaging device is controlled by a plurality of control devices. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is a hardware configuration diagram showing the configuration of a digital camera. [Diagram 2] FIG. 2 is a hardware configuration diagram showing the configuration of a control device. [Diagram 3] FIG. 1 is a diagram showing the configuration of a camera control system. [Figure 4A] 5 is a flowchart showing the operation of the control device in the first embodiment. [Figure 4B]5 is a flowchart showing the operation of the control device in the first embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of a display screen of the control device in the first embodiment. [Figure 6A] 5 is a flowchart showing the operation of the digital camera according to the first embodiment. [Figure 6B] 5 is a flowchart showing the operation of the digital camera according to the first embodiment. [Figure 6C] 5 is a flowchart showing the operation of the digital camera according to the first embodiment. [Figure 7] 4 is a diagram showing an example of a remote control information list stored in the digital camera. [Figure 8A] 10 is a flowchart showing the operation of a digital camera according to a second embodiment. [Figure 8B] 10 is a flowchart showing the operation of a digital camera according to a second embodiment. [Figure 9] FIG. 13 is a diagram showing an example of a display screen of a control device according to the third embodiment. [Figure 10A] 10 is a flowchart showing the operation of a digital camera according to a third embodiment. [Figure 10B] 10 is a flowchart showing the operation of a digital camera according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0018] (First embodiment) <Configuration of Digital Camera 100> 1(a) is a hardware configuration diagram showing an example of the configuration of a digital camera (imaging device) 100 in a camera control system according to a first embodiment of the present invention. Note that, although a case where a digital camera is used as an example of a control device constituting the camera control system will be described here, the control device is not limited to this. For example, the control device may be an information processing device such as a portable media player, a so-called tablet device, or a personal computer.

[0019] In camera 100, control unit 101 controls each unit of digital camera 100 in accordance with input signals and programs described below. Note that instead of control unit 101 controlling the entire device, the entire device may be controlled by multiple pieces of hardware sharing the processing.

[0020] The imaging unit 102 is composed of, for example, an optical lens unit, a photographing optical system that controls the aperture, zoom, focus, etc., and an imaging element for converting an optical image formed through the optical lens unit into an electrical image signal. As the imaging element, a CMOS sensor (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is generally used.

[0021] Under the control of the control unit 101, the imaging unit 102 converts subject light formed by a lens included in the imaging unit 102 into an electrical signal using an imaging element, performs noise reduction processing, and outputs digital image data. In the digital camera 100 of this embodiment, the image data is recorded on the recording medium 110 in accordance with the DCF (Design Rule for Camera File System) standard.

[0022] The non-volatile memory 103 is an electrically erasable and recordable non-volatile memory, and stores programs, etc., which are described below, executed by the control unit 101. The working memory 104 is used as a buffer memory for temporarily storing image data captured by the imaging unit 102, an image display memory for the display unit 106, a working area for the control unit 101, etc.

[0023] The operation unit 105 is used to accept instructions from the user to the digital camera 100. The operation unit 105 includes, for example, a power button for the user to instruct to power on / off the digital camera 100, a release switch to instruct to shoot, and a playback button to instruct to play back image data. It also includes operation members such as a dedicated connection button for starting communication with an external device via a communication unit 111 described later. The operation unit 105 also includes a touch panel 105d arranged on a display unit 106 described later.

[0024] The release switch has three states: a non-pressed state, a fully pressed state (SW2) where the push button is pressed to the movable end, and a half-pressed state (SW1) between these two. When the release switch is in the SW1 state, the control unit 101 outputs a command to start a shooting preparation operation, i.e., a shooting preparation command. In the shooting preparation operation, operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing, which will be described later, are executed.

[0025] Furthermore, after performing the shooting preparation operation with SW1, when the release switch is further operated to the SW2 state, the control unit 101 outputs a shooting operation start command, the shooting operation is executed, and the image is written to the recording medium 110. When the continuous shooting mode is set and the release switch is in the SW2 state, shooting is repeated during the shooting operation until the release switch is not pressed or is in the SW1 state. In other words, as long as the release switch remains in the SW2 state, continuous shooting is performed, and multiple images are shot in succession. When the release switch changes from the SW2 state to another state, that is, to the SW1 state or not pressed state, the control unit 101 outputs a shooting stop command, and the continuous shooting operation ends.

[0026] The operation unit 105 also includes an AF-ON button for instructing only the AF process included in the shooting preparation operation. When the AF-ON button is pressed, an instruction to start the AF operation is output from the control unit 101, and the AF process is started.

[0027] In addition, the digital camera 100 allows the AF operation mode (AF operation mode) to be set via the operation unit 105. The AF operation modes include one-shot AF, which is suitable for capturing images of a stationary subject, and servo AF (continuous AF), which is suitable for capturing images of a moving subject. These modes are selectively set via the operation unit 105.

[0028] In the AF operation in one-shot AF, when a command to start the AF operation is output from the control unit 101, automatic focus detection is performed in a focus detection area arbitrarily selected by the user. Then, the focus lens included in the photographing lens is moved to a focus position and the drive of the focus lens is stopped, and thereafter, the position of the focus lens is fixed (hereinafter referred to as "AF lock") until a command to stop the AF operation is output.

[0029] On the other hand, in the AF operation in servo AF, the movement of the main subject is detected even after the focus lens is moved to the focal position. Then, when the movement of the main subject is detected, the focus lens is continuously driven according to the defocus amount detected in the focus detection area. That is, the focus lens continues to be driven to focus on the main subject until a command to stop the AF operation is output from the control unit 101.

[0030] The digital camera 100 can also be set to a tracking AF mode, in which the focus detection area is automatically moved to track the movement of the subject, via the operation unit 105. The tracking AF mode can be used in combination with one-shot AF or servo AF.

[0031] The display unit 106 displays a viewfinder image during shooting, displays captured image data, displays characters for interactive operations, etc. Note that the display unit 106 does not necessarily have to be built into the digital camera 100. The digital camera 100 can be connected to an internal or external display unit 106, and it is sufficient that the digital camera 100 has at least a display control function for controlling the display of the display unit 106.

[0032] The RTC 107 performs time management. It manages the time based on the time setting input by the user via the operation unit 105, the time information acquired via the communication unit 111, or the time information captured by a radio clock. It is sufficient if the time can be managed regardless of the time input method.

[0033] The recording medium 110 records the image data output from the imaging unit 102. The recording medium 110 may be configured to be detachable from the digital camera 100, or may be built into the digital camera 100. In other words, it is sufficient that the digital camera 100 has at least a means for accessing the recording medium 110.

[0034] The communication unit 111 is an interface for connecting to an external device. The digital camera 100 of this embodiment can exchange data with the external device via the communication unit 111. For example, image data generated by the imaging unit 102 can be transmitted to the external device via the communication unit 111. In this embodiment, the communication unit 111 includes an interface for communicating with the external device via a so-called wireless LAN in accordance with the IEEE802.11 standard. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 111. The communication method is not limited to wireless LAN, and also includes, for example, an infrared communication method.

[0035] The communication unit 112 is an interface for connecting to an external device. The digital camera 100 of this embodiment can exchange data with the external device via the communication unit 112. For example, image data generated by the imaging unit 102 can be transmitted to the external device via the communication unit 112. Note that in this embodiment, the communication unit 112 includes an interface for communicating with the external device via so-called Bluetooth (registered trademark) in accordance with the IEEE802.15.1 standard. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 112. Note that the communication method is not limited to Bluetooth, and can also include, for example, a wireless LAN known as the IEEE802.11 standard or an infrared communication method.

[0036] The communication unit 113 is an interface for connecting to an external device. The digital camera 100 of this embodiment can exchange data with the external device via the communication unit 113. For example, image data generated by the imaging unit 102 can be transmitted to the external device via the communication unit 113. Note that in this embodiment, the communication unit 113 includes an interface for communicating with the external device via a wired LAN (Ethernet) in accordance with the IEEE802.3 standard. The control unit 101 realizes communication with the external device by controlling the communication unit 113. Note that the communication method is not limited to a wired LAN, and also includes, for example, a USB communication method.

[0037] The communication unit 112 of the digital camera 100 in this embodiment has a peripheral mode and a central mode as operation modes. By operating the communication unit 112 in the peripheral mode, the digital camera 100 in this embodiment can operate as a client device in Bluetooth. When the digital camera 100 operates as a client device, it can communicate by connecting to an external device in central mode. For authentication of the external device to be connected, pairing is performed in advance, and unique information of the external device to be connected is stored in the non-volatile memory 103. Even if the power switch of the digital camera 100 is OFF, the digital camera 100 can make a call if power is supplied to the Bluetooth module.

[0038] The near field communication unit 114 is composed of, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, a communication controller, etc. The near field communication unit 114 outputs a modulated wireless signal from the antenna and demodulates a wireless signal received by the antenna to realize non-contact near field communication in accordance with the ISO / IEC 18092 standard (so-called NFC: Near Field Communication). The near field communication unit 114 of this embodiment is disposed on the side of the digital camera 100.

[0039] The digital camera 100 starts communication and is connected to the control device 200 described later by bringing the close proximity wireless communication units 114 and 214 into close proximity to each other. When connecting to the control device 200 using the close proximity wireless communication unit 114, it is not necessary to bring the close proximity wireless communication units 114 and 214 into contact with each other. Since the close proximity wireless communication units 114 and 214 can communicate with each other even if they are apart by a certain distance, in order to connect the devices to each other, it is sufficient to bring them into close proximity to a range where close proximity wireless communication is possible. In the following description, bringing them into close proximity to a range where close proximity wireless communication is possible is also referred to as bringing them into close proximity.

[0040] Next, the appearance of the digital camera 100 will be described. FIG. 1(b) and FIG. 1(c) are diagrams showing an example of the appearance of the digital camera 100. The release switch 105a, the playback button 105b, the directional keys 105c, and the touch panel 105d are operation members included in the operation unit 105 described above. The display unit 106 displays an image obtained as a result of imaging by the imaging unit 102. The digital camera 100 of this embodiment also has an antenna portion of the power supply unit 116 on the side of the camera housing. Power can be supplied by bringing these power supply units 116 close to each other at a certain distance. This allows power to be supplied contactlessly without using a cable or the like, and allows the start and end of power supply to be controlled.

[0041] In the following description, the digital camera 100 may be described as being the subject of processing, but in reality, the control unit 101 of the digital camera 100 reads programs stored in the non-volatile memory 103 and realizes various processes.

[0042] The above is a description of the digital camera 100.

[0043] <Configuration of control device 200> 2 is a hardware configuration diagram showing an example of the configuration of a control device 200, which is an example of an information processing device of this embodiment. Note that, although a case where the control device 200 is used as an example of a control device constituting a camera control system will be described here, the control device is not limited to this. For example, the control device may be a digital camera with a wireless function, a tablet device, a personal computer, or the like.

[0044] In the control device 200, the control unit 201 controls each unit of the control device 200 in accordance with input signals and a program described later. Note that instead of the control unit 201 controlling the entire device, the entire device may be controlled by multiple hardware devices sharing the processing.

[0045] The non-volatile memory 203 is an electrically erasable and recordable non-volatile memory. In the non-volatile memory 203, an OS (operating system) which is basic software executed by the control unit 201 and applications which cooperate with the OS to realize applied functions are recorded. In this embodiment, the non-volatile memory 203 also stores an application (hereinafter, an app) for communicating with the digital camera 100.

[0046] The work memory 204 is used as an image display memory for the display unit 206, a work area for the control unit 201, and the like.

[0047] The operation unit 205 is used to receive instructions from a user for the control device 200. The operation unit 205 includes operation members such as a power button for the user to instruct the control device 200 to be powered on / off, an operation member for setting the RTC 207, and a touch panel 206d disposed on the display unit 206.

[0048] The display unit 206 displays image data, characters for interactive operations, etc. The display unit 206 does not necessarily have to be included in the control device 200. The control device 200 only needs to be able to connect to the display unit 206 and have at least a display control function for controlling the display of the display unit 206.

[0049] The RTC 207 performs clock management. It manages the time based on the time setting input by the user via the operation unit 205, time information acquired via the communication unit 212 or the public network connection unit 213, or time information captured by a radio-controlled clock. It is sufficient if it can manage the time regardless of the time input method. It may also be possible to obtain the time from a mechanical mechanism such as an analog clock by a detection mechanism. In this case, the RTC 207 is considered to include a detection mechanism from the analog clock.

[0050] The recording medium 210 can record image data transferred from the digital camera 100 to the control unit 201 via the communication unit 211. The recording medium 210 may be configured to be detachable from the control device 200, or may be built into the control device 200. In other words, it is sufficient for the control device 200 to have at least a means for accessing the recording medium 210.

[0051] The communication unit 211 is an interface for connecting to an external device. The control device 200 of this embodiment can exchange data with the external device via the communication unit 211. In this embodiment, the communication unit 211 is an antenna, and the control unit 201 can connect to the digital camera 100 via the antenna. In this embodiment, the communication unit 211 includes an interface for communicating with the external device via a so-called wireless LAN in accordance with the IEEE802.11 standard. The control unit 201 realizes wireless communication with the external device by controlling the communication unit 211. The communication method is not limited to wireless LAN, and also includes, for example, an infrared communication method.

[0052] The communication unit 212 is an interface for connecting to an external device. The control device 200 of this embodiment can exchange data with the external device via the communication unit 212. For example, image data generated by the digital camera 100 can be received via the communication unit 212. Note that in this embodiment, the communication unit 212 includes an interface for communicating with the external device via so-called Bluetooth (registered trademark) in accordance with the IEEE802.15.1 standard. The control unit 201 realizes wireless communication with the external device by controlling the communication unit 212. Note that the communication method is not limited to Bluetooth, and can also include, for example, a wireless LAN known as the IEEE802.11 standard or an infrared communication method.

[0053] The communication unit 213 is an interface for connecting to an external device. The control device 200 of this embodiment can exchange data with the external device via the communication unit 213. For example, image data generated by the digital camera 100 can be received via the communication unit 213. Note that in this embodiment, the communication unit 213 includes an interface for communicating with the external device via a wired LAN (Ethernet) in accordance with the IEEE802.3 standard. The control unit 201 realizes communication with the external device by controlling the communication unit 213. Note that the communication method is not limited to a wired LAN, and also includes, for example, a USB communication method.

[0054] The communication unit 212 of the control device 200 in this embodiment has a peripheral mode and a central mode as operation modes. By operating the communication unit 212 in the central mode, the control device 200 in this embodiment can operate as a server device in Bluetooth. When the control device 200 operates as a server device, it is possible to communicate by connecting to an external device in the peripheral mode. For authentication of the external device to be connected, pairing is performed in advance, and unique information of the external device to be connected is stored in the non-volatile memory 203.

[0055] The near field communication unit 214 is composed of, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, a communication controller, etc. The near field communication unit 214 outputs a modulated wireless signal from the antenna and demodulates a wireless signal received by the antenna to realize non-contact near field communication in accordance with the ISO / IEC 18092 standard (so-called NFC: Near Field Communication). The near field communication unit 214 of this embodiment is disposed on the side of the control device 200.

[0056] In addition, in the following description, the control device 200 may be described as being the main processing unit, but in reality, the control unit 201 of the control device 200 loads the program of the application (or the application's function, or the OS or OS services, etc.) deployed in the working memory 204 and performs various processes.

[0057] <System configuration> Next, the configuration of the camera control system in this embodiment will be described.

[0058] FIG. 3 is a diagram showing the configuration of a system in which a plurality of control devices 200 and a plurality of digital cameras 100 are connected via a network device 300, and the digital cameras 100 can be remotely controlled by the control devices 200. As shown in FIG.

[0059] Digital camera 100 is mounted on tripod 303 or the like and set up at each shooting position. Note that, although in this embodiment digital camera 100 is set up on tripod 303, it may be set up on a remote platform that allows remote control of pan, tilt and zoom operations.

[0060] The following are examples of connection forms for communication between the digital camera 100 and the control device 200. First, the digital camera 100 connects to the network device 300 by wireless communication using radio waves 302 via the communication unit 112, and communicates with the control device 200. Another form is where the digital camera 100 connects to the network device 300 by wired LAN via the communication unit 113, and communicates with the control device 200.

[0061] In still another embodiment, the control device 200 connects to the network device 300 by wireless communication using radio waves 302 via the communication unit 212, and communicates with the digital camera 100. In still another embodiment, the control device 200 connects to the network device 300 by wired LAN via the communication unit 213, and communicates with the digital camera 100.

[0062] In this embodiment, an example in which communication is performed via the network device 300 has been described, but the digital camera 100 and the control device 200 may be directly connected.

[0063] As shown in FIG. 3, when multiple installed digital cameras 100 and the control device 200 are capable of communicating with each other, the control device 200 can issue commands to each individual digital camera 100 to obtain setting information for the digital camera 100 and to change the settings.

[0064] The control device 200 can also transmit a start shooting command, which is a command requesting the start of a shooting operation, and a stop shooting command, which is a command requesting the stop of a shooting operation, to each digital camera 100. These commands can be used to instruct the start and stop timing of the shooting operation of the digital camera 100.

[0065] Furthermore, the control device 200 can transmit, to each digital camera 100, an autofocus start command, which is a command requesting the start of an autofocus operation, and an autofocus stop command, which requests the stop of an autofocus operation. These commands make it possible to instruct the timing of starting and stopping the autofocus operation of the digital camera 100. Note that hereinafter, the shooting start command and shooting stop command are collectively referred to as "shooting control commands", and the autofocus start command and autofocus stop command are referred to as "autofocus control commands".

[0066] The digital camera 100 not only starts a photographing operation in response to a photographing operation start command output from the control unit 101 when the release switch is in the SW2 state, but also starts a photographing operation in response to a photographing operation start command received from the control device 200.

[0067] Similarly, the autofocus operation is not only started in response to an autofocus operation start command output from the control unit 101 when the AF-ON button is pressed, but also in response to an autofocus operation start command received from the control device 200.

[0068] With this configuration, it becomes possible for the control device 200 to control the photography and autofocus of the digital camera 100.

[0069] <System Issues> However, in the system of this embodiment, when multiple control devices 200 communicate with the same digital camera 100 and control autofocus or photography within the same period, a problem arises in that operation collisions may occur.

[0070] For example, if there is a restriction that when the digital camera 100 is already in shooting operation due to a shooting start command from one control device 200, it will not accept a shooting start command from another control device 200, the following problem occurs. In other words, when the digital camera 100 is already in shooting operation due to a shooting start command from a control device 200 of one photographer, even if another photographer sends a shooting start command from another control device 200 to take a picture, the command will not be accepted by the digital camera 100. Therefore, after the digital camera 100 has finished shooting operation, the photographer needs to send a start command from the control device 200 again to make the digital camera 100 start shooting. However, there is a risk that the photographer will miss the photo opportunity due to the time that has passed during this time.

[0071] The same problem also exists in the case of autofocus. For example, if there is a restriction that when the digital camera 100 is already in autofocus operation by an autofocus start command from a certain control device 200, the autofocus start command from another control device 200 is not accepted, the following problem occurs. In other words, when the digital camera 100 is already in autofocus operation by an autofocus start command from a control device 200 of a certain photographer, even if another photographer transmits an autofocus start command from another control device 200 to prepare before taking a picture, the command is not accepted by the digital camera 100. Therefore, after the digital camera 100 finishes the autofocus operation, the photographer needs to transmit a start command from the control device 200 again to make the digital camera 100 start the autofocus operation. However, the time that passes during this time may delay the preparation for taking a picture, and the photographer may miss the photo opportunity.

[0072] <How to solve the problem> Therefore, in this embodiment, when a plurality of control devices 200 communicate with the same digital camera 100 and control is performed on the autofocus or shooting operation within the same period, the following control is performed. That is, when the digital camera 100 receives a shooting start command from any one of the control devices 200 for the first time, the shooting operation is started, and the shooting operation is continued until shooting stop commands are received from all the control devices 200 that transmitted the start command. Then, when shooting stop commands are received from all the control devices 200 that transmitted the shooting start command, the shooting operation is stopped. Also, when the autofocus start command is received from any one of the control devices 200 for the first time, the autofocus operation is started, and the autofocus operation is continued until autofocus stop commands are received from all the control devices 200 that transmitted the start command. Then, when autofocus stop commands are received from all the control devices 200 that transmitted the autofocus start command, the autofocus operation is stopped.

[0073] The operations of the control device 200 and the digital camera 100 in the first embodiment will be described below.

[0074] 4A and 4B are flowcharts showing the operation of the control device 200 in this embodiment. In the following, the case where the control device 200 controls multiple digital cameras 100 by remote operation for photographing is called "multi-remote photographing." Also, the case where the control device 200 controls individual digital cameras 100 by remote operation for photographing is called "remote photographing."

[0075] Fig. 4A is a flowchart showing a series of operations from when the control device 200 establishes a connection with multiple digital cameras 100 until the connection is terminated. The operations in Fig. 4A are realized by the control unit 201 of the control device 200 expanding a control program stored in the non-volatile memory 203 into the working memory 204 and executing the program. In this flowchart, the series of operations are described as starting when the control device 200 is started up.

[0076] In step S400, the control unit 201 registers the connection settings of the multiple digital cameras 100 that are to be connected.

[0077] In step S401, the control unit 201 performs processing to detect the digital camera 100, and determines whether or not the control unit 201 has detected the digital camera 100. If the control unit 201 has detected the digital camera 100, the process proceeds to step S402, and if the control unit 201 has not detected the digital camera 100, the control unit 201 repeats step S401.

[0078] In step S402, the control unit 201 determines whether or not a connection operation has been performed by the user. If a connection request has been received, the control unit 201 advances the process to step S403, and if no connection request has been received, the control unit 201 repeats step S402.

[0079] In step S403, the control unit 201 performs connection processing with the detected digital camera 100 to establish a connection with the digital camera 100. When establishing a connection with the digital camera 100, the control device 200 also receives a session ID from the digital camera 100. The session ID is an ID for identifying a communication session from when the connection is established to when it is terminated. The session ID is attached to each command transmitted by the control device 200 to the digital camera 100 in the remote shooting and multi-remote shooting in step S407 described later, and is transmitted. This allows the digital camera 100 to distinguish a command received from the control device 200 from a command received in a different connection with another control device 200 or the same control device.

[0080] In step S404, the control device 200 stores in the non-volatile memory 203, the working memory 204, or the recording medium 210 all of the session IDs received in step S403.

[0081] In step S405, the control unit 201 determines whether there is a second or subsequent digital camera 100 to be connected that was registered for connection in step S400. If there is no digital camera 100 to be connected, the control unit 201 determines that remote shooting and multi-remote shooting can be started, and proceeds to step S406. If there are still digital cameras 100 to be connected, the control unit 201 returns to step S401.

[0082] In step S406, the control unit 201 displays a multi-remote shooting screen on the display unit 206.

[0083] Here, the multi remote shooting screen will be described with reference to FIG.

[0084] <Multi remote shooting control screen> FIG. 5 shows the configuration of a screen displayed on the control device 200 when two digital cameras 100 and the control device 200 are connected to perform multi-remote photography.

[0085] 5(a) shows a multi-remote photography screen 500. The multi-remote photography screen 500 has an individual camera control member 501 that controls settings related to photography, focus, photography, and the like for the first digital camera 100 connected to the control device 200.

[0086] It has an individual camera control member 502 that controls settings related to photography and controls focus, photography, etc. for the second digital camera 100 connected to the control device 200. It also has a multi-camera control member 503 that controls multiple digital cameras 100 at once. Note that hereinafter, control of multiple cameras is referred to as "multi-camera control."

[0087] The individual camera control members 501 and 502 have the same functions. Furthermore, when the connection settings for the third and subsequent digital cameras 100 are registered in the control device 200, an individual camera control member for the third digital camera 100 is added to the multi remote photography screen 500.

[0088] The individual camera control member 501, the other individual camera control member 502, the multi-camera control member 503, etc. are realized by the function of the touch panel 206d.

[0089] <Configuration of individual camera control components> FIG. 5B is a diagram showing the configuration of the individual camera control member 501. As shown in FIG.

[0090] The individual camera control member 501 has an operation member 510 for controlling the connection state with the digital camera 100, a display member 511 for indicating the power state and the status of the recording member of the digital camera 100, and a name display member 512 for identifying the individual camera. It also has an operation member 513 for controlling the autofocus of the individual digital camera 100, a display member 514 for indicating the network address of the digital camera 100, and a setting member 515 for making various settings for individual camera control. It also has a group of members 516 for controlling the display and change of the shooting settings of the digital camera 100, an operation member 517 for remote shooting of the individual digital camera 100, and a display member 518 for indicating the remaining number of shots and the number of shots of the digital camera 100. It also has a member 519 for controlling the live view display of the digital camera 100, a display operation member 520 for displaying the remote live view, and a display member 521 for indicating the focus detection area (hereinafter referred to as the "AF frame") in the autofocus of the digital camera 100.

[0091] 5(b), the user performs autofocus control to focus on a subject using the operation member 513, and performs remote shooting control using the operation member 517. When the control device 200 detects that the user has touched (contacted) the operation member 517 with his / her finger, it transmits a shooting start command to the digital camera 100. Thereafter, when it detects that the touch on the operation member 517 has been released, it transmits a shooting stop command to the digital camera 100. Furthermore, when it detects that the position of the operation member 513 has been touched, it transmits an autofocus start command to the digital camera 100, and when it detects that the touch on the operation member 513 has been released, it transmits an autofocus stop command to the digital camera 100.

[0092] As shown in FIG. 5(c), the operation member 513 is disposed at a position away from the operation member 517. However, the operation member 513 is configured to be movable toward the operation member 517 by the user touching and sliding the operation member 513. Therefore, when the control device 200 detects that the operation member 513 has been touched and the touch position has been moved, the control device 200 changes the display position of the operation member 513 according to the movement of the touch position. At this time, as shown in FIG. 5(d), a guide line 530 indicating the sliding direction of the operation member 513 may be displayed to clearly indicate that the operation member 513 is slidable. After that, as shown in FIG. 5(e), when the control device 200 detects that the position of the operation member 513 has been moved by the user's touch slide operation and overlaps with the operation member 517, the control device 200 transmits a shooting start command to the digital camera 100. Here, if operation member 513 overlaps with operation member 517, and then operation member 513 is moved in a direction different from the slidable direction and separated from operation member 517, control unit 201 transmits a shooting stop command to digital camera 100.

[0093] The above-described configuration of the operation members for autofocus control and remote shooting control in remote shooting is merely an example, and can be modified or changed as appropriate.

[0094] <Configuration of multi-camera control components> FIG. 5( f ) shows the configuration of the multi-camera control member 503 .

[0095] The multi-camera control member 503 is composed of members that output commands to multiple digital cameras 100 at once. Specifically, the multi-camera control member 503 has an operation member 531 that sets shooting parameters at once, an operation member 532 that issues an instruction for multi-remote shooting, and an operation member 533 that selects a group when issuing an instruction for multi-remote shooting. In addition, the multi-camera control member 503 has an operation member 534 that issues an instruction for autofocus to multiple digital cameras 100 at once.

[0096] The operation member 534 can be operated in the same manner as the operation member 513 in the individual camera control member 501, and issues autofocus start commands and autofocus stop commands to the multiple digital cameras 100.

[0097] Furthermore, the operation member 532 can be displayed and operated in the same manner as the operation member 517 in the individual camera control member 501, and issues shooting start commands and shooting stop commands to the multiple digital cameras 100.

[0098] The above-described configuration of the operation members for autofocus control and multi remote shooting control in multi remote shooting is merely an example, and can be modified or changed as appropriate.

[0099] This concludes the description of the control screen for multi remote photography.

[0100] Returning to the explanation of Fig. 4A, in step S407, the control unit 201 performs the remote photographing process and the multi remote photographing process shown in Fig. 4B, which will be explained later.

[0101] In step S408, the control unit 201 determines whether or not the connection with the multiple digital cameras 100 has ended. If the connection has ended, the control unit 201 determines that the user has completed the remote shooting process and the multi remote shooting process, and proceeds to step S409. If not completed, the control unit 201 returns to step S407.

[0102] In step S409, the control unit 201 deletes the session IDs with the multiple digital cameras 100 whose connections have been terminated from the non-volatile memory 203, the working memory 204, or the recording medium 210, and ends the series of operations in this flowchart.

[0103] FIG. 4B is a flowchart showing a series of operations of the remote photographing process and the multi-remote photographing process that the control unit 201 performs on the multiple digital cameras 100 in step S407 in FIG. 4A.

[0104] 4B is realized by the control unit 201 of the control device 200 expanding a control program stored in the non-volatile memory 203 into the work memory 204 and executing it. In this flowchart, a series of operations is described as starting when the control device 200 displays the multi-remote shooting screen.

[0105] 4B, the operation member 513 in the individual camera control member 501 and the operation member 534 in the multi-camera control member 503 are collectively referred to as the operation member for autofocus control. Also, the operation member 517 in the individual camera control member 501 and the operation member 532 for issuing a shooting command in the multi-camera control member 503 are collectively referred to as the operation member for shooting control.

[0106] In step S410, the control unit 201 determines whether or not the user has selected the autofocus control operation member 513 or 534. If the control unit 201 detects that a selection has been made, the process proceeds to step S411, and if not, the process proceeds to step S414.

[0107] In step S411, the control unit 201 transmits an autofocus start command to the digital camera 100 corresponding to the operation member for autofocus control selected in step S410, among the digital cameras 100 with which a connection was established in step S403. That is, if the operation member 513 is selected in step S410, the autofocus start command is transmitted to each individual digital camera 100. Also, if the operation member 534 is selected in step S410, the autofocus start command is transmitted to the multiple cameras belonging to the group to be photographed. Also, the control unit 201 reads out a session ID for identifying the connection with each digital camera 100 from the nonvolatile memory 203, the working memory 204, or the recording medium 210, and transmits it together with the autofocus start command.

[0108] In step S412, the control unit 201 determines whether or not a sliding operation has been performed while the operation member for autofocus control is selected. If a sliding operation has been performed, the control unit 201 advances the process to step S413, and if a sliding operation has not been performed, the control unit 201 advances the process to step S414.

[0109] In step S413, the control unit 201 determines whether or not the autofocus control operation member overlaps the shooting control operation member when the slide operation is performed to a position where the autofocus control operation member and the shooting control operation member overlap. If the operation members overlap, the control unit 201 proceeds to step S415, and if they do not overlap, the control unit 201 proceeds to step S414.

[0110] In step S414, the control unit 201 determines whether or not an operation member for shooting control has been selected. If selected, the control unit 201 advances the process to step S415, and if not selected, the control unit 201 advances the process to step S416.

[0111] In step S415, the control unit 201 transmits a shooting start command to the digital camera 100 corresponding to the shooting control operation member selected in step S413 or step S414, among the digital cameras 100 with which a connection was established in step S403. That is, if operation member 517 is selected, the shooting start command is transmitted to each individual digital camera 100, and if operation member 532 is selected, the shooting start command is transmitted to the multiple digital cameras 100 belonging to the group to be photographed. The control unit 201 also reads out a session ID that identifies the connection with each digital camera 100 from the nonvolatile memory 203, the working memory 204, or the recording medium 210, and transmits it together with the shooting start command.

[0112] In step S416, the control unit 201 determines whether the selection of the shooting control operation member has been released. If the selection has been released, the control unit 201 advances the process to step S417, and if not, the control unit 201 advances the process to step S418.

[0113] In step S417, the control unit 201 transmits a shooting stop command to the digital camera 100 corresponding to the shooting control operation member deselected in step S416, among the digital cameras 100 with which a connection was established in step S403. The control unit 201 also reads out a session ID for identifying the connection with each digital camera 100 from the non-volatile memory 203, the working memory 204, or the recording medium 210, and transmits it together with the shooting stop command.

[0114] In step S418, the control unit 201 determines whether the selection of the operation member for autofocus control has been released. If the selection has been released, the control unit 201 advances the process to step S419, and if the selection has not been released, the control unit 201 ends the remote shooting and multi remote shooting operations of this flowchart.

[0115] In step S419, the control unit 201 transmits an autofocus control stop command to the digital camera 100 corresponding to the autofocus control operation member deselected in step S418, among the digital cameras 100 with which a connection was established in step S403. The control unit 201 also reads out a session ID that identifies the connection with each digital camera 100 from the nonvolatile memory 203, the working memory 204, or the recording medium 210, and transmits it together with the autofocus stop command. Thereafter, the remote shooting and multi-remote shooting operations of this flowchart end.

[0116] The above is the process in which the control device 200 establishes connections with multiple digital cameras 100, performs remote photography and multi-remote photography, and ends.

[0117] 6A to 6C are flowcharts showing the operation of the digital camera 100 in this embodiment. In accordance with this processing flow, the digital camera 100 receives commands from a plurality of control devices 200 and performs autofocus and image capture.

[0118] Fig. 6A is a flowchart showing a series of operations from when digital camera 100 establishes a connection with control device 200 until the connection is terminated. The operations in Fig. 6A are realized by control unit 101 of digital camera 100 expanding a control program stored in non-volatile memory 103 into working memory 104 and executing it. In this flowchart, the series of operations are described as starting from a state in which digital camera 100 is placed in a shooting position.

[0119] When the user turns on the power of the digital camera 100 in step S600, the control unit 101 advances the process to step S601.

[0120] In step S601, the control unit 101 performs network settings for connection to the control device 200.

[0121] In step S602, the control unit 101 enables the network settings to make it possible to connect to the control device 200.

[0122] In step S603, the control unit 101 determines whether or not there has been a connection request from the control device 200. If there has been a connection request, the control unit 101 performs a connection process to establish a connection with the control device 200.

[0123] When establishing a connection with the control device 200, the control unit 101 generates a session ID for identifying a communication session to be started with the control device 200, and transmits it to the control device 200. Note that the session ID generated by the control unit 101 uses a random number or a random character string based on the current time, etc., but the generation method and format are not particularly limited. Thereafter, it is determined whether or not a connection has been established with one or more control devices 200, and if a connection has not been established, step S603 is repeated to check a connection request from the control device 200. If a connection has been established with one or more control devices, the control unit 101 advances the process to step S604.

[0124] In step S604, the control unit 101 determines whether a list (hereinafter referred to as a "remote control information list") has already been created, which holds the session ID transmitted to the control device 200 with which the connection was established in step S603, and the latest state (content) of the autofocus control command and the latest state (content) of the shooting control command received from the control device 200 (sender) in the process in step S605 described later. If the list has not been created, the control unit 101 creates a remote control information list and saves it in the nonvolatile memory 203, the working memory 204, or the recording medium 210.

[0125] The remote control information list will be described with reference to FIG.

[0126] 7 is a diagram showing an example of a remote control information list, which is made up of a session ID 701, an autofocus command status flag 702, and a shooting command status flag 703.

[0127] The session ID 701 is generated when the digital camera 100 establishes a connection with the control device 200 in step S603. This is an ID unique to the communication session that is received from the control device 200 together with the command when the digital camera 100 receives the command from the control device 200.

[0128] Autofocus command status flag 702 is a variable that indicates whether the most recent autofocus control command received from each control device 200 was an autofocus start command ("START") or an autofocus stop command ("STOP").

[0129] The photographing command status flag 703 is a variable indicating whether the latest photographing control command received from each control device 200 was a photographing start command ("START") or a photographing stop command ("STOP").

[0130] The remote control information list is expressed as a combination of a session ID 701, an autofocus command status flag 702, and a shooting command status flag 703. In Fig. 7, for example, the session ID is 0x41, and the latest autofocus control command received from the control device 200 is an autofocus start command, and the latest shooting control command received from the control device 200 is a shooting stop command.

[0131] The above is an explanation of the remote control information list.

[0132] Returning to the explanation of Fig. 6A, in step S604, in addition to the above-mentioned processing, the control unit 101 performs the following processing: In other words, the control unit 101 adds to the remote control information list the autofocus command status flag and the shooting command status flag corresponding to the session ID transmitted to each control device 200 in step S603, setting them to "stop" as the initial value.

[0133] In step S605, the control unit 101 determines whether or not an autofocus control command or a shooting control command has been received from the control device 200. If the control unit 101 has received the command, it proceeds to step S606, and if the control unit 101 has not received the command, it repeats step S605.

[0134] In step S606, the control unit 101 updates the remote control information list based on the autofocus control command or the shooting control command received from the control device 200 in step S605 and the session ID received together with the command.

[0135] If an autofocus start command is received from the control terminal 200 in step S605, the autofocus command status flag corresponding to the session ID received with the command is updated to "start", and if an autofocus stop command is received, it is updated to "stop". Also, if a shooting start command is received from the control terminal 200 in step S605, the shooting command status flag corresponding to the session ID received with the command is updated to "start", and if a shooting stop command is received, it is updated to "stop".

[0136] In step S607, the control unit 101 executes the photographing operation continuation process shown in Fig. 6B, which will be described later.

[0137] In step S608, the control unit 101 determines whether or not the connection established in step S603 with any of the control devices 200 has been terminated. If the connection has been terminated, the control unit 101 proceeds to step S609, and if the connection has not been terminated, the control unit 101 returns to step S603.

[0138] In step S609, the control unit 101 deletes from the remote control information list the control device 200 for which the connection was terminated in step S608. Note that instead of deleting the control device 200 from the remote control information list, the autofocus command status flag and the image capture command status flag in the remote control information list corresponding to the control device 200 for which the connection was terminated in step S608 may be set to "stopped." The remote control information list may then be managed without being deleted until it is deleted in step S612, which will be described later.

[0139] In step S610, the control unit 101 executes the shooting operation continuation process shown in FIG. 6B, similarly to step S607.

[0140] This is because, in response to updating the remote control information list in step S609, it is determined again whether or not to continue the autofocus operation and shooting operation of the digital camera 100, and the status of the autofocus operation and shooting operation is updated. For example, if a control device 200 whose shooting command status flag was in the "start" state in step S609 is deleted, after disconnection from that control device 200, the shooting operation may continue even though all the shooting command status flags in the remote control information list are in the "stop" state. Therefore, after the remote control information list is updated, it is necessary to perform a shooting operation continuation process based on the updated remote control information list.

[0141] In step S611, the control unit 101 determines whether or not the connections established in step S603 have been completed with all of the control devices 200. If the connections have been completed, the control unit 101 advances the process to step S612, and if the connections have not been completed, the control unit 101 returns the process to step S603.

[0142] In step S612, the control unit 101 deletes all remote control information lists from the non-volatile memory 203, the work memory 204, or the recording medium 210, and ends the operation of this flowchart.

[0143] FIG. 6B is a flowchart showing the operation of the photographing operation continuation process performed by the control unit 101 in steps S607 and S610 in FIG. 6A.

[0144] In step S620, the control unit 101 refers to the photography command status flags for all session IDs in the remote control information list, and determines whether any of the photography command status flags are in the "start" state. If any of the photography command status flags are in the "start" state, the control unit 101 advances the process to step S621, and if all of the photography command status flags are not in the "start" state, the control unit 101 advances the process to step S623.

[0145] In step S621, the control unit 101 determines whether or not a photographing operation has already started in the digital camera 100. If the photographing operation has already started, the control unit 101 ends the photographing operation continuation process of this flowchart, and if the photographing operation has not started, the control unit 101 advances the process to step S622.

[0146] In step S622, the control unit 101 performs a shooting operation start process to start shooting a still image, and then ends the shooting operation continuation process of this flowchart. However, if the continuous shooting mode is set, the shooting operation is repeated from start to stop. In other words, continuous shooting is performed and multiple images are shot continuously until the shooting operation stop process is performed in step S625 described later.

[0147] In step S623, the control unit 101 refers to the photography command status flags for all session IDs in the remote control information list, and determines whether all the photography command status flags are in the "stop" state. If all the photography command status flags are in the "stop" state, the control unit 101 proceeds to step S624, and if any of the photography command status flags are not in the "stop" state, the photography operation continuation process of this flowchart is terminated.

[0148] In step S624, the control unit 101 determines whether or not the photographing operation has already been stopped in the digital camera 100. If the photographing operation has already been stopped, the control unit 101 advances the process to step S626, and if the photographing operation has not been stopped, that is, if the photographing operation has already started, the control unit 101 advances the process to step S625.

[0149] In step S625, the control unit 101 performs a shooting operation stop process to stop the shooting operation of a still image.

[0150] In step S626, the control unit 101 executes the autofocus operation continuation process shown in Fig. 6C, and then ends the shooting operation continuation process of this flowchart. Fig. 6C will be described later.

[0151] The autofocus operation continuation process is a process for starting and stopping the autofocus operation based on the remote control information list, as described later. The autofocus operation continuation process of step S626 is executed when it is confirmed in step S624 that the photographing operation has been stopped, or after the photographing operation is stopped in step S625. Therefore, the continuation state of the autofocus operation does not change while the photographing operation is continuing. Also, after the photographing operation is stopped in step S625, the process of the following step S626 is executed, so that the autofocus operation can be started immediately if necessary.

[0152] FIG. 6C is a flowchart showing the operation of the autofocus operation continuation process performed by control unit 101 in step S626 in FIG. 6B.

[0153] In step S630, control unit 101 refers to the autofocus command status flags for all session IDs in the remote control information list, and determines whether any of the autofocus command status flags are in the "start" state. If any of the autofocus command status flags are in the "start" state, control unit 101 advances the process to step S631, and if all of the autofocus command status flags are not in the "start" state, control unit 101 advances the process to step S633.

[0154] In step S631, the control unit 101 determines whether or not the autofocus operation of the digital camera 100 has already started. If the autofocus operation has already started, the control unit 101 ends the autofocus operation continuation process of this flowchart, and if the autofocus operation has not started, the control unit 101 advances the process to step S632.

[0155] In step S632, the control unit 101 starts the autofocus operation, and then ends the autofocus operation continuation process of this flowchart. However, the autofocus operation continues from when it starts until it stops. That is, it continues until the autofocus operation stop process in step S635 described later is performed.

[0156] When the AF operation mode is servo AF, the defocus amount in the focus detection area is continuously detected and the focus lens is continuously driven according to the detected defocus amount until the autofocus operation stop processing is performed. When the tracking AF mode is set, the focus detection area is automatically moved to continuously track the subject, regardless of whether it is one-shot AF or servo AF, until the autofocus operation stop processing is performed.

[0157] In step S633, control unit 101 refers to the autofocus command status flags for all session IDs in the remote control information list, and determines whether all the autofocus command status flags are in the "stop" state. If all the autofocus command status flags are in the "stop" state, control unit 101 proceeds to step S634, and if it is determined that any of the autofocus command status flags are not in the "stop" state, control unit 101 ends the autofocus operation continuation process of this flowchart.

[0158] In step S634, the control unit 101 determines whether or not the autofocus operation of the digital camera 100 has already been stopped. If it has already been stopped, the autofocus operation continuation process of this flowchart is terminated, and if it has not been stopped, the process proceeds to step S635.

[0159] In step S635, the control unit 101 stops the autofocus operation that has already started by performing an autofocus operation stop process, and then ends the autofocus operation continuation process of this flowchart.

[0160] The above is a series of operations executed by the digital camera 100 when the digital camera 100 receives commands from a plurality of control devices 200 and performs the process of autofocusing and photographing in this embodiment.

[0161] As described above, in the above embodiment, the digital camera 100 starts the shooting operation when it first receives a shooting start command from any one of the control devices 200. Then, the shooting operation is continued until shooting stop commands are received from all the control devices 200 that transmitted the shooting start commands. On the other hand, when shooting stop commands are received from all the control devices 200 that transmitted the shooting start commands, the shooting operation is stopped.

[0162] Furthermore, when an autofocus start command is first received from any one of the control devices 200, the autofocus operation is started. Then, the autofocus operation is continued until autofocus stop commands are received from all the control devices 200 that transmitted the start commands. On the other hand, when an autofocus stop command is received from all the control devices 200 that transmitted the autofocus start commands, the autofocus operation is stopped.

[0163] As a result, even if a photographer attempts to take a photograph while the digital camera is already taking a photograph in response to a command from another photographer, the photographing continues until the other photographer issues a stop command, thereby preventing the other photographer from missing a photo opportunity.

[0164] Second embodiment In the first embodiment, the following control has been described. That is, when an autofocus start command is first received from any one of the control devices 200, the autofocus process is started. The autofocus process is continued until autofocus stop commands are received from all the control devices 200 that have transmitted the start commands. The autofocus process is stopped when autofocus stop commands are received from all the control devices 200 that have transmitted the start commands.

[0165] On the other hand, when the AF operation mode set in the digital camera 100 is one-shot AF, the autofocus operation is started in step S632 in FIG. 6C, and autofocus detection is performed in the focus detection area. Then, the focus lens is driven to the focus position according to the detected defocus amount, and the driving of the focus lens is stopped. Thereafter, the focus position is fixed until the autofocus operation stop process is performed in step S635. Therefore, even if the main subject moves, the autofocus detection and the driving of the focus lens are not performed continuously after the first reception of the autofocus command from the control device 200 until the autofocus operation stop process is performed. In other words, the main subject may remain out of focus.

[0166] Therefore, in the second embodiment, the autofocus control processing method is switched by referring to the AF operation mode. Specifically, when the AF operation mode is one-shot AF, in addition to the autofocus continuation processing shown in FIG. 6C in the first embodiment, the following processing is performed. That is, when a preset condition (hereinafter, referred to as "autofocus retry condition") is satisfied, the autofocus operation is stopped once and then immediately started again (retry operation). This allows the focus in the detection area to be detected again (focus detection is performed again) and the focus lens to be moved again to the focus position, thereby refocusing on the main subject.

[0167] The same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted or simplified. In this embodiment, only a part of the operation is different from the process executed by the digital camera 100 in the first embodiment shown in Figures 6A to 6C, and only the different parts will be described.

[0168] 8A and 8B are flowcharts showing the operation of digital camera 100 in this embodiment, and in particular show the autofocus operation continuation process among the series of operations.

[0169] FIG. 8A shows a process corresponding to FIG. 6C in the first embodiment.

[0170] In step S631, control unit 101 of digital camera 100 determines whether or not autofocus operation has already started in digital camera 100. If autofocus operation has not started, control unit 101 advances the process to step S801, and if autofocus operation has started, control unit 101 advances the process to step S632 as in FIG. 6C.

[0171] In step S801, the control unit 101 performs the autofocus retry process shown in FIG. 8B, and then ends the autofocus operation continuation process of this flowchart.

[0172] FIG. 8B is a flowchart showing the operation of the autofocus retry process performed by digital camera 100 in step S801 of FIG. 8A.

[0173] In step S810, the control unit 101 determines whether the currently set AF operation mode is one-shot AF. If it is one-shot AF, the control unit 101 advances the process to step S811, and if it is not one-shot AF, the control unit 101 ends the autofocus retry process of this flowchart.

[0174] In step S811, the control unit 101 determines whether or not an autofocus retry condition is satisfied. In this embodiment, the control unit 101 performs the following determination as an example of the autofocus retry condition. That is, when the remote control information list was updated in step S606 or step S609 in FIG. 6A, the control unit 101 determines whether or not any of the autofocus command status flags was updated from "stop" to "start." If the flags were updated, the control unit 101 proceeds to step S812, and if the flags were not updated, the control unit 101 ends the autofocus retry process of this flowchart.

[0175] In step S812, the control unit 101 ends the autofocus operation.

[0176] In step S813, the control unit 101 starts the autofocus operation, and then ends the autofocus retry process of this flowchart.

[0177] The above is the operation of the digital camera 100 in the second embodiment when commands are received from a plurality of control devices 200 to perform autofocus and photography.

[0178] The above-mentioned autofocus retry process performs the following operations. That is, when an autofocus start command is first received from any one of the control devices 200, the autofocus process is started. Then, when an autofocus start command is received from any of the control devices 200 until autofocus stop commands are received from all the control devices 200 that have transmitted the start commands, the main subject is focused on again by autofocus.

[0179] In this embodiment, the autofocus retry condition is that any of the autofocus command status flags has been updated from "Stop" to "Start" when the remote control information list is updated in step S606 or step S609 in FIG. 6A. However, the autofocus retry condition is not limited to this. For example, it is determined whether any of the autofocus command status flags has been updated from "Start" to "Stop" when the remote control information list is updated in step S606 or step S609 in FIG. 6A. If the flags have been updated, the process proceeds to step S812. That is, the process of stopping the autofocus operation once and restarting it is executed. If the flags have not been updated, the series of operations for retrying the autofocus ends.

[0180] This autofocus retry process performs the following operations: That is, when an autofocus start command is first received from any one of the control devices 200, the autofocus process is started. Then, when an autofocus stop command is received from any of the control devices 200 before autofocus stop commands are received from all the control devices 200 that have transmitted the start commands, the main subject is focused on again by autofocus.

[0181] As described above, according to the second embodiment, even if the AF operation mode is one-shot AF and the main subject moves, the focus in the detection area can be detected again and the focus can be realigned on the main subject.

[0182] (Third embodiment) In the first and second embodiments, it has been described that the control device 200 has a display screen and operation members as shown in Fig. 5, but no description has been given of an operation by the user to specify a focus detection area (AF frame) in autofocus of the digital camera 100. When the digital camera 100 is set to a tracking AF mode, the digital camera 100 moves the focus detection area to automatically track the movement of the subject, so that the user does not necessarily need to specify an AF frame. However, when the tracking AF mode is not set, for example, a configuration is required that allows the user to specify the AF frame at any position.

[0183] Therefore, in the third embodiment, a configuration in which the user operates a control member on the display screen of the control device 200 to specify an AF frame at an arbitrary position will be described.

[0184] The same components as those in the first and second embodiments are denoted by the same reference numerals, and the description thereof will be omitted or simplified. Also, in this embodiment, only a part of the screen displayed on the display unit 206 of the control device 200 shown in Fig. 5, a part of the operation performed by the control device 200 shown in Fig. 4, and a part of the operation of the process performed by the digital camera 100 shown in Fig. 8 are different, so only these different parts will be described.

[0185] Fig. 9 shows an operation member in the third embodiment, and shows a portion corresponding to the individual camera control member 501 in Fig. 5(b) shown in the first embodiment. In Fig. 9, by touching the live view display operation member 520 with a finger 900, it is possible to instruct the digital camera 100 to issue an autofocus start command in accordance with the touched position. Then, by releasing the touch on the live view display operation member 520, it is possible to instruct the digital camera 100 to issue an autofocus end command. Note that a modification may be made so that not only an autofocus control command but also a shooting control command is transmitted at any timing in a series of operations from touching the live view display operation member 520 to releasing the touch.

[0186] In the first embodiment, the control device 200 performed a series of processes in the procedure shown in Figs. 4A and 4B. In the third embodiment, the control device 200 accepts not only operations using the autofocus control operation member and the shooting control operation member as shown in Fig. 4B, but also operations on the live view display operation member 520. When the control device 200 detects a touch on the live view display operation member 520, it transmits to the digital camera 100 information on the position in the live view screen corresponding to the touched position (hereinafter referred to as "AF frame information") and an autofocus start command. Then, it displays a display member 521 indicating an AF frame at the touched position. Then, when it detects that the touch has been released, it transmits an autofocus stop command to the digital camera 100.

[0187] 10A and 10B are flowcharts showing the operation of digital camera 100 in this embodiment, and in particular show the autofocus operation continuation process among the series of operations.

[0188] FIG. 10A shows a portion corresponding to FIG. 8A shown in the second embodiment.

[0189] In step S1000, the control unit 101 determines whether or not AF is locked. If AF is locked, the control unit 101 advances the process to step S630, and if AF is not locked, the control unit 101 advances the process to step S1001. Note that, if the AF operation mode of the digital camera 100 is one-shot AF, and after the AF operation has already started, auto focus detection is performed once and the focus lens is moved, and then the focus lens position is fixed. In other words, AF is locked. Therefore, if AF is ongoing, the focus detection area cannot be moved.

[0190] In step S1001, the control unit 101 calculates and updates the focus detection area for the next autofocus based on the AF frame information received together with the autofocus start command in step S605 of Fig. 6A, and then proceeds to step S630.

[0191] FIG. 10B shows a portion corresponding to the autofocus retry process in FIG. 8B shown in the second embodiment.

[0192] In step S812, the control unit 101 ends the autofocus operation, and then proceeds to step S1002.

[0193] In step S1002, the control unit 101 calculates the focus detection area for the next autofocus based on the AF frame information received together with the autofocus start command in step S605 of Fig. 6A, as in step S1001, and updates the focus detection area. After that, the process proceeds to step S813.

[0194] Unlike step S1001, even if the AF operation mode of the digital camera 100 is one-shot AF, the AF operation is stopped in step S812, so the focus detection area can be moved.

[0195] In step S813, the digital camera 100 starts the autofocus operation, and then ends the autofocus retry process of this flowchart.

[0196] The above is the operation of digital camera 100 in the third embodiment when performing autofocus and photographing in response to commands received from multiple control devices 200. In this way, when the user has specified an AF frame, in the autofocus retry process, after the autofocus operation is stopped, the focus detection area is moved based on the AF frame specified by the user, and the autofocus operation is started again.

[0197] In the third embodiment, in step S1001 or step S1002, the focus detection area for the next autofocus is calculated based on the latest AF frame information received in step S605 in Fig. 6, and the focus detection area is updated. However, the method in which the digital camera 100 updates the focus detection area is not limited to this.

[0198] For example, the following method is conceivable: When updating the remote control information list in step S606, the AF frame information received from the control device 200 in step S605 in Fig. 6 is combined with a session ID and stored in the non-volatile memory 203, the working memory 204, or the recording medium 210. Then, in step S1001 or step S1002, an arbitrary AF frame is selected from the AF frame information associated with each session ID, and the focus detection area for the next autofocus is calculated based on the selected AF frame, and the focus detection area is updated.

[0199] (Modification) In the first to third embodiments, a method has been shown in which an autofocus operation equivalent to pressing the AF-ON button is started by transmitting an autofocus start command from a plurality of control devices 200 to the digital camera 100. However, instead of the autofocus operation, a shooting preparation operation may be started by transmitting a command to start a shooting preparation operation when the release switch is in the SW1 state from a plurality of control devices 200 to the digital camera 100. In other words, instead of controlling only the start and stop timing of the autofocus operation, a configuration may be adopted in which the control device 200 controls the start and stop timing of all shooting preparation operations including AF processing, AE processing, AWB processing, EF processing, etc.

[0200] In the first to third embodiments, a method has been described in which a shooting control command or an autofocus control command is transmitted to the digital camera 100 by detecting an operation of a control member displayed on the display unit 206 of the control device 200. However, the method of controlling the digital camera 100 by the control device 200 is not limited to this.

[0201] For example, as described above, the control device 200 may have the same configuration as the digital camera 100, and therefore the control of the digital camera 100 by the control device 200 may be performed by a linked shooting function in the digital camera. The linked shooting function is a function in which multiple digital cameras connected wirelessly or by wire take pictures in a linked manner.

[0202] For example, in the linked shooting function, a digital camera operating in AP mode as a simple AP (Access Point) is called the sender camera, and a digital camera operating in CL mode as a CL (Client) device is called the receiver camera. Each of these receiver cameras is connected to the sender camera. When a user operates the sender camera to take a picture, that operation is transmitted from the sender camera to the wirelessly connected receiver camera. The receiver cameras that receive this information each perform a shooting operation corresponding to that operation.

[0203] In the present invention, the sender camera in the linked shooting function described above can be regarded as the control device 200 of this embodiment, and the receiver camera can be regarded as the digital camera 100 of this embodiment.

[0204] For example, when the AF-ON button is pressed, the sender camera transmits an autofocus start command to the receiver camera, and when the AF-ON button is released, the sender camera transmits an autofocus stop command to the receiver camera. When the sender camera detects that the release switch has entered the SW2 state, it transmits a shooting start command to the receiver camera. When the sender camera detects that the release switch has been released from the SW2 state, it transmits a shooting stop command to the receiver camera. The receiver camera can also receive commands from multiple sender cameras and execute the series of operations executed by digital camera 100 shown in Figures 6A, 6B, 8A, 8B, 10A, and 10B.

[0205] The disclosure of this specification includes the following control system, imaging device, control method thereof, and program.

[0206] (Item 1) A control system for controlling an imaging device by a plurality of control devices, The control device, A first communication means for communicating with the imaging device; a first instruction means for outputting an instruction for starting and stopping an autofocus operation, which is an instruction related to the autofocus operation, to the imaging device; a second instruction means for outputting an instruction to start and stop a photographing operation, which is an instruction related to a photographing operation, to the imaging device; The imaging device, A second communication means for communicating with the control device; An imaging means for performing a photographing operation; a photographing optical system that performs an autofocus operation; When an instruction to start a photographing operation is first received from any one of the plurality of control devices, the photographing operation is started, and the photographing operation is continued until an instruction to stop the photographing operation is received from all of the control devices to which the instruction to start the photographing operation is transmitted; a control means for starting an autofocus operation when an instruction to start an autofocus operation is first received from any one of the plurality of control devices, and for controlling the autofocus operation to continue until an instruction to stop the autofocus operation is received from all of the control devices that have transmitted the instructions to start the autofocus operation.

[0207] (Item 2) The control system described in item 1, characterized in that the imaging device further comprises a storage means for storing a list of the latest instructions regarding autofocus operations and instructions regarding shooting operations from the multiple control devices in a manner that allows the control device that sent the instructions to be distinguished from each other.

[0208] (Item 3) 3. The control system according to item 2, wherein the control means controls the start and stop of an autofocus operation and the start and stop of a shooting operation based on the list.

[0209] (Item 4) The control system described in item 2 or 3, characterized in that when the shooting operation is stopped, the control means starts an autofocus operation if an instruction regarding an autofocus operation from any of the control devices in the list is an instruction to start autofocus.

[0210] (Item 5) The control system according to any one of items 2 to 4, characterized in that the control means executes a retry operation to stop the autofocus operation and start the autofocus operation again when a condition for performing the autofocus operation again is met.

[0211] (Item 6) The control system described in item 5, characterized in that the control means determines that the condition for performing the autofocus operation again is met when an instruction regarding the autofocus operation from any of the control devices in the list is updated from stopping the autofocus operation to starting it.

[0212] (Item 7) The control system described in item 5, characterized in that the control means determines that the condition for performing the autofocus operation again is met when an instruction regarding the autofocus operation from any of the control devices in the list is updated from starting the autofocus operation to stopping it.

[0213] (Item 8) The control system according to any one of items 5 to 7, wherein the control means switches whether or not to perform the retry operation depending on the mode of the autofocus operation. The control system according to item 8, wherein the control means does not perform the retry operation when the autofocus operation mode is servo AF, and performs the retry operation when the autofocus operation mode is one-shot AF.

[0214] (Item 10) 10. The control system according to any one of items 3 to 9, wherein the storage means deletes the list corresponding to a control device whose connection has been terminated.

[0215] (Item 11) 11. The control system according to any one of items 1 to 10, comprising a plurality of the imaging devices.

[0216] (Item 12) 12. The control system according to any one of items 1 to 11, wherein the control device is an imaging device.

[0217] (Item 13) An imaging device controlled by a plurality of control devices, A communication means for communicating with the control device; An imaging means for performing a photographing operation; a photographing optical system that performs an autofocus operation; When an instruction to start a photographing operation is first received from any one of the plurality of control devices, the photographing operation is started, and the photographing operation is continued until an instruction to stop the photographing operation is received from all of the control devices to which the instruction to start the photographing operation is transmitted; and a control means for controlling the autofocus operation so as to start the autofocus operation when an instruction to start the autofocus operation is first received from any one of the plurality of control devices, and to continue the autofocus operation until an instruction to stop the autofocus operation is received from all of the control devices that have transmitted the instructions to start the autofocus operation.

[0218] (Item 14) A method for controlling an imaging device that is controlled by a plurality of control devices and has a communication means for communicating with the control devices, an imaging means for performing an imaging operation, and an imaging optical system for performing an autofocus operation, comprising the steps of: When an instruction to start a photographing operation is first received from any one of the plurality of control devices, the photographing operation is started, and the photographing operation is continued until an instruction to stop the photographing operation is received from all of the control devices to which the instruction to start the photographing operation is transmitted; A control method for an imaging device, comprising a control step of starting an autofocus operation when an instruction to start an autofocus operation is first received from any one of the plurality of control devices, and controlling the autofocus operation to continue until an instruction to stop the autofocus operation is received from all of the control devices that have transmitted the instructions to start the autofocus operation.

[0219] (Item 15) Item 15. A program for causing a computer to execute the control method according to item 14.

[0220] (Other embodiments) The present invention can also be realized by a process in which a program for realizing one or more functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for realizing one or more functions.

[0221] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0222] 100: digital camera, 101, 201: control unit, 102, 202: imaging unit, 103, 203: non-volatile memory, 104, 204: working memory, 105, 205: operation unit, 106, 206: display unit, 200: control device

Claims

1. A control system for controlling an imaging device by a plurality of control devices, The control device, A first communication means for communicating with the imaging device; a first instruction means for outputting an instruction for starting and stopping an autofocus operation, which is an instruction related to the autofocus operation, to the imaging device; a second instruction means for outputting an instruction to start and stop a photographing operation, which is an instruction related to a photographing operation, to the imaging device; The imaging device, A second communication means for communicating with the control device; An imaging means for performing a photographing operation; a photographing optical system that performs an autofocus operation; When an instruction to start a photographing operation is first received from any one of the plurality of control devices, the photographing operation is started, and the photographing operation is continued until an instruction to stop the photographing operation is received from all of the control devices to which the instruction to start the photographing operation is transmitted; a control means for starting an autofocus operation when an instruction to start an autofocus operation is first received from any one of the plurality of control devices, and for controlling the autofocus operation to continue until an instruction to stop the autofocus operation is received from all of the control devices that have transmitted the instructions to start the autofocus operation.

2. The control system according to claim 1, further comprising a storage means for storing a list of the latest instructions regarding autofocus operations and instructions regarding shooting operations from the plurality of control devices in a manner that enables identification of the control device that sent the instructions.

3. 3. The control system according to claim 2, wherein said control means controls the start and stop of an autofocus operation and the start and stop of a photographing operation based on said list.

4. The control system according to claim 2, characterized in that when the photographing operation is stopped, the control means starts an autofocus operation if an instruction regarding the autofocus operation from any of the control devices in the list is an instruction to start autofocus.

5. 3. The control system according to claim 2, wherein the control means executes a retry operation of stopping the autofocus operation and starting the autofocus operation again when a condition for performing the autofocus operation again is satisfied.

6. The control system according to claim 5, characterized in that the control means determines that the conditions for performing the autofocus operation again are met when an instruction regarding the autofocus operation from any of the control devices in the list is updated from stopping the autofocus operation to starting it.

7. The control system according to claim 5, characterized in that the control means determines that the conditions for performing the autofocus operation again are met when an instruction regarding the autofocus operation from any of the control devices in the list is updated from starting the autofocus operation to stopping the autofocus operation.

8. 6. The control system according to claim 5, wherein the control means switches whether or not to perform the retry operation depending on a mode of the autofocus operation.

9. 9. The control system according to claim 8, wherein the control means does not perform the retry operation when the autofocus operation mode is servo AF, and performs the retry operation when the autofocus operation mode is one-shot AF.

10. 4. The control system according to claim 3, wherein said storage means deletes said list corresponding to a control device whose connection has been terminated.

11. 2. The control system according to claim 1, comprising a plurality of said imaging devices.

12. 2. The control system of claim 1, wherein the control device is an imaging device.

13. An imaging device controlled by a plurality of control devices, A communication means for communicating with the control device; An imaging means for performing a photographing operation; a photographing optical system that performs an autofocus operation; When an instruction to start a photographing operation is first received from any one of the plurality of control devices, the photographing operation is started, and the photographing operation is continued until an instruction to stop the photographing operation is received from all of the control devices to which the instruction to start the photographing operation is transmitted; and a control means for controlling the autofocus operation so as to start the autofocus operation when an instruction to start the autofocus operation is first received from any one of the plurality of control devices, and to continue the autofocus operation until an instruction to stop the autofocus operation is received from all of the control devices that have transmitted the instructions to start the autofocus operation.

14. A method for controlling an imaging device that is controlled by a plurality of control devices and has a communication means for communicating with the control devices, an imaging means for performing an imaging operation, and an imaging optical system for performing an autofocus operation, comprising the steps of: When an instruction to start a photographing operation is first received from any one of the plurality of control devices, the photographing operation is started, and the photographing operation is continued until an instruction to stop the photographing operation is received from all of the control devices to which the instruction to start the photographing operation is transmitted; A control method for an imaging device, comprising a control step of starting an autofocus operation when an instruction to start an autofocus operation is first received from any one of the plurality of control devices, and controlling the autofocus operation to continue until an instruction to stop the autofocus operation is received from all of the control devices that have transmitted the instructions to start the autofocus operation.

15. A program for causing a computer to execute the control method according to claim 14.

Images