Control system, image pickup apparatus and control method thereof, computer program product, and storage medium

Abstract

The invention provides a control system, an imaging apparatus, a control method thereof, a computer program product, and a storage medium. In the control system, an image pickup apparatus is controlled by a plurality of control apparatuses, each of the control devices includes a first communication unit for communicating with the imaging device, a first instruction unit for outputting an instruction for starting or stopping an automatic focusing operation, and a second instruction unit for outputting an instruction for starting or stopping a photographing operation. The imaging apparatus includes a second communication unit, an imaging device, an optical imaging system, and a control unit. When an instruction to start a photographing operation is initially received from any one of the control devices, the control unit performs control to start the photographing operation and continue the photographing operation until an instruction to stop the photographing operation is received from all the control devices.

Description

Technical Field

[0001] The present invention relates to a control system in which an image pickup device is controlled by a plurality of control devices. Background Art

[0002] In recent years, in sporting events such as the Olympic Games, photographers shoot a wide range of scenes from various games, and the photographed photos are often released through news media.

[0003] In such competitions, multiple digital camera systems are used that are mounted facing various angles and can be remotely controlled using a portable control device. In such a system, a small number of photographers can control multiple digital cameras at once by operating a control device, such as a tablet or laptop computer connected to the cameras via a network.

[0004] Existing technologies such as Nikon's "NX Field" and Sony's "Remote Camera Tool" are sometimes used as software that can remotely control the photography of multiple digital cameras. Document 1 (Nikon "NX Field System User Manual", retrieved on August 15, 2023, from https: / / nps.nikonimaging.com / technical_info / nx_field / pdf / NXFieldUM_Jp_ver.1.3.pdf) and Document 2 ("How to Use the RemoteCamera Tool", retrieved on August 15, 2023, from https: / / support.d-imaging.sony.co.jp / app / remotecameratool / ja / instruction / 1_connection.php) disclose methods of using the software.

[0005] However, when photographing a sporting event such as a football match where athletes as subjects move around in a wide field, it is difficult for the photographer to predict how the subject will move even when using such software. Therefore, when a single photographer controls multiple digital cameras using a single control device, the following problem will arise. The photographer needs to confirm whether the subject is within the viewing angles of the multiple digital cameras, but the photographer may not be able to pay attention to all the digital cameras and may therefore miss an opportunity to shoot using one of the digital cameras.

[0006] Therefore, there is a need for a remote photography system in which a plurality of control devices can be connected to a network and a plurality of photographers can operate the respective control devices to capture images using digital cameras so as not to miss an opportunity to take a photo.

[0007] When taking a still image using a digital camera, the photographer uses automatic focus to focus the image according to the movement of the subject and takes the picture.

[0008] However, when using the remote photography system to shoot still images, the photographer can control the timing of the digital camera's autofocus operation by sending an autofocus start command and a stop command from the control device. Similarly, the timing of the digital camera's shooting can be controlled by sending a shooting start command and a stop command.

[0009] However, with the prior art such as the aforementioned NX Field and Remote Camera Tool, there are cases where the timing of the autofocus or shooting operation of the digital camera cannot be controlled from a plurality of control devices within the same period.

[0010] For example, in a system having a limitation that when a digital camera is already photographing in response to a photographing start command from a given control device, the digital camera does not accept a photographing start command from another control device, the following problem occurs. Specifically, when the digital camera is photographing in response to a photographing start command that has been sent from one photographer and another photographer sends a photographing start command from another control device to take a picture, the digital camera will not accept the photographing start command. Therefore, the other photographer needs to send a start command from the control device again to cause the digital camera to start photographing after the digital camera has completed the initial photographing. However, during this period of time, there is a risk that the other photographer will miss the opportunity to photograph.

[0011] This problem occurs in autofocus control in a similar manner. For example, in a system having a limitation that when a digital camera is already performing an autofocus operation in response to an autofocus start command from one control device, the digital camera does not accept an autofocus start command from another control device, the following problem occurs. Specifically, when the digital camera is performing autofocus in response to an autofocus start command that has been sent from one photographer and another photographer sends an autofocus start command from another control device to prepare for taking a picture, the digital camera will not accept the autofocus start command. Therefore, the other photographer needs to send a start command from the control device again to cause the digital camera to perform autofocus after the digital camera has completed the initial autofocus. However, during this period of time, there is a risk that the other photographer will be late in preparing to shoot and miss the opportunity to shoot. Summary of the invention

[0012] The present invention, which has been achieved in view of the above-described problems, provides a control system that reduces the possibility that a photographer misses an opportunity to take a picture even when an image pickup apparatus is controlled by a plurality of control apparatuses.

[0013] According to a first aspect of the present invention, a control system is provided, wherein an image pickup device is controlled by a plurality of control devices, wherein each control device comprises: a first communication unit for communicating with the image pickup device; a first indication unit for outputting an indication for starting or stopping an automatic focusing operation to the image pickup device, the indication being an indication related to the automatic focusing operation; and a second indication unit for outputting an indication for starting or stopping a shooting operation to the image pickup device, the indication being an indication related to the shooting operation, wherein the image pickup device comprises: a second communication unit for communicating with each of the control devices; an image pickup device for performing the shooting operation; an optical image pickup system for performing the automatic focusing operation; and a control unit. element, wherein, when an instruction for starting the shooting operation is initially received from any one of the multiple control devices, the control unit performs the following control: starts the shooting operation and continues the shooting operation until an instruction for stopping the shooting operation is received from all the control devices that have sent instructions for starting the shooting operation, and when an instruction for starting the autofocus operation is initially received from any one of the multiple control devices, the control unit performs the following control: starts the autofocus operation and continues the autofocus operation until an instruction for stopping the autofocus operation is received from all the control devices that have sent instructions for starting the autofocus operation.

[0014] According to a second aspect of the present invention, there is provided an imaging device which is controlled by a plurality of control devices, the imaging device comprising: a communication unit for communicating with each of the control devices; an imaging device for performing a shooting operation; an optical imaging system for performing an autofocus operation; and a control unit, wherein, when an instruction for starting the shooting operation is initially received from any one of the plurality of control devices, the control unit performs the following control: starts the shooting operation and continues the shooting operation until an instruction for stopping the shooting operation is received from all the control devices which have sent instructions for starting the shooting operation, and when an instruction for starting the autofocus operation is initially received from any one of the plurality of control devices, the control unit performs the following control: starts the autofocus operation and continues the autofocus operation until an instruction for stopping the autofocus operation is received from all the control devices which have sent instructions for starting the autofocus operation.

[0015] According to a third aspect of the present invention, a control method for a camera device is provided, wherein the camera device is controlled by multiple control devices, and the camera device includes a communication unit for communicating with the control device, a camera device for performing a shooting operation, and an optical camera system for performing an automatic focusing operation. The method includes: when an instruction for starting the shooting operation is initially received from any one of the multiple control devices, the following control is performed: starting the shooting operation and continuing the shooting operation until an instruction for stopping the shooting operation is received from all control devices that have sent instructions for starting the shooting operation, and when an instruction for starting the automatic focusing operation is initially received from any one of the multiple control devices, the following control is performed: starting the automatic focusing operation and continuing the automatic focusing operation until an instruction for stopping the automatic focusing operation is received from all control devices that have sent instructions for starting the automatic focusing operation.

[0016] According to a fourth aspect of the present invention, a computer program product is provided, for causing a computer to execute the above method.

[0017] According to a fifth aspect of the present invention, there is provided a non-transitory computer-readable storage medium storing a program for causing a computer to execute the above method.

[0018] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figures 1A to 1C is a hardware configuration diagram showing the configuration of a digital camera.

[0020] Figure 2 is a hardware configuration diagram showing the configuration of a control device.

[0021] Figure 3 is a diagram showing the configuration of a camera control system.

[0022] Figure 4A is a flowchart showing an example of operations performed by the control device according to the first embodiment.

[0023] Figure 4B is a flowchart showing an example of operations performed by the control device according to the first embodiment.

[0024] FIG. 5A to FIG. 5F is a diagram showing an example of a display screen of the control device according to the first embodiment.

[0025] Fig. 6A is a flowchart illustrating operations performed by the digital camera according to the first embodiment.

[0026] Figure 6B is a flowchart illustrating operations performed by the digital camera according to the first embodiment.

[0027] Figure 6C is a flowchart illustrating operations performed by the digital camera according to the first embodiment.

[0028] Figure 7 is a diagram showing an example of a remote control information list stored in a digital camera.

[0029] Fig. 8A is a flowchart illustrating operations performed by the digital camera according to the second embodiment.

[0030] Figure 8B is a flowchart illustrating operations performed by the digital camera according to the second embodiment.

[0031] Fig. 9 is a diagram showing an example of a display screen of a control device according to the third embodiment.

[0032] Fig. 10A is a flowchart illustrating operations performed by the digital camera according to the third embodiment.

[0033] Fig. 10B is a flowchart illustrating operations performed by the digital camera according to the third embodiment. DETAILED DESCRIPTION

[0034] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the claimed invention. A plurality of features are described in the embodiments, but are not limited to inventions requiring all such features, and a plurality of such features may be appropriately combined. In addition, in the accompanying drawings, the same reference numerals are assigned to the same or similar configurations, and redundant descriptions thereof are omitted.

[0035] First embodiment

[0036] Configuration of digital camera 100

[0037] Figure 1A 1 is a hardware configuration diagram showing an example of the configuration of a digital camera (imaging device) 100 in a camera control system according to a first embodiment of the present invention. Here, a case where a digital camera is used as an example of a control device included in the camera control system will be described, but the control device is not limited thereto. For example, the control device may be any information processing device such as a portable media player, a so-called "tablet device", or a personal computer.

[0038] In the digital camera 100, a control unit 101 controls each part of the digital camera 100 in response to input signals and programs (described later), etc. Note that a plurality of hardware may control the entire device by sharing processing, rather than the control unit 101 controlling the entire device.

[0039] The imaging unit 102 is composed of, for example, an optical imaging system for controlling an optical lens unit and an aperture, zooming, and focusing, and an image sensor for converting an optical image formed by the optical lens unit into an electrical image signal, etc. A complementary metal oxide semiconductor (CMOS) sensor or a charge coupled device (CCD), etc., is generally used as the image sensor.

[0040] Under the control of the control unit 101, the imaging unit 102 converts subject light imaged through a lens included in the imaging unit 102 into an electric signal using an image sensor, performs noise reduction processing, etc., and outputs digital image data. The digital camera 100 according to the present embodiment records an image data file into a recording medium 110 according to the design rule for camera file system (DCF) standard.

[0041] The nonvolatile memory 103 is a nonvolatile memory that can be electrically erased and recorded, and stores a program or the like (described later) executed by the control unit 101. The working memory 104 is used as a buffer memory for temporarily storing image data captured by the imaging unit 102, an image display memory for the display unit 106, and a working area for the control unit 101, etc.

[0042] The operation unit 105 is used to accept instructions made by the user to the digital camera 100. The operation unit 105 includes, for example, a power button through which the user instructs turning on and off the power of the digital camera 100, a release switch for instructing shooting, and a playback button for instructing playback of image data. The operation unit 105 also includes operating members such as a dedicated "connect" button for starting communication with an external device via a communication unit 111 (described later). The operation unit 105 also includes a touch panel 105d arranged on a display unit 106 (described later).

[0043] Note that the release switch has a state where the switch is not pressed, a fully pressed state (SW2) where the push button is fully pressed to the movable end, and a half-pressed state (SW1) between the two. When the release switch enters the SW1 state, a shooting preparation operation start command (i.e., shooting preparation command) is output from the control unit 101. In the shooting preparation operation, operations such as automatic focus (AF) processing, automatic exposure (AE) processing, automatic white balance (AWB) processing, and flash pre-emission (EF) processing are performed.

[0044] When the release switch is further operated to the SW2 state after the shooting preparation operation is performed in the SW1 state, the control unit 101 outputs a shooting operation start command, and the shooting operation is performed, and the image is written to the recording medium 110. If the continuous shooting mode is set and the release switch is in the SW2 state, shooting is repeated during the shooting operation until the release switch is no longer pressed or the release switch enters the SW1 state. In other words, as long as the release switch remains in the SW2 state, shooting is performed continuously and a plurality of images are sequentially captured. When the release switch changes from the SW2 state to other states (i.e., to the SW1 state or the unpressed state), the control unit 101 outputs a shooting stop command, and the continuous shooting operation ends.

[0045] The operation unit 105 also includes an AF-ON button for instructing to perform only the AF process in the shooting preparation operation. When the AF-ON button is pressed, an AF operation start command is output from the control unit 101, and the AF process is started.

[0046] Note that the mode of AF operation (AF operation mode) can be set for the digital camera 100 through the operation unit 105. The AF operation mode includes single AF suitable for capturing an image of a still subject and servo AF (continuous AF) suitable for capturing an image of a moving subject. These modes are selectively set through the operation unit 105.

[0047] In the AF operation of the single AF, when an AF operation start command is output from the control unit 101, automatic focus detection is performed in a focus detection area selected as desired by the user. Then, a focus lens included in the photographing lens is moved to a focus position, the driving of the focus lens is stopped, and then the position of the focus lens is fixed until an AF operation stop command is output (hereinafter referred to as "AF lock").

[0048] On the other hand, in the AF operation of the servo AF, the movement of the main subject is detected even after the focus lens has moved to the focus position. Then, when the movement of the main subject is detected, the focus lens is continuously driven according to the defocus amount detected in the focus detection area. In other words, the focus lens continues to be driven so that the main subject is focused until the AF operation stop command is output from the control unit 101.

[0049] In addition, the digital camera 100 can be set to a tracking AF mode in which the focus detection area is moved to automatically track the movement of a subject using the operation unit 105. The tracking AF mode can be used in combination with single AF or servo AF.

[0050] The display unit 106 displays a viewfinder image at the time of shooting, shot image data, and text for interactive operation, etc. Note that the display unit 106 does not necessarily have to be built in the digital camera 100. It is sufficient that the digital camera 100 can be connected to an internal or external display unit 106 and has at least a display control function for controlling display in the display unit 106.

[0051] The RTC 107 manages time. The time is managed based on the time setting input by the user through the operation unit 105, the time information obtained through the communication unit 111, and the time information obtained by the radio wave clock, etc. Any method can be used to input the time as long as the time can be managed.

[0052] The recording medium 110 records image data output from the imaging unit 102. The recording medium 110 may be configured to be removable from the digital camera 100, or may be built in the digital camera 100. In other words, it is sufficient for the digital camera 100 to have at least a component for accessing the recording medium 110.

[0053] The communication unit 111 is an interface for connecting to an external device. The digital camera 100 of the present embodiment can exchange data with an external device through the communication unit 111. For example, image data generated by the imaging unit 102 can be sent to the external device through the communication unit 111. In the present embodiment, the communication unit 111 includes an interface for communicating with the external device through a so-called "wireless LAN" based on the IEEE 802.11 standard. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 111. Note that the communication method is not limited to the wireless LAN, and also includes, for example, an infrared communication method.

[0054] The communication unit 112 is an interface for connecting to an external device. The digital camera 100 of the present embodiment can exchange data with an external device through the communication unit 112. For example, image data generated by the camera unit 102 can be sent to the external device through the communication unit 112. In the present embodiment, the communication unit 112 includes an interface for communicating with the external device through the so-called "Bluetooth" (registered trademark) (Bluetooth) based on the IEEE 802.15.1 standard. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 112. Note that the communication method is not limited to Bluetooth, and also includes, for example, a wireless LAN or infrared communication method known according to the IEEE 802.11 standard.

[0055] The communication unit 113 is an interface for connecting to an external device. The digital camera 100 of the present embodiment can exchange data with an external device through the communication unit 113. For example, image data generated by the imaging unit 102 can be sent to the external device through the communication unit 113. In the present embodiment, the communication unit 113 includes an interface for communicating with the external device through a wired LAN (Ethernet) based on the IEEE 802.3 standard. The control unit 101 realizes communication with the external device by controlling the communication unit 113. Note that the communication method is not limited to the wired LAN, and also includes, for example, a USB communication method.

[0056] Note that the communication unit 112 of the digital camera 100 according to the present embodiment has a "peripheral mode" and a "central mode" as operation modes. By operating the communication unit 112 in the peripheral mode, the digital camera 100 according to the present embodiment can operate as a client device according to Bluetooth. When the digital camera 100 operates as a client device, communication can be performed by connecting to an external device set to the central mode. In order to authenticate the connected external device, unique information of the connected external device is stored in the nonvolatile memory 103 by performing pairing in advance. Additionally, if power is supplied to the Bluetooth module, the digital camera 100 can perform transmission even when the power switch is turned off.

[0057] The near field wireless communication unit 114 is composed of, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, a communication controller, and the like. The near field wireless communication unit 114 outputs a modulated wireless signal from the antenna, and demodulates a wireless signal received from the antenna to implement non-contact near field communication (referred to as "near field communication" (NFC)) according to the ISO / IEC 18092 standard. The near field wireless communication unit 114 according to the present embodiment is arranged on the side of the digital camera 100.

[0058] By bringing the near-field wireless communication unit 114 and the near-field wireless communication unit 214 close to each other, communication between the digital camera 100 and the control device 200 (described later) is started, and a connection is established. Note that when establishing a connection with the control device 200 using the near-field wireless communication unit 114, it is not necessary to bring the near-field wireless communication unit 114 and the near-field wireless communication unit 214 into contact with each other. The near-field wireless communication unit 114 and the near-field wireless communication unit 214 can communicate even when separated by a certain distance, and thus, in order to connect these devices to each other, it is sufficient to bring these units into a range where near-field wireless communication can be performed. The following description will also refer to bringing the units into a range where near-field wireless communication can be performed as bringing the units "close to" or "approaching" each other.

[0059] Next, the appearance of the digital camera 100 will be described. Figure 1B and Figure 1C 105 is a diagram showing an example of the appearance of the digital camera 100. A release switch 105a, a playback button 105b, a direction key 105c, and a touch panel 105d are operating members included in the above-mentioned operating unit 105. An image obtained by shooting of the camera unit 102 is also displayed in the display unit 106. The digital camera 100 according to the present embodiment also includes an antenna portion of a power supply unit 116 on a side surface of the camera housing. Power can be supplied by bringing the power supply units 116 within a certain distance from each other. Contactless power supply without the need for cables or the like can be performed, and as a result, the start and end of power supply can be controlled.

[0060] Although the following description may refer to the digital camera 100 as an entity that performs processing, it is actually the control unit 101 of the digital camera 100 that loads the program stored in the nonvolatile memory 103 and implements various types of processing.

[0061] The digital camera 100 is described above.

[0062] Configuration of the control device 200

[0063] Figure 2 1 is a hardware configuration diagram showing an example of the configuration of a control device 200 used as an example of an information processing device according to the present embodiment. Here, a case where the control device 200 is used as an example of a control device included in a camera control system will be described, but the control device is not limited thereto. For example, the control device may be a digital camera, a tablet device, a personal computer, or the like having a wireless function.

[0064] In the control device 200, the control unit 201 controls various parts of the control device 200 according to input signals and programs (described later), etc. Note that a plurality of hardware may control the entire device by sharing processing, rather than the control unit 201 controlling the entire device.

[0065] The nonvolatile memory 203 is a nonvolatile memory that can be electrically erased and recorded. An operating system (OS) as basic software executed by the control unit 201 and applications that realize actual functions by operating in cooperation with the OS are recorded in the nonvolatile memory 203. Additionally, in the present embodiment, for example, an application for communicating with the digital camera 100 (hereinafter referred to as an "app") is stored in the nonvolatile memory 203.

[0066] The working memory 204 is used as an image display memory of the display unit 206 , a working area of ​​the control unit 201 , and the like.

[0067] The operation unit 205 is used to accept instructions made by the user in the control device 200. The operation unit 205 includes, for example, operation members such as a power button through which the user instructs turning on and off the power of the control device 200, an operation member for setting the RTC 207, and a touch panel 206d arranged on the display unit 206.

[0068] The display unit 206 displays image data and text display for interactive operation, etc. Note that the control device 200 does not necessarily have to include the display unit 206. It is sufficient that the control device 200 can be connected to the display unit 206 and has at least a display control function for controlling display in the display unit 206.

[0069] The RTC 207 manages the clock. The time is managed based on the time setting input by the user through the operation unit 205, the time information obtained through the communication unit 212 or the PSTN connection unit 216, and the time information obtained by the radio wave clock. Any method can be used to input the time as long as the time can be managed. The time can also be obtained from a mechanical mechanism such as an analog clock by a detection mechanism. In this case, it is assumed that the RTC 207 includes a detection mechanism for detection from the analog clock.

[0070] The recording medium 210 can record image data transmitted from the digital camera 100 to the control unit 201 via the communication unit 211. The recording medium 210 may be configured to be removable from the control device 200, or may be built in the control device 200. In other words, it is sufficient that the control device 200 has at least a component for accessing the recording medium 210.

[0071] The communication unit 211 is an interface for connecting to an external device. The control apparatus 200 of the present embodiment can exchange data with the external device through the communication unit 211. In the present embodiment, the communication unit 211 is an antenna, and the control unit 201 can be connected to the digital camera 100 via the antenna. In the present embodiment, the communication unit 211 includes an interface for communicating with the external device through a so-called "wireless LAN" based on the IEEE802.11 standard. The control unit 201 realizes wireless communication with the external device by controlling the communication unit 211. Note that the communication method is not limited to the wireless LAN, and also includes, for example, an infrared communication method.

[0072] The communication unit 212 is an interface for connecting to an external device. The control device 200 of the present embodiment can exchange data with the external device through the communication unit 212. For example, the control device 200 can receive image data generated by the digital camera 100 through the communication unit 212. In the present embodiment, the communication unit 212 includes an interface for communicating with the external device through the so-called "Bluetooth" (registered trademark) based on the IEEE 802.15.1 standard. The control unit 201 realizes wireless communication with the external device by controlling the communication unit 212. Note that the communication method is not limited to Bluetooth, and also includes, for example, a wireless LAN or infrared communication method known according to the IEEE802.11 standard.

[0073] The communication unit 213 is an interface for connecting to an external device. The control device 200 of the present embodiment can exchange data with the external device through the communication unit 213. For example, the control device 200 can receive image data generated by the digital camera 100 through the communication unit 213. In the present embodiment, the communication unit 213 includes an interface for communicating with the external device through a wired LAN (Ethernet) based on the IEEE 802.3 standard. The control unit 201 realizes communication with the external device by controlling the communication unit 213. Note that the communication method is not limited to the wired LAN, and also includes, for example, a USB communication method.

[0074] Note that the communication unit 212 of the control device 200 according to the present embodiment has "peripheral mode" and "central mode" as operation modes. By operating the communication unit 212 in the central mode, the control device 200 according to the present embodiment can operate as a server device according to Bluetooth. When the control device 200 operates as a server device, communication can be performed by connecting to an external device set to the peripheral mode. In order to authenticate the connected external device, unique information of the connected external device is stored in the non-volatile memory 203 by performing pairing in advance.

[0075] The near field wireless communication unit 214 is composed of, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, and a communication controller, etc. The near field wireless communication unit 214 outputs a modulated wireless signal from the antenna, and demodulates a wireless signal received from the antenna to implement non-contact near field communication (referred to as "near field communication" (NFC)) according to the ISO / IEC 18092 standard. The near field wireless communication unit 214 according to the present embodiment is arranged on the side of the control device 200.

[0076] Although the following description may refer to the control device 200 as an entity that performs processing, it is actually the control unit 201 of the control device 200 that loads the program of the application (or function of the application, OS or service of OS, etc.) loaded into the working memory 204 and implements various types of processing.

[0077] System Configuration

[0078] Next, the configuration of a camera control system according to the present embodiment will be described.

[0079] Figure 3 is a diagram showing a configuration of a system in which a plurality of control apparatuses 200 and a plurality of digital cameras 100 are connected via a network device 300 and the digital cameras 100 can be remotely controlled by the control apparatuses 200 .

[0080] Each digital camera 100 is mounted on a tripod 303 or the like and installed at a corresponding shooting position. Although the present embodiment describes a mounting method in which the digital camera 100 is mounted on a tripod 303, the digital camera 100 may be mounted on a remote gimbal that can remotely control pan, tilt, and zoom operations.

[0081] The following can be considered as examples of connection modes for communication between the digital camera 100 and the control apparatus 200. One mode is that the digital camera 100 is connected to the network device 300 by wireless communication via the radio wave 302 through the communication unit 112 and communicates with the control apparatus 200. Another mode is that the digital camera 100 is connected to the network device 300 via a wired LAN through the communication unit 113 and communicates with the control apparatus 200.

[0082] Still another mode is that the control apparatus 200 connects to the network device 300 through the communication unit 212 by wireless communication via the radio wave 302 and communicates with the digital camera 100. Still another mode is that the control apparatus 200 connects to the network device 300 through the communication unit 213 via a wired LAN and communicates with the digital camera 100.

[0083] Although the present embodiment describes an example of communication through the network device 300 , the digital camera 100 and the control apparatus 200 may be directly connected.

[0084] like Figure 3 As shown, in a state where a plurality of installed digital cameras 100 and the control apparatus 200 are capable of communicating, the control apparatus 200 can issue a command for obtaining setting information of the digital camera 100 and a command for changing the setting to each digital camera 100 .

[0085] Additionally, the control device 200 may transmit a shooting start command as a command for requesting to start a shooting operation and a shooting stop command as a command for requesting to stop a shooting operation to each digital camera 100. These commands may be used to specify the timing of starting and stopping a shooting operation performed by the digital camera 100.

[0086] Furthermore, the control device 200 may transmit an autofocus start command as a command for requesting the start of an autofocus operation and an autofocus stop command as a command for requesting the stop of an autofocus operation to each digital camera 100. These commands may be used to instruct the timing of starting and stopping the autofocus operation performed by the digital camera 100. Hereinafter, the shooting start command and the shooting stop command will be collectively referred to as a “shooting control command”, and the autofocus start command and the autofocus stop command will be referred to as an “autofocus control command”.

[0087] The digital camera 100 starts a shooting operation not only in response to a shooting operation start command output from the control unit 101 when the release switch enters the SW2 state, but also in response to a shooting start command received from the control device 200 .

[0088] Likewise, the autofocus operation is started not only in response to the autofocus operation start command output from the control unit 101 when the AF-ON button is pressed, but also in response to the autofocus operation start command received from the control device 200 .

[0089] Such a configuration makes it possible to control shooting and autofocusing by the digital camera 100 from the control device 200 .

[0090] System issues

[0091] However, in the system according to the present embodiment, when a plurality of control devices 200 communicate with the same digital camera 100 and perform automatic focusing or shooting control in the same period, there is a problem that the operations will conflict.

[0092] For example, in the case where there is a restriction that the digital camera 100 does not accept a shooting start command from another control device 200 when the digital camera 100 is already performing a shooting operation in response to a shooting start command from a given control device 200, the following problem occurs. That is, when the digital camera 100 is performing a shooting operation in response to a shooting start command that has been sent from one photographer through the control device 200, and another photographer sends a shooting start command from another control device 200 to shoot a picture, the digital camera 100 will not accept the shooting start command. Therefore, the other photographer needs to send a start command from the control device 200 again to cause the digital camera 100 to start shooting after the digital camera 100 has completed the initial shooting operation. However, during this period of time, there is a risk that the other photographer will miss his or her chance to shoot.

[0093] A similar problem occurs in the case of autofocus. For example, in a system having a limitation that when the digital camera 100 is already performing an autofocus operation in response to an autofocus start command from one control device 200, the digital camera 100 does not accept an autofocus start command from another control device 200, the following problem occurs. That is, when the digital camera 100 is performing an autofocus operation in response to an autofocus start command that has been sent from one photographer through the control device 200 and another photographer sends an autofocus start command from another control device 200 to prepare for taking a picture, the digital camera 100 will not accept the autofocus start command. Therefore, the other photographer needs to send a start command from the control device 200 again to cause the digital camera 100 to start the autofocus operation after the digital camera 100 has finished performing the initial autofocus operation. However, during this period of time, there is a risk that the other photographer will be late in preparing for his / her shooting and miss his / her chance to shoot.

[0094] Solutions to the problem

[0095] Therefore, in the present embodiment, when a plurality of control devices 200 communicate with the same digital camera 100 and perform control related to the autofocus or shooting operation in the same period, the following control is performed. That is, when the digital camera 100 initially receives a shooting start command from any one of the control devices 200, the shooting operation is started, and the shooting operation is continued until a shooting stop command is received from all the control devices 200 that have sent the start command. Then, when a shooting stop command is received from all the control devices 200 that have sent the shooting start command, the shooting operation is stopped. Additionally, when an autofocus start command is initially received from any one of the control devices 200, the autofocus operation is started, and the autofocus operation is continued until an autofocus stop command is received from all the control devices 200 that have sent the start command. Then, when an autofocus stop command is received from all the control devices 200 that have sent the autofocus start command, the autofocus operation is stopped.

[0096] The operations of the control apparatus 200 and the digital camera 100 according to the first embodiment will be described below.

[0097] A series of operations of the control device 200

[0098] Figure 4A and Figure 4B 1 is a flowchart showing the operation performed by the control device 200 according to the present embodiment. Hereinafter, the case where the control device 200 performs shooting control by remotely operating a plurality of digital cameras 100 will be referred to as "multi-remote shooting". On the other hand, the case where the control device 200 performs shooting control by remotely operating a single digital camera 100 will be referred to as "remote shooting".

[0099] Figure 4A 1 is a flowchart showing a series of operations performed by the control device 200 from establishing connections with a plurality of digital cameras 100 to ending the processing. Note that Figure 4A The illustrated operation is realized by the control unit 201 of the control device 200 loading the control program stored in the nonvolatile memory 203 into the working memory 204 and executing the program. This flowchart will describe a series of operations as starting when the control device 200 is started.

[0100] In step S400 , the control unit 201 registers connection settings of a plurality of digital cameras 100 with which connections are to be established.

[0101] In step S401, the control unit 201 performs processing for detecting the digital camera 100, and determines whether the digital camera 100 has been detected. If the digital camera 100 has been detected, the control unit 201 moves the sequence to step S402, and if not, repeats step S401.

[0102] In step S402, the control unit 201 determines whether a connection operation has been performed by the user. If a connection request has been made, the control unit 201 moves the sequence to step S403, and if not, repeats step S402.

[0103] In step S403, the control unit 201 performs connection processing with the detected digital camera 100 to establish a connection with the digital camera 100. When the connection with the digital camera 100 is established, the control device 200 also receives a session ID from the digital camera 100. The session ID is an ID for identifying a communication session from establishment to end of the connection. In remote shooting and multi-remote shooting performed in step S407 (described later), the session ID is added to each command sent by the control device 200 to the digital camera 100, and is sent together with the command. This allows the digital camera 100 to distinguish a command received from the control device 200 from a command received from another control device 200 or via another connection with the same control device.

[0104] In step S404 , the control device 200 stores all the session IDs received in step S403 in the nonvolatile memory 203 , the working memory 204 , or the recording medium 210 .

[0105] In step S405, the control unit 201 determines whether there is a second digital camera 100 or subsequent digital camera 100 to be connected whose connection is registered in step S400. If there is no digital camera 100 to be connected, the control unit 201 determines that remote photography and multi remote photography can be started, after which the sequence moves to step S406. If there are digital cameras 100 to be connected remaining, the sequence returns to step S401.

[0106] In step S406 , the control unit 201 displays the multi remote photography screen in the display unit 206 .

[0107] Here we will refer to FIG. 5A to FIG. 5F Describes multiple remote shooting scenes.

[0108] Multiple remote shooting control screens

[0109] FIG. 5A to FIG. 5F Shown is a configuration of a screen displayed by the control device 200 when two digital cameras 100 are connected to the control device 200 and multi-remote shooting is performed.

[0110] Figure 5A There is shown a multi-remote photographing screen 500. The multi-remote photographing screen 500 includes a separate camera control section 501 for controlling photographing-related settings, focusing, photographing, and the like of the first digital camera 100 connected to the control apparatus 200.

[0111] It also includes a separate camera control section 502 for controlling shooting-related settings, focusing, shooting, etc. of a second digital camera 100 connected to the control device 200. It also includes a multi-camera control section 503 for controlling a plurality of digital cameras 100 at a time. Note that, hereinafter, controlling a plurality of cameras will be referred to as "multi-camera control".

[0112] The individual camera control sections 501 and 502 have the same function. Furthermore, when the connection settings of the third and subsequent digital cameras 100 are registered in the control apparatus 200 , the individual camera control sections of the third and subsequent digital cameras 100 are added to the multi remote photographing screen 500 .

[0113] Note that the individual camera control section 501, another individual camera control section 502, the multi-camera control section 503, and the like are realized by the function of the touch panel 206d.

[0114] Configuration of a separate camera control unit

[0115] Figure 5B 2 is a diagram showing the configuration of a separate camera control section 501 .

[0116] The individual camera control section 501 includes an operation member 510 for controlling the connection state with the digital camera 100, a display member 511 for displaying the power state of the digital camera 100, the status of the recording member, etc., and a name display member 512 for identifying the individual camera. It also includes an operation member 513 for controlling the automatic focus of the individual digital camera 100, a display member 514 for indicating the network address of the digital camera 100, and a setting member 515 for performing various settings for individual camera control. It also includes a member group 516 for controlling the display and change of the shooting settings of the digital camera 100, an operation member 517 for performing remote shooting of the individual digital camera 100, and a display member 518 for indicating the number of shots taken by the digital camera 100 and the number of remaining shots that can be taken. It also includes a member 519 for controlling the live view display in the digital camera 100, a display operation member 520 for remote live view, and a display member 521 for indicating a focus detection area (hereinafter referred to as an "AF frame") during automatic focus in the digital camera 100.

[0117] exist Figure 5B In the separate camera control section 501 shown, the user performs autofocus control for focusing on a subject using an operation member 513, and performs remote shooting control using an operation member 517. When it is detected that the user has touched the operation member 517 with a finger, the control device 200 sends a shooting start command to the digital camera 100. Then, when it is detected that the operation member 517 is no longer in contact, a shooting stop command is sent to the digital camera 100. Additionally, when it is detected that the position of the operation member 513 has been touched, an autofocus start command is sent to the digital camera 100, and when it is detected that the operation member 513 is no longer in contact, an autofocus stop command is sent to the digital camera 100.

[0118] like Figure 5C As shown in FIG. 2 , the operating member 513 is arranged at a position separated from the operating member 517. However, the operating member 513 is configured to be movable in the direction of the operating member 517 by the user touching and sliding the operating member 513. Therefore, if the control device 200 detects that the operating member 513 has been touched and the touched position has been moved, the control device 200 changes the display position of the operating member 513 in response to the movement of the touched position. At this time, as shown in FIG. Figure 5D As shown, a clear indication that the operating member 513 can slide can be given by displaying a guide line 530 for indicating the sliding direction of the operating member 513. Then, as shown in FIG. Figure 5E As shown, when it is detected that the position of the operation member 513 has moved and overlapped with the operation member 517 by the touch slide operation performed by the user, the control device 200 sends a shooting start command to the digital camera 100. Here, after the operation member 513 overlaps with the operation member 517, if the operation member 513 moves in a direction different from the direction in which the operation member 513 can slide and moves away from the operation member 517, the control unit 201 sends a shooting stop command to the digital camera 100.

[0119] Note that the form of the operating member for the automatic focus control and the remote photography control in the above-described remote photography is merely an example and may be modified or changed as appropriate.

[0120] Configuration of multi-camera control unit

[0121] Fig. 5F The configuration of the multi-camera control unit 503 is shown.

[0122] The multi-camera control section 503 is composed of components for outputting commands to a plurality of digital cameras 100 at once. Specifically, the multi-camera control section 503 includes an operation member 531 for setting shooting parameters at once, an operation member 532 for instructing multi-remote shooting, and an operation member 533 for selecting a group when instructing multi-remote shooting. It also includes an operation member 534 for instructing a plurality of digital cameras 100 to perform autofocus at once.

[0123] The operation member 534 can perform the same operation as the operation member 513 in the separate camera control section 501 , and issue an autofocus start command and an autofocus stop command to a plurality of digital cameras 100 .

[0124] Additionally, the operation member 532 can perform the same display and operation as the operation member 517 in the separate camera control section 501 , and issue a shooting start command and a shooting stop command to a plurality of digital cameras 100 .

[0125] Note that the form of the operating members for the automatic focus control and the multi-remote photography control in the above-described multi-remote photography is merely an example and may be modified or changed as appropriate.

[0126] The multiple remote shooting control screens are described above.

[0127] Back to Figure 4A In step S407, the control unit 201 performs Figure 4B The remote shooting process and multi-remote shooting process shown in the figure will be described later. Figure 4B .

[0128] In step S408, the control unit 201 determines whether the connection with the plurality of digital cameras 100 has been ended. If the connection has been ended, the control unit 201 determines that the user has completed the remote shooting process and the multi-remote shooting process, and the sequence moves to step S409. If the process is not completed, the sequence returns to step S407.

[0129] In step S409, the control unit 201 deletes the session IDs of the plurality of digital cameras 100 whose connections have been terminated from the nonvolatile memory 203, the working memory 204, or the recording medium 210, and terminates a series of operations in the flowchart.

[0130] Figure 4B It is shown in Figure 4A Flowchart of a series of operations in the remote photographing process and the multi-remote photographing process performed by the control unit 201 on a plurality of digital cameras 100 in step S407 of FIG.

[0131] Notice, Figure 4BThe illustrated operation is realized by the control unit 201 of the control device 200 loading the control program stored in the nonvolatile memory 203 into the working memory 204 and executing the program. This flowchart will describe a series of operations starting when the control device 200 displays a multi-remote shooting screen.

[0132] Additionally, in Figure 4B In the description of FIG. 5 , the operating member 513 in the individual camera control section 501 and the operating member 534 in the multi-camera control section 503 will be collectively referred to as “autofocus control operating member”. Additionally, the operating member 517 in the individual camera control section 501 and the operating member 532 for issuing a shooting command in the multi-camera control section 503 will be collectively referred to as “shooting control operating member”.

[0133] In step S410, the control unit 201 determines whether the user has selected the automatic focus control operation member 513 or 534. If such selection is detected, the control unit 201 moves the sequence to step S411, and if not, the control unit 201 moves the sequence to step S414.

[0134] In step S411, the control unit 201 transmits an autofocus start command to the digital camera 100 corresponding to the autofocus control operation member selected in step S410 among the digital cameras 100 with which the connection has been established in step S403. In other words, if the operation member 513 is selected in step S410, the autofocus start command is sent to the individual digital camera 100. However, if the operation member 534 is selected in step S410, the autofocus start command is sent to a plurality of cameras belonging to the group as the photographing object. The control unit 201 also reads out a session ID for identifying the connection with the corresponding digital camera 100 from the nonvolatile memory 203, the working memory 204, or the recording medium 210, and sends the session ID together with the autofocus start command.

[0135] In step S412, the control unit 201 determines whether an operation for sliding the automatic focus control operation member while it is selected has been performed. If a sliding operation has been performed, the control unit 201 moves the sequence to step S413, and if not, the control unit 201 moves the sequence to step S414.

[0136] In step S413, the control unit 201 determines whether the slide operation is performed until the autofocus control operation member and the shooting control operation member overlap, and whether the autofocus control operation member overlaps with the shooting control operation member. If the operation members overlap, the control unit 201 moves the sequence to step S415, and if not, the control unit 201 moves the sequence to step S414.

[0137] In step S414, the control unit 201 determines whether the shooting control operation member is selected. If the operation member is selected, the control unit 201 moves the sequence to step S415, and if not, the control unit 201 moves the sequence to step S416.

[0138] In step S415, the control unit 201 transmits a shooting start command to the digital camera 100 corresponding to the shooting control operation member selected in step S413 or step S414 among the digital cameras 100 with which the connection has been established in step S403. In other words, if the operation member 517 is selected, the shooting start command is transmitted to the individual digital camera 100, and if the operation member 532 is selected, the shooting start command is transmitted to the plurality of digital cameras 100 belonging to the group as the shooting object. The control unit 201 also reads out a session ID for identifying the connection with the corresponding digital camera 100 from the nonvolatile memory 203, the working memory 204, or the recording medium 210, and transmits the session ID together with the shooting start command.

[0139] In step S416, the control unit 201 determines whether the shooting control operation member has been deselected. If the member has been deselected, the control unit 201 moves the sequence to step S417, and if not, the control unit 201 moves the sequence to step S418.

[0140] In step S417, the control unit 201 transmits a shooting stop command to the digital camera 100 corresponding to the shooting control operation member deselected in step S416 among the digital cameras 100 with which the connection has been established in step S403. The control unit 201 also reads out a session ID for identifying the connection with the corresponding digital camera 100 from the nonvolatile memory 203, the working memory 204, or the recording medium 210, and transmits the session ID together with the shooting stop command.

[0141] In step S418, the control unit 201 determines whether the automatic focus control operation member has been deselected. If the member has been deselected, the control unit 201 moves the sequence to step S419, and if the member has not been deselected, the control unit 201 ends the remote shooting and multi-remote shooting operations in this flowchart.

[0142] In step S419, the control unit 201 sends an automatic focus control stop command to the digital camera 100 corresponding to the automatic focus control operation member that was deselected in step S418 among the digital cameras 100 with which the connection has been established in step S403. The control unit 201 also reads out a session ID for identifying the connection with the corresponding digital camera 100 from the nonvolatile memory 203, the working memory 204, or the recording medium 210, and sends the session ID together with the automatic focus stop command. Then, the remote shooting and multi-remote shooting operations in this flowchart end.

[0143] The above describes the process in which the control apparatus 200 establishes connection with a plurality of digital cameras 100 , performs remote photography and multi-remote photography, and ends photography.

[0144] A series of operations of the digital camera 100

[0145] FIG. 6A to FIG. 6C 1 is a flowchart showing the operation performed by the digital camera 100 according to the present embodiment. According to this processing flow, the digital camera 100 receives commands from a plurality of control devices 200 and performs automatic focusing and shooting.

[0146] Fig. 6A 2 is a flowchart showing a series of operations performed by the digital camera 100 from establishing a connection with the control device 200 to ending the processing. Note that Fig. 6A The illustrated operation is realized by the control unit 101 of the digital camera 100 loading a control program stored in the nonvolatile memory 103 into the working memory 104 and executing the program. This flowchart will describe a series of operations as starting when the digital camera 100 is placed at a shooting position.

[0147] In step S600 , when the user turns on the power of the digital camera 100 , the control unit 101 moves the sequence to step S601 .

[0148] In step S601 , the control unit 101 performs network settings for connecting to the control device 200 .

[0149] In step S602 , the control unit 101 applies the network setting to enter a state capable of connecting to the control device 200 .

[0150] In step S603, the control unit 101 determines whether a connection request has been made from the control device 200. If a connection request has been made, the control unit 101 performs a connection process to establish a connection with the control device 200.

[0151] When establishing a connection with the control device 200, the control unit 101 generates a session ID for identifying a communication session to be started with the control device 200, and sends the session ID to the control device 200. Although a random number or a random character string based on the current time or the like is used for the session ID generated by the control unit 101, the method for generating the session ID and its format are not particularly limited. Then, it is determined whether a connection has been established with at least one control device 200. If a connection has not been established, step S603 is repeated, and a connection request from the control device 200 is confirmed. If a connection has been established with at least one control device, the control unit 101 moves the sequence to step S604.

[0152] In step S604, the control unit 101 determines whether a list has been generated that maintains (i) the session ID sent to the control device 200 with which the connection is established in step S603, and (ii) the latest status (details) of the autofocus control command and the shooting control command received from the control device 200 (source) in the process of step S605 (described later) in association with each other (the list will be referred to as a "remote control information list" hereinafter). If not, the control unit 101 generates the remote control information list and stores the list in the nonvolatile memory 203, the working memory 204, or the recording medium 210.

[0153] Reference Figure 7 Describes a list of remote control information.

[0154] Figure 7 701 , an auto focus command status flag 702 , and a shooting command status flag 703 .

[0155] When the digital camera 100 establishes connection with the control device 200 in step S603, a session ID 701 is generated. The session ID is an ID unique to a communication session, and is received from the control device 200 together with a command when the digital camera 100 receives a command from the control device 200.

[0156] The automatic focus command state flag 702 is a variable for indicating whether the latest automatic focus control command received from each control device 200 is an automatic focus start command (“Start”) or an automatic focus stop command (“Stop”).

[0157] The shooting command state flag 703 is a variable for indicating whether the latest shooting control command received from each control device 200 is a shooting start command (“Start”) or a shooting stop command (“Stop”).

[0158] The remote control information list is represented as a combination of a session ID 701, an auto focus command status flag 702, and a shooting command status flag 703. Figure 7 In the example, the latest automatic focus control command with a session ID of 0x41 received from the control device 200 is an automatic focus start command, and the latest shooting control command received from the control device 200 is a shooting stop command.

[0159] The remote control information list is described above.

[0160] Back to Fig. 6A In step S604, in addition to the above processing, the following processing is performed. That is, the control unit 101 sets the auto focus command state flag and the shooting command state flag corresponding to the session ID sent to each control device 200 in step S603 to the initial value "stop", and adds these items to the remote control information list.

[0161] In step S605, the control unit 101 determines whether an autofocus control command or a shooting control command has been received from the control device 200. If a command has been received, the control unit 101 moves the sequence to step S606, and if not, the control unit 101 repeats step S605.

[0162] In step S606 , the control unit 101 updates the remote control information list based on the automatic focus control command or the shooting control command received from the control device 200 in step S605 and the session ID received together with the command.

[0163] If an automatic focus start command has been received from the control device 200 in step S605, the automatic focus command state flag corresponding to the session ID received together with the command is updated to “start”, and if an automatic focus stop command has been received, the flag is updated to “stop”. If a shooting start command has been received from the control device 200 in step S605, the shooting command state flag corresponding to the session ID received together with the command is updated to “start”, and if a shooting stop command has been received, the flag is updated to “stop”.

[0164] In step S607, the control unit 101 performs the following steps: Figure 6B The shooting operation shown continues. Figure 6B .

[0165] In step S608, the control unit 101 determines whether the connection with any of the control devices 200 connected in step S603 has ended. If the connection has ended, the control unit 101 moves the sequence to step S609, and if not, the control unit 101 moves the sequence to step S603.

[0166] In step S609, the control unit 101 deletes the control device 200 whose connection is ended in step S608 from the remote control information list. Note that, instead of deleting the control device 200 from the remote control information list, the auto focus command state flag and the shooting command state flag corresponding to the control device 200 whose connection is ended in step S608 in the remote control information list may be set to "stop". Then, the remote control information list may be managed without being deleted until the list is deleted in step S612 (described later).

[0167] In step S610, the control unit 101 performs the same operation as in step S607. Figure 6B The shooting operation shown continues to process.

[0168] This is done in order to re-judge whether to continue the automatic focus operation and the shooting operation of the digital camera 100 in response to the remote control information list updated in step S609, and to update the status of the automatic focus operation and the shooting operation. For example, if the control device 200 whose shooting command status flag is "start" is deleted in step S609, the shooting operation may continue even if all the shooting command status flags in the remote control information list are set to "stop" after the control device 200 has been disconnected. Thus, after the remote control information list is updated, it is necessary to perform the shooting operation continuation processing based on the updated remote control information list.

[0169] In step S611, the control unit 101 determines whether the connection with all the control devices 200 connected in step S603 has ended. If the connection has ended, the control unit 101 moves the sequence to step S612, and if not, the control unit 101 moves the sequence to step S603.

[0170] In step S612 , the control unit 101 deletes the entire remote control information list from the nonvolatile memory 203 , the working memory 204 , or the recording medium 210 , and ends the operation of the flowchart.

[0171] Figure 6B It is shown in Fig. 6A Flowchart of operations in the photographing operation continuation process performed by the control unit 101 in steps S607 and S610.

[0172] In step S620, the control unit 101 refers to the shooting command status flags of all session IDs in the remote control information list, and determines whether any shooting command status flag is set to "start". If any shooting command status flag is set to "start", the control unit 101 moves the sequence to step S621, and if all shooting command status flags are not set to "start", the control unit 101 moves to step S623.

[0173] In step S621, the control unit 101 determines whether a shooting operation has started in the digital camera 100. If the shooting operation has started, the control unit 101 ends the shooting operation continuation processing of this flowchart, and if the shooting operation has not started, the control unit 101 moves the sequence to step S622.

[0174] In step S622, the control unit 101 performs a shooting operation start process of starting a shooting operation of a still image, and then ends the shooting operation continuation process of this flowchart. However, if a continuous shooting mode is set, the shooting operation is repeated from start to stop. In other words, shooting is performed continuously and a plurality of images are sequentially shot until the shooting operation stop process is performed in step S625 (described later).

[0175] In step S623, the control unit 101 refers to the shooting command status flags of all session IDs in the remote control information list, and determines whether all the shooting command status flags are set to "stop". If all the shooting command status flags are set to "stop", the control unit 101 moves the sequence to step S624, and if there is any shooting command status flag that is not set to "stop", the control unit 101 ends the shooting operation of this flowchart and continues the processing.

[0176] In step S624, the control unit 101 determines whether the shooting operation has been stopped in the digital camera 100. If the shooting operation has been stopped, the control unit 101 moves the sequence to step S626, and if the shooting operation has not been stopped (i.e., if the shooting operation has been started), the control unit 101 moves the sequence to step S625.

[0177] In step S625 , the control unit 101 performs a photographing operation stop process of stopping the photographing operation of the still image.

[0178] In step S626, the control unit 101 performs Figure 6C The autofocus operation shown in the flowchart continues to be processed, and then the shooting operation continues to be processed in this flowchart. Figure 6C .

[0179] Note that the automatic focus operation continuation process is a process of starting and stopping the automatic focus operation based on the remote control information list (described later). After it has been confirmed that the shooting operation has been stopped in step S624, or after the shooting operation has been stopped in step S625, the automatic focus operation continuation process of step S626 is performed. Therefore, when the shooting operation is in progress, the state of the automatic focus operation continuation does not change. It is also possible to start the automatic focus operation as soon as possible when necessary by performing the process of step S626 after the shooting operation has been stopped in step S625.

[0180] Figure 6C It is shown in Figure 6B Flowchart of operations in the automatic focusing operation continuing process performed by the control unit 101 in step S626 of FIG.

[0181] In step S630, the control unit 101 refers to the automatic focus command status flags of all session IDs in the remote control information list, and determines whether any automatic focus command status flag is set to "start". If any automatic focus command status flag is set to "start", the control unit 101 moves the sequence to step S631, and if all automatic focus command status flags are not set to "start", the control unit 101 moves the sequence to step S633.

[0182] In step S631, the control unit 101 determines whether an automatic focus operation has started in the digital camera 100. If the automatic focus operation has started, the control unit 101 ends the automatic focus operation continuation processing of this flowchart, and if the automatic focus operation has not started, the control unit 101 moves the sequence to step S632.

[0183] In step S632, the control unit 101 starts the automatic focusing operation, after which the automatic focusing operation continuation processing of the flowchart ends. However, the automatic focusing operation is performed continuously from start to stop. In other words, the automatic focusing operation is performed continuously until the automatic focusing operation stop processing is performed in step S635 (described later).

[0184] If the AF operation mode is servo AF, the defocus amount in the focus detection area is continuously detected, and the focus lens is driven according to the continuously detected defocus amount until the automatic focus operation stop process is performed. If the tracking AF mode is set, the focus detection area is automatically moved to continuously track the subject in both single AF and servo AF until the automatic focus operation stop process is performed.

[0185] In step S633, the control unit 101 refers to the automatic focus command status flags of all session IDs in the remote control information list, and determines whether all the automatic focus command status flags are set to "stop". If all the automatic focus command status flags are set to "stop", the control unit 101 moves the sequence to step S634, and if it is determined that any automatic focus command status flag is not set to "stop", the control unit 101 ends the automatic focus operation continuation processing of this flowchart.

[0186] In step S634, the control unit 101 determines whether the autofocus operation has been stopped in the digital camera 100. If the autofocus operation has been stopped, the autofocus operation continuation processing of this flowchart ends, and if the autofocus operation has not been stopped, the sequence moves to step S635.

[0187] In step S635, the control unit 101 stops the already started automatic focus operation through the automatic focus operation stop processing. Then, the automatic focus operation continuation processing of this flowchart ends.

[0188] A series of operations performed by the digital camera 100 in the present embodiment when the digital camera 100 performs processing to receive commands from a plurality of control devices 200 and perform automatic focusing and shooting has been described above.

[0189] As described above, in the aforementioned embodiment, the photographing operation is started when the digital camera 100 initially receives a photographing start command from any one of the control devices 200. The photographing operation is continued until a photographing stop command is received from all the control devices 200 that sent the start command. On the other hand, when a photographing stop command is received from all the control devices 200 that sent the photographing start command, the photographing operation is stopped.

[0190] Additionally, the autofocus operation is started when the autofocus start command is initially received from any one of the control devices 200. The autofocus operation is continued until the autofocus stop command is received from all the control devices 200 that sent the start command. On the other hand, when the autofocus stop command is received from all the control devices 200 that sent the autofocus start command, the autofocus operation is stopped.

[0191] In this way, if one photographer attempts to shoot while the digital camera is already shooting in response to a command from another photographer, shooting will continue until the one photographer issues a stop command, which avoids the situation where the one photographer misses his or her opportunity to shoot.

[0192] Second embodiment

[0193] The first embodiment describes the following control. That is, when the automatic focus start command is initially received from any one of the control devices 200, the automatic focus process is started. The automatic focus process is continued until the automatic focus stop command is received from all the control devices 200 that sent the start command. Then, when the automatic focus stop command is received from all the control devices 200 that sent the start command, the automatic focus process is stopped.

[0194] On the other hand, if the AF operation mode set in the digital camera 100 is single AF, Figure 6C The automatic focus operation is started in step S632, and automatic focus detection is performed in the focus detection area. Then, after the focus lens is driven to the focus position according to the detected defocus amount, the driving of the focus lens is stopped. Then, the focus position is fixed until the automatic focus operation stop processing is performed in step S635. Therefore, after the automatic focus command is initially received from the control device 200, even if the main subject moves, the automatic focus detection and the focus lens driving are not continuously performed until the automatic focus operation stop processing is performed. In other words, there is a situation where the main subject remains out of focus.

[0195] Therefore, in the second embodiment, the automatic focus control processing method is switched by referring to the AF operation mode. Specifically, when the AF operation mode is single AF, in addition to Figure 6C In addition to the autofocus continuation process shown in the figure and described in the first embodiment, the following process is also performed. That is, when a predetermined condition (hereinafter referred to as "autofocus retry condition") is satisfied, the autofocus operation is stopped once, and the autofocus operation is immediately started again (retry operation). Thus, the main subject can be refocused by detecting the focus in the detection area again (performing focus detection) and moving the focus lens back to the focus position.

[0196] The same constituent elements as those in the first embodiment will be given the same reference numerals, and their description will be omitted or simplified. FIG. 6A to FIG. 6C The operations performed by the digital camera 100 in the first embodiment shown are different, and thus only the different parts are described in this embodiment.

[0197] Fig. 8A and Figure 8B 1 is a flowchart showing operations performed by the digital camera 100 according to the present embodiment, and particularly shows autofocus operation continuation processing among a series of operations.

[0198] Fig. 8A The first embodiment is shown Figure 6C Corresponding processing.

[0199] In step S631, the control unit 101 of the digital camera 100 determines whether an automatic focus operation has been started in the digital camera 100. Figure 6C In the same manner as in , if the operation has not yet started, the control unit 101 moves the sequence to step S801, and if the operation has already started, the control unit 101 moves the sequence to step S632.

[0200] In step S801, the control unit 101 performs Figure 8B The automatic focus retry process shown is performed, and then the automatic focus operation continuation process of this flowchart ends.

[0201] Figure 8B It is shown in Fig. 8A Flowchart of operations in the autofocus retry process performed by the digital camera 100 in step S801 of FIG.

[0202] In step S810, the control unit 101 determines whether the currently set AF operation mode is single AF. If the AF operation mode is single AF, the control unit 101 moves the sequence to step S811, and if not, the control unit 101 ends the auto focus retry process of this flowchart.

[0203] In step S811, the control unit 101 determines whether the auto focus retry condition is satisfied. In this embodiment, the control unit 101 performs the following determination as an example of the auto focus retry condition. In other words, when Fig. 6A When the remote control information list is updated in step S606 or step S609, it is determined whether any auto focus command status flag has been updated from "stop" to "start". If the flag has been updated, the control unit 101 moves the sequence to step S812, and if not, the control unit 101 ends the auto focus retry processing of this flowchart.

[0204] In step S812 , the control unit 101 ends the automatic focusing operation.

[0205] In step S813, the control unit 101 starts an automatic focus operation. Then, the automatic focus retry process of this flowchart ends.

[0206] The operation of the digital camera 100 according to the second embodiment when the digital camera 100 receives commands from a plurality of control devices 200 and performs automatic focusing and shooting has been described above.

[0207] As a result of the above-described autofocus retry process, the following operation is performed. That is, when the autofocus start command is initially received from any one of the control devices 200, the autofocus process is started. Then, when the autofocus start command is received from any one of the control devices 200, the main object is brought into focus again by autofocus until the autofocus stop command is received from all the control devices 200 that sent the start command.

[0208] In this embodiment, the auto-focus retry condition is described as: Fig. 6A When the remote control information list is updated in step S606 or step S609, any auto focus command status flag is updated from "stop" to "start". However, the auto focus retry condition is not limited to this. For example, suppose that when Fig. 6A When the remote control information list is updated in step S606 or step S609, it is determined whether any auto focus command status flag has been updated from "start" to "stop". If the flag has been updated, the sequence moves to step S812. In other words, processing is performed for stopping and then restarting the auto focus operation. If the flag has not been updated, the auto focus retry sequence ends.

[0209] As a result of this autofocus retry process, the following operation is performed. That is, when the autofocus start command is initially received from any one of the control devices 200, the autofocus process is started. Then, when the autofocus stop command is received from any one of the control devices 200, the main object is brought into focus again by autofocus until the autofocus stop command is received from all the control devices 200 that sent the start command.

[0210] As described above, according to the second embodiment, even if the AF operation mode is single AF and the main subject has moved, it is possible to detect the focus in the detection area again and bring the main subject back into focus.

[0211] Third embodiment

[0212] Although the first and second embodiments describe the control device 200 as having a FIG. 5A to FIG. 5F The embodiments of the present invention do not discuss the operation of the user specifying the focus detection area (AF frame) during the automatic focusing of the digital camera 100. When the digital camera 100 is set to the tracking AF mode, the digital camera 100 moves the focus detection area according to the movement of the subject to automatically track the subject, so the user does not necessarily need to specify the AF frame. However, it is necessary to provide a configuration in which the user can specify the AF frame at a desired position when the tracking AF mode is not set.

[0213] Therefore, the third embodiment will describe a configuration in which an AF frame is specified at a desired position by the user operating a control member in the display screen of the control device 200 .

[0214] The same constituent elements as those in the first and second embodiments will be given the same reference numerals, and their description will be omitted or simplified. FIG. 5A to FIG. 5F A partial screen displayed on the display unit 206 of the control device 200 shown in FIG. Figure 4A and Figure 4B Some of the operations performed by the control device 200 shown and Fig. 8A and Figure 8B Part of the operations in the processing performed by the illustrated digital camera 100 are different, and thus only these different parts will be described.

[0215] Fig. 9 The operating member according to the third embodiment is shown, and Figure 5B The portion corresponding to the separate camera control section 501 shown and described in the first embodiment. Fig. 9 In the embodiment, by touching the live view display operation member 520 with the finger 900, an auto focus start command can be issued to the digital camera 100 according to the touched position. Then, an auto focus end command can be issued by moving the finger away from the live view display operation member 520. It should be noted that a change can be made so that a shooting control command is sent in addition to the auto focus control command at any timing in a series of operations in which the live view display operation member 520 is touched and the touch ends.

[0216] In the first embodiment, the control device 200 is as follows Figure 4A and Figure 4B A series of processing is performed in the order shown. In the third embodiment, as Figure 4B As shown, the control device 200 accepts not only the operation of the autofocus control operation member and the shooting control operation member, but also the operation of the live view display operation member 520. When a touch on the live view display operation member 520 is detected, the control device 200 sends information about a position in the live view screen corresponding to the touched position (hereinafter referred to as "AF frame information") and an autofocus start command to the digital camera 100. The display member 521 for indicating the AF frame is displayed at the touched position. Then, when it is detected that the touch has stopped, an autofocus stop command is sent to the digital camera 100.

[0217] Fig. 10A and Fig. 10B 1 is a flowchart showing operations performed by the digital camera 100 according to the present embodiment, and particularly shows autofocus operation continuation processing among a series of operations.

[0218] Fig. 10A The same as described in the second embodiment is shown Fig. 8A The corresponding part.

[0219] In step S1000, the control unit 101 determines whether AF is locked. If AF is locked, the control unit 101 moves the sequence to step S630, and if not, the control unit 101 moves the sequence to step S1001. Note that the AF operation mode of the digital camera 100 is single AF, so after the AF operation has been started, automatic focus detection is performed once, the focus lens is moved, and then the focus lens position is fixed. In other words, AF is locked. Therefore, the focus detection area cannot be moved while AF is continued.

[0220] In step S1001, the control unit 101 generates a Fig. 6A The next auto focus focus detection area is calculated and updated based on the AF frame information received together with the auto focus start command in step S605. Then, the sequence moves to step S630.

[0221] Fig. 10B The same as described in the second embodiment is shown Figure 8B The corresponding part of the autofocus retry processing in.

[0222] In step S812, the control unit 101 ends the automatic focus operation. Then, the sequence moves to step S1002.

[0223] In step S1002, similar to step S1001, the control unit 101 Fig. 6A The next auto focus focus detection area is calculated and updated based on the AF frame information received together with the auto focus start command in step S605. Then, the sequence moves to step S813.

[0224] Note that, unlike step S1001, even if the AF operation mode of the digital camera 100 is single AF, the AF operation is stopped in step S812, and thus the focus detection area can be moved.

[0225] In step S813, the digital camera 100 starts an autofocus operation. Then, the autofocus retry process of this flowchart ends.

[0226] The foregoing describes the operation of the digital camera 100 according to the third embodiment when the digital camera 100 receives commands from a plurality of control devices 200 and performs autofocusing and shooting. In this manner, if the user specifies an AF frame, in the autofocus retry process, the autofocus operation is stopped, the focus detection area is moved based on the AF frame specified by the user, and then the autofocus operation is started again.

[0227] The third embodiment describes a method based on Fig. 6A The method of calculating and updating the next automatic focusing focus detection area in step S1001 or step S1002 based on the latest AF frame information received in step S605. However, the method by which the digital camera 100 updates the focus detection area is not limited thereto.

[0228] For example, methods such as the following method are also conceivable. When the remote control information list is updated in step S606, Fig. 6A The AF frame information received from the control device 200 in step S605 is stored in combination with the session ID in the nonvolatile memory 203, the working memory 204, or the recording medium 210. Then, in step S1001 or step S1002, any desired AF frame is selected based on the AF frame information associated with each session ID, the next automatic focusing focus detection area is calculated based on the selected AF frame, and the focus detection area is updated.

[0229] Modifications

[0230] The first to third embodiments describe a method of starting an autofocus operation equivalent to pressing the AF-ON button by sending an autofocus start command from the plurality of control devices 200 to the digital camera 100. However, instead of the autofocus operation, a shooting preparation operation may be started by sending a shooting preparation operation start command when the release switch enters the SW1 state from the plurality of control devices 200 to the digital camera 100. In other words, instead of the control device 200 controlling only the timing of starting and stopping the autofocus operation, the control device 200 may be configured to control the timing of starting and stopping the shooting preparation operation including the AF process, the AE process, the AWB process, the EF process, and the like.

[0231] The first to third embodiments describe a method of transmitting a shooting control command and an autofocus control command to the digital camera 100 by detecting the operation of a control member displayed in the display unit 206 of the control apparatus 200. However, the method by which the control apparatus 200 controls the digital camera 100 is not limited thereto.

[0232] For example, the control device 200 may have the same configuration as the above-described digital camera 100, and thus the digital camera 100 may be controlled by the control device 200 using a tandem shooting function in the digital camera. The "tandem shooting function" is a function in which a plurality of digital cameras connected wirelessly or by wire shoot images in tandem.

[0233] For example, in the linked shooting function, a digital camera operating as a simple AP in access point (AP) mode is called a "sender camera", and a digital camera operating as a CL device in client (CL) mode is called a "receiver camera". Each receiving camera is connected to the sending camera. When the user operates the sending camera and shoots, the operation is transmitted from the sending camera to the receiving camera wirelessly connected thereto. Each receiving camera that receives the information performs a shooting operation corresponding to the operation.

[0234] In the present invention, the sending camera in the above-described linked shooting function may be regarded as the control device 200 according to the present embodiment, and the receiving camera may be regarded as the digital camera 100 according to the present embodiment.

[0235] For example, when the AF-ON button is pressed in the sending camera, an auto focus start command is sent to the receiving camera, and when the AF-ON button is released, an auto focus stop command is sent to the receiving camera. In addition, upon detecting that the release switch has entered the SW2 state, the sending camera sends a shooting start command to the receiving camera. Additionally, by detecting that the release switch has exited the SW2 state, a shooting stop command is sent to the receiving camera. The receiving camera can also receive and execute commands from multiple sending cameras to perform Fig. 6A , Figure 6B , Fig. 8A , Figure 8B , Fig. 10A and Fig. 10B A series of operations performed by the digital camera 100 is shown.

[0236] Other embodiments

[0237] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0238] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A control system, wherein: The camera equipment is controlled by multiple control devices. Among them, each control device includes: A first communication unit, used for communicating with the camera device; a first instruction unit, configured to output an instruction for starting or stopping an automatic focusing operation to the camera device, the instruction being an instruction related to the automatic focusing operation; and a second instruction unit, configured to output an instruction for starting or stopping a photographing operation to the photographing device, the instruction being an instruction related to the photographing operation; The camera device comprises: A second communication unit, used to communicate with each control device in the control device; A camera device, used to perform the shooting operation; An optical camera system, used for performing the automatic focusing operation; and Control unit, wherein, when an instruction for starting the photographing operation is initially received from any one of the plurality of control devices, the control unit performs the following control: starting the photographing operation, and continuing the photographing operation until instructions for stopping the photographing operation are received from all the control devices that have sent instructions for starting the photographing operation, and When an instruction for starting the automatic focusing operation is initially received from any one of the multiple control devices, the control unit performs the following control: starts the automatic focusing operation, and continues the automatic focusing operation until instructions for stopping the automatic focusing operation are received from all control devices that have sent instructions for starting the automatic focusing operation.

2. The control system according to claim 1, in, The imaging apparatus further includes storage means for storing a list of latest contents of instructions related to the autofocus operation and instructions related to the shooting operation from the plurality of control apparatuses in a form that enables the control apparatuses to be distinguished from each other.

3. The control system according to claim 2, in, The control unit controls start and stop of the auto focus operation and start and stop of the photographing operation based on the list.

4. The control system according to claim 2, in, The control unit starts the automatic focus operation if the instruction related to the automatic focus operation from any one of the control devices in the list is an instruction for starting automatic focus when the photographing operation is stopped.

5. The control system according to claim 2, in, The control unit performs a retry operation for stopping the automatic focus operation and starting the automatic focus operation again when a condition for performing the automatic focus operation again is satisfied.

6. The control system according to claim 5, in, The control unit determines that a condition for performing the automatic focus operation again is satisfied when an instruction related to the automatic focus operation from any one of the control devices in the list is updated from stopping the automatic focus operation to starting the automatic focus operation.

7. The control system according to claim 5, in, The control unit determines that a condition for performing the automatic focus operation again is satisfied when an instruction related to the automatic focus operation from any one of the control devices in the list is updated from starting the automatic focus operation to stopping the automatic focus operation.

8. The control system according to claim 5, in, The control unit switches whether to perform the retry operation according to a mode of the autofocus operation.

9. The control system according to claim 8, in, The control unit skips the retry operation when the mode of the auto focus operation is the servo AF, and performs the retry operation when the mode of the auto focus operation is the single AF.

10. The control system according to claim 3, in, For a control device whose connection has ended, the storage device deletes the list corresponding to the control device.

11. The control system according to claim 1, comprising: A plurality of said camera devices.

12. The control system according to claim 1, in, Each of the control devices is a camera device.

13. A camera device, which is controlled by a plurality of control devices, the camera device comprising: A communication unit, used for communicating with each of the control devices; A camera device, used for performing shooting operations; An optical camera system for performing an automatic focusing operation; as well as Control unit, wherein, when an instruction for starting the photographing operation is initially received from any one of the plurality of control devices, the control unit performs the following control: starting the photographing operation, and continuing the photographing operation until instructions for stopping the photographing operation are received from all the control devices that have sent instructions for starting the photographing operation, and When an instruction for starting the automatic focusing operation is initially received from any one of the multiple control devices, the control unit performs the following control: starts the automatic focusing operation, and continues the automatic focusing operation until instructions for stopping the automatic focusing operation are received from all control devices that have sent instructions for starting the automatic focusing operation.

14. A method for controlling an image pickup device, wherein the image pickup device is controlled by a plurality of control devices, the image pickup device comprising a communication unit for communicating with the control devices, an image pickup device for performing a shooting operation, and an optical image pickup system for performing an automatic focusing operation, the method comprising: When an instruction for starting the photographing operation is initially received from any one of the plurality of control devices, control is performed to start the photographing operation and to continue the photographing operation until instructions for stopping the photographing operation are received from all the control devices that have sent instructions for starting the photographing operation, and When an instruction for starting the automatic focus operation is initially received from any one of the multiple control devices, the following control is performed: the automatic focus operation is started, and the automatic focus operation is continued until instructions for stopping the automatic focus operation are received from all control devices that have sent instructions for starting the automatic focus operation.

15. A computer program product, configured to cause a computer to execute the method according to claim 14. 16 . A non-transitory computer-readable storage medium storing a program for causing a computer to execute the method according to claim 14 .

Images