Imaging device, control method, and program

Abstract

To improve accuracy of control of a position or the like of an imaging apparatus.SOLUTION: An imaging apparatus comprises: imaging means which captures an image in an imaging frequency according to the transmission setting and has higher imaging frequency when the transmission setting is a first setting than when the transmission setting is a second setting or a third setting; generation means which generates additional information that is related to a photographed image obtained by capturing the image at the imaging frequency and is used by a control device for control processing of controlling at least one of the position and posture of the imaging apparatus when the transmission setting is the first setting or the third setting; and transmission means which transmits the additional information to the control device when the transmission setting is the first setting, transmits the photographed image to the control device when the transmission setting is the second setting, and transmits the additional information and the photographed image to the control device when the transmission setting is the third setting.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an imaging device, a control method, and a program. [Background technology]

[0002] Patent Document 1 describes a method for controlling the flight of a drone using image data generated by an imaging device mounted on the drone and linked to the drone. Patent Document 2 describes a method for utilizing live view images and accompanying information from a camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-220004 [Patent Document 2] Japanese Patent Application Laid-Open No. 2017-85437 Summary of the Invention [Problem to be solved by the invention]

[0004] When a mobile device such as a drone controls the position (at least one of the position and attitude) of an imaging device based on additional information, the accuracy of control may decrease depending on the update frequency of the additional information, making it difficult for the imaging device to follow the movement of the subject. For example, if the subject moves away from the center of the angle of view, if the mobile device cannot quickly obtain additional information reflecting the position of the subject after the movement, it may not be able to control the imaging device to return the subject to the center of the angle of view. The methods described in Patent Documents 1 and 2 cannot solve this problem.

[0005] SUMMARY OF THE INVENTION It is therefore an object of the present invention to improve the accuracy of control of the position of an imaging device. [Means for solving the problem]

[0006] In order to solve the above problems, Attachable to mobile devices The imaging device the moving device an imaging means for capturing an image at an imaging frequency determined based on a transmission setting related to transmission of additional information and a captured image to a communication device, wherein, when the transmission setting is a first setting, the imaging frequency is higher than when the transmission setting is a second setting or a third setting; and when the transmission setting is the first setting or the third setting, the additional information related to the captured image obtained by capturing an image at the imaging frequency, Mobile Device a generating unit that generates the additional information used for a control process to control at least one of the position and the orientation of the imaging device, and when the transmission setting is the first setting, the additional information is Mobile Device When the transmission setting is the second setting, the captured image is transmitted to Mobile Device and when the transmission setting is the third setting, the additional information and the captured image are transmitted to the Mobile Device and a transmitting means for transmitting to The moving device controls at least one of the position and the attitude of the imaging device attached to the moving device in response to a change in at least one of the position and the attitude of the moving device. do. [Effects of the Invention]

[0007] According to the present invention, it is possible to improve the accuracy of control of the position of the imaging device, etc. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram illustrating components of an imaging device 10 according to first to third embodiments. [Figure 2] FIG. 2 is a block diagram for explaining components of a moving device 20 in the first to third embodiments. [Figure 3] FIG. 1 is a diagram illustrating an example of the configuration of an imaging system according to first to third embodiments. [Figure 4] 4 is a flowchart for explaining processing 400 performed by the imaging device 10 in the imaging system according to the first embodiment. [Figure 5]10 is a flowchart for explaining processing 500 performed by the imaging device 10 in the imaging system according to the second embodiment. [Figure 6] 10 is a flowchart for explaining processing 600 performed by the imaging device 10 in the imaging system according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings, but the present invention is not limited to the following embodiments.

[0010] [Embodiment 1] 1 is a block diagram illustrating components of an image capture device 10 according to embodiment 1. The image capture device 10 is, for example, a device that can operate as a digital camera.

[0011] As shown in Fig. 1, the imaging device 10 includes a lens unit 100, an imaging element 101, an A / D converter 102, a microcomputer 103, a volatile memory 104, and a non-volatile memory 105. The imaging device 10 further includes an image processing unit 106, a communication unit 107, a display unit 108, an operation unit 109, and a recording medium 110. Each of these components of the imaging device 10 includes a circuit for realizing the functions described below. Note that the components of the imaging device 10 are not limited to those shown in Fig. 1.

[0012] Lens unit 100 is a single-focus lens unit or a zoom lens unit. Microcomputer 103 can acquire information such as the focal length, the current zoom position, and the length of the lens barrel from lens unit 100. Furthermore, when microcomputer 103 or the like issues an instruction to drive the zoom of lens unit 100, lens unit 100 can move the zoom position.

[0013] The image sensor 101 is a CCD image sensor or a CMOS image sensor. The image sensor 101 converts the subject image formed by the lens unit 100 into an electrical signal. The A / D converter 102 converts the analog output signal of the image sensor 101 into a digital signal.

[0014] The microcomputer 103 controls each component of the imaging device 10. The microcomputer 103 also performs control in response to operation instructions from the operation unit 109, generates images to be displayed on the display unit 108, and performs network control via the communication unit 107. The microcomputer 103 also performs communication processing when linking with the mobile device 20 (described later), control for receiving the status of the mobile device 20, and processing for controlling the mobile device 20. The microcomputer 103 also controls communication with the lens unit 100. The microcomputer 103 also determines whether the lens unit 100 is connected, acquires the zoom position, acquires the minimum imaging distance, and performs control related to the lens unit 100 (zoom control, etc.). The microcomputer 103 also generates additional information that supplements the live view image generated by the image processing unit 106 (described later). The additional information includes, for example, information obtained from a spirit level provided in the imaging device 10, information indicating the position and size of an AF frame (AF frame information) that indicates the position of a subject focused by autofocus (AF), and information indicating whether the subject is in focus.

[0015] The volatile memory 104 is a storage medium that stores image data converted into digital signals by the A / D converter 102. The nonvolatile memory 105 is a storage medium that stores a computer program that the microcomputer 103 executes to control each component of the imaging device 10. The nonvolatile memory 105 also stores setting values ​​for the imaging device 10. The image processing unit 106 performs image processing on captured images (captured images). The image processing unit 106 also works in cooperation with the microcomputer 103 to generate live view images for checking composition and focus during imaging.

[0016] The communication unit 107 communicates using a communication method such as a wireless LAN. The communication method used by the communication unit 107 may be a wired communication method or a wireless communication method. The microcomputer 103 communicates with the mobile device 20 or the gimbal 118 (described later) via the communication unit 107, thereby coordinating with the mobile device 20 or the gimbal 118. As a coordinating method, a coordinating method such as a dedicated software development kit (SDK) may be used, or an API disclosure method such as an HTTP-based WebAPI may be used. Alternatively, a coordinating method disclosed by the imaging device 10, the mobile device 20, or the gimbal 118 may be used, or a coordinating method disclosed by each of these devices may be used. In the first embodiment, the coordinating method is not particularly limited.

[0017] The display unit 108 displays menus and playback images under the control of the microcomputer 103. The display unit 108 also displays live view images. The operation unit 109 includes, for example, a plurality of operation members (buttons or keys) or a touch panel. If the touch panel of the operation unit 109 is provided on the display unit 108, the user can operate what is displayed on the display unit 108. The recording medium 110 is, for example, a memory card. The microcomputer 103 can write data from the volatile memory 104 to the recording medium 110. In addition, the microcomputer 103 can read data stored in the recording medium 110 to the volatile memory 104.

[0018] 2 is a block diagram illustrating components of the mobile device 20 in embodiment 1. The mobile device 20 is, for example, a device that can operate as a drone.

[0019] As shown in Fig. 2, the mobile device 20 has a propeller 111, a flight control unit 112, a microcomputer 113, a volatile memory 114, a non-volatile memory 115, and a communication unit 116. The mobile device 20 also has a gimbal control unit 117, a gimbal 118, a remote control communication unit 119, a light emission control unit 120, and a light emission unit 121. Each of these components of the mobile device 20 has a circuit for realizing the functions described below. Note that the components of the mobile device 20 are not limited to those shown in Fig. 2.

[0020] The propeller 111 is a propeller for moving the mobile device 20 up, down, forward, backward, right, or left. The flight control unit 112 controls the flight of the mobile device 20 in cooperation with the microcomputer 113. The flight control unit 112 performs processing to control the flight speed and control to obtain the length and height of the propeller. The flight control unit 112 also performs control to prevent the mobile device 20 from colliding with an object such as a subject. Any existing technology can be used as the collision avoidance algorithm for the mobile device 20.

[0021] The microcomputer 113 controls each component of the mobile device 20. The volatile memory 114 is a storage medium that stores various information or data used by the microcomputer 113. The non-volatile memory 115 is a storage medium that stores computer programs that the microcomputer 113 executes to control each component of the mobile device 20.

[0022] The communication unit 116 is capable of communicating with the communication unit 107 of the imaging device 10. The communication unit 116 communicates with the communication unit 107 of the imaging device 10, thereby realizing cooperation between the imaging device 10 and the mobile device 20. The communication method of the communication unit 116 is not particularly limited. The communication method used by the communication unit 116 may be a wired communication method or a wireless communication method. Examples of information to be communicated include control commands for controlling the mobile device 20, notifications regarding the state of the mobile device 20, control commands for controlling the imaging device 10, and information regarding the lens unit 100 attached to the imaging device 10.

[0023] The gimbal 118 is detachable from the mobile device 20. The gimbal control unit 117 is a control unit that controls the gimbal 118 attached to the mobile device 20. The imaging device 10 can be attached to the gimbal 118 and is mounted on the mobile device 20 via the gimbal 118. The gimbal control unit 117 works in conjunction with the microcomputer 113 to adjust the angle, etc., of the imaging device 10 attached to the gimbal 118. The remote control communication unit 119 is capable of communicating with a remote control operated by a user. The mobile device 20 may be configured to be remotely controlled by a user operating the remote control, etc. Alternatively, the mobile device 20 may be an autonomous flying drone that can fly with a flight path, etc., set in advance. When the mobile device 20 is controlled via a remote control, etc., the microcomputer 113 receives control commands via the remote control communication unit 119 and controls the mobile device 20 according to the received control commands.

[0024] The light-emitting control unit 120 is a control unit that controls the light-emitting state of the light-emitting unit 121. The light-emitting unit 121 includes a light-emitting element (e.g., an LED). In consideration of night flights and the like, the mobile device 20 has the light-emitting unit 121 so that the user can see where the mobile device 20 is flying. The light-emitting control unit 120 controls the light-emitting state of the light-emitting unit 121.

[0025] FIG. 3 is a diagram illustrating an example of the configuration of the imaging system in the first embodiment. Reference numeral 200 denotes a remote control for remotely controlling the mobile device 20. The remote control 200 is operated by a user, and the mobile device 20 can be controlled based on the instructions. Reference numeral 201 denotes a display unit of the remote control 200. The remote control 200 displays image data captured by the imaging device 10 attached to the mobile device 20 on the display unit 201. This allows the user to check the angle of view of a still image or video, etc. If an error occurs when the imaging device 10 and the mobile device 20 cooperate to provide a function, the remote control 200 can display an error message on the display unit 201.

[0026] Reference numeral 202 denotes an operation unit of the remote control 200. By operating the operation unit 202, the user can instruct the mobile device 20 to take off, land, move forward, rotate, etc. The user can also control the imaging device 10 via the mobile device 20. By operating the operation unit 202, the user can also instruct the control of, for example, the lens unit 100 attached to the imaging device 10.

[0027] Reference numeral 203 conceptually indicates communication performed between the remote control 200 and the remote control communication unit 119 of the mobile device 20. Remote control radio waves for controlling the mobile device 20 are, for example, a radio transmitter. Since the mobile device 20 may fly at an altitude of several hundred meters, it is assumed that long-distance wireless or wired communication will be performed. There are no particular limitations on the communication method between the remote control 200 and the mobile device 20. The imaging device 10 is supported by a gimbal 118 of the mobile device 20 and attached to the mobile device 20.

[0028] In the imaging system of the first embodiment, the position or attitude of the imaging device 10 changes in response to a change in the position or attitude of the moving device 20. The moving device 20 can also change the position or attitude of the imaging device 10 by driving the gimbal 118. Therefore, the moving device 20 serves as a control device that controls the position, etc. (at least one of the position and attitude) of the imaging device 10.

[0029] The imaging device 10 generates additional information related to the live view image. The additional information includes first-type information used by the mobile device 20 for control processing to control the position of the imaging device 10, etc. An example of the first-type information is information (AF frame information) indicating the size and position of a frame (AF frame) indicating the position of a subject targeted for autofocus. Another example of the first-type information is information indicating whether the subject is in focus. When the additional information includes AF frame information, the mobile device 20 can control the position of the imaging device 10, for example, so that the subject is centered in the angle of view based on the position indicated by the AF frame information. The additional information may include at least one of AF frame information and information indicating whether the subject is in focus, as first-type information. Note that the mobile device 20 may transmit the additional information including the AF frame information to the remote control 200 together with the live view image. In this case, the remote control 200 can superimpose the AF frame information on the live view image and display it on the display unit 201, thereby improving user operability.

[0030] The additional information may also include second-type information that is not used in control processing for controlling the position, etc., of the imaging device 10. An example of the second-type information is level information. The imaging device 10 has a function for superimposing level information indicating the tilt of the imaging device 10 on a live-view image displayed on the display unit 108. This allows the user to recognize the tilt of the imaging device 10. The level information can also be used when the imaging device 10 and the mobile device 20 cooperate with each other. For example, when displaying a live-view image of the imaging device 10 on the display unit 201 of the remote control 200 that controls the mobile device 20, the remote control 200 can superimpose the level information included in the additional information on the live-view image. This allows the user to check the tilt of the imaging device 10 even when the mobile device 20 is flying. In this way, the additional information may include information that is not used for controlling the position, etc., of the imaging device 10 by the mobile device 20 but that improves user operability.

[0031] The mobile device 20 can acquire either or both of a live view image and additional information from the imaging device 10. To acquire either or both of a live view image and additional information from the imaging device 10, the mobile device 20 can use an HTTP-based control command (acquisition command) in the following format, for example: Example of get command format: GET http: / / [IPAddress]:[Port] / ccapi / [Version] / shooting / liveview / flipdetail[?kind] In the above format, "kind" indicates the type of data requested as follows: image: Live view image (default value if kind is omitted) info : additional information both: Live view image and additional information Example of a get command: GET http: / / 192.168.1.2:8080 / ccapi / ver100 / shooting / liveview / flipdetail?kind=both

[0032] In addition to the above-described acquisition commands, the mobile device 20 can use control commands to instruct the imaging device 10 to capture an image or to instruct the lens unit 100 attached to the imaging device 10 to zoom. The imaging device 10 is configured to receive control commands transmitted by the mobile device 20. Similarly, the mobile device 20 is configured to receive control commands for controlling the mobile device 20. When the imaging device 10 wishes to control the mobile device 20, the imaging device 10 communicates with the communication unit 116 of the mobile device 20 via the communication unit 107 and transmits a control command to the mobile device 20. The microcomputer 113 of the mobile device 20 interprets the control command received from the imaging device 10 and controls at least one of the mobile device 20 and the gimbal 118. An example of a control command for controlling the mobile device 20 is a control command to increase or decrease the flight speed of the mobile device 20. Various control commands, including acquisition commands, are communicated via the communication unit 107 of the imaging device 10 and the communication unit 116 of the mobile device 20.

[0033] The imaging device 10 operates with a transmission setting determined according to the type of data requested by the acquisition command. In a setting (first setting) where the requested data is additional information, the imaging device 10 repeatedly captures live view images at a higher-than-standard imaging frequency (frame rate) and generates additional information corresponding to each image. In a setting (second setting) where the requested data is live view images, the imaging device 10 repeatedly captures live view images at a standard imaging frequency (frame rate). In a setting (third setting) where the requested data is live view images and additional information, the imaging device 10 repeatedly captures live view images at a standard imaging frequency (frame rate) and generates additional information corresponding to each image. In the following description, it is assumed, as an example, that the standard imaging frequency (frame rate) is 30 fps and the higher-than-standard imaging frequency (frame rate) is 60 fps.

[0034] In this way, when the requested data is additional information, each piece of additional information related to each image captured at a higher than standard imaging frequency is generated and provided to the mobile device 20. Therefore, the mobile device 20 can frequently obtain additional information related to the latest image, which makes it possible to control the position, etc. of the imaging device 10 with higher accuracy.

[0035] The control device of the first embodiment is not limited to a flying mobile device such as the mobile device 20. For example, if the gimbal 118 is configured to acquire additional information from the imaging device 10 and change its own attitude based on the additional information, the gimbal 118 can serve as the control device. Alternatively, if the mobile device 20 is a self-propelled vehicle that travels on land without flying, the self-propelled vehicle can also serve as the control device.

[0036] 4 is a flowchart for explaining processing 400 performed by the imaging device 10 in the imaging system according to embodiment 1. When the imaging device 10 and the mobile device 20 are connected via the communication units 107 and 116, processing 400 starts.

[0037] In S401, the microcomputer 103 determines whether or not a control command for the imaging device 10 has been received from the mobile device 20. The microcomputer 103 repeats the determination in S401 until a control command is received. When a control command is received, the process 400 proceeds to S402.

[0038] In S402, the microcomputer 103 analyzes the received control command.

[0039] In S403, the microcomputer 103 determines, based on the result of the analysis in S402, whether the received control command is an acquisition command (a control command for acquiring one or both of a live view image and additional information from the imaging device 10). If the received control command is an acquisition command, the process 400 proceeds to S404; if not, the process 400 proceeds to S410.

[0040] In S404, the microcomputer 103 determines whether the data requested by the acquisition command is "additional information." When the acquisition command format exemplified above is used, the microcomputer 103 can determine whether the data requested by the acquisition command is "additional information" based on the value of "kind." If the requested data is "additional information," the process 400 proceeds to S405; otherwise (if the requested data is a "live view image" or "live view image and additional information"), the process 400 proceeds to S407.

[0041] In S405, the microcomputer 103 starts control to repeatedly capture live view images at a higher imaging frequency than the standard.

[0042] In S406, the microcomputer 103 starts generating additional information including type 1 information (information used by the mobile device 20 for control processing to control the position, etc., of the image capture device 10). This generates additional information related to each image obtained by repeatedly capturing live view images at a higher-than-standard imaging frequency. Therefore, for example, if the additional information includes AF frame information, the mobile device 20 can identify the position and size of the subject with high frequency, enabling the position, etc., of the image capture device 10 to be controlled with higher accuracy. Furthermore, because the additional information whose generation starts in S406 does not include type 2 information (information not used for control processing to control the position, etc., of the image capture device 10), the size of the data transmitted from the image capture device 10 to the mobile device 20 is reduced.

[0043] In S407, the microcomputer 103 starts control to repeatedly capture live view images at a standard capture frequency. In S408, the microcomputer 103 starts generating additional information including the first type information and the second type information. Note that if the requested data is a "live view image," the microcomputer 103 may omit generating the additional information.

[0044] In S409, the microcomputer 103 starts control to transmit the data requested by the acquisition command to the mobile device 20. For example, if the requested data is "additional information," the microcomputer 103 starts control to transmit each piece of additional information generated as a result of S406 to the mobile device 20. If the requested data is "live view images," the microcomputer 103 starts control to transmit each live view image captured as a result of S407 to the mobile device 20. If the requested data is "live view images and additional information," the microcomputer 103 starts control to transmit each live view image captured as a result of S407 and each piece of additional information generated as a result of S408 to the mobile device 20.

[0045] When the process 400 proceeds from S403 to S410, the microcomputer 103 executes processing according to the received control command.

[0046] As described above, according to the first embodiment, when the data requested by the mobile device 20 is "additional information," the imaging device 10 repeatedly captures live view images at a higher imaging frequency than normal. The imaging device 10 then generates additional information related to each captured image and transmits it to the mobile device 20. Therefore, according to the first embodiment, the mobile device 20 can frequently obtain additional information related to the latest image, making it possible to control the position, etc., of the imaging device 10 with higher accuracy.

[0047] In the above description, the images repeatedly captured by the imaging device 10 are live view images, but they may be other types of images (for example, frame images of a moving image for recording).

[0048] In the first embodiment, the process of increasing the imaging frequency in S405 and the process of switching the data to be generated depending on the type of additional information in S406 have been described. In the embodiments, a sequence in which both S405 and S406 are performed may be used as in the first embodiment, or only one of S405 or S406 may be adopted and a sequence appropriate for that may be created and performed.

[0049] Note that, as an example of increasing the transmission frequency of additional information, a method of increasing the image capture frequency as in S406 has been described, but it is also possible that the frequency of generating live view images differs from the frequency of processing required to generate additional information, resulting in a state in which additional information is generated more frequently. In such a case, instead of processing to increase the image capture frequency, processing to increase the transmission frequency of additional information may be performed.

[0050] [Embodiment 2] Embodiment 2 will be described with reference to Fig. 5. In Embodiment 2, the basic configurations of the imaging device 10 and the moving device 20 are the same as those in Embodiment 1. Below, differences from Embodiment 1 will be mainly described.

[0051] 5 is a flowchart for explaining processing 500 performed by the imaging device 10 in the imaging system according to embodiment 2. As can be seen from FIG. 5, processing 500 differs from processing 400 in that S406 and S409 are replaced with S501 and S503, respectively, and S502 following S501 is added. Processing 500 starts when the imaging device 10 and the mobile device 20 are connected via the communication units 107 and 116.

[0052] In S501, the microcomputer 103 starts generating additional information including first type information and second type information. In S502, the microcomputer 103 starts processing to delete the second type information from each of the generated additional information.

[0053] Following S502 or S408, in S503, the microcomputer 103 starts control to transmit the data requested by the obtain command to the mobile device 20. S503 in process 500 is similar to S409 in process 400, but when the requested data is "additional information," the additional information to be transmitted is the additional information from which the second type of information has been deleted by the process described in S502.

[0054] As described above, in the second embodiment, even if the data requested by the acquisition command is "additional information," additional information including both the first type information and the second type information is generated. Then, if the requested data is "additional information," the second type information is deleted from the additional information before the additional information is transmitted. As a result, similar to the first embodiment, if the requested data is "additional information," additional information that does not include the second type information is transmitted to the mobile device 20.

[0055] As in the first embodiment, the method of increasing the image capture frequency in step S405 has been described as an example of increasing the transmission frequency of additional information, but it is also possible that the frequency of generating live view images differs from the frequency of processing required to generate additional information, resulting in a state in which additional information is generated more frequently. In such a case, processing such as increasing the transmission frequency of additional information may be performed instead of processing such as increasing the image capture frequency.

[0056] [Embodiment 3] Embodiment 3 will be described with reference to Fig. 6. In Embodiment 3, the basic configurations of the imaging device 10 and the moving device 20 are the same as those in Embodiment 1. Below, differences from Embodiment 1 will be mainly described.

[0057] 6 is a flowchart for explaining processing 600 performed by the imaging device 10 in the imaging system according to the third embodiment. As can be seen from FIG. 6, processing 600 differs from processing 400 in that steps S601 to S604 are added between steps S403 and S410, and S405 and S406 are replaced with steps S605 and S606, respectively. Processing 600 starts when the imaging device 10 and the mobile device 20 are connected via the communication units 107 and 116.

[0058] If it is determined in S403 that the control command received from the mobile device 20 is not an acquisition command, then in S601 the microcomputer 103 determines whether the control command is a command to set an image capture frequency. An image capture frequency setting command is a command for setting the image capture frequency of live view images in the setting (first setting) when the data requested from the mobile device 20 is additional information. If the control command is a command to set an image capture frequency, then the process 600 proceeds to S602; if not, the process 600 proceeds to S603.

[0059] In S602, the microcomputer 103 sets the imaging frequency (e.g., 120 fps) instructed by the imaging frequency setting command as the imaging frequency for live view images in the setting (first setting) when the data requested from the mobile device 20 is additional information. The microcomputer 103 stores the set imaging frequency in the volatile memory 104.

[0060] When process 600 proceeds from S601 to S603, microcomputer 103 determines whether the control command is a setting command for the type of additional information. The setting command for the type of additional information is a command for setting the type of information to be included in the additional information generated in the setting (first setting) when the data requested from mobile device 20 is additional information. If the control command is a setting command for the type of additional information, process 600 proceeds to S604; if not, process 600 proceeds to S410.

[0061] In S604, the microcomputer 103 sets the type of information specified by the command to set the type of additional information as the type of information to be included in the additional information generated in the setting (first setting) when the data requested by the mobile device 20 is additional information. The microcomputer 103 stores the set type in the volatile memory 104. For example, the mobile device 20 can set the first type of information described in the first embodiment using the command to set the type of additional information. Alternatively, the mobile device 20 can set the type of information individually. In this case, for example, the mobile device 20 can set the type of information as "size, position, and focus / defocus information of a frame indicating the position of a subject."

[0062] On the other hand, if it is determined in S403 that the control command received from the mobile device 20 is an acquisition command and that the requested data is "additional information" in S404, the process 600 proceeds to S605. In S605, the microcomputer 103 starts control to repeatedly capture live view images at the imaging frequency (e.g., 120 fps) set in the process of S602 (frequency setting process). In S606, the microcomputer 103 starts generating additional information including information of the type set in the process of S604 (type setting process) (e.g., "size, position, and focus / defocus information of a frame indicating the position of the subject"). This makes it possible to capture live view images at the set imaging frequency and generate additional information at the corresponding frequency. It also makes it possible to generate additional information including information of the set type.

[0063] It is to be noted that there may be cases where the imaging frequency set in S602 is not supported by the imaging device 10. In such cases, for example, the microcomputer 103 captures a live view image at an imaging frequency that is closest to the set imaging frequency among imaging frequencies supported by the imaging device 10. Alternatively, if the imaging device 10 does not support the imaging frequency instructed by the imaging frequency setting command, the microcomputer 103 may return an error to the mobile device 20 in S602.

[0064] As described above, in the third embodiment, the imaging device 10 sets the imaging frequency of live view images in a setting (first setting) in which the data requested by the mobile device 20 is additional information, in accordance with a setting command for setting the imaging frequency received from the mobile device 20. Furthermore, the imaging device 10 sets the type of information to be included in the additional information to be generated in a setting (first setting) in which the data requested by the mobile device 20 is additional information, in accordance with a setting command for setting the type of additional information received from the mobile device 20. Therefore, according to the third embodiment, it is possible to flexibly change the imaging frequency of live view images, and also to flexibly change the type of additional information to be transmitted.

[0065] [Embodiment 4] The various functions, processes, or methods described in the above embodiments can also be realized by a personal computer, a microcomputer, a CPU (Central Processing Unit), or a microprocessor executing a program. Hereinafter, in embodiment 4, the personal computer, microcomputer, CPU, or microprocessor will be referred to as "computer X." In embodiment 4, a program for controlling computer X and for realizing the various functions, processes, or methods described in the above embodiments will be referred to as "program Y."

[0066] The various functions, processes, or methods described in the above embodiments are realized by computer X executing program Y. In this case, program Y is supplied to computer X via a computer-readable storage medium. The computer-readable storage medium in embodiment 4 includes at least one of a hard disk drive, a magnetic storage device, an optical storage device, a magneto-optical storage device, a memory card, a volatile memory, and a non-volatile memory. The computer-readable storage medium in embodiment 4 is a non-transitory storage medium. [Explanation of symbols]

[0067] 10...imaging device, 20...moving device

Claims

1. An imaging device that can be attached to a mobile device, an imaging means for capturing images at an imaging frequency determined based on a transmission setting related to transmission of additional information and captured images from the imaging device to the mobile device, wherein when the transmission setting is a first setting, the imaging frequency is higher than when the transmission setting is a second setting or a third setting; a generation means for generating, when the transmission setting is the first setting or the third setting, additional information related to the captured image obtained by capturing an image at the capturing frequency, the additional information being used by the mobile device for a control process of controlling at least one of a position and an attitude of the imaging device; a transmitting means for transmitting the additional information to the mobile device when the transmission setting is the first setting, transmitting the captured image to the mobile device when the transmission setting is the second setting, and transmitting the additional information and the captured image to the mobile device when the transmission setting is the third setting; and The imaging device, characterized in that the moving device controls at least one of the position and the attitude of the imaging device attached to the moving device in response to a change in at least one of the position and the attitude of the moving device.

2. 2. The imaging device according to claim 1, wherein the transmission setting is determined in response to a request from the mobile device.

3. When the transmission setting is the third setting, the generating means generates the additional information so as to include first type information used by the mobile device for the control process and second type information not used for the control process; 3. The imaging device according to claim 1, wherein when the transmission setting is the first setting, the generating means generates the additional information so as to include the first type of information but not the second type of information.

4. When the transmission setting is the first setting or the third setting, the generating means generates the additional information so as to include first type information used by the mobile device for the control process and second type information not used for the control process; The imaging device according to claim 1 or 2, further comprising a deletion means for deleting the second type of information from the additional information before transmitting the additional information when the transmission setting is the first setting.

5. further comprising type setting means for setting a type of information for the first setting; 3. The imaging device according to claim 1, wherein, when the transmission setting is the first setting, the generating means generates the additional information so as to include information on the type set by the type setting means.

6. further comprising a frequency setting means for setting an imaging frequency for the first setting, 6. The imaging device according to claim 1, wherein when the transmission setting is the first setting, the imaging unit captures images at the imaging frequency set by the frequency setting unit.

7. 7. The imaging device according to claim 1, wherein the additional information includes information indicating the position of the subject, or information indicating whether the subject is in focus.

8. 8. The imaging device according to claim 7, wherein the information indicating the position of the subject includes information indicating the position and size of an autofocus (AF) frame.

9. The imaging device described in any one of claims 1 to 8, characterized in that the additional information is used to move the mobile device so as to change at least one of the position and attitude of the imaging device attached to the mobile device so as to control at least one of the position and attitude of the imaging device.

10. An imaging device, an imaging means for capturing images at an imaging frequency determined based on a transmission setting related to transmission of additional information and captured images from the imaging device to a control device, wherein when the transmission setting is a first setting, the imaging frequency is higher than when the transmission setting is a second setting or a third setting; a generation means for generating, when the transmission setting is the first setting or the third setting, additional information related to the captured image obtained by capturing an image at the capturing frequency, the additional information being used by the control device for control processing to control at least one of a position and an attitude of the imaging device; a transmitting means for transmitting the additional information to the control device when the transmission setting is the first setting, transmitting the captured image to the control device when the transmission setting is the second setting, and transmitting the additional information and the captured image to the control device when the transmission setting is the third setting; and The additional information includes information indicating the position of the subject or information indicating whether the subject is in focus. An imaging device characterized by:

11. A method for controlling an imaging device that can be attached to a mobile device, comprising: an imaging step of capturing an image at an imaging frequency determined based on a transmission setting related to transmission of additional information and captured images from the imaging device to the mobile device, wherein when the transmission setting is a first setting, the imaging frequency is higher than when the transmission setting is a second setting or a third setting; a generating step of generating, when the transmission setting is the first setting or the third setting, the additional information related to the captured image obtained by capturing an image at the capturing frequency, the additional information being used by the mobile device for a control process of controlling at least one of a position and an attitude of the imaging device; a transmitting step of transmitting the additional information to the mobile device when the transmission setting is the first setting, transmitting the captured image to the mobile device when the transmission setting is the second setting, and transmitting the additional information and the captured image to the mobile device when the transmission setting is the third setting; and A control method, characterized in that the mobile device controls at least one of the position and the attitude of the imaging device attached to the mobile device in response to a change in at least one of the position and the attitude of the mobile device.

12. A control method for an imaging device, comprising: an imaging step of capturing an image at an imaging frequency determined based on a transmission setting related to transmission of additional information and captured images from the imaging device to a control device, wherein when the transmission setting is a first setting, the imaging frequency is higher than when the transmission setting is a second setting or a third setting; a generating step of generating, when the transmission setting is the first setting or the third setting, the additional information related to the captured image obtained by capturing an image at the capturing frequency, the additional information being used by the control device for a control process of controlling at least one of a position and an attitude of the imaging device; a transmitting step of transmitting the additional information to the control device when the transmission setting is the first setting, transmitting the captured image to the control device when the transmission setting is the second setting, and transmitting the additional information and the captured image to the control device when the transmission setting is the third setting; and The additional information includes information indicating the position of the subject or information indicating whether the subject is in focus. A control method comprising:

13. A program for causing a computer to function as each of the means of the imaging device according to any one of claims 1 to 10.

Images