Imaging device, lens device, and control method

Abstract

To provide an imaging device capable of communicating information required for VFX at an appropriate frequency.SOLUTION: An imaging device is an imaging device that can be fitted with an optical lens and can acquire at least one of images and videos, and includes a communication unit that sends and receives data to and from the optical lens, a determination unit that determines whether communication of the data satisfies specified conditions, and a setting unit that sets priority of the data depending on a result of the determination unit.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an imaging device, a lens device, and a control method. [Background technology]

[0002] In the field of video production, VFX (Visual Effects) is used to create visual expressions that are difficult to achieve with live-action footage alone by combining CG (Computer Graphics) and live-action footage. To achieve a natural, high-quality composite image, it is important to match the range of the live-action footage with the CG. Methods include applying correction processing to the CG to recreate the image through a lens, and applying correction processing to the live-action footage to remove the effects of the lens. Because correction and compositing are performed on a per-image (frame) basis, it is preferable that the information used for correction be acquired at a frequency equal to or greater than the frame rate of the video. Patent Document 1 discloses a configuration that prioritizes the communication of highly necessary data by changing the data communication order according to the lens. Patent Document 2 also discloses a configuration that shortens the time required to acquire multiple data sets by continuously transmitting multiple data sets from the lens to the camera in response to a single request from the camera to the lens using commands that indicate a combination of multiple data sets and the transmission order. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-130639 [Patent Document 2] JP 2017-15980 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the configuration of Patent Document 1, if the amount of data acquired in one cycle of communication processing increases, the communication cycle becomes longer, which reduces the frequency of data acquisition, and there is a possibility that high-frequency or high-precision correction processing cannot be performed. Moreover, the configuration of Patent Document 2 does not mention the communication cycle, which raises concerns about a decrease in the frequency of data acquisition.

[0005] An object of the present invention is to provide an imaging device that can communicate information required for VFX at an appropriate frequency. [Means for solving the problem]

[0006] An imaging device according to one aspect of the present invention is an imaging device that can be fitted with an optical lens and can acquire at least one of an image and a video, and is characterized by having a communication unit that transmits and receives data to and from the optical lens, a determination unit that determines whether the data communication satisfies predetermined conditions, and a setting unit that sets the priority of the data depending on the result of the determination unit. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide an imaging device and a lens device that are capable of communicating information required for VFX at an appropriate frequency. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram illustrating an example of the configuration of a camera system according to an embodiment of the present invention. [Figure 2] 10 is a flowchart illustrating a metadata transmission process. [Figure 3] 10 is a flowchart showing a lens communication acquisition data determination process. [Figure 4] 10 is a flowchart showing a process of checking lens communication obtainable information. [Figure 5] 10 is a flowchart showing a data acquisition priority change process. [Figure 6] 10 is a flowchart showing a process of selecting and determining data to be acquired with priority. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to designate the same components, and redundant explanations will be omitted. (Configuration of imaging device) 1 is a block diagram showing a schematic configuration example of an interchangeable lens digital camera for capturing still images and moving images as an example of a camera system according to an embodiment of the present invention. Note that the scope of application of the present invention is not limited to digital cameras, and the present invention can be applied to various camera systems.

[0010] The camera system 1 has a lens unit (optical lens) 100 and a camera body (imaging device) 200 to which the lens unit 100 can be attached. The lens unit 100 is a lens device that can be attached to and detached from the camera body 200.

[0011] In the lens unit 100, the zoom unit 101 includes a zoom lens that changes magnification, and the zoom drive control unit 102 drives and controls the zoom unit 101. The aperture unit 103 has an aperture function, and the aperture drive control unit 104 drives and controls the aperture unit 103. The image stabilization unit 105 includes an image stabilization lens such as a shift lens, and the optical image stabilization control unit 106 drives and controls the image stabilization unit 105. The focus unit 107 includes a focus lens that changes the focus position, and the focus drive control unit 108 drives and controls the focus unit 107.

[0012] The lens operation unit 109 includes operation members such as rings for operating the zoom, aperture, and focus (optical system) of the lens, and is used by the user to operate the lens unit 100. The lens shake detection unit 110 detects the amount of shake applied to the lens unit 100 and outputs a detection signal to the lens system control unit 111.

[0013] The lens system control unit 111 includes a CPU (Central Processing Unit) and controls the entire lens unit 100. The lens system control unit 111 can communicate with a camera system control unit 212 of the camera body 200 via a lens communication control unit 112. The lens system control unit 111 acquires information necessary for control and information related to the characteristics of the optical system from each component of the lens unit 100. For example, the lens system control unit 111 acquires focus operation information of the operating components for operating the focus from the lens operation unit 109. The focus operation information includes the current focus position, manual focus direction, manual focus operation amount, etc. The information necessary for control and information related to the characteristics of the optical system are transmitted to the camera system control unit 212 via the lens communication control unit 112 and the camera communication control unit (communication unit) 213 periodically or in response to a request from the camera system control unit 212. The transmitted information is used for various processes of the camera body 200. In this embodiment, the operating components for operating the zoom, aperture, focus, etc. are included in the lens operation unit 109 and are operating components provided in the lens unit 100, but the present invention is not limited to this configuration. For example, it may be an operation member connected to the lens unit 100, or an operation member provided in the camera body 200 or connected to the camera body 200.

[0014] In the camera body 200, the shutter unit 201 controls the incidence of light that has passed through the lens unit 100 into the camera body 200. The shutter drive control unit 202 drives and controls the shutter unit 201. The imaging unit 203 includes an imaging element configured with a CCD, CMOS sensor, or the like, and performs photoelectric conversion on the light that has passed through the shutter unit 201 to output an electrical signal. Note that the imaging element in this embodiment is capable of receiving light that has passed through different exit pupil regions of the lens unit 100 and acquiring electrical signals corresponding to the amount of received light. The imaging element can perform focus detection using a so-called image plane phase difference method based on the obtained electrical signals. The imaging element can also add and output electrical signals corresponding to light that has passed through different exit pupil regions.

[0015] The imaging signal processing unit 204 converts the electrical signal output from the imaging unit 203 into a focus detection signal and / or an imaging signal. The imaging signal processing unit 204 outputs the focus detection signal to the camera system control unit 212, and outputs the imaging signal to the video signal processing unit 205. The video signal processing unit 205 processes the imaging signal output from the imaging signal processing unit 204 according to the application. For example, image stabilization can be performed by changing the crop position of the video signal according to the correction amount of the electronic image stabilization control unit 211.

[0016] The display unit 206 displays images based on the video signal output from the video signal processing unit 205, and displays various control information from the lens system control unit 111 as necessary. The recording unit 207 (recording medium) stores various data including the video information output from the video signal processing unit 205. The power supply unit 208 supplies power to the entire camera system 1 depending on the application.

[0017] The camera operation unit 209 is used by the user to operate the camera system 1. The camera operation unit 209 includes a shutter release button for instructing shooting of a still image, a video recording switch for instructing recording of a video, and a selection switch for changing shooting settings via a menu screen or the like displayed on the display unit 206. The camera operation unit 209 outputs a signal according to the operation to the camera system control unit 212. The buttons and switches included in the camera operation unit 209 may be configured as hardware keys, soft keys, or a combination thereof. The camera operation unit 209 may also have a shift button or the like for operating a focus lens or a zoom lens.

[0018] The shutter release button is configured so that a first switch (SW1) and a second switch (SW2) are turned on in sequence depending on the amount of depression. When the user presses the shutter release button about halfway, the first switch SW1 is turned on, and when the user presses the shutter release button all the way, the second switch SW2 is turned on. When the first switch SW1 is turned on, the focus drive control unit 108 drives the focus unit 107 to adjust the focus, and the aperture drive control unit 104 drives the aperture unit 103 to set an appropriate exposure amount. When the second switch SW2 is turned on, image data obtained from the light image exposed by the imaging unit 203 is stored in the recording unit 207.

[0019] Furthermore, when the user presses the video recording switch, video recording begins, and when the user presses the video recording switch again while video recording is in progress, video recording ends. Note that separate switches may be provided to start and end video recording.

[0020] The camera shake detection unit 210 detects the amount of shake applied to the camera body, and outputs a signal indicating the detected amount of shake to the camera system control unit 212 .

[0021] The camera system control unit 212 includes a CPU and controls the entire camera system 1. The camera system control unit 212 and the lens system control unit 111 communicate with each other via the camera communication control unit 213 and the lens communication control unit 112. That is, when the lens unit 100 is attached to the camera body 200 and electrically connected, mutual communication (hereinafter referred to as lens communication) is performed via the lens communication control unit 112 and the camera communication control unit 213.

[0022] The camera system control unit 212 generates metadata based on information about the lens unit 100 acquired via the camera communication control unit 213 and information acquired from each unit of the camera body unit 200. The external communication control unit 214 receives the metadata generated by the camera system control unit 212 from the camera system control unit 212. The external communication control unit 214 is connected to an arbitrary external device (not shown) and transmits the metadata to the connected external device periodically or in response to a request from the external device. Note that the metadata may be transmitted alone, or may be transmitted as information combined with the video signal in a video format or the like to which information other than the video signal can be added. Alternatively, a configuration may be adopted in which a generation unit that generates metadata is provided separately and the external communication control unit 214 transmits the metadata from the generation unit to the external device, or the external communication control unit 214 generates the metadata.

[0023] In this embodiment, the camera system control unit 212 functions as a determination unit that determines whether or not communication of data transmitted and received through lens communication satisfies predetermined conditions. The camera system control unit 212 also functions as a setting unit that sets the priority of data transmitted and received through lens communication according to the result of the determination made by the determination unit. (Metadata transmission process) 2 is a flowchart showing the metadata transmission process executed by the camera system control unit 212. In this embodiment, the metadata transmission process is executed at a predetermined cycle, whereby lens communication and metadata generation and transmission are executed periodically.

[0024] In step S201, the camera system control unit 212 determines whether or not the lens unit 100 is attached to the camera body 200. If the camera system control unit 212 determines that the lens unit 100 is attached to the camera body 200, it executes the process of step S202, and if it determines that the lens unit 100 is not attached to the camera body 200, it executes the process of step S204.

[0025] In step S202, the camera system control unit 212 performs a lens communication acquisition data determination process. The lens communication acquisition data determination process is a process for determining data to be communicated and acquired through lens communication (hereinafter, lens communication acquisition data), and will be described in detail later.

[0026] In step S203, the camera system control unit 212 executes lens communication to acquire the lens communication acquisition data based on the information of the lens communication acquisition data determined in step S202.

[0027] The lens communication acquisition data determination process performed in step S202 may be a process of determining a communication command to be transmitted from the camera communication control unit 213 to the lens communication control unit 112 for data acquisition. In this case, in step S203, lens communication is performed using the communication command determined in step S202, and the desired data is acquired.

[0028] In step S204, the camera system control unit 212 determines whether the lens communication acquired data determined in step S202 has changed from the lens communication acquired data determined one cycle before. If the camera system control unit 212 determines that the lens communication acquired data determined in step S202 has changed from the lens communication acquired data determined one cycle before, it executes the process of step S205, and if it determines that the lens communication acquired data has not changed, it executes the process of step S206.

[0029] In step S205, the camera system control unit 212 notifies the user of a list of newly acquireable data or data that has become unavailable (acquired data information) by means of displaying it on the display unit 206, for example. That is, the camera system control unit 212 functions as a notification unit. Note that the lens communication acquired data information may be reset when the lens unit 100 is removed from the camera body 200. In this case, the lens communication acquired data is recognized as being absent while the lens unit 100 is not attached to the camera body 200. Furthermore, if a change occurs in the lens communication acquired data due to the attachment or detachment of the lens unit 100, the user is notified of the acquired data information in step S205.

[0030] In step S206, the camera system control unit 212 generates metadata including the lens communication acquisition data acquired in step S203.

[0031] In step S207, the camera system control unit 212 transmits the metadata to the external device via the external communication control unit 214. The transmitted metadata is used for externally monitoring and controlling the state of the camera system 1, and for video processing of the video output from the camera system 1.

[0032] The process of transmitting the metadata to an external device after the metadata is generated includes transmitting the metadata to a recording medium that is detachably attached to the camera body 200 in order to record the metadata on the recording medium. (Lens communication acquisition data determination process) FIG. 3 is a flowchart showing the lens communication acquisition data determination process executed in step S202 of FIG.

[0033] In step S301, the camera system control unit 212 determines whether the execution of the lens communication obtainment data determination process is the first execution since the system was started. If the camera system control unit 212 determines that the execution of the lens communication obtainment data determination process is the first execution since the system was started, it executes the process of step S303, and if it determines that the execution is not the first execution, it executes the process of step S302.

[0034] In step S302, the camera system control unit 212 determines whether a new lens unit 100 has been attached, or whether the lens unit 100 has been changed to a different lens unit 100 from the previously attached one. If the camera system control unit 212 determines that a new lens unit 100 has been attached, or that the lens unit 100 has been changed to a different lens unit 100 from the previously attached one, it executes the process of step S303. On the other hand, if the camera system control unit 212 determines that this is not the case, it executes the process of step S304.

[0035] In step S303, the camera system control unit 212 executes a lens communication obtainable information confirmation process. The lens communication obtainable information confirmation process is a process for obtaining a list of data obtainable by lens communication from the currently attached lens unit 100, or a list of communication commands that can be communicated, and details of this process will be described later.

[0036] In step S304, the camera system control unit 212 executes a data acquisition priority change process. The data acquisition priority change process is a process for updating data acquisition priority information, which is the selection criterion for priority acquisition data in a priority acquisition data selection and determination process, which will be described later, based on the state of the lens unit 100 and the camera body 200. Details will be described later.

[0037] In step S305, the camera system control unit 212 determines whether a change has occurred in the data acquisition priority order in step S304. If the camera system control unit 212 determines that a change has occurred in the data acquisition priority order, it executes the process of step S307, and if it determines that a change has not occurred, it executes the process of step S306.

[0038] In step S306, the camera system control unit 212 determines whether the processing load of the camera body unit 200 has changed. Operations that can cause fluctuations in the processing load include changing the sensor mode, frame rate, or operating frequency among the shooting settings of the camera body unit 200, and starting or ending recording. These operations can cause fluctuations in the communication cycle of lens communication and the distribution cycle of metadata in addition to the processing load of the camera body unit 200. If the camera system control unit 212 determines that the processing load has changed, it executes the process of step S307; if it determines that the processing load has not changed, it executes the process of step S308.

[0039] In step S307, the camera system control unit 212 executes a priority acquisition data selection and determination process to determine priority acquisition data including data used for correction according to the optical characteristics of the lens unit 100.

[0040] In step S308, the camera system control unit 212 determines lens communication acquisition data by adding the required acquisition data to the priority acquisition data determined in step S307. In this embodiment, the required acquisition data is information necessary to control the zoom drive control unit 102, the aperture drive control unit 104, the optical image stabilization control unit 106, and the focus drive control unit 108. For example, this information includes position information, focal length, F-number, T-number, and the like for each lens. Note that for a lens unit that does not include some of the units shown in FIG. 1, such as the zoom unit 101 or the image stabilization unit 105, information corresponding to the missing components may be excluded from the required acquisition data. (Lens communication availability information confirmation process) FIG. 4 is a flowchart showing the lens communication obtainable information confirmation process executed in step S303 of FIG.

[0041] In step S401, the camera system control unit 212 acquires information on communication that the camera body unit 200 can use for lens communication (camera-side compatible communication information).

[0042] In step S402, the camera system control unit 212 checks whether the camera-side compatible communication information acquired in step S401 corresponds to information on communication that the lens unit 100 can use for lens communication.

[0043] In step S403, the camera system control unit 212 checks whether the confirmation process in step S402 has been executed for all of the camera-side compatible communication information. If the camera system control unit 212 determines that the confirmation process in step S402 has been executed for all of the camera-side compatible communication information, it ends this flow, but if it determines that the confirmation process in step S402 has not been executed, it executes the process of step S402.

[0044] Note that in this embodiment, a method is assumed in which, in step S402, lens communication is actually performed for one predetermined communication, and the communication compatibility status on the lens unit 100 side is confirmed based on a response from the lens communication control unit 112, but the present invention is not limited to this. For example, a communication command for confirming the communication compatibility status may be prepared, or the communication command may be in a form in which the compatibility status is confirmed for multiple communications in one lens communication.

[0045] Furthermore, if all of the camera-side compatible communication information acquired in step S401 can be confirmed through one lens communication, that is, one execution of the process of step S402, the process of step S403 may be omitted. (Data acquisition priority change processing) FIG. 5 is a flowchart showing the data acquisition priority change process executed in step S304 of FIG.

[0046] In this embodiment, the first priority data and second priority data in the preferential acquisition data selection and determination process described below are information relating to the order of priority (priority) of data acquisition through lens communication, and each includes one or more pieces of data.

[0047] In this embodiment, the information included in the first priority data is data used for correction according to the optical characteristics of the lens unit 100, and is data related to correction of a phenomenon in which an image formed on the imaging unit 203 through the optical system changes in a direction parallel to the optical axis. For example, the data is data used for correction (second correction) performed on one of the image and video, which involves a change in the position coordinates of one of the image and video in the vertical direction. Furthermore, the information included in the first priority data is data required for aligning the shooting range and the position of the captured object when combining a live-action image or video with a CG image or video in VFX. For example, the data is data used for correction (first correction) which involves a change in the position coordinates of at least one of the image and video in the width direction and height direction. More specifically, the information included in the first priority data is information related to distortion, such as the distance from a predetermined position in the optical system of the lens unit 100 to the subject (subject distance), the entrance pupil position, and parameters indicating the degree of distortion, as well as image magnification change information.

[0048] The information included in the second priority data is data used for corrections according to the optical characteristics of the lens unit 100, and is data related to correction of phenomena that cause changes in the image quality (sharpness) and color of the image formed on the imaging unit 203 through the optical system. For example, the second priority data is data used for corrections (third correction) that involve changes in brightness between one of the image and the video, among corrections made to one of the image and the video, and data used for correction of color shifts between one of the image and the video (fourth correction) among corrections made to one of the image and the video. The information included in the second priority data is also data required for processing in VFX to match the image quality and color between a live-action image or video and a CG image or video. More specifically, the information included in the second priority data is information related to changes in peripheral illumination, information related to image magnification aberrations, including parameters indicating the degree of image magnification aberrations, and information related to axial chromatic aberrations.

[0049] Basically, first-priority data has a higher acquisition priority than second-priority data. Furthermore, among each of the first-priority data and the second-priority data, an acquisition priority is predetermined for one or more pieces of data included. For example, among the data used for the first correction, the priority of data used for the first correction that has a larger amount or rate of change in position coordinates before and after correction is increased. Furthermore, among the data used for the second correction, the priority of data used for the second correction that has a larger amount or rate of change in position coordinates before and after correction is increased. Furthermore, the priority of data used for the second correction is decreased relative to the priority of data used for the first correction. Furthermore, among the data used for the third correction, the priority of data used for the third correction that has a larger amount or rate of change in brightness before and after correction is increased. Furthermore, among the data used for the fourth correction, the priority of data used for the fourth correction that has a larger amount or rate of correction or that changes depending on the image height is increased. Furthermore, the priority of data used for the fourth correction is decreased relative to the data used for the third correction.

[0050] In step S501, the camera system control unit 212 determines whether or not the zoom unit 101 is operating. If the camera system control unit 212 determines that the zoom unit 101 is operating, it executes the process of step S503, and if it determines that the zoom unit 101 is not operating, it executes the process of step S202.

[0051] In step S502, the camera system control unit 212 lowers the priority of information relating to distortion.

[0052] In step S503, the camera system control unit 212 sets the priority of the information related to distortion to a predetermined specified value. Here, since the priority is lowered in step S502 relative to the specified value, the priority set in step S502 is lower than the priority set in step S503.

[0053] In step S504, the camera system control unit 212 determines whether the aperture value is equal to or less than a predetermined value. If the camera system control unit 212 determines that the aperture value is equal to or less than the predetermined value, it executes the process of step S505, and if it determines that the aperture value is not equal to or less than the predetermined value, it executes the process of step S506.

[0054] In step S505, the camera system control unit 212 increases the priority of information relating to changes in the amount of peripheral light.

[0055] In step S506, the camera system control unit 212 sets the priority of the information relating to the change in peripheral light amount to a predetermined specified value. Here, in step S505, the priority is increased relative to the specified value, so the priority set in step S505 is higher than the priority set in step S506.

[0056] In step S507, the camera system control unit 212 increases the priority of information relating to chromatic aberration of magnification.

[0057] In step S508, the camera system control unit 212 sets the priority of the chromatic aberration of magnification related data to a predetermined value. Here, since the priority is increased relative to the predetermined value in step S507, the priority set in step S507 is higher than the priority set in step S508.

[0058] The specified values ​​set in steps S503, S506, and S508 correspond to the respective pieces of information individually, and may be different for each piece of information. (Priority acquisition data selection and judgment processing) FIG. 6 is a flowchart showing the priority acquisition data selection and determination process executed in step S307 of FIG.

[0059] In step S601, the camera system control unit 212 acquires the acquisition priority order information of the first priority data.

[0060] In step S602, the camera system control unit 212 acquires the acquisition priority order information of the second priority data.

[0061] In step S603, the camera system control unit 212 first executes, among communications for acquiring information included in the acquisition priority order information of the first and second priority data, communications included in the information on communications usable for lens communication and communications for acquiring essential acquisition data. In this embodiment, the camera system control unit 212 measures the time required for each communication. Note that the measurement target may be not only the time required for communication but also the size of data transmitted and received in communication.

[0062] In step S604, the camera system control unit 212 determines whether the series of communications executed in step S603 satisfies communication requirements (predetermined conditions). In this embodiment, this determination is made based on whether the time required for the series of communications executed in step S603 (required communication time) is within the display time per frame of the video signal output from the video signal processing unit 205 or the video signal recorded in the recording unit 207 (within a predetermined time). However, the present invention is not limited to this. For example, this determination may be made based on whether the data size of the series of communications executed in step S603 is within the data size that can be transmitted and received within the display time per frame (within a predetermined amount). In this case, it is not necessary to measure the required time for each communication in step S603. Furthermore, when determining whether the communication requirements are satisfied based on the data size as described above, step S603 may be omitted if the communications are not executed for any purpose other than measuring the required time for each communication in step S603. If step S603 is omitted, in the following description, the communications executed in step S603 may be replaced with communications to be executed. If the camera system control unit 212 determines that the series of communications executed in step S603 meets the communication requirements, it executes the process of step S611. In step S611, the camera system control unit 212 determines all of the communications executed in step S603 as priority acquisition data from among the data included in the acquisition priority order of the first priority data and the acquisition priority order of the second priority data (hereinafter, priority acquisition expected data). On the other hand, if the camera system control unit 212 determines that this is not the case, it executes the process of step S605.

[0063] In step S605, the camera system control unit 212 deletes one piece of data included in the second priority data in ascending order of priority from the series of communications executed in step S603, and recalculates the time required for the series of communications.

[0064] In step S606, the camera system control unit 212 determines whether the series of communications executed in step S605 satisfies the communication requirements. If the camera system control unit 212 determines that the series of communications executed in step S605 satisfies the communication requirements, it executes the processing of step S611. In step S611, the camera system control unit 212 determines that the communications executed in step S605 are the data expected to be preferentially acquired, other than the data deleted in step S605, as the data to be preferentially acquired. On the other hand, if the camera system control unit 212 determines that the series of communications executed in step S605 does not satisfy the communication requirements, it executes the processing of step S607.

[0065] In step S607, the camera system control unit 212 determines whether or not there is deletable second priority data. If the camera system control unit 212 determines that there is deletable second priority data, it executes the process of step S605. If it determines that there is not deletable second priority data, it executes the process of step S608. That is, the processes of steps S605 to S607 are repeated until the communication requirements are satisfied or there is no more deletable second priority data.

[0066] In step S608, the camera system control unit 212 deletes one communication corresponding to data included in the first priority data from the series of communications executed in step S603, in order of decreasing acquisition priority, and recalculates the time required for the series of communications.

[0067] In step S609, the camera system control unit 212 determines whether the series of communications executed in step S608 satisfies the communication requirements. If the camera system control unit 212 determines that the series of communications executed in step S608 satisfies the communication requirements, it executes the process of step S611. In step S611, the camera system control unit 212 determines that the communications executed in step S608 are the priority acquisition data out of the priority acquisition expected data other than all of the second priority data and the data deleted in step S608. On the other hand, if the camera system control unit 212 determines that the series of communications does not satisfy the communication requirements, it executes the process of step S610.

[0068] In step S610, the camera system control unit 212 determines whether or not there is first priority data that can be deleted. If the camera system control unit 212 determines that there is first priority data that can be deleted, it executes the process of step S608. On the other hand, if the camera system control unit 212 determines that there is no data that can be determined as priority acquisition data, in step S611, it determines that there is no data that can be determined as priority acquisition data. That is, the processes from step S608 to step S610 are repeated until the communication requirements are satisfied or there is no first priority data that can be deleted.

[0069] Note that the data communication order may be set according to the priority described above for the priority acquisition data selection and determination process executed in step S307 of FIG. 3. For example, in lens communication, communication of required acquisition data may be executed first, followed by communication of first-priority data and second-priority data. Also, when communicating multiple pieces of data as first-priority data, data with a higher priority may be communicated first. Alternatively, when communicating multiple pieces of data as second-priority data, data with a higher priority may be communicated first.

[0070] Furthermore, even if the priority of first-priority data is lowered, the priority may be lowered than that of second-priority data. For example, if there is no need to communicate specific data included in the first-priority data when the camera system 1 satisfies a predetermined condition, the priority of the specific data may be lowered below that of the second-priority data to facilitate communication of the second-priority data. Furthermore, if a period during which communication of the second-priority data is not performed is longer than a predetermined period, the second-priority data may be temporarily prioritized over at least one of the required acquisition data and the first-priority data for communication. For example, immediately before step S611, a step of determining whether a period during which communication of the deleted second-priority data is not performed is longer than a predetermined period may be provided. If the period is longer than the predetermined period, the priority of the deleted second-priority data may be increased, and the process proceeds to step S611. In this case, the second-priority data to be increased in priority may be increased so as to replace the second-priority data that is expected to be communicated, or a special priority may be set that is higher than the first-priority data.

[0071] As described above, information required for VFX can be communicated at an appropriate frequency. Also, low-priority data can be communicated even if the frequency of acquisition of low-priority data is reduced.

[0072] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An imaging device that can be fitted with an optical lens and can acquire at least one of an image and a video, a communication unit that transmits and receives data to and from the optical lens; a determination unit that determines whether the data communication satisfies a predetermined condition; a setting unit that sets a priority of the data in accordance with a result of the determination unit. (Configuration 2) 2. The imaging device according to configuration 1, wherein the determination unit determines whether or not a time required for communication of the data is within a predetermined time. (Configuration 3) 3. The imaging device according to configuration 2, wherein the predetermined time is a display time for one frame of the video. (Configuration 4) 2. The imaging device according to configuration 1, wherein the determining unit determines whether the size of the data is within a predetermined amount. (Configuration 5) The imaging device according to any one of configurations 1 to 4, wherein the determination unit determines whether the communication of the data according to the priority set by the setting unit satisfies the predetermined condition. (Configuration 6) 6. The imaging device according to any one of configurations 1 to 5, wherein the setting section sets the highest priority to data required for controlling the optical lens. (Configuration 7) 7. The imaging device according to any one of configurations 1 to 6, wherein the data includes data used for correction according to the optical characteristics of the optical lens. (Configuration 8) The imaging device described in any one of configurations 1 to 7, wherein the setting unit increases the priority of data used for a first correction involving a change in position coordinates in at least one of the width direction and height direction of one of the image and the video, among the corrections performed on one of the image and the video. (Configuration 9) The imaging device according to configuration 8, wherein the setting unit increases the priority of data used for the first correction that has a larger amount or rate of change in position coordinates before and after correction, among the data used for the first correction. (Configuration 10) The imaging device described in any one of configurations 1 to 9, wherein the setting unit increases the priority of data used for a second correction involving a change in vertical position coordinates of one of the image and the video, among the corrections performed on one of the image and the video. (Configuration 11) 11. The imaging device according to claim 10, wherein the setting unit increases the priority of data used for the second correction that has a larger amount or rate of change in position coordinates before and after correction, among the data used for the second correction. (Configuration 12) The imaging device described in any one of configurations 1 to 11, characterized in that the setting unit increases the priority of data used for a third correction that involves a change in brightness of one of the image and the video, among the corrections performed on one of the image and the video. (Configuration 13) The imaging device described in configuration 12, characterized in that the setting unit increases the priority of data used for the third correction that has a larger amount or ratio of change in brightness before and after correction, among the data used for the third correction. (Configuration 14) The imaging device described in any one of configurations 1 to 13, characterized in that the setting unit increases the priority of data used for a fourth correction of color shift between one of the image and the video, among corrections performed on one of the image and the video. (Configuration 15) The imaging device described in configuration 14, characterized in that the setting unit increases the priority of data used for the fourth correction that has a larger amount or ratio of correction among the data used for the fourth correction. (Configuration 16) The imaging device according to configuration 14 or 15, wherein the setting unit increases the priority of data used for the fourth correction, in which at least one of the amount and rate of correction changes depending on the image height, among the data used for the fourth correction. (Configuration 17) 17. The imaging device according to any one of configurations 1 to 16, wherein the determination unit performs the determination before the communication unit performs repeated transmission and reception at a predetermined cycle. (Configuration 18) 18. The imaging device according to any one of configurations 1 to 17, wherein the determination unit executes the determination when the optical lens is attached to the imaging device. (Configuration 19) 19. The imaging device according to any one of configurations 1 to 18, wherein the determination unit executes the determination when the processing load fluctuates. (Configuration 20) 20. The imaging device according to any one of configurations 1 to 19, wherein the communication unit receives the data, the communication of which is determined by the determination unit to satisfy the predetermined condition, at a predetermined cycle. (Configuration 21) 21. The imaging device according to configuration 20, wherein the communication unit receives the data, the communication of which is determined by the determination unit not to satisfy the predetermined condition, at a period longer than the predetermined period. (Configuration 22) 22. The imaging device according to any one of configurations 1 to 21, further comprising a notification unit that notifies a user of data whose communication has been determined by the determination unit to satisfy the predetermined condition. (Configuration 23) An imaging device according to any one of configurations 1 to 22, further comprising a notification unit that notifies a user of data that is not included in the data determined by the determination unit to satisfy the predetermined condition for the data communication. (Configuration 24) The imaging device described in any one of configurations 1 to 23, characterized in that the setting unit lowers the priority of data used for correction involving a change in position coordinates in at least one of the width direction and height direction of one of the image and the video, or data used for correction involving a change in position coordinates in the vertical direction of one of the image and the video, compared to the priority of data used for correction involving a change in brightness of one of the image and the video, or data used for correction of color shift of one of the image and the video. (Configuration 25) The imaging device described in any one of configurations 1 to 24, characterized in that the setting unit lowers the priority of data used for correction involving a change in position coordinates in at least one of the width direction and height direction of one of the image and the video, compared to the priority of data used for correction involving a change in position coordinates in the vertical direction of one of the image and the video. (Configuration 26) The imaging device described in any one of configurations 1 to 25, characterized in that the setting unit lowers the priority of data used to correct color shifts between one of the image and the video compared to data used for corrections involving changes in brightness between one of the image and the video. (Configuration 27) A lens device that is detachable from an imaging device that can acquire at least one of an image and a video, a communication unit that transmits and receives data to and from the imaging device; a determination unit that determines whether the data communication satisfies a predetermined condition; a setting unit that sets a priority of the data in accordance with a result of the determination unit. (Configuration 28) A lens device that is detachable from an imaging device that can acquire at least one of an image and a video, a communication unit for transmitting and receiving data to and from the imaging device; The lens device is characterized in that the communication unit transmits data used for correction involving a change in vertical position coordinates or a change in position coordinates in at least one of the width and height directions, which is performed on one of the image and video captured by the imaging device, in priority to data used for correction involving a change in brightness or color shift, which is performed on one of the image and video. (Method 1) A control method for an imaging device that can be fitted with an optical lens and can acquire at least one of an image and a video, comprising: a communication step of transmitting and receiving data to and from the optical lens; a determination step of determining whether the data communication satisfies a predetermined condition; a setting step of setting a priority of the data in accordance with a result of the determination unit. (Method 2) A method for controlling a lens device detachable from an imaging device capable of acquiring at least one of an image and a video, comprising: a communication step of transmitting and receiving data to and from the imaging device; a determination step of determining whether the data communication satisfies a predetermined condition; a setting step of setting a priority of the data in accordance with a result of the determination unit. (Method 3) A lens device that is detachable from an imaging device that can acquire at least one of an image and a video, A control method for a lens device, characterized in that data used for correction involving a change in vertical position coordinates or a change in position coordinates in at least one of the width and height directions, performed on one of an image and a video captured by the imaging device, is transmitted to the imaging device in priority to data used for correction involving a change in brightness or color shift, performed on one of the image and a video.

[0073] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the present invention. For example, at least a part of the processing executed by the camera system control unit 212 may be executed by the lens system control unit 111, and the lens system control unit 111 may execute the processing shown in Figures 5 and 6, etc. [Explanation of symbols]

[0074] 100 Lens unit (optical lens) 200 Camera body (imaging device) 212 camera system control unit (determination unit, setting unit) 213 Camera communication control unit (communication unit)

Claims

1. An imaging device that can be fitted with an optical lens and can acquire at least one of an image and a video, a communication unit that transmits and receives data to and from the optical lens; a determination unit that determines whether the data communication satisfies a predetermined condition; a setting unit that sets a priority of the data in accordance with a result of the determination unit.

2. The imaging device according to claim 1 , wherein the determination unit determines whether a time required for communication of the data is within a predetermined time.

3. 3. The imaging device according to claim 2, wherein the predetermined time is a display time for one frame of the video.

4. The imaging device according to claim 1 , wherein the determining unit determines whether the size of the data is within a predetermined amount.

5. 5. The imaging device according to claim 1, wherein the determining unit determines whether or not the communication of the data according to the priority set by the setting unit satisfies the predetermined condition.

6. 5. The imaging device according to claim 1, wherein the setting unit sets the highest priority to data required for controlling the optical lens.

7. 5. The imaging device according to claim 1, wherein the data includes data used for correction according to the optical characteristics of the optical lens.

8. The imaging device described in any one of claims 1, 2, and 4, characterized in that the setting unit increases the priority of data used for a first correction, among corrections performed on one of the image and the video, that involves a change in position coordinates in at least one of the width and height directions of one of the image and the video.

9. The imaging device according to claim 8, characterized in that the setting unit increases the priority of data used for the first correction that has a larger amount or rate of change in position coordinates before and after correction, among the data used for the first correction.

10. The imaging device described in any one of claims 1, 2, and 4, characterized in that the setting unit increases the priority of data used for a second correction that involves a change in vertical position coordinates of one of the image and the video, among the corrections performed on one of the image and the video.

11. 11. The imaging device according to claim 10, wherein the setting unit increases the priority of data used for the second correction that has a larger amount or rate of change in position coordinates before and after correction, among the data used for the second correction.

12. The imaging device described in any one of claims 1, 2, and 4, characterized in that the setting unit increases the priority of data used for a third correction, among corrections performed on one of the image and the video, that involves a change in brightness of one of the image and the video.

13. The imaging device according to claim 12, wherein the setting unit increases the priority of data used for the third correction that has a larger amount or ratio of change in brightness before and after correction, among the data used for the third correction.

14. The imaging device described in any one of claims 1, 2, and 4, characterized in that the setting unit increases the priority of data used for a fourth correction of color shift between one of the image and the video, among corrections performed on one of the image and the video.

15. 15. The imaging device according to claim 14, wherein the setting unit increases the priority of data to be used for the fourth correction that has a larger amount or rate of correction, among the data to be used for the fourth correction.

16. 15. The imaging device according to claim 14, wherein the setting unit increases the priority of data used for the fourth correction, in which at least one of an amount and a rate of correction changes depending on an image height, among the data used for the fourth correction.

17. 5. The imaging device according to claim 1, wherein the determination unit performs the determination before the communication unit performs repeated transmission and reception at a predetermined cycle.

18. 5. The imaging device according to claim 1, wherein the determination unit executes the determination when the optical lens is attached to the imaging device.

19. 5. The imaging device according to claim 1, wherein the determination unit executes the determination when the processing load fluctuates.

20. 5. The imaging device according to claim 1, wherein the communication unit receives the data, the communication of which is determined by the determination unit to satisfy the predetermined condition, at a predetermined cycle.

21. 21. The imaging device according to claim 20, wherein the communication unit receives the data, the communication of which is determined by the determination unit not to satisfy the predetermined condition, at a period longer than the predetermined period.

22. 5. The imaging device according to claim 1, further comprising a notification unit that notifies a user of data whose communication has been determined by the determination unit to satisfy the predetermined condition.

23. 5. The imaging device according to claim 1, further comprising a notification unit that notifies a user of data that is not included in the data determined by the determination unit to satisfy the predetermined condition.

24. The imaging device described in any one of claims 1, 2, and 4, characterized in that the setting unit lowers the priority of data used for correction involving a change in position coordinates in at least one of the width and height directions of one of the image and the video, or data used for correction involving a change in position coordinates in the vertical direction of one of the image and the video, compared to the priority of data used for correction involving a change in brightness of one of the image and the video, or data used for correction of color shift of one of the image and the video.

25. The imaging device described in any one of claims 1, 2, and 4, characterized in that the setting unit lowers the priority of data used for correction involving a change in position coordinates in the vertical direction of one of the image and the video relative to the priority of data used for correction involving a change in position coordinates in at least one of the width direction and height direction of one of the image and the video.

26. The imaging device described in any one of claims 1, 2, and 4, characterized in that the setting unit lowers the priority of data used to correct color shifts between one of the image and the video compared to data used for corrections involving changes in brightness between one of the image and the video.

27. A lens device that is detachable from an imaging device that can acquire at least one of an image and a video, a communication unit that transmits and receives data to and from the imaging device; a determination unit that determines whether the data communication satisfies a predetermined condition; a setting unit that sets a priority of the data in accordance with a result of the determination unit.

28. A lens device that is detachable from an imaging device that can acquire at least one of an image and a video, a communication unit for transmitting and receiving data to and from the imaging device; The lens device is characterized in that the communication unit transmits data used for correction involving a change in vertical position coordinates or a change in position coordinates in at least one of the width and height directions, which is performed on one of the image and video captured by the imaging device, in priority to data used for correction involving a change in brightness or color shift, which is performed on one of the image and video.

29. A control method for an imaging device that can be fitted with an optical lens and can acquire at least one of an image and a video, comprising: a communication step of transmitting and receiving data to and from the optical lens; a determination step of determining whether the data communication satisfies a predetermined condition; a setting step of setting a priority of the data in accordance with a result of the determination unit.

30. A method for controlling a lens device detachable from an imaging device capable of acquiring at least one of an image and a video, comprising: a communication step of transmitting and receiving data to and from the imaging device; a determination step of determining whether the data communication satisfies a predetermined condition; a setting step of setting a priority of the data in accordance with a result of the determination unit.

31. A lens device that is detachable from an imaging device that can acquire at least one of an image and a video, A control method for a lens device, characterized in that data used for correction involving a change in vertical position coordinates or a change in position coordinates in at least one of the width and height directions, performed on one of an image and a video captured by the imaging device, is transmitted to the imaging device in priority to data used for correction involving a change in brightness or color shift, performed on one of the image and a video.

Images