Terminal device, lens control system, and program

Abstract

To provide a technology that can easily be used to suitably change the optical state of a lens in accordance with camerawork. [Solution] Before video shooting, a processor (11) provided in a terminal device (10) estimates the correspondence between the holding state of the camera (CA) and the optical state of the lens (20) from a combination of a detection value (DV) representing the holding state of the camera (CA) and a set value (SV) representing the optical state of the lens (20), and during video shooting, identifies the optical state of the lens corresponding to the holding state and outputs a control signal to control the lens (20) to the identified optical state.

Description

[Technical Field]

[0001] The present invention relates to a terminal device that controls a camera lens, a lens control system that includes the terminal device and a sensor, and a program that causes a computer to function as the terminal device. [Background technology]

[0002] There are known techniques for changing the optical state of a lens in response to camerawork that changes the camera's support state. For example, Patent Document 1 discloses an imaging device that drives a zoom lens in response to imaging parameters. Specifically, the imaging device generates sequence data in which detection values ​​of the camera's attitude during panning and tilting operations, as well as reproduction data that associates camera position data with the imaging parameters, are arranged in chronological order. Furthermore, in response to an operator's reproduction instruction, the imaging device extracts the imaging parameters associated with the detected camera attitude in the sequence data and drives the zoom lens. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-76836 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when a user wishes to use a technology that changes the optical state of a lens in response to camerawork, the imaging device described in Patent Document 1 allows the user to use the technology only by using the imaging device itself. Therefore, even if the user already owns an imaging device, the user must newly prepare the imaging device described in Patent Document 1 in order to use the technology. In other words, there is a problem in that the user cannot easily use the technology.

[0005] Furthermore, the imaging device described in Patent Document 1 extracts imaging parameters linked to camera position data in sequence data, which is reproduction data that associates imaging parameters with camera position data, and drives the zoom lens. Therefore, it is not possible to extract appropriate imaging parameters from the positions in the sequence data arranged in time series. In other words, there is a problem in that the optical state of the lens cannot be appropriately changed according to the camerawork.

[0006] An aspect of the present invention aims to provide a technology that allows easy use of a technology for suitably changing the optical state of a lens in accordance with camerawork. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems, a terminal device according to one aspect of the present invention is a terminal device including a processor and a communication interface for communicating with a sensor that detects a support state of a support body that supports the camera and at least one of a camera and a lens attached to the camera, and the processor is configured to receive a detection value that indicates the support state of the camera by the support body, which is obtained from the sensor via the communication interface at a time point designated by a user operation on the terminal device, before video shooting using the camera, and a setting value that indicates the optical state of the lens, which is obtained from at least one of the camera and the lens via the communication interface at the time point. and the setting value are recorded in combination, and an estimation process is performed to estimate a correspondence relationship between the holding state of the camera and the optical state of the lens from a combination of the detection values ​​and the setting values ​​recorded in the recording process. During video shooting using the camera, the lens is controlled by repeating the following steps: an identification process to identify the optical state of the lens corresponding to the holding state represented by the detection values ​​acquired from the sensor via the communication interface, in accordance with the correspondence relationship estimated in the estimation process; and an output process to output, via the communication interface, a control signal for controlling the optical state of the lens to the optical state identified in the identification process.

[0008] In order to solve the above-mentioned problems, a lens control system according to one aspect of the present invention is a lens control system comprising a terminal device and a sensor that detects a support state of a support that supports a camera to which a lens is attached, the sensor comprising a detection unit and a communication interface for communicating with the terminal device, the detection unit detects a support state of the camera by the support and outputs a detection value representing the detected support state to the terminal device via the communication interface, the terminal device comprising a processor and a communication interface for communicating with at least one of a camera and a lens attached to the camera, and the sensor, the processor detecting the detection value obtained from the sensor via the communication interface at a time specified by a user operation on the terminal device before video shooting using the camera, and outputting a detection value representing the detected support state to the terminal device via the communication interface. The lens is controlled by repeating the following steps: a recording process is performed at least twice to record a combination of the detection values ​​and setting values ​​representing the optical state of the lens, which are acquired from at least one of the camera and the lens via the communication interface at the time; an estimation process is performed to estimate a correspondence relationship between the holding state of the camera and the optical state of the lens from a combination of the detection values ​​and the setting values ​​recorded in the recording process; and a determination process is performed during video shooting using the camera to identify the optical state of the lens corresponding to the holding state represented by the detection values ​​acquired from the sensor via the communication interface, in accordance with the correspondence relationship estimated in the estimation process; and an output process is performed to output a control signal via the communication interface to control the optical state of the lens to the optical state identified in the determination process.

[0009] In order to solve the above problem, a program according to one aspect of the present invention is a program that causes a computer to function as a terminal device having a processor and a communication interface for communicating with a sensor that detects a support state of a support that supports the camera, and a camera and / or a lens attached to the camera, and the program causes the processor to receive a detection value that indicates the support state of the camera by the support, obtained from the sensor via the communication interface at a time specified by a user operation on the terminal device before video shooting using the camera, and a light intensity of the lens, obtained from at least one of the camera and the lens via the communication interface at the time specified. and a setting value representing the optical state of the lens, and the camera is caused to execute a recording process at least twice, in which the recording process is performed in combination with the detection value and the setting value representing the optical state of the lens, and an estimation process is performed in which a correspondence relationship between the holding state of the camera and the optical state of the lens is estimated from the combination of the detection value and the setting value recorded in the recording process, and while video shooting is being performed using the camera, the camera is controlled by repeating the following processes: an identification process in which the optical state of the lens corresponding to the holding state represented by the detection value acquired from the sensor via the communication interface is identified in accordance with the correspondence relationship estimated in the estimation process; and an output process in which a control signal for controlling the optical state of the lens to the optical state identified in the identification process is output via the communication interface. [Effects of the Invention]

[0010] According to one aspect of the present invention, it is possible to provide a technique that allows easy use of a technique for suitably changing the optical state of a lens in accordance with camerawork. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a configuration of a lens control system according to a first embodiment of the present invention. [Figure 2] 1 is a diagram illustrating an example of the configuration of a lens control system according to a first embodiment of the present invention. [Figure 3]FIG. 2 is a diagram showing an example of an image displayed on a display before moving image shooting is performed using a camera in the first embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing an example of an image displayed on a display while a moving image is being captured using a camera in the first embodiment of the present invention. [Figure 5] FIG. 3 is a diagram illustrating an example of processing executed by an estimation unit according to the first embodiment of the present invention. [Figure 6] FIG. 4 is a diagram showing setting values ​​according to the position of a camera in the first embodiment of the present invention. [Figure 7] 1 is a flowchart showing the flow of processing executed by a terminal device before video shooting using a camera in the first embodiment of the present invention. [Figure 8] 1 is a flowchart showing the flow of processing executed by a terminal device while a moving image is being captured using a camera in the first embodiment of the present invention. [Figure 9] FIG. 2 is a diagram showing an example of an image captured by a camera in the first embodiment of the present invention. [Figure 10] FIG. 4 is a diagram showing another example of an image captured by the camera in the first embodiment of the present invention. [Figure 11] FIG. 10 is a diagram showing still another example of an image captured by the camera in the first embodiment of the present invention. [Figure 12] FIG. 10 is a block diagram showing the configuration of a lens control system according to a second embodiment of the present invention. [Figure 13] FIG. 10 is a diagram illustrating an example of the configuration of a lens control system according to a second embodiment of the present invention. [Figure 14] FIG. 10 is a block diagram showing the configuration of a lens control system according to a third embodiment of the present invention. [Figure 15] FIG. 10 is a diagram illustrating an example of the configuration of a sensor according to a third embodiment of the present invention. [Figure 16] FIG. 11 is a diagram showing another example of an image displayed on the display while a moving image is being captured using a camera in the third embodiment of the present invention. [Figure 17] FIG. 11 is a diagram illustrating an example of processing executed by an estimation unit according to the third embodiment of the present invention. [Figure 18] FIG. 10 is a diagram showing an example of setting values ​​according to the elevation and depression angles of the camera according to the third embodiment of the present invention. [Figure 19] FIG. 11 is a diagram showing an example of setting values ​​according to the azimuth angle of a camera in the third embodiment of the present invention. [Figure 20] FIG. 11 is a diagram illustrating another example of the process executed by the identifying unit according to the third embodiment of the present invention. [Figure 21] 10A and 10B are diagrams showing an example of optical states depending on the support state of the multi-angle unit and the tripod in a modified example of the present invention. [Figure 22] 10A and 10B are diagrams showing other examples of optical states depending on the state of support by the multi-angle unit and the tripod in the modified example of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0012] [Embodiment 1] Hereinafter, one embodiment of the present invention will be described in detail.

[0013] (Overview and Configuration of Lens Control System 100) The outline and configuration of a lens control system 100 according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the lens control system 100 according to this embodiment.

[0014] 1, the lens control system 100 includes a terminal device 10, a lens 20, and a sensor 30. The terminal device 10 and the lens 20, and the terminal device 10 and the sensor 30 are connected so as to be able to transmit and receive information to and from each other.

[0015] In the lens control system 100, a camera CA to which a lens 20 is attached is supported by a support, and the support state in which the camera CA is supported is detected by a sensor 30. The sensor 30 outputs the detected support state.

[0016] Examples of the support include a camera platform PH, a slider SL, a multi-angle unit MAU, and a tripod TR. Examples of the support state output by the sensor 30 include a position, an elevation / depression angle, and an azimuth angle. In this embodiment, a case will be described in which the support state detected by the sensor 30 is the position of the camera CA.

[0017] The lens 20 attached to the camera CA outputs an optical state. The optical state of the lens 20 is controlled by a control signal. Examples of the optical state output by the lens 20 include focal length (focus), zoom magnification, iris, and ND (Neutral Density) filter. In this embodiment, a case where the optical state of the lens 20 is focal length will be described.

[0018] In addition, the lens control system 100 may be configured such that the terminal device 10 and a camera CA to which the lens 20 is attached are connected so as to be able to transmit and receive information to and from each other, and the lens 20 and the camera CA are connected so as to be able to transmit and receive information to and from each other. In this case, the lens 20 may output its optical state via the camera CA, and the optical state may be controlled by a control signal via the camera CA. That is, hereinafter, "the terminal device 10 acquires the optical state from the lens 20" can be rephrased as "the terminal device 10 acquires the optical state from at least one of the camera CA and the lens 20." Furthermore, "the terminal device 10 outputs a control signal to the lens 20" can be rephrased as "the terminal device 10 outputs a control signal to at least one of the camera CA and the lens 20."

[0019] Before capturing video using the camera CA, the terminal device 10 acquires, at predetermined intervals, the support state indicating the position of the camera CA output from the sensor 30 and the optical state indicating the focus transmitted from the lens 20, and executes a recording process to record the combination of the support state and the optical state at least twice. In the present disclosure, the support state and optical state recorded the first time are also referred to as the first detection value DV1 and the first setting value SV1, and the support state and optical state recorded the second time are also referred to as the second detection value DV2 and the second setting value SV2.

[0020] Furthermore, the terminal device 10 estimates the correspondence between the position of the camera CA and the focal point of the lens 20 from a combination of the recorded holding state and optical state.

[0021] Next, while capturing video using the camera CA, the terminal device 10 refers to the support state output from the sensor 30 and performs a specification process to specify the focal length of the lens 20 that corresponds to the position of the camera CA from the estimated correspondence. The terminal device 10 also performs an output process to output a control signal to the lens 20 to control the lens 20 to the specified focal length. The terminal device 10 controls the lens 20 by repeating the specification process and the output process.

[0022] (Configuration example of lens control system 100) An example configuration of the lens control system 100 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example configuration of the lens control system 100 according to this embodiment. In this disclosure, the direction perpendicular and horizontal to the optical axis of the camera CA is defined as the x-axis direction, and the right side as viewed from the subject side toward the camera CA is defined as the positive x-axis direction. The vertical direction is defined as the y-axis direction, and the upper side is defined as the positive y-axis direction. The description will also be given assuming that the direction parallel to the optical axis of the camera CA is defined as the z-axis direction, and the subject side is defined as the positive z-axis direction.

[0023] In the lens control system 100 shown in Fig. 2, the terminal device 10 is connected to a lens 20 and a sensor 30 via a USB (Universal Serial Bus) HUB. A camera CA to which the lens 20 is attached is attached to a slider SL via a camera platform PH. The slider SL moves the camera CA along the x-axis direction, as indicated by the arrow in Fig. 2.

[0024] A detection unit 31 is installed on the slider SL, and a sensor 30 outputs to the terminal device 10 a support state that indicates the position of the camera head PH detected by the detection unit 31 (in other words, the position of the camera CA).

[0025] The lens 20 attached to the camera CA outputs the optical state of the lens 20 to the terminal device 10.

[0026] The terminal device 10 acquires the support state output from the sensor 30 and the optical state output from the lens 20. Furthermore, the terminal device 10 repeats the above-described identification process and output process, and repeatedly outputs a control signal to the lens 20, thereby controlling the focal length of the lens 20.

[0027] (Configuration of terminal device 10) The terminal device 10 is a device that processes information. Examples of the terminal device 10 include a portable smartphone, a tablet terminal, and a PC (Personal Computer). As shown in FIG. 1, the terminal device 10 includes a processor 11, a communication interface 12, a display 13, and a memory 14.

[0028] (Processor 11) The processor 11 executes a program stored in the memory 14 to function as an acquisition unit 111, a display control unit 112, a recording unit 113, an estimation unit 114, an identification unit 115, and an output unit 116.

[0029] (Acquisition part 111) The acquisition unit 111 acquires information via the communication interface 12. As one example, the acquisition unit 111 acquires the optical state of the lens 20 from the lens 20 via the communication interface 12. As another example, the acquisition unit 111 acquires the support state of the camera CA by the support body from the sensor 30 via the communication interface 12.

[0030] Furthermore, the acquisition unit 111 acquires information representing a user operation via the touchpad 131, which will be described later. As an example, the acquisition unit 111 acquires, via the touchpad 131, information representing a user operation to execute a recording process for recording a combination of the holding state and the optical state at a specified time point.

[0031] (Display control unit 112) The display control unit 112 outputs an image signal to the display 13, which will be described later, to display an image on the display 13. As an example, the display control unit 112 displays on the display 13 an image including a user interface that accepts a user operation in a recording process that records combinations of support states and optical states at least twice.

[0032] An example of an image displayed on the display 13 by the display control unit 112 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of an image displayed on the display 13 before video shooting is performed using the camera CA in this embodiment.

[0033] As shown in Figure 3, before video shooting is performed using camera CA, display control unit 112 displays on display 13 an image including button B_1 for accepting an operation to perform the first recording process of recording the support state and optical state at a specified time, and button B_2 for accepting an operation to perform the second recording process.

[0034] 3, the display control unit 112 may display on the display 13 an image including an area DR_F that displays the position of the focal length, which is the support state obtained from the lens 20. Also, the display control unit 112 may display on the display 13 an image including an area DR_I that displays the F-number, which is the optical state obtained from the lens 20.

[0035] Another example of an image displayed on the display 13 by the display control unit 112 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of an image displayed on the display 13 while video shooting is being performed using the camera CA in this embodiment.

[0036] As shown in FIG. 4, while video shooting is being performed using the camera CA, the display control unit 112 displays on the display 13 an image including an area DR_S that displays the support state indicating the position of the camera CA obtained from the sensor 30.

[0037] 4, the display control unit 112 displays an image including a button B_5 for receiving an operation to change the position of the camera CA in the first recording process and a button B_6 for receiving an operation to change the position of the camera CA in the second recording process on the display 13. Also, as shown in FIG. 4, the display control unit 112 displays an image including an area DR_IR for displaying the position of the camera CA in the first recording process and the position of the camera CA in the second recording process on the display 13.

[0038] Furthermore, the display control unit 112 displays on the display 13 an image including a button B_3 that accepts an operation to switch whether or not to use the function of controlling the focus of the lens 20 depending on the position of the camera CA. Also, the display control unit 112 may display on the display 13 an image including a button B_3 that accepts an operation to invert the camera CA if the camera CA is installed upside down and left to right, as shown in Fig. 4 .

[0039] (Recording Unit 113) Before video shooting using the camera is performed, the recording unit 113 performs a recording process at least twice to record a combination of a detection value DV representing the support state of the camera by the support body, obtained from the sensor 30 via the communication interface 12 at a time specified by user operation on the terminal device 10, and a setting value SV representing the optical state of the lens 20, obtained from the lens 20 via the communication interface 12 at the same time.

[0040] For example, we will explain the case where the acquisition unit 111 acquires information indicating that button B_1 in the image shown in Figure 3 has been pressed and held down, as information representing an operation to perform the first recording process of combining and recording the support state and optical state at a specified time point.

[0041] In this case, the recording unit 113 combines the support state obtained from the sensor 30 via the communication interface 12 at the time the acquisition unit 111 acquires the information with the optical state obtained from the lens 20 via the communication interface 12 at the time the acquisition unit 111 acquires the information, and records them as a first detection value DV1 and a first set value SV1.

[0042] Similarly, we will explain the case where the acquisition unit 111 acquires information indicating that button B_2 in the image shown in Figure 3 has been pressed and held, as information representing an operation to perform the second recording process of combining and recording the support state and optical state at a specified time point.

[0043] In this case, the recording unit 113 combines the support state obtained from the sensor 30 via the communication interface 12 at the time the acquisition unit 111 acquires the information with the optical state obtained from the lens 20 via the communication interface 12 at the time the acquisition unit 111 acquires the information, and records them as a second detection value DV2 and a second set value SV2.

[0044] (Estimation part 114) Before video shooting is performed using the camera CA, the estimation unit 114 performs an estimation process to estimate the correspondence between the support state of the camera CA and the optical state of the lens 20 from a combination of the detection value DV and the set value SV recorded in the recording process.

[0045] An example of processing executed by the estimation unit 114 will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a diagram showing an example of processing executed by the estimation unit 114 according to this embodiment. Fig. 6 is a diagram showing the setting value SV (focus position) according to the position of the camera CA in this embodiment.

[0046] As an example, the estimation unit 114 estimates that, as a correspondence relationship, the optical state corresponding to the support state between two support states (first detection value DV1 and second detection value DV2) recorded in the recording process performed by the recording unit 113 is a numerical value between the two optical states (first setting value SV1 and second setting value SV2) recorded in the recording process performed by the recording unit 113.

[0047] For example, in the upper part of Figure 5, we will explain the case where the support state when the position of camera CA is x=10 is recorded as the first detection value DV1, and the support state when the position of camera CA is x=80 is recorded as the second detection value DV2.

[0048] In this case, the first set value SV1 is a value indicating the focus position A shown on the left side of Figure 6, and the second set value SV2 is a value indicating the focus position B shown on the right side of Figure 6.

[0049] In this case, as an example, the estimation unit 114 estimates that the set value SV corresponding to the support state between two support states (first detection value DV1 and second detection value DV2) recorded in the recording process executed by the recording unit 113 as a correspondence relationship is a numerical value on a line that continuously connects two combinations of support states and optical states (first detection value DV1 and first set value SV1, and second detection value DV2 and second set value SV2) recorded in the recording process with a straight line or a curve.

[0050] For example, as shown in the lower part of Fig. 5, in a coordinate system with the support state on the horizontal axis and the optical state on the vertical axis, the estimation unit 114 connects a point corresponding to the first detection value DV1 and the first set value SV1 with a point corresponding to the second detection value DV2 and the second set value SV2 with a straight line. Then, the estimation unit 114 estimates the straight line in the coordinate system as a line representing the correspondence between the support state of the camera CA and the optical state of the lens 20.

[0051] With this configuration, when the camera CA is located between positions recorded in the recording process, the estimation unit 114 can suitably adjust the focus position of the lens 20 at the location where the camera CA is located.

[0052] Similarly, the estimation unit 114 executes the above-described process when the recording unit 113 has executed the recording process three or more times. For example, when the recording unit 113 has executed the recording process three times, the estimation unit 114 estimates, for each of the three recorded combinations of the detection values ​​DV and the setting values ​​SV, a continuous line or curve between adjacent points in the coordinate system as a line or curve that represents the correspondence between the support state of the camera CA and the optical state of the lens 20.

[0053] (Specific Section 115) The identification unit 115 performs an identification process to identify the optical state of the lens 20 corresponding to the support state represented by the detection value DV obtained from the sensor 30 via the communication interface 12 during video shooting using the camera CA, in accordance with the correspondence estimated by the estimation unit 114 in the estimation process.

[0054] 5, when the position of the camera CA is x=45, the acquisition unit 111 acquires a detection value DV indicating that the position of the camera CA is x=45. The identification unit 115 refers to the detection value DV acquired by the acquisition unit 111, and identifies the setting value SV corresponding to x=45 in the correspondence relationship estimated by the estimation unit 114.

[0055] When the correspondence relationship estimated by the estimation unit 114 is the straight line shown in the lower part of Figure 5, the identification unit 115 identifies the setting value SV (C in the lower part of Figure 5) at the point on the straight line representing the correspondence relationship, which corresponds to x = 45, as shown in the lower part of Figure 5.

[0056] In this case, the setting value SV specified by the specifying unit 115 is a value that causes the focus position to be at position C between A and B, as shown in the center of FIG.

[0057] (output unit 116) The output unit 116 executes an output process to output, via the communication interface 12, a control signal for controlling the optical state of the lens 20 to the optical state identified in the identification process.

[0058] For example, when the determination unit 115 determines the setting value SV corresponding to C shown in Figures 5 and 6, the output unit 116 outputs a control signal to the lens 20 via the communication interface 12, which causes the focus position of the lens 20 to become C.

[0059] (Communication Interface 12) The communication interface 12 is an interface for communicating with other devices. As an example, the communication interface 12 is an interface for communicating with a lens 20 attached to the camera CA and a sensor that detects the support state of a support that supports the camera CA.

[0060] Examples of the communication interface 12 include, but are not limited to, communication chips for various communication standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), and wireless communication standards for mobile data communication networks, and a connector conforming to the Universal Serial Bus (USB). In this disclosure, a case where the communication interface 12 is a connector conforming to the USB will be described as an example.

[0061] (Display 13) Display 13 is a device that displays images. Examples of display 13 include a liquid crystal display and an organic EL (Electro Luminescence) display. As shown in FIG. 1 , display 13 also includes a touchpad 131 that is superimposed on display 13 and accepts operations on display 13. Display 13 outputs information indicating the operations accepted by touchpad 131 to processor 11.

[0062] (Memory 14) The memory 14 stores programs and data to be processed by the programs, etc. The memory 14 is, for example, a combination of a volatile memory such as a dynamic random access memory (DRAM), a flash memory, a hard disk drive (HDD), a magneto-optical disk, or the like.

[0063] Examples of data stored in memory 14 include, as shown in FIG. 1, a first detection value DV1, a first set value SV1, a second detection value DV2, a second set value SV2, and a detection value DV during video recording using camera CA.

[0064] (Configuration of lens 20) The lens 20 is a component connected to the camera CA and forms an image of a subject on an image sensor included in the camera CA. As shown in FIG. 1, the lens 20 includes a processor 21, a communication interface 22, and a lens optical system 23.

[0065] The processor 21 controls each component of the lens 20 by executing a program stored in a memory not shown in Fig. 1. As one example, the processor 21 outputs the optical state of the lens optical system 23 to the terminal device 10 via the communication interface 22. As another example, the processor 21 controls the lens optical system 23 in accordance with a control signal acquired via the communication interface 22.

[0066] The communication interface 22 has the same configuration as the communication interface 12 described above, and is an interface for communicating with the terminal device 10.

[0067] The lens optical system 23 is a unit including at least one single lens and a support member connected to the at least one single lens and capable of being driven and stopped. In the lens optical system 23, the state of the lens optical system 23 is changed or maintained by driving or stopping the support member. In this embodiment, the support member of the lens optical system 23 is driven or stopped in accordance with a signal from the processor 21.

[0068] As an example, the lens optical system 23 moves a single lens along the optical axis in accordance with a control signal from the processor 21, thereby changing the focus position (also called the focal position) of the lens optical system 23.

[0069] (Sensor 30) The sensor 30 is a sensor that detects the support state of the support body that supports the camera CA to which the lens 20 is attached. In the present disclosure, the sensor 30 detects the support state of the camera CA by the support body and outputs the detected support state. As shown in FIG. 1, the sensor 30 includes a detection unit 31 and a communication interface 32.

[0070] The detection unit 31 is a component that detects the support state of the camera CA by the support body. The detection unit 31 outputs the detected support state to the terminal device 10 via the communication interface 32.

[0071] The detector 31 is not particularly limited as long as it is a sensor that can detect the support state of the camera CA by the support body. In this embodiment, the detector 31 is a potentiometer sensor attached to a slider SL that moves the position of the camera platform PH to which the camera CA is attached.

[0072] The communication interface 32 has the same configuration as the communication interface 12 described above, and is an interface for communicating with the terminal device 10.

[0073] (Processing flow 1 executed by terminal device 10) The flow of processing executed by the terminal device 10 before video shooting using the camera CA will be described with reference to Fig. 7. Fig. 7 is a flow diagram showing the flow of processing executed by the terminal device 10 before video shooting using the camera CA in this embodiment.

[0074] (Step S11) In step S11, the acquisition unit 111 acquires from the sensor 30 via the communication interface 12 the support state of the camera CA by the support body.

[0075] (Step S12) In step S12, the acquisition unit 111 acquires the optical state of the lens 20 from the lens 20 via the communication interface 12.

[0076] (Step S13) In step S13, the display control unit 112 displays on the display 13 an image including a user interface that accepts a user operation in a recording process for recording a combination of the detected value DV and the set value SV at least twice.

[0077] For example, in step S13, the display control unit 112 displays the image shown in the area DR_F in FIG. 3, which is the optical state acquired by the acquisition unit 111 in step S12.

[0078] (Step S14) In step S14, the acquisition unit 111 determines whether or not it has acquired information representing a user operation via the touchpad 131 to perform a first recording process that combines and records the detection value DV and the set value SV at a specified time point.

[0079] For example, in step S14, the acquisition unit 111 determines whether or not information indicating that the button B_1 included in the image shown in FIG. 3 has been pressed and held has been acquired.

[0080] In step S14, if it is determined that information indicating a user operation to execute the first recording process has not been acquired (step S14: NO), the terminal device 10 executes step S11 again.

[0081] Here, in the above-mentioned step S13, as shown in FIG. 3, an image showing the optical state in the area DR_F is displayed, and when step S13 is executed again, in the re-executed step S12, the display control unit 112 updates the image in the area DR_F to reflect the optical state acquired by the acquisition unit 111 in the re-executed step S12.

[0082] (Step S15) If it is determined in step S14 that information representing a user operation to execute the first recording process has been acquired (step S14: YES), in step S15, the recording unit 113 combines the combination of support state and optical state acquired by the acquisition unit 111 in the immediately preceding steps S12 and S13 as a first detection value DV1 and a first setting value SV1 and records them in memory 14.

[0083] (Step S16) In step S16, the acquisition unit 111 acquires the support state of the camera CA by the support body from the sensor 30 via the communication interface 12.

[0084] (Step S17) In step S12, the acquisition unit 111 acquires the optical state of the lens 20 from the lens 20 via the communication interface 12.

[0085] (Step S18) In step S18, the display control unit 112 displays on the display 13 an image including a user interface that accepts a user operation in a recording process for recording the combination of the detected value DV and the set value SV at least twice.

[0086] In step S18, since an image including the user interface has already been displayed on the display 13 in the above-mentioned step S13, the display control unit 112 updates, for example, the image displayed on the display 13 to the image shown in area DR_F in Figure 3, which is the optical state acquired by the acquisition unit 111 in step S17.

[0087] (Step S19) In step S19, the acquisition unit 111 determines whether or not it has acquired information representing a user operation via the touchpad 131 to perform a second recording process in which the detection value DV and the set value SV are combined and recorded at a specified time point.

[0088] For example, in step S19, the acquisition unit 111 determines whether or not information indicating that the button B_2 included in the image shown in FIG. 3 has been pressed and held has been acquired.

[0089] In step S19, if it is determined that information indicating a user operation to execute the second recording process has not been acquired (step S19: NO), the terminal device 10 executes step S16 again.

[0090] (Step S20) If it is determined in step S19 that information representing a user operation to execute a second recording process has been acquired (step S19: YES), in step S20, the recording unit 113 combines the combination of support state and optical state acquired by the acquisition unit 111 in the immediately preceding steps S16 and S17 as a second detection value DV2 and a second setting value SV2 and records them in memory 14.

[0091] (Step S21) In step S21, the estimation unit 114 executes an estimation process to estimate the correspondence between the support state of the camera CA and the optical state of the lens 20 from the combination of the first detection value DV1 and the first setting value SV1 recorded in the memory 14 in step S15 and the combination of the second detection value DV2 and the second setting value SV2 recorded in the memory 14 in step S20. An example of the estimation process is as described above.

[0092] In this way, before video shooting using the camera CA is performed, the terminal device 10 executes the recording process at least twice and also executes the estimation process.

[0093] (Processing flow 2 executed by terminal device 10) The flow of processing executed by the terminal device 10 while video shooting is being performed using the camera CA will be described with reference to Fig. 8. Fig. 8 is a flow diagram showing the flow of processing executed by the terminal device 10 while video shooting is being performed using the camera CA in this embodiment.

[0094] (Step S31) In step S31, the acquisition unit 111 acquires, from the sensor 30 via the communication interface 12, a detection value DV that indicates the support state of the camera CA by the support body.

[0095] (Step S32) In step S32, the display control unit 112 displays on the display 13 an image to be displayed while video shooting is being performed using the camera CA.

[0096] For example, in step S32, the display control unit 112 displays an image including the detection value DV acquired by the acquisition unit 111 in step S31 and the region DR_P in FIG.

[0097] (Step S33) In step S33, the identification unit 115 executes an identification process to identify the optical state of the lens 20 corresponding to the support state indicated by the detection value DV acquired by the acquisition unit 111 in step S31, in accordance with the correspondence estimated in step S21. An example of the identification process is as described above.

[0098] (Step S34) In step S34, the output unit 116 executes an output process of outputting, to the lens 20 via the communication interface 12, a control signal for controlling the lens 20 to the optical state identified in step S33.

[0099] (Step S35) In step S35, the acquisition unit 111 determines whether or not an operation to end the processing shown in Fig. 8 has been received via the touchpad 131. As an example, the acquisition unit 111 determines whether or not an operation to close the image displayed by the display control unit 112 in step S32 has been received.

[0100] In step S35, if it is determined that an operation to end the process has not been received (step S35: NO), the terminal device 10 executes step S31 again. That is, the terminal device 10 controls the lens 20 by repeating the identification process and the output process.

[0101] On the other hand, if it is determined in step S35 that an operation to end the process has been accepted (step S35: YES), the terminal device 10 ends the process shown in FIG.

[0102] (Example of an image included in a video captured by camera CA) Examples of moving images (images) captured by the camera CA will be described with reference to Figures 9 to 11. Figures 9 to 11 are diagrams each showing an example of an image captured by the camera CA in this exemplary embodiment.

[0103] As in the example described above, we will explain the case where the detection value DV when the camera CA is positioned at x=10 is recorded as the first detection value DV1, as shown in the upper part of Figure 9, and the detection value DV when the camera CA is positioned at x=80 is recorded as the second detection value DV2, as shown in the upper part of Figure 10.

[0104] In this case, the first setting value SV1 and the second setting value SV2 are described as follows: as shown in FIG. 6, the first setting value SV1 represents a focus position closer to the camera CA, and the second setting value SV2 represents a focus position farther from the camera CA than the first setting value SV1.

[0105] That is, when the position of camera CA is x=10, an image focused on a position close to camera CA is captured, as shown in the lower part of Fig. 9. Also, when the position of camera CA is x=80, an image focused on a position farther from camera CA is captured compared to when camera CA is located at x=10.

[0106] 11, when the acquisition unit 111 acquires a detection value DV indicating that the position of the camera CA is x=45, the identification unit 115 identifies the optical state corresponding to x=45 by the method described above. Then, the output unit 116 outputs a control signal to the lens 20 via the communication interface 12, which causes the focus position of the lens 20 to be in the optical state identified by the identification unit 115.

[0107] When the lens 20 receives a control signal from the terminal device 10, it controls the lens optical system 23 in accordance with the control signal. In this case, as shown in the lower part of Fig. 11, the image captured when the position of the camera CA is x = 45 is an image that is focused on a position farther from the camera CA than when the position of the camera CA is x = 10, and closer to the camera CA than when the position of the camera CA is x = 80.

[0108] (Effects of lens control system 100) Thus, in the lens control system 100, before video shooting using the camera CA, the terminal device 10 performs a process of recording the holding state of the camera CA in combination with the optical state of the lens 20 at least twice, and estimates the correspondence between the holding state of the camera CA and the optical state of the lens from the combination of the recorded detection value DV (first detection value DV1 and second detection value DV2) and setting value SV (first setting value SV1 and second setting value SV2).

[0109] In addition, while video shooting is being performed using the camera CA, the terminal device 10 repeats a determination process of determining the optical state of the lens 20 corresponding to the holding state of the camera CA according to the estimated correspondence, and an output process of outputting a control signal to the lens 20 to control the lens 20 to the determined optical state.

[0110] As described above, in the lens control system 100, the terminal device 10 acquires the support state from a sensor that detects the support state of the support body of the camera CA (for example, the camera platform PH, the slider SL, the multi-angle unit MAU, and the tripod TR), and acquires the optical state from the lens 20, thereby controlling the optical state of the lens 20 to correspond to the support state of the camera CA. Therefore, in the lens control system 100, the optical state of the lens 20 can be changed in accordance with the camerawork without using a special camera CA. Furthermore, the terminal device 10 does not have to be a special terminal device, and a mobile terminal such as a smartphone can be used as the terminal device 10. Therefore, in the lens control system 100, the user can easily use a technique for suitably changing the optical state of the lens 20 in accordance with the camerawork.

[0111] Furthermore, in the lens control system 100, user operations are accepted by the terminal device 10. In other words, the user can change the optical state of the lens in accordance with camerawork without touching the camera CA, the lens 20, or the support. Therefore, the lens control system 100 can reduce the possibility that the user will unintentionally change the support state of the camera CA.

[0112] A configuration that further reduces the possibility of unintentionally changing the support state is one in which a reception unit (e.g., a button) that receives an operation to cause the terminal device 10 to execute a predetermined process is provided on the support. With this configuration, the user can cause the terminal device 10 to execute, for example, a recording process without releasing the support. The reception unit may also receive an operation according to a purpose and cause the terminal device 10 to execute a predetermined process in accordance with the operation.

[0113] [Embodiment 2] Other embodiments of the present invention will be described below. For ease of explanation, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0114] (Overview and Configuration of Lens Control System 100A) The overview and configuration of a lens control system 100A according to this embodiment will be described with reference to Fig. 12 and Fig. 13. Fig. 12 is a block diagram showing the configuration of the lens control system 100A according to this embodiment. Fig. 13 is a diagram showing an example of the configuration of the lens control system 100A according to this embodiment.

[0115] 12, the lens control system 100A includes a terminal device 10A, a lens 20, a sensor 30, and an external drive system 40 (drive device). The terminal device 10A and the lens 20, the terminal device 10A and the sensor 30, and the terminal device 10A and the external drive system 40 are connected to each other so as to be able to transmit and receive information to and from each other.

[0116] In the lens control system 100A, instead of the configuration in which the terminal device 10 in the lens control system 100 of the above-described embodiment outputs a control signal to the lens 20, the terminal device 10A outputs a control signal to an external drive system 40 that changes the optical state of the lens 20. Therefore, the lens 20 and the sensor 30 have the same configuration as the lens 20 and the sensor 30 in the above-described embodiment, and therefore description thereof will be omitted.

[0117] (Configuration of terminal device 10A) 12, the terminal device 10A includes a processor 11A, a communication interface 12, a display 13, and a memory 14. The communication interface 12, the display 13, and the memory 14 have the same configurations as the communication interface 12, the display 13, and the memory 14 in the above-described embodiment, and therefore a description thereof will be omitted.

[0118] (Processor 11A) The processor 11A executes the programs stored in the memory 14 to function as an acquisition unit 111, a display control unit 112, a recording unit 113, an estimation unit 114, an identification unit 115, and an output unit 116A. The acquisition unit 111, the display control unit 112, the recording unit 113, the estimation unit 114, and the identification unit 115 perform the same processes as the acquisition unit 111, the display control unit 112, the recording unit 113, the estimation unit 114, and the identification unit 115 in the above-described embodiment, and therefore description thereof will be omitted.

[0119] (output section 116A) In addition to the configuration of the output unit 116 described above, the output unit 116A performs output processing to output a control signal to the external drive system 40 via the communication interface 12 to control the optical state of the lens 20 to the optical state identified in the identification processing.

[0120] (Configuration of external drive system 40) The external drive system 40 is attached to the lens 20 to drive the lens 20. As an example, the external drive system 40 drives a focus ring, a zoom ring, and a filter (such as an ND filter) attached to a filter frame. For example, the external drive system 40 changes the focus setting by driving the focus ring. As shown in FIG. 12, the external drive system 40 includes a processor 41, a communication interface 42, and a drive unit 43.

[0121] The processor 41 controls each component of the external drive system 40 by executing a program stored in a memory not shown in Fig. 12. As an example, the processor 41 drives the drive unit 43 in accordance with a control signal obtained via the communication interface 42.

[0122] The communication interface 22 has the same configuration as the communication interface 12 described above, and is an interface for communicating with the terminal device 10.

[0123] The driving unit 43 physically drives the lens 20 in order to change the focus setting of the lens 20 .

[0124] (Effects of Lens Control System 100A) As described above, in lens control system 100A, terminal device 10A outputs a control signal to external drive system 40 to control the lens 20 to the specified optical state. Therefore, in lens control system 100A, even if the lens 20 does not have the function of changing the optical state in accordance with a control signal, the user can easily use a technique for suitably changing the optical state of the lens in accordance with camerawork. In other words, lens control system 100A in which the external drive system 40 changes the optical state of the lens 20 can also achieve the same functions as those of lens control system 100 described above.

[0125] [Embodiment 3] Further, for the sake of convenience, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0126] (Overview and Configuration of Lens Control System 100B) The outline and configuration of a lens control system 100B according to this embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the configuration of the lens control system 100B according to this embodiment.

[0127] 14, the lens control system 100B includes a terminal device 10B, a lens 20, and a sensor 30B. The terminal device 10B and the lens 20, and the terminal device 10B and the sensor 30B are connected so as to be able to transmit and receive information to and from each other.

[0128] In addition to the configuration of the above-described embodiment, in lens control system 100B, sensor 30B outputs a plurality of holding states of camera CA before video shooting using camera CA is performed. Furthermore, while video shooting is being performed using camera CA, terminal device 10B refers to detection values ​​DV representing each of the plurality of holding states output from sensor 30B, and performs identification processing to identify the optical state of lens 20 corresponding to the holding state of camera CA from the estimated correspondence relationship.

[0129] In this embodiment, a case will be described in which the sensor 30B outputs the position, the elevation / depression angle, and the azimuth angle as the support state. In this embodiment, the lens 20 has the same configuration as the lens 20 in the above-described embodiment, and therefore a description thereof will be omitted.

[0130] (Configuration example of sensor 30B) An example of the configuration of the sensor 30B will be described with reference to Fig. 15. Fig. 15 is a diagram showing an example of the configuration of the sensor 30B according to this embodiment.

[0131] 15, camera CA is attached to camera platform PH. Therefore, the position, elevation / depression angles, and azimuth angles of camera platform PH are detected as the position, elevation / depression angles, and azimuth angles of camera CA. As shown in FIG. 15, sensor 30B detects the position of camera CA in the x-axis direction (slider position: Xslid), the elevation / depression angles of camera platform PH (tilt angle: θtilt), and the azimuth angle of camera platform PH (pan angle: θpan). Sensor 30B outputs the detected position, elevation / depression angles, and azimuth angles to terminal device 10B.

[0132] (Configuration of terminal device 10B) 14, the terminal device 10B includes a processor 11B, a communication interface 12, a display 13, and a memory 14. The communication interface 12, the display 13, and the memory 14 have the same configurations as the communication interface 12, the display 13, and the memory 14 in the above-described embodiment, and therefore a description thereof will be omitted.

[0133] (Processor 11B) The processor 11B executes the programs stored in the memory 14 to function as an acquisition unit 111B, a display control unit 112B, a recording unit 113B, an estimation unit 114B, an identification unit 115B, and an output unit 116. The output unit 116 executes the same processing as the output unit 116 in the above-described embodiment, and therefore a description thereof will be omitted.

[0134] (Acquisition part 111B) In addition to the configuration of the acquisition unit 111 described above, the acquisition unit 111B acquires the position, elevation and depression angles, and azimuth angles as the support state of the camera CA from the lens 20 via the communication interface 12 and from the sensor 30B via the communication interface 12.

[0135] (Display control unit 112B) In addition to the configuration of the display control unit 112 described above, the display control unit 112B displays an image including an area DR_P that displays the position, elevation and depression angles, and azimuth angle of the camera CA acquired from the sensor 30.

[0136] Another example of an image displayed on the display 13 by the display control unit 112B will be described with reference to Fig. 16. Fig. 16 is a diagram showing another example of an image displayed on the display 13 while video shooting is being performed using the camera CA in this embodiment.

[0137] As shown in Figure 16, during video shooting using camera CA, the display control unit 112B displays on the display 13 an image including, in addition to the image shown in Figure 5 described above, an area DR_P displaying the elevation and depression angles of camera CA obtained from the sensor 30 and an area DR_T displaying the azimuth angle.

[0138] Furthermore, the display control unit 112B displays on the display 13 an image including an area DR_Z that displays the zoom magnification obtained from the lens 20 as the optical state, as shown in FIG.

[0139] Furthermore, the display control unit 112B displays on the display 13, as shown in FIG. 16, an image including an area DR_IS for accepting an operation to change the optical state of the lens 20 for which support state.

[0140] (Recording unit 113B) In addition to the configuration of the recording unit 113 described above, the recording unit 113B executes a recording process at least twice before video shooting using the camera, in which a detection value DV indicating the position, elevation and depression angles, and azimuth angles of the camera as the support state of the support body, which is obtained from the sensor 30 via the communication interface 12 at a time specified by user operation on the terminal device 10, and a setting value SV indicating the optical state of the lens 20, which is obtained from the lens 20 via the communication interface 12 at the same time, are combined and recorded.

[0141] (Estimation part 114B) In addition to the configuration of the estimation unit 114 described above, the estimation unit 114B performs an estimation process to estimate the correspondence between the position, elevation and depression angles, and azimuth angles of the camera CA, which are the support state of the camera CA, and the optical state of the lens 20, from a combination of the detection value DV and the set value SV recorded in the recording process, before video shooting is performed using the camera CA.

[0142] An example of the processing executed by the estimation unit 114B will be described with reference to Figs. 17 to 19. Fig. 17 is a diagram showing an example of the processing executed by the estimation unit 114B according to this embodiment. Fig. 18 is a diagram showing an example of the optical state (focus position) according to the elevation and depression angles of the camera CA according to this embodiment. Fig. 19 is a diagram showing an example of the optical state according to the azimuth angle of the camera CA according to this embodiment.

[0143] For example, as shown in Figure 17, we will explain the case where the detection value DV when the position of camera CA is Xslid = 10 is recorded as the first detection value DV1, and the detection value DV when the position of camera CA is Xslid = 80 is recorded as the second detection value DV2.

[0144] Also, as shown in Figure 17, we will explain the case where the detection value DV when the tilt angle (elevation / depression angle) of camera CA is θtilt = +45 is recorded as the first detection value DV1, and the detection value DV when the tilt angle of camera CA is θtilt = 0 is recorded as the second detection value DV2.

[0145] In this case, the first set value SV1 is a value indicating the focus position A shown in the upper part of Figure 18, and the second set value SV2 is a value indicating the focus position B shown in the lower part of Figure 18.

[0146] Furthermore, as shown in Figure 17, we will explain the case where the detection value DV when the pan angle (azimuth angle) of camera CA is θpan = +30 is recorded as the first detection value DV1, and the detection value DV when the pan angle of camera CA is θpan = -30 is recorded as the second detection value DV2.

[0147] In this case, the first set value SV1 is a value indicating the focus position A shown on the left side of FIG. 19, and the second set value SV2 is a value indicating the focus position B shown on the right side of FIG. 19.

[0148] 17, in a coordinate system with the horizontal axis representing each support state and the vertical axis representing the set value SV, the estimation unit 114B connects the points of the first detection value DV1 and the first set value SV1 with the points of the second detection value DV2 and the second set value SV2 with straight lines. Then, the estimation unit 114B estimates that the straight lines in the coordinate system represent the correspondence between the support state of the camera CA and the optical state of the lens 20.

[0149] (Specific part 115B) In addition to the configuration of the identification unit 115 described above, the identification unit 115B performs an identification process to identify the optical state of the lens 20 corresponding to the support state represented by the detection value DV obtained from the sensor 30B via the communication interface 12 during video shooting using the camera CA, in accordance with the correspondence estimated in the estimation process.

[0150] For example, the identification unit 115B performs an identification process to identify a support state selected in an area DR_IS included in the image shown in FIG. 16, which accepts an operation to determine which support state is to be used to change the optical state of the lens 20, in accordance with the correspondence estimated in the estimation process.

[0151] As an example, when the acquisition unit 111 acquires information indicating that "Tilt" has been selected in the area DR_IS included in the image shown in Fig. 16, the identification unit 115B identifies the optical state of the lens 20 corresponding to the tilt angle of the camera CA acquired from the sensor 30B by the acquisition unit 111. For example, in the graph shown in Fig. 17, the identification unit 115 identifies the optical state corresponding to the tilt angle of the camera CA acquired from the sensor 30B by the acquisition unit 111.

[0152] For example, if the tilt angle of camera CA obtained from sensor 30B is the tilt angle of camera CA shown in the center of Figure 18, the optical state identified by the identification unit 115 is a value that results in the focus position being position C between A and B, as shown in the center of Figure 18.

[0153] As another example, when the acquisition unit 111 acquires information indicating that "Pan" has been selected in the area DR_IS included in Fig. 16, the identification unit 115B identifies the optical state of the lens 20 corresponding to the pan angle of the camera CA acquired from the sensor 30B by the acquisition unit 111. For example, in the graph shown in Fig. 17, the identification unit 115 identifies the optical state corresponding to the pan angle of the camera CA acquired from the sensor 30B by the acquisition unit 111.

[0154] For example, if the pan angle of camera CA obtained from sensor 30B is the pan angle of camera CA shown in the center of Figure 19, the optical state identified by the identification unit 115 is a value that results in the focus position being position C between A and B, as shown in the center of Figure 19.

[0155] Another example of the process executed by the identification unit 115B will be described with reference to Fig. 20. Fig. 20 is a diagram showing another example of the process executed by the identification unit 115B according to this embodiment.

[0156] For example, when camera CA is manually panned or tilted, the support state does not necessarily change as shown by the straight line at the bottom of Fig. 5. For example, in Fig. 20, the support state may change from position A (Xa, Ya) to position B (Xb, Yb) as shown by the dashed line in Fig. 20.

[0157] In such a case, the specification unit 115B performs the following process, for example, using the actual position as the real position (X, Y). The point (X0, Y0) (hereinafter referred to as the F position (X0, Y0)) at which the following R is smallest is determined as the point on the line connecting A and B (hereinafter referred to as the "ideal line") that is closest to the actual position (X, Y). R=√{(X-X0) 2 +(Y-Y0) 2} As another example, the specification unit 115B performs the following process to find the F position (X0, Y0) using an ideal straight line y=ax+b and a straight line y=cx+d that passes through the actual position and intersects with the ideal straight line perpendicularly. a=(Yb-Ya) / (Xb-Xa) b=0 ·c=-1 / a d=Y-cX=Y+X / a From the above, the F position (X0, Y0) can be calculated as follows: ·X0={a(Yb)+X} / (a 2 +1) Y0=a{a(Yb)+X} / (a 2 +1)+b In this configuration, if lens 20 has a function for automatically adjusting the optical state (for example, an autofocus function), specifying unit 115B may cause lens 20 to perform the function for automatically adjusting the optical state in addition to the specified optical state. That is, specifying unit 115B may instruct lens 20 to temporarily set the optical state of lens 20 corresponding to one of detection values ​​DV, and then to automatically adjust more detailed settings. With this configuration, when the holding state of camera CA changes, terminal device 10B can quickly change the optical state of lens 20 to a state corresponding to the holding state of camera CA.

[0158] (Configuration of sensor 30B) In addition to the configuration of the sensor 30 described above, the sensor 30B is a device that detects the support state (position, elevation / depression angles, and azimuth angles) of the camera CA by the support body and outputs the detected support state. As shown in Fig. 14, the sensor 30B includes a detection unit 31B and a communication interface 32. The communication interface 32 executes the same processing as the communication interface 32 in the above-described embodiment, and therefore a description thereof will be omitted.

[0159] The sensor 30B is not particularly limited as long as it detects the support state of the camera CA by the support and outputs the detected support state. Examples of the sensor 30B include a dedicated support component, such as an encoder installed on the rotation axis of the camera platform PH, and an IMU (Inertial Measurement Unit) built into a smartphone fixed to the camera CA. The method of fixing the camera CA to the smartphone is not particularly limited as long as the relative positional relationship between the camera CA and the smartphone is fixed. The smartphone with the built-in IMU may be a smartphone constituting the terminal devices 10 to 10B, or may be a smartphone different from the terminal devices 10 to 10B, and is not particularly limited. Furthermore, if the smartphone with the built-in IMU is a smartphone constituting the terminal devices 10 to 10B, the acquisition units 110 to 111B acquire the support state detected by the IMU via a communication interface 12 for communication between devices inside the terminal devices 10 to 10B.

[0160] The detector 31B is a component that detects the position, elevation and depression angles, and azimuth angle of the camera CA, which are the support state of the camera CA by the support body. The detector 31B outputs the detected support state to the terminal device 10 via the communication interface 32.

[0161] (Effects of lens control system 100B) Thus, in the lens control system 100B, before video shooting using the camera CA, the terminal device 10B performs a process of recording at least twice the support state of the camera CA by combining detection values ​​DV representing multiple support states (position, elevation / depression angles, and azimuth angles) with setting values ​​SV representing the optical state of the lens 20, and estimates the correspondence between the support state of the camera CA and the optical state of the lens from the combination of the recorded detection values ​​DV (first detection value DV1 and second detection value DV2) and setting values ​​SV (first setting value SV1 and second setting value SV2).

[0162] In addition, while video shooting is being performed using the camera CA, the terminal device 10B repeats a determination process of determining the optical state of the lens 20 corresponding to at least one of the multiple support states of the camera CA according to the estimated correspondence, and an output process of outputting a control signal to the lens 20 to control the lens 20 to the determined optical state.

[0163] With this configuration, the lens control system 100 can change the optical state of the lens 20 in response to changes in the support state, even for camerawork that changes various support states such as the position, elevation angle, and azimuth angle of the camera CA.

[0164] [Variations] The support may be a multi-angle unit MAU and a tripod TR in addition to or instead of the above-described camera platform PH and slider SL. A case in which the support is a multi-angle unit MAU and a tripod TR will be described with reference to FIGS. 21 and 22. FIG. 21 is a diagram showing an example of the optical state (focus position) depending on the support state of the multi-angle unit MAU and the tripod TR in this modified example. FIG. 22 is a diagram showing another example of the optical state (focus position) depending on the support state of the multi-angle unit MAU and the tripod TR in this modified example.

[0165] As an example of a case where the support is a multi-angle unit MAU and a tripod TR, the sensor 30 outputs the angle u between one of the legs of the tripod TR (for example, the central leg that appears vertical in FIG. 21) and the arm on which the camera CA is installed as a support state representing the position, as shown in FIG. 21.

[0166] As an example, we will explain the case where the detection value DV when the angle u is less than 90 degrees is recorded as the first detection value DV1, as shown in the upper part of Figure 21, and the detection value DV when the angle u is greater than 90 degrees is recorded as the second detection value DV2, as shown in the lower part of Figure 21.

[0167] In this case, the focal position is close to the camera CA when the angle u is less than 90 degrees, and is far from the camera CA when the angle u is greater than 90 degrees, as shown in FIG.

[0168] In this case, as shown in the center of Figure 21, when the angle u is 90 degrees, the terminal device 10 identifies, as the focus position, position C, which is farther away than when the angle u is less than 90 degrees and closer than when the angle u is greater than 90 degrees.

[0169] As another example when the support is a multi-angle unit MAU and a tripod TR, the sensor 30 outputs the angle v between one of the legs of the tripod TR (for example, the leg extending toward the subject in FIG. 22) and the arm on which the camera CA is installed, as shown in FIG. 22 (in FIG. 22, the leg extending toward the subject of the tripod TR is used as the reference, with the upper side being positive and the lower side being negative).

[0170] As an example, we will explain the case where the detection value DV when the angle v is negative is recorded as the first detection value DV1, as shown in the upper part of Figure 22, and the detection value DV when the angle v is positive is recorded as the second detection value DV2, as shown in the lower part of Figure 22.

[0171] In this case, the focal position is close to the camera CA when the angle v is negative, and far from the camera CA when the angle v is positive, as shown in FIG.

[0172] In this case, as shown in the center of FIG. 22, when the angle v is 0, the terminal device 10 identifies, as the focal position, position C that is farther away than when the angle v is negative and closer than when the angle v is positive.

[0173] [Software implementation example] The functions of each of the terminal devices 10, 10A, and 10B (hereinafter referred to as "devices") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly the blocks in which processors 11, 11A, and 11B function).

[0174] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0175] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0176] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0177] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0178] [Additional Notes] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

[0179] 〔summary〕 As can be understood from the above description, the present invention includes the following aspects.

[0180] Aspect 1: A terminal device (10) including a processor (11) and a communication interface (12) for communicating with a camera (CA) and / or a lens (20) attached to the camera, and a sensor (30) that detects a support state of a support that supports the camera, wherein the processor combines a detection value that indicates the support state of the camera by the support, obtained from the sensor via the communication interface at a time designated by a user operation on the terminal device, before video shooting using the camera, and a setting value that indicates the optical state of the lens, obtained from at least one of the camera and the lens via the communication interface at the time designated. and an estimation process for estimating a correspondence relationship between the holding state of the camera and the optical state of the lens from a combination of the detection values ​​and the setting values ​​recorded in the recording process, and controlling the lens by repeating the following processes during video shooting using the camera: an identification process for identifying the optical state of the lens corresponding to the holding state represented by the detection values ​​acquired from the sensor via the communication interface, in accordance with the correspondence relationship estimated in the estimation process; and an output process for outputting, via the communication interface, a control signal for controlling the optical state of the lens to the optical state identified in the identification process.

[0181] Aspect 2: The program described in Aspect 1, characterized in that in the estimation process, the processor executes a process to estimate that the optical state corresponding to the two support states recorded in the recording process is a numerical value between the two optical states recorded in the recording process as the correspondence relationship.

[0182] Aspect 3: The program described in aspect 2, characterized in that in the estimation process, the processor executes a process to estimate that the optical state corresponding to the two support states recorded in the recording process as the correspondence is a numerical value on a line that continuously connects the two combinations of the support states and the optical states recorded in the recording process with a straight line or curve.

[0183] Aspect 4: The terminal device further includes a display (13) that displays an image, and a touchpad (131) that is superimposed on the display and accepts operations on the display, and the processor displays an image on the display that includes a user interface that accepts user operations to execute the recording process, and executes a process to obtain information representing the user operations via the touchpad, according to any of aspects 1 to 3.

[0184] Aspect 5: A program described in any of aspects 1 to 4, characterized in that, in the output processing, the processor executes a process of outputting the control signal to at least one of the camera and the lens via the communication interface.

[0185] Aspect 6: A program described in any of aspects 1 to 4, characterized in that, in the output processing, the processor executes a process of outputting the control signal via the communication interface to a driving device that changes the optical state of the lens.

[0186] Aspect 7: The terminal device according to any one of aspects 1 to 6, wherein the detection value represents at least one of the position of the camera, the elevation / depression angle of the camera, and the azimuth angle of the camera.

[0187] Aspect 8: The terminal device according to any one of aspects 1 to 7, wherein the setting value indicates at least one of a focal length, a zoom magnification, an aperture, and an ND (Neutral Density) filter.

[0188] Aspect 9: A lens control system comprising a terminal device and a sensor that detects a support state of a support that supports a camera to which a lens is attached, wherein the sensor comprises a detection unit and a communication interface for communicating with the terminal device, the detection unit detects a support state of the camera by the support and outputs a detection value representing the detected support state to the terminal device via the communication interface, the terminal device comprises a processor and a communication interface for communicating with at least one of a camera and a lens attached to the camera, and the sensor, and the processor, before video shooting using the camera, detects the detection value acquired from the sensor via the communication interface at a time specified by a user operation on the terminal device and outputs a detection value representing a previous support state via the communication interface at the time. a recording process for recording a combination of the detection values ​​acquired from the sensor via the communication interface and a setting value representing the optical state of the lens, the recording process being performed at least twice; and an estimation process for estimating a correspondence relationship between a holding state of the camera and an optical state of the lens from a combination of the detection values ​​and the setting values ​​recorded in the recording process, and controlling the lens by repeating the following processes during video shooting using the camera: an identification process for identifying the optical state of the lens corresponding to the holding state represented by the detection values ​​acquired from the sensor via the communication interface, in accordance with the correspondence relationship estimated in the estimation process; and an output process for outputting, via the communication interface, a control signal for controlling the optical state of the lens to the optical state identified in the identification process.

[0189] Aspect 10: A program that causes a computer to function as a terminal device having a processor and a communication interface for communicating with a sensor that detects a camera and / or a lens attached to the camera, and a support state of a support that supports the camera, the program causing the processor to store a combination of a detection value that indicates the support state of the camera by the support, which is acquired from the sensor via the communication interface at a time designated by a user operation on the terminal device before video shooting using the camera, and a setting value that indicates the optical state of the lens, which is acquired from at least one of the camera and the lens via the communication interface at the time designated. and executing an estimation process of estimating a correspondence relationship between a holding state of the camera and an optical state of the lens from a combination of the detection values ​​and the setting values ​​recorded in the recording process, and controlling the lens by repeating the following processes during video shooting using the camera: an identification process of identifying the optical state of the lens corresponding to the holding state represented by the detection values ​​acquired from the sensor via the communication interface, in accordance with the correspondence relationship estimated in the estimation process; and an output process of outputting, via the communication interface, a control signal for controlling the optical state of the lens to the optical state identified in the identification process. [Explanation of symbols]

[0190] 10, 10A, 10B terminal equipment 11, 11A, 11B, 21, 41 processors 12, 22, 32, 42 communication interface 13. Display 14 Memory 20 lenses 30, 30B sensor 40 External drive system (drive unit) 100, 100A, 100B Lens Control System 111, 111B Acquisition Department 112, 112B Display control unit 113, 113B Recording section 114, 114B Estimation part 115, 115B Specific part 116, 116A output section 131 Touchpad DV detection value SV setting value

Claims

1. a processor; a communication interface for communicating with a camera, a lens attached to the camera, and a sensor for detecting a support state of a support for supporting the camera; A terminal device comprising: The processor: Before video shooting using the camera is performed, a recording process is performed at least twice to combine and record detection values ​​indicating the support state of the camera by the support body, which are obtained from the sensor via the communication interface at a time point designated by a user operation on the terminal device, and setting values ​​indicating the optical state of the lens, which are obtained from at least one of the camera and the lens via the communication interface at the time point, and to estimate a correspondence relationship between the support state of the camera and the optical state of the lens from the combination of the detection values ​​and the setting values ​​recorded in the recording process; During video shooting using the camera, the lens is controlled by repeating a determination process of determining an optical state of the lens corresponding to the support state represented by the detection value acquired from the sensor via the communication interface, in accordance with the correspondence estimated in the estimation process, and an output process of outputting, via the communication interface, a control signal for controlling the optical state of the lens to the optical state determined in the determination process. A terminal device characterized by:

2. the processor executes a process of estimating, as the correspondence relationship, that an optical state corresponding to the two support states recorded in the recording process is a numerical value between the two optical states recorded in the recording process.

2. The terminal device according to claim 1, wherein:

3. In the estimation process, the processor executes a process of estimating, as the correspondence relationship, that the optical state corresponding to the two support states recorded in the recording process is a numerical value on a line continuously connecting two combinations of the support states and the optical states recorded in the recording process with a straight line or a curve.

3. The terminal device according to claim 2.

4. The terminal device a display for displaying an image; a touch pad disposed over the display and configured to receive operations on the display; Furthermore, The processor: displaying on the display an image including a user interface for accepting a user operation to execute the recording process; executes a process of acquiring information representing the user operation via the touchpad; 4. The terminal device according to claim 1, wherein the terminal device is a terminal device having a plurality of terminals.

5. In the output process, the processor executes a process of outputting the control signal to at least one of the camera and the lens via the communication interface.

4. The terminal device according to claim 1, wherein the terminal device is a terminal device having a plurality of terminals.

6. In the output process, the processor executes a process of outputting the control signal via the communication interface to a driving device that changes the optical state of the lens.

4. The terminal device according to claim 1, wherein the terminal device is a terminal device having a plurality of terminals.

7. the detected value represents at least one of a position of the camera, an elevation / depression angle of the camera, and an azimuth angle of the camera; 4. The terminal device according to claim 1, wherein the terminal device is a terminal device having a plurality of terminals.

8. The setting value indicates at least one of a focal length, a zoom magnification, an aperture, and an ND (Neutral Density) filter.

4. The terminal device according to claim 1, wherein the terminal device is a terminal device having a plurality of terminals.

9. A lens control system including a terminal device and a sensor for detecting a support state of a support for supporting a camera to which a lens is attached, The sensor A detection unit; a communication interface for communicating with the terminal device; Equipped with the detection unit detects a support state of the camera by the support body, and outputs a detection value representing the detected support state to the terminal device via the communication interface; The terminal device a processor; a communication interface for communicating with at least one of a camera and a lens attached to the camera, and the sensor; Equipped with The processor: Before video shooting using the camera is performed, a recording process is performed at least twice to combine and record the detection value obtained from the sensor via the communication interface at a time point designated by a user operation on the terminal device and a setting value indicating an optical state of the lens obtained from at least one of the camera and the lens via the communication interface at the time point, and an estimation process is performed to estimate a correspondence relationship between the holding state of the camera and the optical state of the lens from the combination of the detection value and the setting value recorded in the recording process; During video shooting using the camera, the lens is controlled by repeating a determination process of determining an optical state of the lens corresponding to the support state represented by the detection value acquired from the sensor via the communication interface, in accordance with the correspondence estimated in the estimation process, and an output process of outputting, via the communication interface, a control signal for controlling the optical state of the lens to the optical state determined in the determination process. A lens control system comprising:

10. a processor; a communication interface for communicating with a camera, a lens attached to the camera, and a sensor for detecting a support state of a support for supporting the camera; A program that causes a computer to function as a terminal device comprising: the processor, Before video shooting using the camera is performed, a recording process is performed at least twice to combine and record detection values ​​indicating the support state of the camera by the support body, which are obtained from the sensor via the communication interface at a time point designated by a user operation on the terminal device, and setting values ​​indicating the optical state of the lens, which are obtained from at least one of the camera and the lens via the communication interface at the time point, and to perform an estimation process to estimate a correspondence relationship between the support state of the camera and the optical state of the lens from the combination of the detection values ​​and the setting values ​​recorded in the recording process; During video shooting using the camera, the lens is controlled by repeating a determination process of determining an optical state of the lens corresponding to the support state represented by the detection value acquired from the sensor via the communication interface in accordance with the correspondence estimated in the determination process, and an output process of outputting, via the communication interface, a control signal for controlling the optical state of the lens to the optical state determined in the determination process. A program characterized by:

Images