Imaging apparatus, program, and storage medium

Abstract

To provide an imaging apparatus that enables photography according to user's intended settings even when the center of gravity changes due to the length or weight of an interchangeable lens attached to a device.SOLUTION: The Imaging apparatus has an imaging unit having an imaging element, a position acquisition unit capable of acquiring the position of the imaging unit, and a setting storage unit for storing settings related to photographing conditions using the imaging unit. The setting storage unit is configured to update the settings according to the position of the imaging unit.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] This invention relates to a camera whose shooting direction can be changed in the panning and tilting directions. [Background technology]

[0002] In the field of video production, imaging devices that can change the shooting direction in the pan and tilt directions are often used. These imaging devices have a preset function that allows users to save settings such as pan and tilt directions in advance and then reproduce those settings.

[0003] Among the imaging devices with the preset function described above, there are some that allow interchangeable lenses to be attached or detached. When the interchangeable lens is changed, the focal length and shooting range also change. Patent Document 1 discloses a technology that updates the settings of the preset function according to the interchangeable lens attached. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2017-224932 Summary of the Invention [Problem to be solved by the invention]

[0005] Patent Document 1 does not take into consideration that the center of gravity of an imaging device when an interchangeable lens is attached changes depending on the length and weight of the interchangeable lens.

[0006] Therefore, the present invention aims to enable a user to take photographs using the settings intended by the user even when the center of gravity of an imaging device with an interchangeable lens attached changes depending on the length and weight of the interchangeable lens. [Means for solving the problem]

[0007] In order to solve the above problem, the present invention is characterized in that it comprises an imaging unit having an image sensor, a position acquisition unit capable of acquiring the position of the imaging unit, and a setting storage unit that stores settings related to the conditions for photographing using the imaging unit, and the setting storage unit is configured to update the settings depending on the position of the imaging unit. [Effects of the Invention]

[0008] According to the present invention, even if the center of gravity of an imaging device when an interchangeable lens is attached changes depending on the length or weight of the interchangeable lens, it is possible to realize photography using the settings intended by the user. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an imaging system including an imaging apparatus according to an embodiment. [Figure 2] FIG. 1 is a diagram showing an example of the configuration of an imaging apparatus according to an embodiment. [Figure 3] FIG. 2 is a diagram showing an example of the configuration of a client device connected to the imaging device according to the embodiment via the Internet. [Figure 4] FIG. 2 is a diagram showing an example of the configuration of a server device connected to an imaging device according to an embodiment. [Figure 5] FIG. 2 is a diagram showing an example of a mechanism of an imaging apparatus according to an embodiment. [Figure 6] 3 shows an example of a functional configuration of an imaging device according to an embodiment. [Figure 7] FIG. 10 is a conceptual diagram illustrating updating the setting contents of the setting storage unit according to the position of the imaging unit. [Figure 8] 10 is a flowchart showing an example of the operation of the imaging system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The embodiments described below are examples of means for realizing the present invention, and should be appropriately modified or changed depending on the configuration of the device to which the present invention is applied and various conditions. The present invention is not limited to the following embodiments. Furthermore, the present invention may be configured by appropriately combining parts of each embodiment described below.

[0011] <Example> (System Configuration) FIG. 1 is a diagram illustrating an example of the configuration of an imaging system including an imaging device according to this embodiment. The imaging system 100 includes an imaging device 101, a server device 102, an input device 103, a display device 104, a network 105, multiple client devices 106, a display device 107, an input device 108, and a switch 109. For example, the imaging device 101 may be a single device, or multiple imaging devices may be connected to the server device 102. The imaging device 101 transmits captured video to the server device 102 via the switch 109. A LAN cable is assumed as the connection method, but other methods are also acceptable, such as SDI, HDMI (registered trademark), wireless LAN, and UVC. In the case of a LAN cable, it is assumed that up to approximately 100 devices can be connected. The server device 102 is connected to an input device 103, a display device 104, and a network 105. The input device 103 is a user interface capable of operating a camera, such as a keyboard or a multi-directional input stick controller, and is capable of operating the imaging device 101. The display device 104 can display video captured by the imaging device 101. The network 105 is connected to the client device 106, allowing the video distributed from the server device 102 to be viewed on the client device 106. As an example, three client devices 106, client device 106a, client device 106b, and client device 106c, are connected to the network 105. The client device 106 is also connected to a display device 107 and an input device 108. The client device 106 can request video distribution from the server device 102 via the network 105, and the received distributed video is displayed on the display device 107. The input device 108 is a keyboard, mouse, or the like, and is used to operate the client device 106. The switch 109 is assumed to be a network hub if the connection method is LAN, or a distributor if the connection method is HDMI. The input device 110 is a user interface capable of operating a camera, such as a keyboard or a multi-directional input stick controller, similar to the input device 103, and can operate the imaging device 101.

[0012] In this embodiment, the client device 106, the display device 107, and the input device 108 are separate entities, but they may be integrated into one device, such as a notebook PC with a touch panel display. Similarly, the input device 103 and the display device 104 are separate entities, but they may be integrated into one device, such as a controller with an integrated panel.

[0013] (Internal configuration of the imaging device) 2 is a diagram showing an example of the configuration of an image capturing apparatus according to this embodiment. The image capturing apparatus 101 includes an image capturing unit 201, an encoder unit 202, a network I / F 203, a CPU 204, a RAM 205, and a ROM 206.

[0014] The imaging optical system 200 is detachable from a mounting portion (not shown) of the imaging device 101. The imaging device 101 can acquire lens information of the imaging optical system 200 via electronic contacts provided in the mounting portion. The lens information is, for example, information indicating the type of the imaging optical system 200 (identification information corresponding to the lens model, attribute information indicating the functions that can be realized, etc.) and information regarding the shooting conditions (focal length, focus position, aperture value, etc.).

[0015] The imaging optical system 200 (also called an interchangeable lens) is a lens that focuses light from a subject onto the imaging surface of an imaging element 201a (described later), and is composed of, for example, a zoom lens, a focus lens, and a blur correction lens.

[0016] The imaging unit 201 captures an image of a subject using an imaging optical system 200 and generates an image. The imaging unit 201 has an image sensor 201a, an amplifier 201b, and an image processing unit 201c. Exposure parameters can be set and changed for each pixel group consisting of multiple pixels (e.g., 128 x 128 pixels) on the imaging surface. The exposure parameters are parameters related to exposure, and include exposure time, analog gain, and exposure value.

[0017] The image sensor 201a converts light from the subject, which is focused on the imaging surface by the imaging optical system 200, into an electrical signal for each pixel and outputs the signal. The image sensor 201a captures an image of the subject using an exposure time for each pixel group according to set exposure parameters. The image sensor 201a is, for example, an IC chip on which pixels, each made of photoelectric conversion elements such as a CCD sensor or a CMOS sensor, are arranged in a matrix. The image sensor 201a is primarily sensitive to visible light, with each pixel having high sensitivity to red (R), green (G), or blue (B), but also has some sensitivity to infrared light. This allows for clear imaging of subjects bright with infrared light, such as during times of day when sunlight is present or in places illuminated by infrared lighting.

[0018] The amplifier 201b amplifies and outputs the electrical signal output from the image sensor 201a. The amplifier 201b is provided for each pixel or pixel group, and the signal amplification factor (analog gain) is set according to the exposure parameters for each pixel group.

[0019] The image processing unit 201c performs A / D conversion of the analog electrical signal output from the amplifier 201b into a digital signal, and performs image processing including demosaicing, white balance processing, and gamma processing to generate a digital image. The image processing unit 201c corrects image brightness by amplifying or attenuating the digital value of the image signal output from each pixel or pixel group for each pixel or pixel group. Electronic image stabilization is also performed based on attitude information from the sensor unit at the time of attachment. Electronic image stabilization is capable of correcting image shake, and performs pan / tilt shift correction and roll angle correction. The sensor unit is, for example, a gyro sensor, and can obtain the attitude angle of the imaging device 101 by vector detection.

[0020] The encoder unit 202 encodes the image data output from the imaging unit 201 (image processing unit 201c) into a predetermined file format such as Motion JPEG, H264, or H265.

[0021] The network I / F 203 transmits the image data that has been encoded by the encoder unit 202 to the client device 106 via the network 105. The encoded image data may be stored in an internal storage device such as a RAM 205 or a ROM 206 (described later) or in a removable storage medium (not shown) such as an SD card. Storage in these cases may also be performed after the image data is output from the image processing unit 201c. In this case, the image data is saved as RAW data before encoding. The network I / F 203 also accepts operations and instructions for the imaging device 101 from the server device 102 or the client device 106 via the network. The accepted content includes, for example, changes to the settings of the functions of the imaging device 101.

[0022] The CPU 204 is a central processing unit that controls the image capturing apparatus 101 .

[0023] The RAM 205 temporarily stores computer programs executed by the CPU 204. The RAM 205 also provides a work area used when the CPU 204 executes processing. The RAM 205 also functions as a frame memory and a buffer memory.

[0024] The ROM 206 stores a program for the CPU 204 to control the image capturing apparatus 101 and the like.

[0025] The driving unit 207 is a driving unit for changing the imaging angle of view of the imaging device 101. It is assumed that a stepping motor, a DC (Direct Current) motor, a brushed motor, a brushless motor, or the like is used, and one is provided for each of the pan and tilt rotation axes.

[0026] (Internal configuration of the client device) 3 is a diagram showing an example of the configuration of a client device connected to the imaging device according to this embodiment via the Internet. The client device 106 is an information processing device having a CPU 301, a RAM 302, a ROM 303, an input I / F 304, an output I / F 305, and a network I / F 306.

[0027] The CPU 301 is a central processing unit that controls the client device 106 .

[0028] The RAM 302 has a work area in which the CPU 301 temporarily stores programs and the like for controlling the client device 106 .

[0029] The ROM 303 stores a program for the CPU 301 to control the client device 106 and the like.

[0030] The input I / F 304 is an interface that is connected to the input device 108 and that accepts operations for the client device 106 input by the user via the input device 108 .

[0031] The output I / F 305 is an interface that connects to the display device 107 and causes the image output from the imaging device 101 to be displayed on the display device 107 .

[0032] The network I / F 306 is an interface that connects to the image capturing apparatus 101 via the network 105 , and is used to input operation information for the image capturing apparatus 101 and to receive images output from the image capturing apparatus 101 .

[0033] (Internal configuration of the server device) 4 is a diagram showing an example of the configuration of a server device connected to the imaging device according to this embodiment. The server device 102 is an information processing device having a CPU 401, a RAM 402, a ROM 403, a video input I / F 404, an input I / F 405, an output I / F 406, and a network I / F 407.

[0034] The CPU 401 is a central processing unit that controls the server device 102 .

[0035] The RAM 402 has a work area for temporarily storing programs for the CPU 401 to control the server device 102, images input from the imaging device 101, and the like.

[0036] The ROM 403 stores a program for the CPU 401 to control the server device 102, images input from the imaging device 101, and the like.

[0037] The video input I / F 404 is connected to the imaging device 101 via a LAN cable, an HDMI cable, an SDI cable, a wireless LAN, or a USB cable, and an image captured by the imaging device 101 is input to the server device 102.

[0038] The input I / F 405 is an interface that is connected to the input device 103 and receives operations for the server device 102 inputted by the server administrator via the input device.

[0039] The output I / F 406 is an interface that is connected to the display device 104 to display the image output from the imaging device 101 on the display device 104 .

[0040] The network I / F 407 is an interface that connects a LAN cable or the like to the network 105. Images captured by the video device 101 and input to the server device 102 are distributed to the client device 106 via the network 105. It is also an interface that receives a video distribution request from the client device 106 and distributes the video.

[0041] (Mechanism of imaging device) FIG. 5 is a diagram showing an example of the mechanism of the imaging device 101 according to this embodiment, viewed from above. As described above, the imaging optical system 200 is detachable from the imaging unit 201. The imaging unit 201 has a mechanism that allows it to be shifted in the optical axis direction relative to the imaging device 101. This shift mechanism is used to adjust the center of gravity of the imaging unit 201 to which the imaging optical system 200 is attached, depending on the weight and length of the imaging optical system 200. The black circle in the diagram indicates the rotation center of the drive unit 207 in the pan direction. FIG. 5(a) is a diagram showing a case where a short imaging optical system 200 is attached, and FIG. 5(b) is a diagram showing a case where a long imaging optical system 200 is attached. In FIG. 5(a), because the imaging optical system 200 is short, the imaging unit 201 is shifted upward in the diagram, and the center of gravity is moved closer to or near the rotation center of the black circle in the diagram. 5(b), because the imaging optical system 200 is long, the imaging unit 201 is shifted downward in the figure to bring the center of gravity closer to the center of rotation indicated by the black circle in the figure or its vicinity. The imaging unit 201 in this embodiment is assumed to be manually shifted in the optical axis direction by a user, but a drive unit (not shown) may be provided to realize electrically driven shifting.

[0042] (Functional configuration) FIG. 6 is a diagram illustrating an example of the functional configuration of the imaging device 101 according to this embodiment. Of the functional blocks illustrated in FIG. 6, functions implemented by software are implemented by storing a program in a memory such as the ROM 206. The program is then read into the RAM 205 and executed by the CPU 204. Functions implemented by hardware are implemented by an FPGA reading data from a memory such as the ROM 206 and generating a circuit. FPGA stands for Field Programmable Gate Array. Alternatively, a gate array circuit may be formed in a similar manner to an FPGA to implement the functions as hardware. Alternatively, the functions may be implemented by an ASIC (Application Specific Integrated Circuit). The functional block configuration illustrated in FIG. 6 is merely an example, and multiple functional blocks may form one functional block, or any functional block may be divided into blocks performing multiple functions.

[0043] The position acquisition unit 601 detects the position of the imaging unit 201. In this embodiment, it is assumed that a position detection sensor capable of acquiring absolute position is used for position detection, but an incremental system or a configuration using a mechanical switch for position detection may also be used. Also, a scale may be engraved on the mechanism, and the user may manually input a value corresponding to the position measured visually by the user.

[0044] The setting storage unit 602 stores settings related to image capture made by the user. By storing settings previously set (preset) by the user, image capture under the set conditions can be easily reproduced. Settings that can be stored include all settings that can be set by the user for the image capture device 101, such as coordinates in the pan or tilt direction by the drive unit 207 and the focal length (or zoom magnification) of the image capture optical system 200.

[0045] When saving the settings, the setting saving unit 602 saves the settings in association with the position of the image capturing unit 201 acquired by the position acquiring unit 601. The setting saving unit 602 may be provided in the server device 102, the client device 106, or the like, instead of the image capturing device 101.

[0046] (Functional concept) FIG. 7 is a conceptual diagram illustrating updating the settings stored in the setting storage unit 602 according to the position of the imaging unit 201. FIG. 7(a) shows a state in which the imaging device 101 captures an image within a range of an angle of view 700, and an object plane 703 indicates the plane on which the object to be captured is located. The angle of view 700 captures an image capture range 704 that intersects with the object plane 703. The center of gravity of the imaging optical system 200 and the imaging unit 201 is located at a position that overlaps with the black circle indicating the center of rotation of the drive unit 207. FIG. 7(b) shows a state in which the imaging optical system 200 has been changed from that shown in FIG. 7(a). Specifically, it is assumed that the imaging optical system 200 has been replaced with a heavier imaging optical system 200 having the same focal length. In this case, the imaging optical system 200 becomes heavier, and the center of gravity of the imaging unit 201 and the imaging unit 201 is shifted closer to the imaging optical system 200. Therefore, the imaging optical system 200 and the imaging unit 201 are shifted rearward along the optical axis so as to approach the black circle indicating the rotation center of the drive unit 207. Here, the angle of view 701 indicated by the dashed line is the angle of view 700 in FIG. 1A, because the imaging optical system 200 has been shifted rearward, the imaging range 705 on the object plane 703 is wider than the imaging range 704. This means that the content saved in the setting saving unit 602 is applied with the wider imaging range, resulting in captured images that differ from those intended at the time the settings were saved. Therefore, to change the angle of view 701 to the angle of view 702, for example, the focal length is changed, and the imaging range 706 on the object plane 703 is adjusted to be equal to the imaging range 704. This makes it possible to continue capturing images as intended with the settings saved in the setting saving unit 602 when the angle of view 700 (imaging range 704) was set, even after replacing the imaging optical system 200.

[0047] (Operation description) 8 is a flowchart showing an example of the operation of the imaging system according to this embodiment. This operation is started by loading a program stored in a storage medium such as the ROM 206 in the imaging device 101, and having the CPU 204 read and execute the program using a memory such as the RAM 205 as a work area. Before the operation starts, it is assumed that settings have been saved in the setting saving unit 602 in advance. Details of the operation will be explained below.

[0048] In step S801, the settings stored in the setting storage unit 602 are read out. The settings to be read out include the position information of the image capture unit 201 at the time the settings were stored.

[0049] In step S802, the current position information of the image capturing unit 201 is read from the position acquisition unit 601.

[0050] In step S803, the position information of the image capturing unit 201 at the time of saving the settings, acquired in step S801, is compared with the current position information of the image capturing unit 201, acquired in step S802. If the comparison shows that the position information has changed, the process proceeds to step S804; if there has been no change, the process ends.

[0051] In step S804, the settings saved in the setting saving unit 602 are updated based on the current position information of the imaging unit 201 acquired in step S802. For example, when updating the settings so that the angle of view is the same as when the settings were saved, the focal length setting is updated taking into account the current position of the imaging unit 201. The focal length may be updated by calculation each time from the position and focal length of the imaging unit 201 when the settings were saved or the current position and focal length of the imaging unit 201. Alternatively, a table may be used that stores a corrected focal length or a correction value for calculating the focal length according to the focal length and the position of the imaging unit. Furthermore, a table may be used that stores focal length values ​​to be set for each type of imaging optical system 200, taking into account that the position of the imaging unit 201 has a one-to-one relationship for each type of imaging optical system 200. This table may be stored according to the angle of view to be set. For example, the focal length setting that maintains the angle of view can be updated by acquiring information about the type of imaging optical system 200 from the imaging optical system 200 via communication and referring to the table.

[0052] The setting update process described above can also be applied to settings other than focal length.

[0053] Furthermore, if the updated focal length is longer than the focal length of the imaging optical system 200 when the settings were saved, the pan speed is updated so that it is set slower. This makes it possible to change the rate of change of the image to be equal to the rate of change when panning is performed with the imaging optical system 200 before the change. After the update is complete, the process ends.

[0054] By performing the above-described control, it is possible to update the setting storage unit 602 taking into consideration the position shift of the imaging unit 201.

[0055] <Other Examples> In this embodiment, the imaging device 101 and the imaging optical system 200 are provided as separate units that can be attached and detached. However, the imaging device 101 may have the imaging optical system 200, as in an integrated lens camera. For example, if the center of gravity of the imaging device 101 and the imaging optical system 200 differs depending on the position of each lens in the imaging optical system 200, it is possible to change the position of the imaging device 101. The change in the position of the imaging device 101 is replaced with the change in the position of the imaging unit 201 in the above-described embodiment, and the settings saved in the setting saving unit 602 are updated in the same way. This makes it possible to capture images that reproduce the conditions previously set by the user even in an integrated lens camera or the like.

[0056] In the above embodiment, correction control is described as being performed in the imaging device 101, but it may also be executed in the server device 102. In this case, the correction control is realized by reading a program stored in a storage medium such as the ROM 403 in the server device 102, and having the CPU 401 read and execute the program using a memory such as the RAM 402 as a work area.

[0057] The present invention can also be realized by reading and executing a program that realizes the functions of the above-described embodiments. This program is supplied to a system or device via a network or a storage medium, and is read and executed by one or more processors in the computer of the system or device. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions. [Explanation of symbols]

[0058] 101 Imaging device 201 Imaging unit 601 Position acquisition part 602 Settings storage section

Claims

1. an imaging unit having an imaging element; a position acquisition unit capable of acquiring the position of the imaging unit; a setting storage unit that stores settings related to conditions for photographing using the imaging unit, The imaging device, wherein the setting storage unit updates the setting depending on the position of the imaging unit.

2. 2. The imaging device according to claim 1, wherein the setting storage section stores the settings in association with information about an interchangeable lens that was attached when the settings were saved.

3. The setting is a focal length, The imaging device according to claim 1 or claim 2, characterized in that the setting saving unit obtains a focal length that results in an angle of view equal to the angle of view of the setting saved in the setting saving unit when the setting was saved, from the focal length of the interchangeable lens that was attached when the setting saved in the setting saving unit was saved and the position of the imaging unit when the setting was saved, as well as the focal length of a newly attached interchangeable lens and the position of the imaging unit corresponding to that interchangeable lens, and updates the setting.

4. The setting is the pan speed, The imaging device according to any one of claims 1 to 3, characterized in that, when the focal length of the setting updated to correspond to the newly attached interchangeable lens is longer than the focal length of the interchangeable lens that was attached when the setting saved in the setting saving unit was saved, the setting saving unit updates the setting to a pan speed that is slower than the pan speed saved in association with the interchangeable lens that was attached when the setting saved in the setting saving unit was saved.

5. 5. The imaging device according to claim 1, further comprising a mounting section to which an interchangeable lens can be attached, wherein the setting storage section updates the settings based on lens information obtained from the interchangeable lens via electronic contacts provided on the mounting section.

6. 6. The imaging device according to claim 1, wherein the position acquisition unit acquires position information input by a user.

7. 6. The imaging device according to claim 1, further comprising a position detection sensor in addition to the imaging device, and the imaging device is caused to acquire position information obtained by the position detection sensor.

8. A program for causing a computer to execute the method for controlling an imaging device according to any one of claims 1 to 5.

9. A computer-readable storage medium storing the program according to claim 8.

Images