Lens device, imaging device, method of operation of lens device, method of operation of imaging device, and storage medium

Abstract

A lens device of the present application is a lens device provided in a camera body having an image sensor, which includes a processor, a memory connected to or built in the processor, a lens including a moving lens and imaging incident light on the image sensor, and a driving mechanism that moves the moving lens by imparting power to the moving lens along a coordinate plane intersecting an optical axis of the lens. The processor controls the driving mechanism to change a movement amount of the moving lens in accordance with a wavelength band of light transmitted through the moving lens.

Description

TECHNICAL FIELD

[0001] The technology of the present application relates to a lens device, an image pickup device, a method for operating a lens device, a method for operating an image pickup device, and a storage medium. BACKGROUND

[0002] In Japanese Patent Application Publication No. 2017-44878, there is disclosed an image pickup device characterized by including: an image pickup member that picks up an object through an image pickup optical system; first and second image blur correction members that correct image blur of an image of the object; and a control member that performs control of acquiring a detection signal of a shake and controlling the first and second image blur correction members to correct the image blur, and performs control of acquiring a pixel shift of a plurality of images while moving the first or second image blur correction member or the first and second image blur correction members.

[0003] In Japanese Patent Application Publication No. 2014-21349, there is disclosed an image acquisition method, which is an image acquisition method based on an image pickup device configured to have at least a part of a lens group or a lens constituting a photographing lens as a movable lens group, and to move the movable lens group by a control section to have a component in a direction orthogonal to an optical axis, the image acquisition method characterized by comprising: a step of acquiring two or more images different in position of the optical axis on an image pickup surface by moving the movable lens group to displace the optical axis of the photographing lens on the image pickup surface; and a step of generating one image by synthesizing the two or more images.

[0004] In Japanese Patent Application Publication No. 2000-13670, there is disclosed an image pickup device characterized by including: an image pickup member; a shake detection member that detects a shake; an image blur correction member that corrects image blur based on an output of the shake detection member; a pixel shift member that slightly displaces a position of an image on the image pickup member using the image blur correction member; an image synthesizing member that synthesizes high-resolution image data from a plurality of image data picked up by displacing the position of the image on the image pickup member using the pixel shift member; and a control member that can select a first photographing mode for the purpose of correcting the image blur and a second photographing mode for the purpose of synthesizing the high-resolution image, and changes drive control of the image blur correction member according to the selected photographing mode. SUMMARY

[0005] As one example, one embodiment of the technology of the present application provides a lens device, an image pickup device, a method for operating a lens device, a method for operating an image pickup device, and a storage medium, which are capable of moving a movable lens by an amount corresponding to a wavelength band of light transmitted through the movable lens.

[0006] Means for solving the technical problem

[0007] A first aspect of the present technology is a lens device provided in a camera body having an image sensor, the lens device including: a processor; a memory connected to or built in the processor; a lens including a moving lens and imaging incident light on the image sensor; and a driving mechanism that moves the moving lens by imparting power to the moving lens along a coordinate plane intersecting an optical axis of the lens, the processor controlling the driving mechanism to change a movement amount of the moving lens in accordance with a wavelength band of light transmitted through the moving lens.

[0008] A second aspect of the present technology is the lens device according to the first aspect, including: a first lens; a second lens; a first driving mechanism that moves the first lens along a coordinate plane; and a second driving mechanism that moves the second lens along a coordinate plane, at least one of the first lens and the second lens being a moving lens.

[0009] A third aspect of the present technology is the lens device according to the second aspect, wherein the processor controls the first driving mechanism to move the first lens in a direction in which an image of light imaged on the image sensor by the first lens is shaken, and controls the second driving mechanism to move the second lens in a direction in which the image is displaced.

[0010] A fourth aspect of the present technology is the lens device according to the third aspect, wherein the processor controls the second driving mechanism to move the second lens to a position in which the image is displaced by a pitch of a pixel pitch of the image sensor or less.

[0011] A fifth aspect of the present technology is the lens device according to the third aspect or the fourth aspect, wherein a displacement amount of the image on a light-receiving surface of the image sensor with respect to movement of the second lens by a unit movement amount is smaller than a shake correction amount of the image on the light-receiving surface of the image sensor with respect to movement of the first lens by the unit movement amount.

[0012] A sixth aspect of the present technology is the lens device according to any one of the third aspect to the fifth aspect, wherein a displacement amount of a central ray of light on the light-receiving surface of the image sensor through the second lens after movement with respect to movement of the second lens by a unit movement amount is set as S1, and a displacement amount of a peripheral ray of light on the light-receiving surface of the image sensor through the second lens after movement with respect to movement of the second lens by the unit movement amount is set as S2, and a relationship of 0.8 ≤ S2 / S1 ≤ 1.2 is satisfied.

[0013] A seventh aspect of the present technology is the lens device according to any one of the second aspect to the sixth aspect, further including a zoom lens, the first lens and the second lens being disposed at positions closer to the image sensor than the zoom lens.

[0014] The 8th aspect of the present technology is the lens device according to any one of the 2nd to 6th aspects, further including a filter configured at a position closer to the subject than the image sensor, and transmitting near-infrared light included in the light.

[0015] The 9th aspect of the present technology is the lens device according to any one of the 2nd to 8th aspects, further including a focus lens, the first lens and the second lens being configured at a position closer to the image sensor than the focus lens.

[0016] The 10th aspect of the present technology is the lens device according to any one of the 2nd to 9th aspects, further including an aperture, the first lens and the second lens being configured at a position closer to the image sensor than the aperture.

[0017] The 11th aspect of the present technology is the lens device according to any one of the 1st to 10th aspects, further including a switching mechanism that switches a wavelength band of the light transmitted by the moving lens.

[0018] The 12th aspect of the present technology is the lens device according to any one of the 1st to 11th aspects, including: a light separating mechanism that separates the light into first light and second light; a first light lens that transmits the first light; and a second light lens that transmits the second light, at least one of the first light lens and the second light lens being the moving lens.

[0019] The 13th aspect of the present technology is an imaging device including: a processor; a memory connected to or built in the processor; an image sensor; a lens including a moving lens, and imaging the incident light on the image sensor; and a driving mechanism that moves the moving lens by imparting power to the moving lens along a coordinate plane intersecting an optical axis of the lens, the processor controlling the driving mechanism to change an amount of movement of the moving lens according to a wavelength band of the light transmitted by the moving lens.

[0020] The 14th aspect of the present technology is the imaging device according to the 13th aspect, in which the processor controls the driving mechanism to move the image obtained by imaging the light on the image sensor on the image sensor at a position displaced by a pitch equal to or greater than a pixel pitch of the image sensor or a pitch smaller than the pixel pitch of the image sensor, causes the image sensor to capture an image each time the image is displaced, and synthesizes a plurality of frames of images obtained by the capturing.

[0021] A 15th aspect of the technology relates to a method for operating a lens device including a lens including a movable lens and imaging light incident on an image sensor of a camera body, and a drive mechanism that moves the movable lens by imparting a driving force to the movable lens along a coordinate plane intersecting an optical axis of the lens, the method including controlling the drive mechanism to change a movement amount of the movable lens in accordance with a wavelength band of light transmitted through the movable lens.

[0022] A 16th aspect of the technology relates to a method for operating a camera including an image sensor, a lens including a movable lens and imaging light incident on the image sensor, and a drive mechanism that moves the movable lens by imparting a driving force to the movable lens along a coordinate plane intersecting an optical axis of the lens, the method including controlling the drive mechanism to change a movement amount of the movable lens in accordance with a wavelength band of light transmitted through the movable lens.

[0023] A 17th aspect of the technology relates to a storage medium storing a program for causing a computer applicable to a lens device including a lens including a movable lens and imaging light incident on an image sensor of a camera body, and a drive mechanism that moves the movable lens by imparting a driving force to the movable lens along a coordinate plane intersecting an optical axis of the lens, to execute processing including controlling the drive mechanism to change a movement amount of the movable lens in accordance with a wavelength band of light transmitted through the movable lens.

[0024] A 18th aspect of the technology relates to a storage medium storing a program for causing a computer applicable to a camera including an image sensor, a lens including a movable lens and imaging light incident on the image sensor, and a drive mechanism that moves the movable lens by imparting a driving force to the movable lens along a coordinate plane intersecting an optical axis of the lens, to execute processing including controlling the drive mechanism to change a movement amount of the movable lens in accordance with a wavelength band of light transmitted through the movable lens. BRIEF DESCRIPTION OF DRAWINGS

[0025] Figure 1 is a perspective view showing an example of the structure of a monitoring system according to an embodiment of the technology.

[0026] Figure 2 is a side view showing an example of the structure of an optical system of a monitoring camera according to an embodiment of the technology.

[0027] Figure 3is a perspective view showing an example of the structure of a filter unit and an image sensor according to an embodiment of the present technology.

[0028] Figure 4 is a front view showing an example of the structure of a main part of an image sensor according to an embodiment of the present technology.

[0029] Figure 5 is a block diagram showing an example of the structure of a surveillance camera main body according to an embodiment of the present technology.

[0030] Figure 6 is a block diagram showing an example of the structure of a lens device according to an embodiment of the present technology.

[0031] Figure 7 is a comparison diagram showing an example of comparing the optical characteristics of a shake correction lens and the optical characteristics of a shift lens according to an embodiment of the present technology.

[0032] Figure 8 is a side view showing an example of details of the optical characteristics of a shift lens according to an embodiment of the present technology.

[0033] Figure 9 is a block diagram showing an example of the functional structure of a CPU of a lens device according to an embodiment of the present technology.

[0034] Figure 10 is a block diagram showing an example of the structure for executing a filter change process according to an embodiment of the present technology.

[0035] Figure 11 is a block diagram showing an example of the structure for executing a shake correction process according to an embodiment of the present technology.

[0036] Figure 12 is a block diagram showing an example of the structure for executing a shift process according to an embodiment of the present technology.

[0037] Figure 13 is a block diagram showing an example of the structure for obtaining a composite image in a surveillance camera according to an embodiment of the present technology.

[0038] Figure 14 is a flowchart showing an example of the flow of a filter change process according to an embodiment of the present technology.

[0039] Figure 15 is a flowchart showing an example of the flow of a shake correction process according to an embodiment of the present technology.

[0040] Figure 16 FIG. 1 is a flowchart showing an example of a flow of displacement processing according to an embodiment of the present technology.

[0041] Figure 17 FIG. 2 is a side view showing an example of a structure of an optical system of a monitoring camera according to a first modification.

[0042] Figure 18 FIG. 3 is a side view showing an example of a structure of an optical system of a monitoring camera according to a second modification.

[0043] Figure 19 FIG. 4 is a side view showing an example of a structure of an optical system of a monitoring camera according to a third modification. DETAILED DESCRIPTION

[0044] Hereinafter, an example of an embodiment of a lens device, an imaging device, a method of operation of a lens device, a method of operation of an imaging device, and a program according to the present technology will be described with reference to the drawings.

[0045] First, words used in the following description will be explained.

[0046] CPU is an abbreviation for "Central Processing Unit". GPU is an abbreviation for "Graphics Processing Unit". NVM is an abbreviation for "Non-Volatile Memory". RAM is an abbreviation for "Random Access Memory". IC is an abbreviation for "Integrated Circuit". ASIC is an abbreviation for "Application Specific Integrated Circuit". PLD is an abbreviation for "Programmable Logic Device". FPGA is an abbreviation for "Field-Programmable Gate Array". SoC is an abbreviation for "System-on-a-Chip". SSD is an abbreviation for "Solid State Drive". HDD is an abbreviation for "Hard Disk Drive". EEPROM is an abbreviation for "Electrically Erasable and Programmable Read Only Memory". SRAM is an abbreviation for "Static Random Access Memory". I / F is an abbreviation for "Interface". UI is an abbreviation for "User Interface". USB is an abbreviation for "Universal Serial Bus". CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor". CCD is an abbreviation for "Charge Coupled Device". LAN is an abbreviation for "Local Area Network". WAN is an abbreviation for "Wide Area Network". BPF is an abbreviation for "Band Pass Filter". Ir is an abbreviation for "Infrared Rays".

[0047] In this specification, "perpendicular" means perpendicular in the sense of a degree of error, other than perfect perpendicularity, that is generally permissible in the technical field to which the present invention pertains and does not violate the technical spirit of the present invention. In this specification, "horizontal" means horizontal in the sense of a degree of error, other than perfect horizontality, that is generally permissible in the technical field to which the present invention pertains and does not violate the technical spirit of the present invention. In this specification, "orthogonal" means orthogonal in the sense of a degree of error, other than perfect orthogonality, that is generally permissible in the technical field to which the present invention pertains and does not violate the technical spirit of the present invention. In this specification, "consistent" means consistent in the sense of a degree of error, other than perfect consistency, that is generally permissible in the technical field to which the present invention pertains and does not violate the technical spirit of the present invention. In this specification, "equally spaced" means equally spaced in the sense of a degree of error, other than perfect equally spaced, that is generally permissible in the technical field to which the present invention pertains and does not violate the technical spirit of the present invention.

[0048] Hereinafter, one embodiment of the technology of the present invention will be described.

[0049] (Monitoring system)

[0050] As an example, such as Figure 1 As shown, the monitoring system S includes a monitoring camera 10 and a management device 11. The monitoring camera 10 is an example of the "camera device" involved in the technology of this invention.

[0051] The surveillance camera 10 is installed on a pillar or wall, indoors or outdoors, to capture images of the monitored object, generating dynamic images. The dynamic images include multiple frames obtained through the capture. The surveillance camera 10 transmits the captured dynamic images to the management device 11 via the communication line 12. The management device 11 receives the dynamic images transmitted by the surveillance camera 10 and displays the received dynamic images on the display 13 or stores them in the storage device 14.

[0052] in addition, Figure 1 The X-axis corresponds to the pitch axis of the surveillance camera 10, the Y-axis corresponds to the yaw axis of the surveillance camera 10, and the Z-axis corresponds to the roll axis of the surveillance camera 10. Hereinafter, the direction along the X-axis will be referred to as the X-axis direction, the direction along the Y-axis as the Y-axis direction, and the direction along the Z-axis as the Z-axis direction. The X-axis, Y-axis, and Z-axis directions are orthogonal to each other. The XY coordinate plane used in the following description is defined by the X-axis and Y-axis directions.

[0053] (Surveillance camera)

[0054] As an example, such as Figure 2 As shown, the surveillance camera 10 includes a surveillance camera body 20 and a lens assembly 70. The surveillance camera body 20 is an example of a "camera device body" according to the technology of this invention. The surveillance camera body 20 has a lens mount 22. The lens assembly 70 is separate from the surveillance camera body 20 and is detachably mounted on the lens mount 22. The lens assembly 70 is disposed on the surveillance camera body 20 by being mounted on the lens mount 22.

[0055] The main body 20 of the surveillance camera is equipped with an image sensor 24. The image sensor 24 is, for example, a CMOS image sensor, which performs photoelectric conversion on the received light and outputs an electrical signal corresponding to the received light. CMOS image sensor is just one example; image sensor 24 can also be an image sensor with a different operating mode than CMOS image sensor, such as a CCD image sensor.

[0056] Image sensor 24 has a light-receiving surface 24A. Imaging area light incident on lens assembly 70 is imaged onto light-receiving surface 24A by lens assembly 70. An image is obtained by imaging the imaging area light onto light-receiving surface 24A. Multiple photodiodes are arranged in a matrix on light-receiving surface 24A. Each photodiode receives imaging area light. Image sensor 24 captures an image of the imaging area by receiving the imaging area light. As an example, the multiple photodiodes include silicon photodiodes sensitive to visible light and indium gallium arsenide photodiodes sensitive to near-infrared light. Image sensor 24 captures each of the visible and near-infrared light contained in the imaging area light imaged on light-receiving surface 24A.

[0057] The lens assembly 70 has an optical axis OA. As an example, the optical axis OA is an axis passing through the center of the light-receiving surface 24A and perpendicular to the light-receiving surface 24A. The optical axis OA is parallel to the Z-axis. As an example, the lens assembly 70 includes a focusing lens 72, a zoom lens 74, an aperture 76, a filter unit 78, a shake-correcting lens 80, and a shift lens 82. The optical axis OA is an axis passing through the center of each lens in the focusing lens 72, zoom lens 74, shake-correcting lens 80, and shift lens 82. The optical axis OA is also the optical axis of each lens in the focusing lens 72, zoom lens 74, shake-correcting lens 80, and shift lens 82.

[0058] The focus lens 72, the zoom lens 74, the diaphragm 76, the filter unit 78, the shake correction lens 80, and the shift lens 82 are arranged in this order from the object side to the image side along the optical axis OA. As one example, the shake correction lens 80 and the shift lens 82 are arranged at positions closer to the image sensor 24 than the zoom lens 74. Also, as one example, the shake correction lens 80 and the shift lens 82 are arranged at positions closer to the image sensor 24 than the focus lens 72. Also, as one example, the shake correction lens 80 and the shift lens 82 are arranged at positions closer to the image sensor 24 than the diaphragm 76. The filter unit 78 is arranged at a position closer to the object side than the image sensor 24. As one example, the filter unit 78 is arranged between the diaphragm 76 and the shake correction lens 80.

[0059] The shake correction lens 80 is one example of the "moving lens" and the "first lens" according to the technology of the present application, and the shift lens 82 is one example of the "moving lens" and the "second lens" according to the technology of the present application. The plurality of lenses including the focus lens 72, the zoom lens 74, the shake correction lens 80, and the shift lens 82 are one example of the "lenses" according to the technology of the present application. The optical axis OA is one example of the "optical axis of the lenses" according to the technology of the present application, and the X-Y coordinate plane is one example of the "coordinate plane intersecting the optical axis of the lenses" according to the technology of the present application. The X-axis direction is one example of the "first direction" according to the technology of the present application, and the Y-axis direction is one example of the "second direction intersecting the first direction" according to the technology of the present application.

[0060] The imaging region light is incident into the focus lens 72. The focus lens 72 guides the incident imaging region light to the zoom lens 74. The zoom lens 74 is composed of a lens group having a plurality of lenses capable of moving along the optical axis OA, and is used for zooming of the imaging region.

[0061] The diaphragm 76 has an opening 76A. The imaging region light guided by the zoom lens 74 passes through the opening 76A. The diaphragm 76 is a movable diaphragm capable of changing the aperture of the opening 76A. That is, the light quantity of the imaging region light is changed by the diaphragm 76.

[0062] The imaging region light transmitted through the diaphragm 76 is incident into the filter unit 78. The filter unit 78 has a plurality of filters having light-transmitting properties, and selectively transmits light of a plurality of wavelength bands included in the imaging region light (as one example, visible light and near-infrared light of different wavelength bands within the near-infrared wavelength band) by switching a filter that transmits light among the plurality of filters, as described in detail later. The filter unit 78 is one example of the "switching mechanism that switches the wavelength band of the light transmitted through the lens" according to the technology of the present application.

[0063] The shake correction lens 80 is a lens used to correct the shake of the image obtained by the light from the imaging area being imaged on the image sensor 24, as described later. The displacement lens 82 is a lens used to displace the image along the light-receiving surface 24A of the image sensor 24. The shake correction lens 80 and the displacement lens 82 form a main lens group. The main lens group may include lenses other than the shake correction lens 80 and the displacement lens 82.

[0064] The light incident on the imaging area of ​​the shift lens 82 is imaged on the light-receiving surface 24A. Thus, the light incident on the imaging area of ​​the lens assembly 70 is guided to the image sensor 24 by multiple lenses included in the lens assembly 70, and imaged on the light-receiving surface 24A of the image sensor 24. Furthermore, each of the focusing lens 72, zoom lens 74, image correction lens 80, and shift lens 82 can be a single lens, or it can be a lens group with multiple lenses. In addition to the focusing lens 72, zoom lens 74, image correction lens 80, and shift lens 82, the lens assembly 70 may also include other lenses. Moreover, the arrangement order of the focusing lens 72, zoom lens 74, aperture 76, filter unit 78, image correction lens 80, and shift lens 82 can be other than the above-described arrangement order.

[0065] (Filter unit 78)

[0066] As an example, such as Figure 3 As shown, the filter unit 78 includes a circular plate 84. As an example, Ir cutoff filters 86, 1st BPF 88A, 2nd BPF 88B, 3rd BPF 88C, and 4th BPF 88D are arranged at equal intervals along the circumference of the circular plate 84 as multiple filters. Hereinafter, unless otherwise specified, the Ir cutoff filters 86, 1st BPF 88A, 2nd BPF 88B, 3rd BPF 88C, and 4th BPF 88D will be referred to as filters. Furthermore, unless otherwise specified, 1st BPF 88A, 2nd BPF 88B, 3rd BPF 88C, and 4th BPF 88D will be referred to as BPF 88.

[0067] In the filter unit 78, multiple filters are selectively inserted and removed relative to the optical path (hereinafter referred to as the "optical path") of the imaging area light within the lens assembly 70 in a turntable manner. Specifically, the filter unit 78 is rotated circumferentially (e.g., Figure 3 The arc-shaped dashed arrow (as shown) rotates, thereby causing the Ir cutoff filters 86, 1st BPF88A, 2nd BPF88B, 3rd BPF88C, and 4th BPF88D to rotate relative to the optical path (in the direction of the arrow). Figure 3The optical axis OA is selectively inserted and extracted in the example shown. Thus, the Ir-cut filter 86, the 1st BPF 88A, the 2nd BPF 88B, the 3rd BPF 88C, and the 4th BPF 88D respectively transmit light of different wavelength bands.

[0068] If the filter is inserted into the optical path, the optical axis OA passes through the center of the filter, and the center of the filter inserted into the optical path coincides with the center of the light-receiving surface 24A. In the example shown, the Ir-cut filter 86 is inserted into the optical path, and thus the optical axis OA passes through the center of the Ir-cut filter 86, and the center of the Ir-cut filter 86 coincides with the center of the light-receiving surface 24A. Figure 3

[0069] The Ir-cut filter 86 is a filter that cuts infrared rays and transmits only light other than infrared rays. The BPF 88 is a filter that transmits near-infrared light. The 1st BPF 88A, the 2nd BPF 88B, the 3rd BPF 88C, and the 4th BPF 88D respectively transmit near-infrared light of different wavelength bands.

[0070] The 1st BPF 88A is a filter corresponding to a frequency band around 1000 nm (nanometers). That is, the 1st BPF 88A transmits only near-infrared light of a frequency band around 1000 nm. The 2nd BPF 88B is a filter corresponding to a frequency band around 1250 nm. That is, the 2nd BPF 88B transmits only near-infrared light of a frequency band around 1250 nm. The 3rd BPF 88C is a filter corresponding to a frequency band around 1550 nm. That is, the 3rd BPF 88C transmits only near-infrared light of a frequency band around 1550 nm. The 4th BPF 88D is a filter corresponding to a frequency band around 2150 nm. That is, the 4th BPF 88D transmits only near-infrared light of a frequency band around 2150 nm. In addition, errors within a range generally allowed in the technical field to which the technology of the present application pertains and not departing from the technical concept of the present application are also included in each of the frequency bands mentioned here. Furthermore, each of the wavelength bands mentioned here is merely an example, and different wavelength bands can be used as long as they are different.

[0071] (Image sensor)

[0072] As an example, as shown in FIG. 1, the image sensor 24 has a light-receiving portion 26 and a color filter portion 28. The light-receiving portion 26 has a plurality of 1st light-receiving elements 30 and a plurality of 2nd light-receiving elements 32. As an example of the 1st light-receiving element 30, an indium gallium arsenide photodiode can be given. As an example of the 2nd light-receiving element 32, a silicon photodiode can be given. Figure 4

[0073] ​​The color filter section 28 is provided on the plurality of first light receiving elements 30 and the plurality of second light receiving elements 32. The color filter section 28 has an Ir filter, an R filter, a G filter, and a B filter. The Ir filter is a filter that transmits light of an infrared (Ir) component. The R filter is a filter that transmits light of a red (R) component. The G filter is a filter that transmits light of a green (G) component. The B filter is a filter that transmits light of a blue (B) component. Note that the filters provided in the color filter section 28 can be freely changed, and all of the filters can be filters that transmit light of the Ir component.

[0074] The first light receiving elements 30 are light receiving elements that have sensitivity to light of the Ir component. The second light receiving elements 32 are broadly classified into a light receiving element 32R that has sensitivity to light of the R component, a light receiving element 32G that has sensitivity to light of the G component, and a light receiving element 32B that has sensitivity to light of the B component.

[0075] The Ir filter is provided on the first light receiving elements 30. The R filter is provided on the light receiving elements 32R. The G filter is provided on the light receiving elements 32G. The B filter is provided on the light receiving elements 32B. Note that a filter that blocks near-infrared light is further provided on each of the light receiving elements 32R, 32G, and 32B.

[0076] In the image sensor 24 configured as described above, the plurality of first light receiving elements 30 receive near-infrared light that has transmitted any one of the plurality of BPFs 88, generate a near-infrared light image 62 from the received near-infrared light, and output the near-infrared light image 62, and the plurality of second light receiving elements 32 receive visible light that has transmitted the Ir cut filter 86, generate a visible light image 60 from the received visible light, and output the visible light image 60.

[0077] (Monitor camera main body)

[0078] As an example, as shown in FIG. 1, the monitor camera main body 20 includes a controller 40 and a UI system device 50. Figure 5

[0079] The controller 40 controls the operation of the monitor camera main body 20. The controller 40 includes a CPU 42, an NVM 44, and a RAM 46. The CPU 42, the NVM 44, and the RAM 46 are connected to a bus 48.

[0080] ​The NVM 44 stores various parameters and various programs. As an example of the NVM 44, an EEPROM (for example, a flash memory type EEPROM) can be given. The EEPROM is only an example of the NVM 44. The NVM 44 can be any nonvolatile storage device such as an SSD and / or an HDD. The RAM 46 temporarily stores various information and functions as a work memory. As an example of the RAM 46, a DRAM can be given. The DRAM is only an example of the RAM 46. The RAM 46 can also be an SRAM, as long as it is any volatile storage device.

[0081] Various programs are stored in the NVM 44. The CPU 42 reads out a required program from the NVM 44 and executes the read-out program on the RAM 46. The CPU 42 executes various processes according to the program executed on the RAM 46.

[0082] The UI system device 50 is also connected to the bus 48. The UI system device 50 receives an instruction given from a user under the control of the CPU 42, or prompts various information obtained by the processing by the monitoring camera 10 to the user.

[0083] Also, the monitoring camera main body 20 is provided with an image sensor driver 52, a signal processing device 54, a shake amount detection sensor 56, and a communication I / F 58. The image sensor driver 52, the signal processing device 54, the shake amount detection sensor 56, and the communication I / F 58 are connected to the bus 48.

[0084] As an example, as shown in FIG. 2, the image sensor 24 is disposed on the optical axis OA at a position further to the rear than the displacement lens 82, that is, at a position further to the image side than the displacement lens 82. As an example, as shown in FIG. 3, in a state where the Ir cut filter 86 is disposed on the optical axis OA, the image sensor 24 captures an imaging region according to the visible light that is imaged on the light-receiving surface 24A by the displacement lens 82, thereby generating a visible light image 60 shown in FIG. 4, and outputs the generated visible light image 60 to the rear stage. The visible light image 60 is an image that represents an imaging region formed by the visible light. Figure 2 Figure 3 As an example, as shown in FIG. 3, in a state where the Ir cut filter 86 is disposed on the optical axis OA, the image sensor 24 captures an imaging region according to the visible light that is imaged on the light-receiving surface 24A by the displacement lens 82, thereby generating a visible light image 60 shown in FIG. 4, and outputs the generated visible light image 60 to the rear stage. The visible light image 60 is an image that represents an imaging region formed by the visible light. Figure 4

[0085] In a state where the BPF 88 (refer to FIG. 5) is disposed on the optical axis OA, the image sensor 24 captures an imaging region according to the near-infrared light that is imaged on the light-receiving surface 24A by the displacement lens 82, thereby generating a near-infrared light image 62 shown in FIG. 6, and outputs the generated near-infrared light image 62 to the rear stage. The near-infrared light image 62 is an image that represents an imaging region formed by the near-infrared light. Also, hereinafter, when it is not necessary to distinguish between the near-infrared light image 62 and the visible light image 60, it is referred to as an "imaging image" without the symbol being marked. Figure 4 ​​​​

[0086] As an example, as shown in FIG. 2, an image sensor driver 52 and a signal processing device 54 are connected to the image sensor 24. The image sensor driver 52 outputs a timing control signal to the image sensor 24 under the control of the CPU 42. The timing control signal is a signal that controls imaging based on the image sensor 24. The frame rate of imaging based on the image sensor 24 is specified by the timing control signal. Figure 5

[0087] The timing control signal includes a vertical synchronization signal and a horizontal synchronization signal. The vertical synchronization signal is a signal that specifies the timing at which the transmission of an analog image of 1 frame amount is started. The horizontal synchronization signal is a signal that specifies the timing at which the output of an analog image of 1 horizontal line amount is started. The image sensor 24 outputs an imaging image to the signal processing device 54 in units of frames from the start of the vertical synchronization signal input from the image sensor driver 52. Also, the image sensor 24 outputs an imaging image to the signal processing device 54 in units of horizontal lines from the start of the horizontal synchronization signal input from the image sensor driver 52.

[0088] The signal processing device 54 performs signal processing such as demosaicing processing, noise removal processing, gradation correction processing, and color correction processing on an imaging image input from the image sensor 24 under the control of the CPU 42. The imaging image after signal processing is output from the signal processing device 54 to the CPU 42. The CPU 42 stores the imaging image input from the signal processing device 54 in a predetermined storage region (for example, the NVM 44 and / or the RAM 46, etc.).

[0089] The amount-of-shake detection sensor 56 detects, for example, the amount of shake of the image sensor 24 in the horizontal direction and the amount of shake in the vertical direction. Figure 2 ​The amount of the shake (hereinafter, also simply referred to as "shake amount") of the monitoring camera 10 is detected. The shake of the monitoring camera 10 refers to a phenomenon in which the positional relationship between the optical axis OA and the light receiving surface 24A in the monitoring camera 10 is changed. If the shake of the monitoring camera 10 occurs, the shake of the image occurs. As an example of the image, an image obtained by imaging by the image sensor and / or an optical image (hereinafter, also simply referred to as "image" or "object image") obtained by imaging on the light receiving surface 24A can be given. In the present embodiment, the "shake of the image" refers to a phenomenon in which the optical axis OA is tilted due to the vibration phenomenon, and thus the object image deviates from the reference position, that is, a phenomenon in which the object image deviates from the reference position due to the relative movement of the optical axis OA with respect to the object. The vibration phenomenon refers to a phenomenon in which the lens device 70 vibrates due to the vibration transmitted to the lens device 70 from the outside (for example, a hand, wind, and / or a vehicle, etc.) of the monitoring camera 10 and / or the inside (for example, a motor mounted on the monitoring camera 10) of the monitoring camera 10. Also, the "tilt of the optical axis OA" refers to, for example, the tilt of the optical axis OA with respect to the reference axis (for example, the optical axis OA before the vibration phenomenon occurs, that is, the optical axis OA of the monitoring camera 10 when the monitoring camera 10 is stationary). Also, the "reference position" refers to, for example, the position of the object image (for example, the position of the object image in the light receiving surface 24A) obtained in a state in which the vibration is not applied to the lens device 70.

[0090] Figure 5 The shake amount detection sensor 56 is, for example, a gyro sensor. The gyro sensor detects the amount of rotational shake around each of the X-axis, the Y-axis, and the Z-axis. The shake amount detection sensor 56 detects the shake amount of the monitoring camera 10 by converting the amount of rotational shake around the X-axis and the amount of rotational shake around the Y-axis detected by the gyro sensor into the shake amount in a two-dimensional plane parallel to the X-axis and the Y-axis. In addition, in the present embodiment, the meaning of parallel includes the meaning of substantially parallel including a design and manufacturing error, in addition to the meaning of complete parallel.

[0091] Here, as an example of the shake amount detection sensor 56, the gyro sensor is given, but this is only an example, and the shake amount detection sensor 56 can also be an acceleration sensor. The acceleration sensor detects the shake amount in a two-dimensional plane parallel to the X-axis and the Y-axis. The shake amount detection sensor 56 outputs the detected shake amount to the CPU 42.

[0092] Also, here, an example of a manner in which the amount of shake is detected by the physical sensor, the shake amount detection sensor 56, is presented, but the technology of the present application is not limited to this. For example, a movement vector obtained by comparing the captured images before and after in the time series stored in the NVM 44 or the RAM 46 can also be used as the amount of shake. Also, the amount of shake used finally can be derived from the amount of shake detected by the physical sensor and the movement vector obtained by image processing.

[0093] The communication I / F 58 is, for example, a network interface that performs transmission control of various information between the management device 11 via a network. As an example of the network, the Internet or a public communication network, etc. WAN can be presented. The communication I / F 58 manages Figure 1 The communication between the monitoring camera 10 and the management device 11 illustrated.

[0094] Lens device

[0095] As an example, as Figure 6 illustrated, the lens device 70 is provided with a controller 90. The controller 90 controls the operation of the lens device 70. The controller 90 is provided with a CPU 92, an NVM 94, and a RAM 96. The controller 90 is an example of the "computer adapted for the lens device", the CPU 92 is an example of the "processor" involved in the technology of the present application, and the RAM 96 is an example of the "memory" involved in the technology of the present application. The CPU 92, the NVM 94, and the RAM 96 are connected to a bus 98.

[0096] As an example, as Figure 2 illustrated, in a state in which the lens device 70 is attached to the lens mount 22 of the monitoring camera main body 20, a connector (omitted from the drawing) provided to the monitoring camera main body 20 and a connector (omitted from the drawing) provided to the lens device 70 are connected. Then, via a connection path including the connector of the monitoring camera main body 20 and the connector of the lens device 70, etc., Figure 5 illustrated, the CPU 42 of the monitoring camera main body 20 and Figure 6 illustrated, the CPU 92 of the lens device 70 are communicably connected. The CPU 92 of the lens device 70 controls the operation of the lens device 70 in accordance with the instructions given from the CPU 42 of the monitoring camera main body 20.

[0097] NVM94 stores various parameters and programs. An example of NVM94 is EEPROM (e.g., flash memory EEPROM). EEPROM is simply one example of NVM94. NVM94 can be any non-volatile storage device such as SSD and / or HDD. RAM96 temporarily stores various information and is used as working memory. An example of RAM96 is DRAM. DRAM is simply one example of RAM96. RAM96 can also be SRAM, as long as it is any volatile storage device.

[0098] Various programs are stored in the NVM94. The CPU92 reads the required programs from the NVM94 and executes the read programs on the RAM96. The CPU92 performs various processes according to the programs executed on the RAM96. Furthermore, the "various programs" mentioned here also include the camera support processing program 100 (see reference 100). Figure 9 ).

[0099] In the lens assembly 70, the three mutually orthogonal axes are defined by the X-axis, Y-axis, and Z-axis. As an example, ... Figure 2 As shown, when the lens device 70 is installed in the lens mount 22 of the main body 20 of the surveillance camera, the X-axis, Y-axis, and Z-axis directions of the lens device 70 may deviate from the X-axis, Y-axis, and Z-axis directions of the surveillance camera 10 due to factors such as loosening. For convenience, it is assumed that the X-axis, Y-axis, and Z-axis directions of the lens device 70 are consistent with the X-axis, Y-axis, and Z-axis directions of the surveillance camera 10. The X-axis and Y-axis directions are orthogonal to the optical axis OA of the lens device 70, and the Z-axis direction is parallel to the optical axis OA.

[0100] As an example, such as Figure 6 As shown, the lens device 70 includes a first motor driver 102, a second motor driver 104, a third motor driver 106, a fourth motor driver 108, a fifth motor driver 110, and a sixth motor driver 112. Furthermore, the lens device 70 includes a first motor 118, a second motor 120, a third motor 122, a fourth motor 124, a fifth motor 126, and a sixth motor 128. Additionally, the lens device 70 includes a first position sensor 134, a second position sensor 136, a third position sensor 138, a fourth position sensor 140, a fifth position sensor 142, and a sixth position sensor 144.

[0101] The 1st motor driver 102, the 2nd motor driver 104, the 3rd motor driver 106, the 4th motor driver 108, the 5th motor driver 110, the 6th motor driver 112, the 1st position sensor 134, the 2nd position sensor 136, the 3rd position sensor 138, the 4th position sensor 140, the 5th position sensor 142, and the 6th position sensor 144 are connected to the bus 98.

[0102] As an example of each of the 1st position sensor 134, the 2nd position sensor 136, the 3rd position sensor 138, the 4th position sensor 140, the 5th position sensor 142, and the 6th position sensor 144, a potentiometer can be given.

[0103] The 1st position sensor 134 detects the position of the focus lens 72 in the Z-axis direction. The 2nd position sensor 136 detects the position of the zoom lens 74 in the Z-axis direction. The 3rd position sensor 138 detects the aperture of the opening 76A formed in the aperture 76. The 4th position sensor 140 detects the rotational position of the filter unit 78 with respect to the optical axis OA. The 5th position sensor 142 detects the position of the shake correction lens 80 on the X-Y coordinate surface. The 6th position sensor 144 detects the position of the shift lens 82 on the X-Y coordinate surface.

[0104] The detection result detected by the 1st position sensor 134 is output from the 1st position sensor 134 to the CPU 92. The detection result detected by the 2nd position sensor 136 is output from the 2nd position sensor 136 to the CPU 92. The detection result detected by the 3rd position sensor 138 is output from the 3rd position sensor 138 to the CPU 92. The detection result detected by the 4th position sensor 140 is output from the 4th position sensor 140 to the CPU 92. The detection result detected by the 5th position sensor 142 is output from the 5th position sensor 142 to the CPU 92. The detection result detected by the 6th position sensor 144 is output from the 6th position sensor 144 to the CPU 92.

[0105] The focus lens 72 is mounted to a 1st slide mechanism (not shown). The 1st slide mechanism is mechanically connected to a drive shaft of the 1st motor 118, and moves the focus lens 72 in the Z-axis direction by receiving power of the 1st motor 118. The 1st motor driver 102 is connected to the 1st motor 118, and controls the 1st motor 118 according to an instruction from the CPU 92. The CPU 92 controls the 1st motor 118 via the 1st motor driver 102 based on the detection result detected by the 1st position sensor 134, thereby controlling the position of the focus lens 72 in the Z-axis direction.

[0106] The zoom lens 74 is mounted on the second sliding mechanism (not shown). The second sliding mechanism is mechanically connected to the drive shaft of the second motor 120, and moves the zoom lens 74 along the Z-axis by receiving power from the second motor 120. The second motor driver 104 is connected to the second motor 120 and controls the second motor 120 according to instructions from the CPU 92. The CPU 92 controls the second motor 120 via the second motor driver 104 based on the detection result detected by the second position sensor 136, thereby controlling the position of the zoom lens 74 in the Z-axis direction.

[0107] The aperture 76 has multiple blades (not shown) capable of opening and closing the opening 76A. These blades are mechanically connected to the drive shaft of the third motor 122, and open and close the opening 76A by receiving power from the third motor 122. The third motor driver 106 is connected to the third motor 122 and controls the third motor 122 according to instructions from the CPU 92. The CPU 92 controls the third motor 122 based on the detection result detected by the third position sensor 138 and... Figure 5 The amount of light received on the light-receiving surface 24A shown is via Figure 6 The third motor driver 106 shown controls the third motor 122, thereby adjusting the opening degree of the opening 76A.

[0108] The filter unit 78 is mounted on a rotating mechanism (not shown). The rotating mechanism is mechanically connected to the drive shaft of the fourth motor 124, and rotates the filter unit 78 (see reference) by receiving power from the fourth motor 124. Figure 3 The filter unit 78 rotates circumferentially, allowing multiple filters to be inserted and removed in the optical path. A fourth motor driver 108 is connected to the fourth motor 124 and controls the fourth motor 124 according to instructions from the CPU 92. The CPU 92 controls the fourth motor 124 via the fourth motor driver 108 based on the detection result detected by the fourth position sensor 140, thereby controlling the rotational position of the filter unit 78 relative to the optical axis OA.

[0109] The jitter correction lens 80 is mounted on the fifth sliding mechanism (not shown). The fifth sliding mechanism is mechanically connected to the drive shaft of the fifth motor 126, and moves the jitter correction lens 80 along the XY coordinate plane by receiving power from the fifth motor 126. That is, the jitter correction lens 80 moves along both the X-axis and Y-axis. The fifth motor driver 110 is connected to the fifth motor 126 and controls the fifth motor 126 according to instructions from the CPU 92. The CPU 92 controls the fifth motor 126 via the fifth motor driver 110 based on the detection result detected by the fifth position sensor 142, thereby controlling the position of the jitter correction lens 80 on the XY coordinate plane. The fifth motor 126 is an example of the "drive mechanism" and "first drive mechanism" involved in the technology of this invention.

[0110] Further, specifically, the 5th motor 126 that moves the blur correction lens 80 along the X-Y coordinate plane includes an X-axis motor that moves the blur correction lens 80 in the X-axis direction and a Y-axis motor that moves the blur correction lens 80 in the Y-axis direction. The X-axis motor and the Y-axis motor that form the 5th motor 126 are, for example, voice coil motors. Also, specifically, the 5th position sensor that detects the position of the blur correction lens 80 on the X-Y coordinate plane includes an X-axis position sensor that detects the position of the blur correction lens 80 in the X-axis direction and a Y-axis position sensor that detects the position of the blur correction lens 80 in the Y-axis direction.

[0111] The displacement lens 82 is mounted to a 6th slide mechanism (omitted from the drawing). The 6th slide mechanism is mechanically connected to a drive shaft of a 6th motor 128, and moves the displacement lens 82 along the X-Y coordinate plane by receiving power from the 6th motor 128. That is, the displacement lens 82 moves in both the X-axis direction and the Y-axis direction. A 6th motor driver 112 is connected to the 6th motor 128, and controls the 6th motor 128 in accordance with an instruction from the CPU 92. The CPU 92 controls the 6th motor 128 via the 6th motor driver 112 based on a detection result detected by a 6th position sensor 144, thereby controlling the position of the displacement lens 82 on the X-Y coordinate plane. The 6th motor 128 is an example of the "driving mechanism" and the "2nd driving mechanism" according to the present technology.

[0112] Further, specifically, the 6th motor 128 that moves the displacement lens 82 along the X-Y coordinate plane includes an X-axis motor that moves the displacement lens 82 in the X-axis direction and a Y-axis motor that moves the displacement lens 82 in the Y-axis direction. The X-axis motor and the Y-axis motor that form the 6th motor 128 are, for example, DC motors. Instead of the X-axis motor and the Y-axis motor that form the 6th motor 128, piezoelectric elements can be used, for example. Also, specifically, the 6th position sensor that detects the position of the displacement lens 82 on the X-Y coordinate plane includes an X-axis position sensor that detects the position of the displacement lens 82 in the X-axis direction and a Y-axis position sensor that detects the position of the displacement lens 82 in the Y-axis direction.

[0113] In the lens device 70 having the above-described structure, in order to suppress transmission of vibration between the 5th motor 126 and the 6th motor 128, the 5th motor 126 and the 6th motor 128 are preferably separated from each other to a degree that vibration is not transmitted. Also, the 5th motor 126 is preferably fixed to the housing of the lens device 70 via a vibration-isolating elastic member such as a rubber sheet, for example. Similarly, the 6th motor 128 is preferably fixed to the housing of the lens device 70 via a vibration-isolating elastic member such as a rubber sheet, for example.

[0114] (Optical characteristics of the blur correction lens and optical characteristics of the displacement lens)

[0115] InFigure 7 An example comparing the optical characteristics of the shake correction lens 80 and the optical characteristics of the displacement lens 82 is shown below. The optical characteristics of the shake correction lens 80 and the optical characteristics of the displacement lens 82 are different. The optical characteristics referred to here include, for example, characteristics caused by the lens's thickness, diameter, and material, and include, for example, optical characteristics including refractive index. Hereinafter, the differences between the optical characteristics of the shake correction lens 80 and the displacement sensitivity of the displacement lens 82 will be explained.

[0116] In addition, Figure 7 In the upper section, the jitter correction lens 80, indicated by a double-dotted line, represents the jitter correction lens 80 before the jitter of the image is corrected, while the jitter correction lens 80, indicated by a solid line, represents the jitter correction lens 80 that has been moved to the position where the jitter of the image is corrected. Furthermore, the optical axis OA represents the optical axis OA that passes through the center of the light-receiving surface 24A of the image sensor 24 and is perpendicular to the light-receiving surface 24A, and the optical axis OA1 represents the optical axis of the jitter correction lens 80 before the jitter of the image is corrected. If the jitter correction lens 80 moves towards the position where the jitter of the image is corrected, then the central ray E1 passing through the moved jitter correction lens 80 on the optical axis OA1 forms an image at the center of the light-receiving surface 24A.

[0117] In this description, the jitter correction sensitivity of the jitter correction lens 80 refers to the ratio of the jitter correction amount B1 of the image on the light-receiving surface 24A of the image sensor 24 to the unit movement amount A of the jitter correction lens 80. The unit movement amount A of the jitter correction lens 80 refers to a predetermined amount of movement when the jitter correction lens 80 moves along the X-axis or Y-axis. The image jitter correction amount B1 refers to the amount of movement of the image center accompanying the correction of image jitter, equivalent to the distance between the optical axis OA1 and the optical axis OA on the light-receiving surface 24A of the image sensor 24. In this description, correcting image jitter means returning the center of the jittered image to the optical axis OA before the jitter occurred.

[0118] Furthermore, in Figure 7 In the lower section, the displacement lens 82, indicated by a double-dotted line, represents the displacement lens 82 before image displacement, while the displacement lens 82, indicated by a solid line, represents the displacement lens 82 after it has moved to the position that causes image displacement. Furthermore, the optical axis OA represents the optical axis OA passing through the center of the light-receiving surface 24A of the image sensor 24 and perpendicular to the light-receiving surface 24A, and the optical axis OA2 represents the optical axis of the displacement lens 82 before image displacement. If the displacement lens 82 moves towards the position that causes image displacement, the central ray E2 passing through the moved displacement lens 82 on the optical axis OA2 (optical axis OA) forms an image at a position where it has only been displaced by an amount B2 from the center of the light-receiving surface 24A.

[0119] In this description, the displacement sensitivity of the displacement lens 82 refers to the ratio of the displacement B2 of the image on the light-receiving surface 24A of the image sensor 24 to the unit movement A of the displacement lens 82. The unit movement A of the displacement lens 82 refers to a predetermined amount of movement when the displacement lens 82 moves along the X-axis or Y-axis. The image displacement B2 refers to the amount of movement of the image center accompanying the image displacement.

[0120] In this description, the difference between the jitter correction sensitivity of the jitter correction lens 80 and the displacement sensitivity of the displacement lens 82 is specifically explained, assuming that the distance D1 from the center C1 in the thickness direction of the jitter correction lens 80 to the light-receiving surface 24A of the image sensor 24 is the same as the distance D2 from the center C2 in the thickness direction of the displacement lens 82 to the light-receiving surface 24A of the image sensor 24.

[0121] As an example, such as Figure 7 As shown, when the distances D1 and D2 are assumed to be the same, the displacement sensitivity of the displacement lens 82 is lower than the shake correction sensitivity of the shake correction lens 80. That is, when the unit movement A of the shake correction lens 80 is the same as the unit movement A of the displacement lens 82, the displacement B2 of the image on the light-receiving surface 24A of the image sensor 24 relative to the displacement lens 82 with a unit movement A is less than the shake correction B1 of the image on the light-receiving surface 24A of the image sensor 24 relative to the shake correction lens 80 with a unit movement A. In other words, the optical characteristic values ​​of the shake correction lens 80 and the displacement lens 82 are respectively set to values ​​where the displacement sensitivity of the displacement lens 82 is lower than the shake correction sensitivity of the shake correction lens 80.

[0122] Furthermore, for convenience, in this description, it is assumed that the distance D1 from the center C1 in the thickness direction of the jitter correction lens 80 to the light-receiving surface 24A of the image sensor 24 is the same as the distance D2 from the center C2 in the thickness direction of the displacement lens 82 to the light-receiving surface 24A of the image sensor 24. However, as... Figure 2 As shown, the jitter correction lens 80 and the displacement lens 82 are offset on the optical axis OA. Therefore, in Figure 2 In the arrangement of the jitter correction lens 80 and the displacement lens 82 shown, the distance from the center of the jitter correction lens 80 in the thickness direction to the light-receiving surface 24A of the image sensor 24 is different from the distance from the center of the displacement lens 82 in the thickness direction to the light-receiving surface 24A of the image sensor 24.

[0123] Next, the optical characteristics of the displacement lens 82 will be described in more detail. Figure 8 An example of the optical characteristics of the displacement lens 82 is shown in more detail below. Additionally, in Figure 8In the diagram, the displacement lens 82 indicated by the double-dotted line represents the displacement lens 82 before image displacement, and the displacement lens 82 indicated by the solid line represents the displacement lens 82 after it has been moved to the position that causes image displacement. Furthermore, the optical axis OA represents the optical axis that passes through the center of the light-receiving surface 24A of the image sensor 24 and is perpendicular to the light-receiving surface 24A.

[0124] Displacement S1 is the displacement of the central ray F1 passing through the moved displacement lens 82 on the optical axis OA with a unit movement A relative to the displacement lens 82, on the light-receiving surface 24A of the image sensor 24. Displacement S2 is the displacement of the peripheral ray F2 passing through the moved displacement lens 82 on the optical axis OA, other than the moved displacement lens 82, with a unit movement A relative to the displacement lens 82, on the light-receiving surface 24A of the image sensor 24. Furthermore, in the displacement lens 82, the relationship 0.8 ≤ S2 / S1 ≤ 1.2 holds. In other words, the optical characteristic values ​​of the displacement lens 82 are set to values ​​where the relationship 0.8 ≤ S2 / S1 ≤ 1.2 holds.

[0125] Here, when the value of S2 / S1 is outside the aforementioned specified range, that is, when S2 / S1 < 0.8 or when 1.2 < S2 / S1, the image pixel values ​​of the captured image obtained by the image sensor 24 lose continuity, the boundary portions of the image pixels become unnatural (e.g., jagged), and the image quality of the captured image is outside the allowable range. Furthermore, when image processing such as edge enhancement is applied to the captured image, image processing cannot be performed well, resulting in a decrease in the resolution of the captured image. On the other hand, if the optical characteristic value of the displacement lens 82 is set to a value where the relationship 0.8 ≤ S2 / S1 ≤ 1.2 holds, the image quality of the captured image enters the allowable range. Moreover, compared to the case where the value of S2 / S1 is outside the aforementioned specified range, the resolution of the captured image is improved.

[0126] (Functional structure of the CPU in the lens device)

[0127] As an example, such as Figure 9 As shown, the camera support processing is implemented by the CPU 92 of the lens device 70 executing the camera support processing program 100. The camera support processing program 100 is an example of a "program" according to the technology of this invention. Figure 9 In the example shown, the camera support process 100 is stored in the NVM94, and the CPU92 reads the camera support process 100 from the NVM94 and executes it on the RAM96.

[0128] The CPU 92 performs the imaging support processing in accordance with the imaging support processing program 100 executed on the RAM 96. The CPU 92 functions as the acquisition section 150, the filter control section 152, the shake correction amount calculation section 154, the shake correction control section 156, the displacement amount calculation section 158, and the displacement control section 160 by executing the imaging support processing program 100 on the RAM 96. In addition, the imaging support processing is processing including the filter changing processing (refer to Figure 14 ), the shake correction processing (refer to Figure 15 ), and the displacement processing (refer to Figure 16 ).

[0129] As an example, as shown in Figure 10 , the acquisition section 150 acquires the filter designation information as information transmitted from the CPU 42 of the surveillance camera main body 20. The filter designation information is instruction information that designates the filter to be used among the plurality of filters. The filter to be used refers to the filter disposed on the optical axis OA among the plurality of filters provided to the filter unit 78. Also, the acquisition section 150 acquires the position detection result detected by the fourth position sensor 140. The position detection result detected by the fourth position sensor 140 is information indicating the result that the rotational position of the filter unit 78 with respect to the optical axis OA has been detected.

[0130] The filter control section 152 outputs a control instruction to the fourth motor driver 108 to dispose the filter designated by the filter designation information on the optical axis OA in accordance with the filter designation information transmitted from the CPU 42 and the position detection result detected by the fourth position sensor 140.

[0131] If the control instruction is received, the fourth motor driver 108 controls the fourth motor 124 in accordance with the control instruction. Thereby, the filter designated by the filter designation information is disposed on the optical axis OA. For example, when the filter designated by the filter designation information is the Ir cut filter 86, the filter unit 78 is rotated so that the Ir cut filter 86 is disposed on the optical axis OA. As an example, a state in which the Ir cut filter 86 is disposed on the optical axis OA is shown in Figure 10 . In this way, the filter unit 78 is rotated to switch the filter disposed on the optical axis OA among the plurality of filters, thereby switching the wavelength band of the light transmitted through the shake correction lens 80 and the displacement lens 82.

[0132] When the control to dispose the filter designated by the filter designation information described above on the optical axis OA is performed, the filter control section 152 stores the filter designation information in the RAM 96. For example, when the Ir cut filter 86 is disposed on the optical axis OA, the filter control section 152 stores the filter designation information that the Ir cut filter 86 is designated in the RAM 96.

[0133] Also, as shown in Figure 11 The acquisition section 150 acquires the shake correction instruction and the shake amount detection result detected by the shake amount detection sensor 56 as information transmitted from the CPU 42 of the surveillance camera main body 20. The shake correction instruction is instruction information that requests shake correction, and the shake amount detection result detected by the shake amount detection sensor 56 is information that indicates a result of having detected the shake amount of the surveillance camera 10. Also, the acquisition section 150 acquires the position detection result detected by the fifth position sensor 142. The position detection result detected by the fifth position sensor 142 is information that indicates a result of having detected the position of the shake correction lens 80 on the X-Y coordinate plane. Further, the acquisition section 150 acquires the filter designation information stored in the RAM 96.

[0134] The shake correction amount calculation section 154 determines the direction of movement that corrects the shake of the image with respect to the fifth motor 126 based on the shake amount detection result detected by the shake amount detection sensor 56. The direction of movement that corrects the shake of the image is determined to be the direction opposite to the direction in which the image is shaken. Also, the shake correction amount calculation section 154 calculates the amount of movement that corrects the shake of the image with respect to the fifth motor 126 based on the shake amount detection result detected by the shake amount detection sensor 56. Specifically, the shake correction amount calculation section 154 calculates the amount of movement that returns the position of the image that is shaken due to the shake of the surveillance camera 10 to the position of the image before the shake of the surveillance camera 10 occurred with respect to the fifth motor 126.

[0135] However, in the case where the light that is transmitted through the shake correction lens 80 is visible light and in the case where the light that is transmitted through the shake correction lens 80 is near-infrared light, the wavelength bands are different, and thus the shake correction sensitivity of the shake correction lens 80 changes due to the position deviation of the focus on the image side. In other words, as shown in Figure 11

[0136] ​Therefore, the shake correction amount calculation section 154 calculates the amount of movement corresponding to the filter specified by the filter specification information, with respect to the amount of movement of the 5th motor 126 that corrects the shake of the image. For example, when the filter specified by the filter specification information is the Ir cut filter 86, the shake correction amount calculation section 154 calculates the amount of movement corresponding to the Ir cut filter 86, based on the shake amount detection result detected by the shake amount detection sensor 56. Also, when the filter specified by the filter specification information is the BPF 88, the shake correction amount calculation section 154 calculates the amount of movement corresponding to the BPF 88, based on the shake amount detection result detected by the shake amount detection sensor 56. That is, if the wavelength band of the light transmitted through the shake correction lens 80 changes, the shake correction sensitivity of the shake correction lens 80 changes, but even in the case where the wavelength band of the light transmitted through the shake correction lens 80 changes, the shake correction amount calculation section 154 calculates the amount of movement that makes it possible to obtain the shake correction amount B1 that is proportional to the detection result detected by the shake amount detection sensor 56. The amount of movement corresponding to the filter specified by the filter specification information can be predetermined for each of a plurality of filters, based on the shake amount detection result detected by the shake amount detection sensor 56, and can also be calculated using various calculation formulas.

[0137] If the direction of movement of the 5th motor 126 determined by the shake correction amount calculation section 154 and the amount of movement of the 5th motor 126 calculated by the shake correction amount calculation section 154 are acquired, the shake correction control section 156 generates a control command based on the position detection result detected by the 5th position sensor 142, using the acquired direction of movement and amount of movement of the 5th motor 126 as target values. The control command is output to the 5th motor driver 110.

[0138] The 5th motor driver 110 generates a movement signal based on the control command generated by the shake correction control section 156. As an example, the movement signal is a continuous wave. The 5th motor 126 moves in the direction of movement and with the amount of movement corresponding to the movement signal. Thereby, the shake correction lens 80 is given power in the direction in which the shake of the image is corrected, and the shake correction lens 80 moves. For example, when the filter specified by the filter specification information is the Ir cut filter 86, the shake correction lens 80 moves by the movement amount Al corresponding to the Ir cut filter 86, and when the filter specified by the filter specification information is the BPF 88, the shake correction lens 80 moves by the movement amount Al corresponding to the BPF 88.

[0139] Thus, the shake correction control section 156 performs control to change the movement amount Al of the shake correction lens 80 by the 5th motor 126 in accordance with the wavelength band of the light transmitted through the shake correction lens 80. Therefore, even in the case where the wavelength band of the light transmitted through the shake correction lens 80 has changed, the influence caused by the change in the shake correction sensitivity of the shake correction lens 80 is suppressed, and the shake correction amount B1 that is proportional to the detection result detected by the shake amount detection sensor 56 can be obtained. Note that the correction of the shake of the image described herein includes not only the case where the position of the image that has shaken due to the shake of the surveillance camera 10 is made to coincide with the position of the image before the shake of the surveillance camera 10 occurred, but also the case where the position of the image that has shaken due to the shake of the surveillance camera 10 is made to approach the position of the image before the shake of the surveillance camera 10 occurred.

[0140] The control by the shake correction control section 156 described above is feedback control based on the shake amount detection result (i.e., the shake amount of the surveillance camera 10) detected by the shake amount detection sensor 56.

[0141] Also, as an example, as shown in FIG. 15, the acquisition section 150 acquires the image displacement instruction and the frame period information as information transmitted from the CPU 42 of the surveillance camera main body 20. The image displacement instruction is instruction information that requests displacement of the image and is information that indicates the displacement direction and the displacement amount of the image. Also, the acquisition section 150 acquires the position detection result detected by the 6th position sensor 144. Further, the acquisition section 150 acquires the filter designation information stored in the RAM 96. Figure 12 The displacement amount B2 of the image is specified by a pitch that is greater than or less than the pixel pitch of the image sensor 24, for example. The pitch that is greater than the pixel pitch of the image sensor 24 is 1 pitch, 1.5 pitches, 2.5 pitches, 3.5 pitches, or the like, for example. When the pixel pitch of the image sensor 24 is set to p, a natural number is set to n, and a decimal fraction is set to d, the pitch that is greater than the pixel pitch of the image sensor 24 is specified by (n + d) x p. Also, the pitch that is less than the pixel pitch of the image sensor 24 is 0.25 pitch, 0.5 pitch, 0.75 pitch, or the like, for example. When the pixel pitch of the image sensor 24 is set to p and a fraction less than 1 is set to D, the pitch that is less than the pixel pitch of the image sensor 24 is specified by D x p.

[0142] The frame period information is information that specifies the frame period that is synchronized with the timing control signal output from the CPU 42 to the image sensor driver 52 (see FIG. 14).

[0143] Figure 5 The frame period is the period in which imaging is performed in units of frames.

[0144] ​The displacement amount calculation section 158 determines the moving direction of the sixth motor 128 for each frame period based on the displacement direction of the image indicated by the image displacement instruction, the frame period indicated by the frame period information, and the position detection result detected by the sixth position sensor 144. The moving direction of the sixth motor 128 is determined based on the displacement direction of the image indicated by the image displacement instruction and the position detection result detected by the sixth position sensor 144.

[0145] Further, the displacement amount calculation section 158 calculates the moving amount of the sixth motor 128 for each frame period based on the displacement amount of the image indicated by the image displacement instruction, the frame period indicated by the frame period information, and the position detection result detected by the sixth position sensor 144. For example, when the displacement amount of the image indicated by the image displacement instruction is the same pitch as the pixel pitch of the image sensor 24, the displacement amount calculation section 158 calculates the moving amount of the sixth motor 128 to displace the image by the same pitch as the pixel pitch of the image sensor 24. Further, when the displacement amount of the image indicated by the image displacement instruction is a pitch larger than the pixel pitch of the image sensor 24, the displacement amount calculation section 158 calculates the moving amount of the sixth motor 128 to displace the image by (n+d) x p. Further, when the displacement amount of the image indicated by the image displacement instruction is a pitch smaller than the pixel pitch of the image sensor 24, the displacement amount calculation section 158 calculates the moving amount of the sixth motor 128 to displace the image by D x p.

[0146] However, as in the case of the above-described shake correction lens 80, in the case where the light transmitted through the displacement lens 82 is visible light and the case where the light transmitted through the displacement lens 82 is near-infrared light, the wavelength bands are different, and thus the displacement sensitivity of the displacement lens 82 changes due to the position deviation of the focus on the image side. In other words, as shown in FIG. 8, the moving amount A2 of the displacement lens 82 required for the same displacement amount B2 on the light receiving surface 24A of the image sensor 24 is different between the case where the light transmitted through the displacement lens 82 is visible light and the case where the light transmitted through the displacement lens 82 is near-infrared light. Specifically, when compared at the same displacement amount B2, the moving amount A2 required when the light transmitted through the displacement lens 82 is visible light is less than the moving amount A2 required when the light transmitted through the displacement lens 82 is near-infrared light. Figure 12

[0147] ​Therefore, the displacement amount calculation section 158 calculates the amount of movement of the 6th motor 128 corresponding to the filter specified by the filter specification information, with respect to the amount of movement of the image displacement. For example, when the filter specified by the filter specification information is the Ir cut filter 86, the displacement amount calculation section 158 calculates the amount of movement of the 6th motor 128 corresponding to the Ir cut filter 86, from the amount of displacement of the image indicated by the image displacement instruction. Also, when the filter specified by the filter specification information is the BPF 88, the displacement amount calculation section 158 calculates the amount of movement of the 6th motor 128 corresponding to the BPF 88, from the amount of displacement of the image indicated by the image displacement instruction. That is, if the wavelength band of the light transmitted through the displacement lens 82 changes, the displacement sensitivity of the displacement lens 82 changes, but even in the case where the wavelength band of the light transmitted through the displacement lens 82 changes, the displacement amount calculation section 158 calculates the amount of movement of the 6th motor 128 so that the image displacement is to the position corresponding to the amount of displacement of the image indicated by the image displacement instruction. The amount of movement of the 6th motor 128 corresponding to the filter specified by the filter specification information can be predetermined for each of the plurality of filters from the amount of displacement of the image indicated by the image displacement instruction, and can also be calculated using various calculation formulas.

[0148] The displacement control section 160 generates a control instruction corresponding to the direction of movement of the 6th motor 128 determined by the displacement amount calculation section 158 and the amount of movement of the 6th motor 128 calculated by the displacement amount calculation section 158, for each frame period. The control instruction is output to the 6th motor driver 112.

[0149] The 6th motor driver 112 generates a movement signal from the control instruction generated by the displacement control section 160. As an example, the movement signal is a pulse wave. The period of the movement signal is synchronized with the frame period specified by the frame period information. The 6th motor 128 moves by the amount of movement corresponding to the movement signal. Thereby, the displacement lens 82 is given power in the direction of movement of the image displacement for each frame period, and the displacement lens 82 moves. For example, when the filter specified by the filter specification information is the Ir cut filter 86, the dither correction lens 80 moves by the movement amount A2 corresponding to the Ir cut filter 86, and when the filter specified by the filter specification information is the BPF 88, the dither correction lens 80 moves by the movement amount A2 corresponding to the BPF 88.

[0150] Thus, the displacement control section 160 controls the 6th motor 128 so as to change the movement amount A2 of the displacement lens 82, in accordance with the wavelength band of the light transmitted through the displacement lens 82. Therefore, even in the case where the wavelength band of the light transmitted through the dither correction lens 80 changes, the influence due to the change in the displacement sensitivity of the displacement lens 82 is suppressed, and the image displacement is to the position corresponding to the amount of displacement of the image indicated by the image displacement instruction.

[0151] The control based on the displacement control section 160 described above is not a sequence control based on the shake amount detection result (i.e., the amount of shake of the monitoring camera 10) detected by the shake amount detection sensor 56 but a sequence control based on the displacement sequence prescribed in advance.

[0152] Then, as the displacement is performed like every frame period, the control to cause the image sensor 24 to perform imaging is performed by the CPU 42 of the monitoring camera main body 20 each time the displacement is performed. Thus, as an example, as shown in Figure 13 , the plurality of frame images 162 corresponding to each frame period are obtained. Then, the plurality of frame images 162 are synthesized by the CPU 42 of the monitoring camera main body 20, and thus the synthesized image 164 is obtained.

[0153] The synthesized image 164 is obtained, for example, as follows. That is, when the displacement amount of the image is the same as the pitch of the pixels of the image sensor 24, the plurality of image pixels forming one of the plurality of frame images 162 overlap the plurality of image pixels forming the other images, and thus the synthesized image 164 is obtained from the plurality of frame images 162. The synthesized image 164 thus obtained is an image that does not need to be subjected to the demosaicing process. Also, when the displacement amount of the image is larger than the pitch of the pixels of the image sensor 24 or when the displacement amount of the image is smaller than the pitch of the pixels of the image sensor 24, the plurality of image pixels forming one of the plurality of frame images 162 are allocated the plurality of image pixels forming the other images, and thus the synthesized image 164 is obtained from the plurality of frame images 162. The synthesized image 164 thus obtained is an image having a higher resolution than the plurality of frame images 162.

[0154] Next, the operation of the monitoring camera 10 according to the present embodiment (i.e., the operation of the monitoring camera 10) will be described.

[0155] First, reference will be made to Figure 10 and Figure 14 The filter change processing in the imaging support processing will be described. When the filter designation information transmitted from the CPU 42 of the monitoring camera main body 20 is received by the transceiver interface (omitted from illustration) of the lens device 70, the CPU 92 of the lens device 70 executes the filter change processing shown in Figure 14 .

[0156] First, in step ST100, the acquisition section 150 acquires the filter designation information transmitted from the CPU 42 of the monitoring camera main body 20. Also, the acquisition section 150 acquires the position detection result detected by the 4th position sensor 140.

[0157] In the next step ST102, the filter control section 152 outputs a control command to arrange the filter specified by the filter specifying information on the optical axis OA to the 4th motor driver 108 in accordance with the filter specifying information transmitted from the CPU 42 and the position detection result detected by the 4th position sensor 140.

[0158] If the control command is received, the 4th motor driver 108 controls the 4th motor 124 in accordance with the control command. Thus, the filter specified by the filter specifying information is arranged on the optical axis OA. For example, when the filter specified by the filter specifying information is the Ir cut filter 86, the filter unit 78 is rotated so that the Ir cut filter 86 is arranged on the optical axis OA. In this way, the filter unit 78 is rotated to switch the filter arranged on the optical axis OA among the plurality of filters, thereby switching the wavelength band of the light transmitted through the shake correction lens 80 and the shift lens 82.

[0159] In the next step ST104, the filter control section 152 stores the filter specifying information in the RAM 96. For example, when the Ir cut filter 86 is arranged on the optical axis OA, the filter control section 152 stores the filter specifying information that the Ir cut filter 86 is specified in the RAM 96.

[0160] Next, the shake correction processing in the image pickup support processing will be described with reference to Figure 11 and Figure 15 When the shake correction command transmitted from the CPU 42 of the surveillance camera main body 20 is received by the transceiver interface (not shown) of the lens device 70, the CPU 92 of the lens device 70 executes the shake correction processing shown in FIG. 10. Figure 15

[0161] First, in step ST110, the acquisition section 150 acquires the shake correction command transmitted from the CPU 42 of the surveillance camera main body 20. Also, in step ST112, the acquisition section 150 acquires the shake amount detection result transmitted from the CPU 42 of the surveillance camera main body 20. Further, in step ST114, the acquisition section 150 acquires the filter specifying information stored in the RAM 96. Also, the acquisition section 150 acquires the position detection result detected by the 5th position sensor 142.

[0162] In the next step ST116, the shake correction amount calculation section 154 determines the direction of movement to correct the shake of the image for the 5th motor 126 in accordance with the shake amount detection result detected by the shake amount detection sensor 56. The direction of movement to correct the shake of the image is determined as the direction opposite to the direction in which the image is shaken.

[0163] ​Further, in the next step ST116, the shake correction amount calculation section 154 calculates the amount of movement of the 5th motor 126 for correcting the shake of the image based on the shake amount detection result detected by the shake amount detection sensor 56. Specifically, the shake correction amount calculation section 154 calculates the amount of movement of the 5th motor 126 for returning the position of the image that is shaken due to the shake of the monitoring camera 10 to the position of the image before the shake of the monitoring camera 10 is generated.

[0164] At this time, the shake correction amount calculation section 154 calculates the amount of movement corresponding to the filter specified by the filter specification information, with respect to the amount of movement of the 5th motor 126 for correcting the shake of the image. For example, when the filter specified by the filter specification information is the Ir cut filter 86, the shake correction amount calculation section 154 calculates the amount of movement corresponding to the Ir cut filter 86, based on the shake amount detection result detected by the shake amount detection sensor 56. Further, when the filter specified by the filter specification information is the BPF 88, the shake correction amount calculation section 154 calculates the amount of movement corresponding to the BPF 88, based on the shake amount detection result detected by the shake amount detection sensor 56. That is, if the wavelength band of the light transmitted through the shake correction lens 80 changes, the shake correction sensitivity of the shake correction lens 80 changes, but even in the case where the wavelength band of the light transmitted through the shake correction lens 80 changes, the shake correction amount calculation section 154 calculates the amount of movement by which the shake correction amount B1 that is proportional to the detection result detected by the shake amount detection sensor 56 can be obtained.

[0165] In the next step ST118, the shake correction control section 156 acquires the direction of movement of the 5th motor 126 determined by the shake correction amount calculation section 154 and the amount of movement of the 5th motor 126 calculated by the shake correction amount calculation section 154, and generates a control command based on the position detection result detected by the 5th position sensor 142, with the acquired direction of movement and the amount of movement of the 5th motor 126 as target values. The control command is output to the 5th motor driver 110.

[0166] The 5th motor driver 110 generates a movement signal based on the control command generated by the shake correction control section 156. As an example, the movement signal is a continuous wave. The 5th motor 126 moves in the direction of movement and the amount of movement corresponding to the movement signal. Thus, the shake correction lens 80 is given power in the direction for correcting the shake of the image, and the shake correction lens 80 moves. For example, when the filter specified by the filter specification information is the Ir cut filter 86, the shake correction lens 80 moves by the movement amount Al corresponding to the Ir cut filter 86, and when the filter specified by the filter specification information is the BPF 88, the shake correction lens 80 moves by the movement amount Al corresponding to the BPF 88.

[0167] Thus, the shake correction control section 156 performs control to change the movement amount Al of the shake correction lens 80 by the 5th motor 126 in accordance with the wavelength band of the light transmitted through the shake correction lens 80. Therefore, even in the case where the wavelength band of the light transmitted through the shake correction lens 80 has changed, the influence caused by the change in the shake correction sensitivity of the shake correction lens 80 is suppressed, and the shake correction amount Bl that is proportional to the detection result detected by the shake amount detection sensor 56 can be obtained.

[0168] Next, the displacement processing in the image pickup support processing will be described with reference to Figure 12 and Figure 16 The displacement processing in the image pickup support processing will be described with reference to Figure 16 The displacement processing in the image pickup support processing will be described with reference to

[0169] First, in step ST120, the acquisition section 150 acquires the image displacement instruction transmitted from the CPU 42 of the surveillance camera main body 20. Also, in step ST122, the acquisition section 150 acquires the frame period information transmitted from the CPU 42 of the surveillance camera main body 20. Further, in step ST124, the acquisition section 150 acquires the filter designation information stored in the RAM 96. Also, the acquisition section 150 acquires the position detection result detected by the 6th position sensor 144.

[0170] In the next step ST126, the displacement amount calculation section 158 determines the movement direction of the 6th motor 128 for each frame period in accordance with the image displacement direction indicated by the image displacement instruction, the frame period indicated by the frame period information, and the position detection result detected by the 6th position sensor 144. The movement direction of the 6th motor 128 is determined in accordance with the image displacement direction indicated by the image displacement instruction and the position detection result detected by the 6th position sensor 144. Also, the displacement amount calculation section 158 calculates the movement amount of the 6th motor 128 for each frame period in accordance with the image displacement amount indicated by the image displacement instruction, the frame period indicated by the frame period information, and the position detection result detected by the 6th position sensor 144.

[0171] At this time, the displacement amount calculation section 158 calculates the amount of movement of the 6th motor 128 corresponding to the filter specified by the filter specification information. For example, when the filter specified by the filter specification information is the Ir cut filter 86, the displacement amount calculation section 158 calculates the amount of movement corresponding to the Ir cut filter 86 from the displacement amount of the image indicated by the image displacement instruction. Also, when the filter specified by the filter specification information is the BPF 88, the displacement amount calculation section 158 calculates the amount of movement corresponding to the BPF 88 from the displacement amount of the image indicated by the image displacement instruction. That is, if the wavelength band of the light transmitted through the displacement lens 82 changes, the displacement sensitivity of the displacement lens 82 changes, but even in the case where the wavelength band of the light transmitted through the displacement lens 82 changes, the displacement amount calculation section 158 calculates the amount of movement of the image to the position corresponding to the displacement amount of the image indicated by the image displacement instruction.

[0172] In the next step ST128, the displacement control section 160 generates a control instruction corresponding to the direction of movement of the 6th motor 128 determined by the displacement amount calculation section 158 and the amount of movement of the 6th motor 128 calculated by the displacement amount calculation section 158 for each frame period. The control instruction is output to the 6th motor driver 112.

[0173] The 6th motor driver 112 generates a movement signal from the control instruction generated by the displacement control section 160. As an example, the movement signal is a pulse wave. The period of the movement signal is synchronized with the frame period specified by the frame period information. The 6th motor 128 moves with the amount of movement corresponding to the movement signal. Thus, the displacement lens 82 is given power in the direction of movement of the image displacement for each frame period, and the displacement lens 82 moves. Specifically, when the filter specified by the filter specification information is the Ir cut filter 86, the displacement lens 82 moves with the movement amount A2 corresponding to the Ir cut filter 86, and when the filter specified by the filter specification information is the BPF 88, the displacement lens 82 moves with the movement amount A2 corresponding to the BPF 88.

[0174] Thus, the displacement control section 160 controls the 6th motor 128 to change the movement amount A2 of the displacement lens 82 in accordance with the wavelength band of the light transmitted through the displacement lens 82. Therefore, even in the case where the wavelength band of the light transmitted through the jitter correction lens 80 changes, the influence caused by the change in the displacement sensitivity of the displacement lens 82 is suppressed, and the image is displaced to the position corresponding to the displacement amount of the image indicated by the image displacement instruction.

[0175] In addition, with reference to the above-described Figure 14 , Figure 15 and Figure 16The method for operating the surveillance camera 10 described herein is an example of the "method of operating a camera device" according to the technology of this invention. Furthermore, referring to the above... Figure 14 , Figure 15 and Figure 16 The method of operating the lens device 70 included in the described method for making the surveillance camera 10 work is an example of the "method of operating the lens device" involved in the technology of the present invention.

[0176] Next, the effects of the surveillance camera 10 according to this embodiment will be explained.

[0177] like Figure 6 As shown, the lens assembly 70 separately includes a jitter correction lens 80 for correcting image jitter and a displacement lens 82 for displacing the image along the light-receiving surface 24A of the image sensor 24. Therefore, for example, compared to using a common motor and utilizing the jitter correction lens 80 for both image jitter correction and image displacement, it is easier to control the fifth motor 126 that moves the jitter correction lens 80 and the sixth motor 128 that moves the displacement lens 82.

[0178] Furthermore, since the fifth motor 126 that moves the jitter correction lens 80 and the sixth motor 128 that moves the displacement lens 82 are separate, the weight can be distributed between the fifth motor 126 and the sixth motor 128 compared to the case where the jitter correction lens 80, which performs both image jitter correction and image displacement, is moved using a common motor.

[0179] And, as Figure 11 As shown, the CPU 92 of the lens device 70 controls the fifth motor 126 to change the movement amount A1 of the jitter correction lens 80 according to the wavelength band of the light transmitted through the jitter correction lens 80. Therefore, even if the wavelength band of the light transmitted through the jitter correction lens 80 changes, the influence caused by the change in the jitter correction sensitivity of the jitter correction lens 80 is suppressed, and a jitter correction amount B1 that is proportional to the detection result detected by the jitter amount detection sensor 56 can be obtained.

[0180] And, as Figure 12 As shown, the CPU 92 of the lens device 70 controls the sixth motor 128 to change the movement amount A2 of the displacement lens 82 according to the wavelength band of the light from the transmission displacement lens 82. Therefore, even if the wavelength band of the light from the transmission jitter correction lens 80 changes, the effect caused by the change in the displacement sensitivity of the displacement lens 82 is suppressed, and the image can be shifted to a position corresponding to the image displacement amount indicated by the image displacement command.

[0181] And, as Figure 7As shown, the displacement sensitivity of the displacement lens 82 is lower than the jitter correction sensitivity of the jitter correction lens 80. That is, the displacement B2 of the image on the light-receiving surface 24A of the image sensor 24, which moves with a unit displacement A relative to the displacement lens 82, is less than the jitter correction B1 of the image on the light-receiving surface 24A of the image sensor 24, which moves with a unit displacement A relative to the jitter correction lens 80. Therefore, for example, compared to the case where the displacement sensitivity of the displacement lens 82 is higher than the jitter correction sensitivity of the jitter correction lens 80, the error in the amount of movement relative to the displacement lens 82 can be reduced in terms of the amount of image displacement.

[0182] And, as Figure 8 As shown, when the displacement of the central ray F1, which passes through the moved displacement lens 82 on the optical axis OA with a unit movement A relative to the displacement lens 82, on the light-receiving surface 24A of the image sensor 24, is defined as S1, and the displacement of the peripheral ray F2, which passes through the moved displacement lens 82 on the optical axis OA with a unit movement A relative to the displacement lens 82, on the light-receiving surface 24A of the image sensor 24, which is also defined as S2, the relationship 0.8 ≤ S2 / S1 ≤ 1.2 holds. Here, when the value of S2 / S1 is outside the aforementioned specified range, that is, when S2 / S1 < 0.8 or when 1.2 < S2 / S1, the image pixel values ​​of the captured image obtained by the image sensor 24 lose continuity, the boundary portions of the image pixels become unnatural (e.g., jagged), and the image quality of the captured image is outside the acceptable range. Furthermore, when image processing such as edge enhancement is applied to the captured image, image processing cannot be performed well, resulting in a decrease in the resolution of the captured image. In contrast, if the relationship 0.8 ≤ S2 / S1 ≤ 1.2 holds, the image quality can be brought within the acceptable range. Furthermore, compared to cases where the value of S2 / S1 is outside the aforementioned specified range, the resolution of the image can be improved.

[0183] And, as Figure 2As shown, the shake correction lens 80 and the shift lens 82 are positioned closer to the image sensor 24 than the zoom lens 74. Here, if the shake correction lens 80 and the shift lens 82 are positioned closer to the subject than the zoom lens 74, the light transmitted through the shake correction lens 80 and the shift lens 82 is imaged on the image sensor 24 via the zoom lens 74. Therefore, as the zoom lens 74 moves along the Z-axis, the shake correction sensitivity of the shake correction lens 80 and the shift sensitivity of the shift lens 82 change. Therefore, when the zoom lens 74 moves along the Z-axis, it is necessary to control the movement amount A1 of the shake correction lens 80 and the movement amount A2 of the shift lens 82 according to the movement of the zoom lens 74 along the Z-axis, but such control becomes complex. In contrast, if the shake correction lens 80 and the displacement lens 82 are positioned closer to the image sensor 24 than the zoom lens 74, then it is not necessary to control the movement amount A1 of the shake correction lens 80 and the movement amount A2 of the displacement lens 82 based on the movement of the zoom lens 74 in the Z-axis direction.

[0184] Furthermore, since the shake correction lens 80 and the displacement lens 82 are positioned closer to the image sensor 24 than the zoom lens 74, they can each have a smaller diameter compared to the case where the shake correction lens 80 and the displacement lens 82 are positioned closer to the image sensor 24 than the case where the shake correction lens 80 and the displacement lens 82 are positioned closer to the image sensor 24 than the zoom lens 74.

[0185] Furthermore, by setting the jitter correction lens 80 and the displacement lens 82 to have small diameters, the jitter correction lens 80 and the displacement lens 82 can be made lighter. As a result, the drive load of the fifth motor 126 that moves the jitter correction lens 80 and the drive load of the sixth motor 128 that moves the displacement lens 82 can be reduced respectively.

[0186] And, as Figure 3 As shown, the filter unit 78 of the lens assembly 70 includes multiple BPF88s. The filter unit 78 is positioned closer to the subject than the image sensor 24, and the multiple BPF88s allow the transmission of near-infrared light contained in the light. Therefore, by imaging the near-infrared light onto the image sensor 24, a near-infrared light image can be obtained.

[0187] And, as Figure 12 As shown, the CPU 92 of the lens assembly 70 controls the sixth motor 128 to move the displacement lens 82 to a position where the displacement is greater than or less than the pixel pitch of the image sensor 24. Therefore, as Figure 13 As shown, by synthesizing the multiple frames of image 162, a synthesized image 164 can be obtained.

[0188] Further, the shake correction lens 80 and the displacement lens 82 are disposed at positions closer to the image sensor 24 than the focus lens 72. In this case, if the shake correction lens 80 and the displacement lens 82 are disposed at positions closer to the subject than the focus lens 72, light transmitted through the shake correction lens 80 and the displacement lens 82 is imaged on the image sensor 24 via the focus lens 72, and thus the shake correction sensitivity of the shake correction lens 80 and the displacement sensitivity of the displacement lens 82 vary as the focus lens 72 moves in the Z-axis direction. Therefore, when the focus lens 72 moves in the Z-axis direction, control to adjust the movement amount Al of the shake correction lens 80 and the movement amount A2 of the displacement lens 82 in accordance with the movement of the focus lens 72 in the Z-axis direction is required, but such control becomes complicated. In contrast to this, if the shake correction lens 80 and the displacement lens 82 are disposed at positions closer to the image sensor 24 than the focus lens 72, control to adjust the movement amount Al of the shake correction lens 80 and the movement amount A2 of the displacement lens 82 in accordance with the movement of the focus lens 72 in the Z-axis direction is not required.

[0189] Further, the shake correction lens 80 and the displacement lens 82 are disposed at positions closer to the image sensor 24 than the diaphragm 76. In this case, if the shake correction lens 80 and the displacement lens 82 are disposed between the diaphragm 76 and the zoom lens 74, a 5th slide mechanism (omitted from illustration) that supports the shake correction lens 80 so as to be slidable along the X-Y coordinate surface and a 6th slide mechanism (omitted from illustration) that supports the displacement lens 82 so as to be slidable along the X-Y coordinate surface are disposed adjacent to a 2nd slide mechanism (omitted from illustration) that supports the zoom lens 74 so as to be movable in the Z-axis direction, and thus the structure of the lens device 70 becomes complicated. Therefore, as the structure of the lens device 70 becomes complicated, the movement precision of the shake correction lens 80 and the movement precision of the displacement lens 82 can decrease. In contrast to this, if the shake correction lens 80 and the displacement lens 82 are disposed at positions closer to the image sensor 24 than the diaphragm 76, the movement precision of the shake correction lens 80 and the movement precision of the displacement lens 82 can be improved, for example, as compared to the case where the shake correction lens 80 and the displacement lens 82 are disposed between the diaphragm 76 and the zoom lens 74.

[0190] Further, the lens device 70 includes a filter unit 78 that switches the wavelength band of light transmitted through the shake correction lens 80 and the displacement lens 82. Therefore, the wavelength band of light transmitted through the shake correction lens 80 and the displacement lens 82 can be easily switched, for example, as compared to the case where one of a plurality of filters is selectively attached to the lens device 70 in order to change the wavelength band of light transmitted through the shake correction lens 80 and the displacement lens 82.

[0191] Next, a modification of the surveillance camera 10 according to the present embodiment will be described.

[0192] In the above embodiment, the CPU 92 of the lens device 70 performs two types of control: controlling the movement amount A1 of the jitter correction lens 80 and controlling the movement amount A2 of the displacement lens 82 based on the wavelength band of the light from the jitter correction lens 80 and the displacement lens 82. However, the CPU 92 of the lens device 70 may also perform only one of the two types of control: controlling the movement amount A1 of the jitter correction lens 80 and controlling the movement amount A2 of the displacement lens 82.

[0193] Furthermore, in the above embodiment, in order to change the wavelength band of the light transmitted through the jitter correction lens 80 and the displacement lens 82, a rotating filter unit 78 is used, in which multiple filters are arranged in a ring and the filters disposed on the optical axis OA are switched by rotation. However, for example, a sliding filter unit can also be used, in which multiple filters are arranged in a straight line and the filters disposed on the optical axis OA are switched by sliding. Furthermore, in order to change the wavelength band of the light transmitted through the jitter correction lens 80 and the displacement lens 82, one of the multiple filters can be selectively mounted on the lens assembly 70.

[0194] Furthermore, the control of the movement amount A1 of the jitter correction lens 80 according to the wavelength band of the light from the transmission jitter correction lens 80 is not limited to the above-described method; various other methods may be adopted. Similarly, the control of the movement amount A2 of the displacement lens 82 according to the wavelength band of the light from the transmission displacement lens 82 is not limited to the above-described method; various other methods may be adopted.

[0195] Furthermore, in the above embodiment, a focusing lens 72, a zoom lens 74, an aperture 76, a filter unit 78, a shake correction lens 80, and a shift lens 82 are arranged sequentially along the optical axis OA from the subject side to the image side. However, as an example, such as Figure 17 As shown, a zoom lens 74, an aperture 76, a filter unit 78, a shake correction lens 80, a focusing lens 72, and a shift lens 82 can also be arranged sequentially along the optical axis OA from the subject side to the image side.

[0196] Furthermore, the arrangement order of the focusing lens 72, zoom lens 74, aperture 76, filter unit 78, shake correction lens 80, and shift lens 82 can also be [not specified]. Figure 2 The order shown and Figure 17 An order other than the one shown.

[0197] Furthermore, in the above embodiment, the lens device 70 is disposed on the surveillance camera body 20 by mounting the lens device 70 on the surveillance camera body 20 having the image sensor 24. However, as an example, such as Figure 18As shown, the lens device 70 can also be mounted on the main body 20 of the surveillance camera having the image sensor 24.

[0198] Furthermore, the surveillance camera 10 can also be configured as follows. That is, as an example, in Figure 19 In the modified example of the surveillance camera 10 shown, the lens device 70 includes a first optical system 202, a second optical system 204, a dichroic prism 206, a third optical system 208, and a fourth optical system 210. Furthermore, the surveillance camera body 20 includes a first image sensor 214 and a second image sensor 216. The dichroic prism 206 is an example of a "light separation mechanism" according to the technology of this invention, and the first image sensor 214 and the second image sensor 216 are examples of "image sensors" according to the technology of this invention.

[0199] The first optical system 202 has multiple lenses 218, 220, 222, and 224 and a first aperture 230. A second optical system 204 is disposed between the first optical system 202 and the dichroic prism 206. The second optical system 204 has a lens 228. The dichroic prism 206 separates light into a first beam G1 and a second beam G2. For example, the first beam G1 is infrared light, and the second beam G2 is visible light. The optical axis OA is branched by the dichroic prism 206 into a first optical axis OAa and a second optical axis OAb.

[0200] The third optical system 208 is disposed between the dichroic prism 206 and the first image sensor 214. The third optical system 208 includes a first filter unit 231, a first jitter correction lens 232, and a first displacement lens 234. The first jitter correction lens 232 is related to the aforementioned jitter correction lens 80 (see reference). Figure 6 Similarly, it moves along the XY coordinate plane by being powered by the first drive mechanism (not shown). The first displacement lens 234 and the aforementioned displacement lens 82 (see reference) Figure 6 Similarly, it moves along the XY coordinate plane by being powered by the second drive mechanism (not shown). The first jitter correction lens 232 and the first displacement lens 234 are examples of the "first optical lens" and "moving lens" involved in the technology of the present invention, respectively.

[0201] The fourth optical system 210 is disposed between the dichroic prism 206 and the second image sensor 216. The fourth optical system 210 includes a second aperture 236, a second filter unit 238, a second jitter correction lens 240, and a second shift lens 242. The second jitter correction lens 240 is related to the aforementioned jitter correction lens 80 (see reference). Figure 6 Similarly, it moves along the XZ coordinate plane by being powered by the third drive mechanism (not shown). The second displacement lens 242 and the aforementioned displacement lens 82 (see reference)Figure 6 Similarly, it moves along the XZ coordinate plane by being powered by the fourth drive mechanism (not shown). The second jitter correction lens 240 and the second displacement lens 242 are examples of the "second optical lens" and "moving lens" involved in the technology of the present invention, respectively.

[0202] On the light-receiving surface 214A of the first image sensor 214, the first light G1 transmitted through the first jitter correction lens 232 and the first displacement lens 234 is used for imaging, and on the light-receiving surface 216A of the second image sensor 216, the second light G2 transmitted through the second jitter correction lens 240 and the second displacement lens 242 is used for imaging.

[0203] exist Figure 19 In the modified example shown, similarly to the above embodiment, control is performed to change the movement amount of the first jitter correction lens 232 and the movement amount of the first displacement lens 234 based on the wavelength band of the first light G1 transmitted through the first jitter correction lens 232 and the first displacement lens 234. Furthermore, in Figure 19 In the modified example shown, similarly to the above embodiment, the control of the movement amount of the second jitter correction lens 240 and the control of the movement amount of the second displacement lens 242 are respectively performed based on the wavelength band of the second light G2 transmitted through the second jitter correction lens 240 and the second displacement lens 242.

[0204] In addition, Figure 19 In the modified example shown, it is also possible to perform only one of the above-described combinations of controlling the amount of movement of the first jitter correction lens 232 and controlling the amount of movement of the first displacement lens 234, and the combination of controlling the amount of movement of the second jitter correction lens 240 and controlling the amount of movement of the second displacement lens 242.

[0205] Furthermore, in Figure 19 In the modified example shown, it is also possible to perform only one of the above-described controls: changing the movement amount of the first jitter correction lens 232 and changing the movement amount of the first displacement lens 234. Furthermore, in Figure 19 In the modified example shown, either the control of changing the movement amount of the second jitter correction lens 240 or the control of changing the movement amount of the second displacement lens 242 described above can be performed.

[0206] Furthermore, in Figure 19 In the variant shown, one of the first jitter correction lens 232 and the first displacement lens 234 can be a fixed lens. Similarly, one of the second jitter correction lens 240 and the second displacement lens 242 can be a fixed lens.

[0207] Also, in the above-described embodiment, the lens device 70 includes the controller 90 different from the controller 40 of the monitoring camera main body 20, but the lens device 70 can not include the controller 90. Also, the function of the controller 90 of the lens device 70 can be integrated in the controller 40 of the monitoring camera main body 20 and the control of the lens device 70 can be performed by the controller 40 of the monitoring camera main body 20. In this case, the controller 90 is an example of the "computer applicable to the image pickup device".

[0208] Also, in the above-described embodiment, the case where the image pickup processing is performed by the controller 40 of the monitoring camera 10 is described as an example, but the technology of the present application is not limited to this. For example, the image pickup processing can be performed by a computer of an external device communicably connected to the monitoring camera 10 via a network such as a LAN or a WAN. Also, the image pickup processing can be performed by the external device and the monitoring camera 10 described above in a distributed manner, or the image pickup processing can be performed by a plurality of devices including the external device and the monitoring camera 10 described above in a distributed manner.

[0209] Also, in the above-described embodiment, the monitoring camera 10 is described as an example of the image pickup device, but the technology of the present application is not limited to this, and the technology described in the above-described embodiment can be applied to various image pickup devices. As the image pickup device, for example, a digital camera which is interchangeable with a lens and does not use a mirror, a digital camera which is fixed with a lens, a digital camera which uses a mirror, a digital camera built in a smart device, a wearable terminal, a cell observation device, an ophthalmic observation device, or a surgical microscope, or the like can be given. Also, the technology described in the above-described embodiment can be applied to an image pickup device including an image sensor having sensitivity to light having a wavelength band other than the near-infrared light.

[0210] Also, in the above-described embodiment, the case where the image pickup support processing program 100 is stored in the NVM 94 is described as an example, but the image pickup support processing program 100 can be stored in a portable storage medium such as an SSD or a USB memory, and the image pickup support processing program 100 can be stored in a non-temporary storage medium. The image pickup support processing program 100 stored in the non-temporary storage medium is used, for example, by being installed in the lens device 70 or the like.

[0211] Also, in the above-described embodiment, the case where the controller 40 is built in the monitoring camera 10 is described as an example, but the technology of the present application is not limited to this, and the controller 40 can be provided outside the monitoring camera 10, for example.

[0212] Also, in the above-described embodiment, the CPU 42 of the monitoring camera main body 20 is a single CPU, but can be multiple CPUs. Also, a GPU can be used instead of the CPU 42. Similarly, the CPU 92 of the lens device 70 is a single CPU, but can be multiple CPUs. Also, a GPU can be used instead of the CPU 92.

[0213] Also, in the above-described embodiment, the monitoring camera main body 20 is provided with the controller 40, but the technology of the present application is not limited thereto, and a device including an ASIC, an FPGA, and / or a PLD can be used instead of the controller 40. Also, a combination of a hardware structure and a software structure can be used instead of the controller 40.

[0214] Also, in the above-described embodiment, the lens device 70 is provided with the controller 90, but the technology of the present application is not limited thereto, and a device including an ASIC, an FPGA, and / or a PLD can be used instead of the controller 90. Also, a combination of a hardware structure and a software structure can be used instead of the controller 90.

[0215] As a hardware resource that executes the imaging assistance processing described in the above-described embodiment, various processors described below can be used. As the processor, for example, a general-purpose processor, that is, a CPU that functions as a hardware resource that executes the imaging assistance processing by executing software, that is, a program can be cited. Also, as the processor, for example, a processor, that is, a dedicated circuit having a circuit structure that is designed specifically to execute a specific processing, such as an FPGA, a PLD, or an ASIC can be cited. Any processor has a memory built therein or connected thereto, and any processor uses the memory to execute the imaging assistance processing.

[0216] The hardware resource that executes the imaging assistance processing can be constituted by one of these various processors, or can be constituted by a combination of two or more processors of the same kind or different kinds (for example, a combination of a plurality of FPGAs or a combination of a CPU and an FPGA). Also, the hardware resource that executes the imaging assistance processing can be one processor.

[0217] As an example in which one processor is used, first, there is a manner in which one processor constituted by a combination of one or more CPUs and software functions as a hardware resource that executes the imaging assistance processing. Second, there is a manner in which a processor that functions to realize the entire system including a plurality of hardware resources that execute the imaging assistance processing using one IC chip is used as represented by an SoC or the like. In this way, the imaging assistance processing is realized using one or more of the above-described various processors as a hardware resource.

[0218] Further, as the hardware structure of these various processors, more specifically, a circuit in which circuit elements such as semiconductor elements are combined can be used. Also, the above-described imaging assistance processing is only an example. Therefore, within a range not departing from the gist, needless steps can be deleted, or new steps can be added, or the processing order can be changed, of course.

[0219] The above-described description and drawings are a detailed explanation of a part of the technology of the present application, and are only an example of the technology of the present application. For example, the explanation about the above-described structure, function, action, and effect is an explanation about an example of the structure, function, action, and effect of the part of the technology of the present application. Therefore, within a range not departing from the gist of the technology of the present application, needless parts of the above-described description and drawings can be deleted, or new elements can be added or replaced. Also, in order to avoid complicated situations and to easily understand the part of the technology of the present application, the explanation about technical common sense and the like which is not particularly required in aspects of enabling the technology of the present application to be implemented is omitted in the above-described description and drawings.

[0220] In the present specification, the meaning of "A and / or B" is the same as "at least one of A and B". That is, the meaning of "A and / or B" is that only A can be included, or only B can be included, or both A and B can be included. Also, in the present specification, the case in which three or more cases are connected with "and / or" is also applied to the same idea as "A and / or B".

[0221] All of the literature, patent applications, and technical standards cited in the present specification are incorporated by reference to the same extent as the respective literature, patent application, and technical standard is specifically and individually cited by reference in the present specification.

Claims

1. A lens device provided to a camera body having an image sensor, the lens device comprising: a processor; a memory connected to or built in the processor; a lens including a movable lens and imaging an incident light on the image sensor; and a driving mechanism moving the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the processor controlling the driving mechanism according to a detection result detected by a shake amount detection sensor detecting a shake amount of a camera to move the movable lens in a direction to correct a shake of an image obtained by imaging the light on the image sensor.

2. A lens device provided to a camera body having an image sensor, the lens device comprising: a processor; a memory connected to or built in the processor; a lens including a movable lens and imaging an incident light on the image sensor; and a driving mechanism moving the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the processor controlling the driving mechanism according to an image displacement instruction to move the movable lens in a direction to displace an image obtained by imaging the light on the image sensor.

3. The lens device according to claim 2, wherein the processor controls the driving mechanism to move the movable lens to a position where the image is displaced by a distance corresponding to a displacement amount of the image indicated by the image displacement instruction.

4. The lens device according to claim 2 or 3, comprising: a first lens moving in a direction where a shake of the image is corrected; and a second lens as the movable lens.

5. The lens device according to claim 4, wherein a displacement amount of the image on a light receiving surface of the image sensor with respect to movement of the second lens by a unit movement amount is smaller than a shake correction amount of the image on the light receiving surface of the image sensor with respect to movement of the first lens by the unit movement amount.

6. The lens device according to claim 4 or 5, wherein ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ S1 and S2 are established.

7. An imaging device comprising: a processor; a memory connected to or built in the processor; an image sensor; a lens including a movable lens and imaging an incident light on the image sensor; and a driving mechanism moving the movable lens by applying a power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the processor controls the driving mechanism to move the movable lens in a direction to correct a shake of an image obtained by imaging the light on the image sensor according to a detection result detected by a shake amount detection sensor detecting a shake amount of the imaging device; the processor controls the driving mechanism to change a moving amount of the movable lens to a moving amount to obtain a shake correction amount proportional to the detection result detected by the shake amount detection sensor even when a wavelength band of the light transmitted through the movable lens is changed.

8. An imaging device comprising: a processor; a memory connected to or built in the processor; an image sensor; a lens including a movable lens and imaging an incident light on the image sensor; and a driving mechanism moving the movable lens by applying a power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the processor controls the driving mechanism to move the movable lens in a direction to displace an image obtained by imaging the light on the image sensor according to an image displacement instruction instructing an image displacement; the processor controls the driving mechanism to change a moving amount of the movable lens to a moving amount to displace the image to a position corresponding to a displacement amount of the image indicated by the image displacement instruction even when a wavelength band of the light transmitted through the movable lens is changed.

9. The imaging device according to claim 8, wherein the processor performs the following processing: the processor controls the driving mechanism to move the movable lens to a position in which the image obtained by imaging the light on the image sensor is displaced by a pitch equal to or greater than a pixel pitch of the image sensor or a pitch smaller than the pixel pitch of the image sensor; the processor causes the image sensor to perform imaging each time the image is displaced; the processor synthesizes images of a plurality of frames obtained by the imaging.

10. A method of operating a lens device including: a lens including a movable lens and imaging an incident light on an image sensor of an imaging device main body; and a driving mechanism moving the movable lens by applying a power to the movable lens along a coordinate plane intersecting an optical axis of the lens. ​ ​ a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the operation method including the steps of: controlling the driving mechanism to move the movable lens in a direction to correct a blur of an image obtained by imaging the light on the image sensor, in accordance with a detection result detected by a blur amount detection sensor that detects a blur amount of the image pickup device; controlling the driving mechanism to change the movement amount of the movable lens to a movement amount that obtains a blur correction amount proportional to the detection result detected by the blur amount detection sensor, in accordance with a wavelength band of the light transmitted through the movable lens, even when the wavelength band of the light transmitted through the movable lens has changed.

11. An operation method of a lens device that includes: a lens including a movable lens and imaging incident light on an image sensor of an image pickup device main body; and a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the operation method including the steps of: controlling the driving mechanism to move the movable lens in a direction to displace an image obtained by imaging the light on the image sensor, in accordance with an image displacement instruction that is an instruction to displace the image; controlling the driving mechanism to change the movement amount of the movable lens to a movement amount that displaces the image to a position corresponding to a displacement amount of the image indicated by the image displacement instruction, in accordance with a wavelength band of the light transmitted through the movable lens, even when the wavelength band of the light transmitted through the movable lens has changed.

12. An operation method of an image pickup device that includes: an image sensor; a lens including a movable lens and imaging incident light on the image sensor; and a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the operation method including the steps of: controlling the driving mechanism to move the movable lens in a direction to correct a blur of an image obtained by imaging the light on the image sensor, in accordance with a detection result detected by a blur amount detection sensor that detects a blur amount of the image pickup device; controlling the driving mechanism to change the movement amount of the movable lens to a movement amount that obtains a blur correction amount proportional to the detection result detected by the blur amount detection sensor, in accordance with a wavelength band of the light transmitted through the movable lens, even when the wavelength band of the light transmitted through the movable lens has changed.

13. An operation method of an image pickup device that includes: an image sensor; a lens including a movable lens and imaging incident light on the image sensor; and a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the operation method including the steps of: controlling the driving mechanism to move the movable lens in a direction in which an image formed by imaging the light on the image sensor is displaced according to an instruction to displace the image, i.e., an image displacement instruction; controlling the driving mechanism to change the amount of movement of the movable lens to an amount of movement in which the image is displaced to a position corresponding to the amount of displacement of the image indicated by the image displacement instruction, even when the wavelength band of the light transmitted through the movable lens has changed.

14. A non-transitory storage medium storing a program for causing a computer applicable to a lens apparatus having: a lens including a movable lens and imaging incident light on an image sensor of an image pickup device main body; and a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the processing including: controlling the driving mechanism to move the movable lens in a direction in which an image formed by imaging the light on the image sensor is displaced according to a detection result detected by a shake amount detection sensor that detects an amount of shake of the image pickup device; controlling the driving mechanism to change the amount of movement of the movable lens to an amount of movement in which a shake correction amount proportional to the detection result detected by the shake amount detection sensor is obtained, even when the wavelength band of the light transmitted through the movable lens has changed.

15. A non-transitory storage medium storing a program for causing a computer applicable to a lens apparatus having: a lens including a movable lens and imaging incident light on an image sensor of an image pickup device main body; and a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the processing including: controlling the driving mechanism to move the movable lens in a direction in which an image formed by imaging the light on the image sensor is displaced according to an instruction to displace the image, i.e., an image displacement instruction; controlling the driving mechanism to change the amount of movement of the movable lens to an amount of movement in which the image is displaced to a position corresponding to the amount of displacement of the image indicated by the image displacement instruction, even when the wavelength band of the light transmitted through the movable lens has changed.

16. A non-transitory storage medium storing a program for causing a computer applicable to an image pickup device having: an image sensor; a lens including a movable lens and imaging incident light on the image sensor; and a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the processing including: controlling the driving mechanism to move the movable lens in a direction in which an image formed by imaging the light on the image sensor is displaced according to an instruction to displace the image, i.e., an image displacement instruction; and controlling the driving mechanism to change the amount of movement of the movable lens to an amount of movement in which the image is displaced to a position corresponding to the amount of displacement of the image indicated by the image displacement instruction, even when the wavelength band of the light transmitted through the movable lens has changed. controlling the driving mechanism to move the movable lens in a direction to correct a shake of an image obtained by imaging the light on the image sensor, based on a detection result detected by a shake amount detection sensor that detects an amount of shake of the imaging device; controlling the driving mechanism to change the amount of movement of the movable lens to an amount of movement to obtain a shake correction amount that is proportional to the detection result detected by the shake amount detection sensor, even when a wavelength band of the light transmitted through the movable lens changes.

17. A non-transitory storage medium storing a program for causing a computer applicable to an imaging device to execute a process, the imaging device including: an image sensor; a lens including a movable lens and imaging incident light on the image sensor; and a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the process including: controlling the driving mechanism to move the movable lens in a direction to displace an image obtained by imaging the light on the image sensor, based on an image displacement instruction that is an instruction to displace the image; controlling the driving mechanism to change the amount of movement of the movable lens to an amount of movement to displace the image to a position corresponding to an amount of displacement of the image indicated by the image displacement instruction, even when a wavelength band of the light transmitted through the movable lens changes.

18. A lens device provided in an imaging device main body having an image sensor, the lens device including: a processor; a memory connected to or built in the processor; a lens including a movable lens and imaging incident light on the image sensor; and a driving mechanism that moves the movable lens by imparting power to the movable lens along a coordinate plane intersecting an optical axis of the lens, the movable lens including a shake correction lens that moves in a direction to correct a shake of an image obtained by imaging the light on the image sensor and a displacement lens that moves to a position to displace the image, the driving mechanism including a first driving mechanism that moves the shake correction lens along the coordinate plane and a second driving mechanism that moves the displacement lens along the coordinate plane, the processor controlling the driving mechanism to change at least one of the amount of movement of the shake correction lens and the amount of movement of the displacement lens, based on a wavelength band of the light transmitted through the movable lens, controlling the first driving mechanism to move the shake correction lens in a direction to correct a shake of the image; controlling the second driving mechanism to move the displacement lens in a direction to displace the image, S1 and S2 satisfy a relationship of 0.8 ≤ S2 / S1 ≤ 1.

2.

19. An image pickup apparatus comprising: a processor; a memory connected to or built in the processor; an image sensor; a lens including a moving lens and imaging incident light on the image sensor; and a driving mechanism that moves the moving lens by imparting power to the moving lens along a coordinate plane intersecting an optical axis of the lens, the moving lens includes a shake correction lens that moves in a direction to correct shake of an image obtained by imaging the light on the image sensor and a displacement lens that moves to a position where the image is displaced, the driving mechanism includes a first driving mechanism that moves the shake correction lens along the coordinate plane and a second driving mechanism that moves the displacement lens along the coordinate plane, the processor controls at least one of a moving amount of the shake correction lens and a moving amount of the displacement lens according to a wavelength band of the light transmitted through the moving lens, the first driving mechanism is controlled to move the shake correction lens in a direction to correct shake of the image; the second driving mechanism is controlled to move the displacement lens in a direction to displace the image, S1 and S2 satisfy a relationship of 0.8 ≤ S2 / S1 ≤ 1.

2.

20. An operation method of a lens apparatus including: a lens including a moving lens and imaging incident light on an image sensor of an image pickup apparatus main body; and a driving mechanism that moves the moving lens by imparting power to the moving lens along a coordinate plane intersecting an optical axis of the lens, the moving lens includes a shake correction lens that moves in a direction to correct shake of an image obtained by imaging the light on the image sensor and a displacement lens that moves to a position where the image is displaced, the driving mechanism includes a first driving mechanism that moves the shake correction lens along the coordinate plane and a second driving mechanism that moves the displacement lens along the coordinate plane, the operation method includes: ​ ​ the control unit controls at least one of the movement amount of the shake correction lens and the movement amount of the displacement lens according to a wavelength band of the light transmitted through the movable lens, the first drive mechanism is controlled to move the shake correction lens in a direction to correct a shake of the image, the second drive mechanism is controlled to move the displacement lens in a direction to displace the image, when a displacement amount of a central light ray of the displacement lens on the optical axis after the movement is set as S1 and a displacement amount of a peripheral light ray of the displacement lens on the optical axis after the movement is set as S2, 0.8 ≤ S2 / S1 ≤ 1.2 is satisfied.

21. An operation method of an imaging device including: an image sensor; a lens including a movable lens and imaging incident light on the image sensor; and a drive mechanism moving the movable lens by applying a driving force to the movable lens along a coordinate plane intersecting an optical axis of the lens, the movable lens including a shake correction lens moving in a direction to correct a shake of an image obtained by imaging the light on the image sensor and a displacement lens moving in a direction to displace the image, the drive mechanism including a first drive mechanism moving the shake correction lens along the coordinate plane and a second drive mechanism moving the displacement lens along the coordinate plane, the operation method including: the control unit controlling at least one of the movement amount of the shake correction lens and the movement amount of the displacement lens according to a wavelength band of the light transmitted through the movable lens, the first drive mechanism being controlled to move the shake correction lens in a direction to correct a shake of the image, the second drive mechanism being controlled to move the displacement lens in a direction to displace the image, when a displacement amount of a central light ray of the displacement lens on the optical axis after the movement is set as S1 and a displacement amount of a peripheral light ray of the displacement lens on the optical axis after the movement is set as S2, 0.8 ≤ S2 / S1 ≤ 1.2 is satisfied.

22. A non-transitory storage medium storing a program for causing a computer applicable to a lens device including: a lens including a movable lens and imaging incident light on an image sensor of an imaging device main body; and a drive mechanism moving the movable lens by applying a driving force to the movable lens along a coordinate plane intersecting an optical axis of the lens, ​ ​ The moving lens includes a shake correction lens that moves in a direction to correct shake of an image obtained by imaging the light on the image sensor, and a shift lens that moves to a position to shift the image, The drive mechanism includes a first drive mechanism that moves the shake correction lens along the coordinate plane, and a second drive mechanism that moves the shift lens along the coordinate plane, The processing includes the steps of: The drive mechanism is controlled to change at least one of the movement amount of the shake correction lens and the movement amount of the shift lens according to a wavelength band of the light transmitted through the moving lens, The first drive mechanism is controlled to move the shake correction lens in a direction to correct shake of the image; The second drive mechanism is controlled to move the shift lens in a direction to shift the image, When a shift amount of a central light ray of the shift lens on the light-receiving surface of the image sensor after movement is set as S1 with respect to movement of the shift lens by a unit movement amount, and a shift amount of a peripheral light ray of the shift lens on the light-receiving surface of the image sensor after movement is set as S2 with respect to movement of the shift lens by the unit movement amount, 0.8 ≤ S2 / S1 ≤ 1.

2.

23. A non-transitory storage medium storing a program for causing a computer applicable to an image pickup device to execute processing, the image pickup device including: an image sensor; a lens including a moving lens, and imaging incident light on the image sensor; and a drive mechanism that moves the moving lens by imparting power to the moving lens along a coordinate plane intersecting an optical axis of the lens, The moving lens includes a shake correction lens that moves in a direction to correct shake of an image obtained by imaging the light on the image sensor, and a shift lens that moves to a position to shift the image, The drive mechanism includes a first drive mechanism that moves the shake correction lens along the coordinate plane, and a second drive mechanism that moves the shift lens along the coordinate plane, The processing includes the steps of: The drive mechanism is controlled to change at least one of the movement amount of the shake correction lens and the movement amount of the shift lens according to a wavelength band of the light transmitted through the moving lens, The first drive mechanism is controlled to move the shake correction lens in a direction to correct shake of the image; The second drive mechanism is controlled to move the shift lens in a direction to shift the image, When a shift amount of a central light ray of the shift lens on the light-receiving surface of the image sensor after movement is set as S1 with respect to movement of the shift lens by a unit movement amount, and a shift amount of a peripheral light ray of the shift lens on the light-receiving surface of the image sensor after movement is set as S2 with respect to movement of the shift lens by the unit movement amount, 0.8 ≤ S2 / S1 ≤ 1.2.

Images