Lens device, imaging device, lens device operation method, imaging device operation method, and program

Abstract

This lens device is provided in an imaging device body having an image sensor, and comprises a processor, a memory that is connected to or built in the processor, a lens that includes a movable lens and forms an image of incident light on the image sensor, and a drive mechanism that moves the movable lens by applying power to the movable lens along a coordinate plane crossing the optical axis of the lens. The processor performs, on the drive mechanism, control for changing the movement amount of the movable lens on the basis of the wavelength band of light transmitted through the movable lens.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a lens device, an imaging device, a method for operating a lens device, a method for operating an imaging device, and a program. [Background technology]

[0002] Japanese Patent Application Laid-Open Publication No. 2017-44878 discloses an imaging device comprising an imaging means for imaging a subject through an imaging optical system, first and second image blur correction means for correcting image blur in the image of the subject, and a control means for acquiring a shake detection signal and controlling the first and second image blur correction means to correct the image blur, and for controlling pixel shifting to acquire multiple images with the imaging means while moving the first or second image blur correction means or the first and second image blur correction means.

[0003] Japanese Patent Application Laid-Open Publication No. 2014-21349 discloses an image acquisition method using an imaging device configured so that at least a portion of the lens group or lenses that make up the photographing lens are movable lens groups and the movable lens group is moved by a control unit so as to have a component in a direction perpendicular to the optical axis, the image acquisition method comprising the steps of: acquiring two or more images whose optical axes are positioned differently on the imaging plane by moving the movable lens group and shifting the optical axis of the photographing lens on the imaging plane of the image sensor; and synthesizing the two or more images to generate one image.

[0004] Japanese Patent Laid-Open No. 2000-13670 discloses a method for detecting an image by using a pixel shifting device, a vibration detection device for detecting vibration, an image blur correction device for correcting the image blur based on the output of the vibration detection device, a pixel shifting device for slightly displacing the position of an image on the image by using the image blur correction device, and a method for correcting an image by using the pixel shifting device. inThe present invention discloses an imaging device characterized by comprising: an image synthesis means for synthesizing a high-resolution image based on multiple pieces of image data captured by displacing the position of the image; and a control means for selecting a first shooting mode for correcting image shake and a second shooting mode for synthesizing a high-resolution image, and for changing the drive control of the image shake correction means depending on the selected shooting mode. Summary of the Invention

[0005] As an example, one embodiment of the technology disclosed herein provides a lens device, an imaging device, an operating method of a lens device, an operating method of an imaging device, and a program that can move a movable lens by an amount of movement that corresponds to the wavelength band of light that passes through the movable lens. [Means for solving the problem]

[0006] A first aspect of the technology of the present disclosure is a lens device provided in an imaging device body having an image sensor, comprising a processor, a memory connected to or built into the processor, a lens including a movable lens that focuses incident light onto the image sensor, and a drive mechanism that moves the movable lens by applying power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, wherein the processor controls the drive mechanism to change the amount of movement of the movable lens based on the wavelength band of light that passes through the movable lens.

[0007] A second aspect of the technology of the present disclosure is a lens device according to the first aspect, comprising a first lens, a second lens, a first driving mechanism that moves the first lens along a coordinate plane, and a second driving mechanism that moves the second lens along the coordinate plane, wherein at least one of the first lens and the second lens is a movable lens.

[0008] A third aspect of the technology of the present disclosure is a lens device according to the second aspect, in which the processor controls the first drive mechanism to move the first lens in a direction that corrects blurring of the image obtained by focusing light on the image sensor, and controls the second drive mechanism to move the second lens in a direction that shifts the image.

[0009] A fourth aspect of the technology of the present disclosure is a lens device according to the third aspect, in which the processor controls the second drive mechanism to move the second lens to a position where the image shifts at a pitch equal to or greater than the pixel pitch of the image sensor or at a pitch less than the pixel pitch of the image sensor.

[0010] A fifth aspect of the technology of the present disclosure is a lens device according to the third or fourth aspect, in which the amount of image shift on the light receiving surface of the image sensor relative to the movement of the second lens by a unit movement amount is smaller than the amount of image blur correction on the light receiving surface of the image sensor relative to the movement of the first lens by a unit movement amount.

[0011] A sixth aspect of the technology of the present disclosure is a lens device according to any one of the third to fifth aspects, in which, when the shift amount on the light receiving surface of the image sensor of the central ray that passes through the second lens after movement on the optical axis relative to the unit movement amount of the second lens is S1, and the shift amount on the light receiving surface of the image sensor of the peripheral ray that passes through the second lens after movement other than on the optical axis relative to the unit movement amount of the second lens is S2, the relationship 0.8≦S2 / S1≦1.2 holds.

[0012] A seventh aspect of the technology of the present disclosure is a lens device according to any one of the second to sixth aspects, further comprising a zoom lens, wherein the first lens and the second lens are positioned closer to the image sensor than the zoom lens.

[0013] An eighth aspect of the technology of the present disclosure is a lens device according to any one of the second to sixth aspects, which is arranged closer to the subject than the image sensor and includes an optical filter that transmits near-infrared light contained in the light.

[0014] A ninth aspect of the technology of the present disclosure is a lens device according to any one of the second to eighth aspects, further comprising a focus lens, wherein the first lens and the second lens are positioned closer to the image sensor than the focus lens.

[0015] A tenth aspect of the disclosed technology is a lens device according to any one of the second to ninth aspects, further comprising an aperture, and the first lens and the second lens are arranged closer to the image sensor than the aperture.

[0016] An eleventh aspect of the technique of the present disclosure is the lens device according to any one of the first to tenth aspects, further comprising a switching mechanism for switching the wavelength band of light transmitted through the moving lens.

[0017] A twelfth aspect of the technology of the present disclosure is a lens device according to any one of the first to eleventh aspects, comprising a light separation mechanism that separates light into a first light and a second light, a first optical lens through which the first light passes, and a second optical lens through which the second light passes, wherein at least one of the first optical lens and the second optical lens is a movable lens.

[0018] A thirteenth aspect of the technology of the present disclosure is an imaging device comprising a processor, a memory connected to or built into the processor, an image sensor, a lens including a movable lens that focuses incident light onto the image sensor, and a drive mechanism that moves the movable lens by applying power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, wherein the processor controls the drive mechanism to change the amount of movement of the movable lens based on the wavelength band of light that passes through the movable lens.

[0019] A fourteenth aspect of the technology of the present disclosure is an imaging device according to the thirteenth aspect, in which the processor controls the drive mechanism to move the movable lens to a position where the image obtained by focusing light on the image sensor shifts at a pitch equal to or greater than the pixel pitch of the image sensor or at a pitch less than the pixel pitch of the image sensor, causes the image sensor to capture an image each time the image shifts, and combines multiple frame images obtained by capturing the image.

[0020] A fifteenth aspect of the technology of the present disclosure is a method for operating a lens device that includes a movable lens that focuses incident light on an image sensor of an imaging device body, and a drive mechanism that moves the movable lens by applying power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, and the method includes controlling the drive mechanism to change the amount of movement of the movable lens based on the wavelength band of light that passes through the movable lens.

[0021] A sixteenth aspect of the technology of the present disclosure is a method for operating an imaging device that includes an image sensor, a lens that includes a movable lens and focuses incident light onto the image sensor, and a drive mechanism that moves the movable lens by applying power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, the method including controlling the drive mechanism to change the amount of movement of the movable lens based on the wavelength band of light that passes through the movable lens.

[0022] A 17th aspect of the technology of the present disclosure is a program for causing a computer applied to a lens device that includes a movable lens that focuses incident light on an image sensor of an imaging device body, and a drive mechanism that moves the movable lens by applying power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, to execute processing that includes controlling the drive mechanism to change the amount of movement of the movable lens based on the wavelength band of light that passes through the movable lens.

[0023] An 18th aspect of the technology of the present disclosure is a program for causing a computer applied to an imaging device that includes an image sensor, a lens that includes a movable lens and focuses incident light on the image sensor, and a drive mechanism that moves the movable lens by applying power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, to execute processing that includes controlling the drive mechanism to change the amount of movement of the movable lens based on the wavelength band of light that passes through the movable lens. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a perspective view illustrating an example of a configuration of a monitoring system according to an embodiment of the technology of the present disclosure. [Figure 2] 1 is a side view showing an example of the configuration of an optical system of a surveillance camera according to an embodiment of the technology of the present disclosure. [Figure 3] 1 is a perspective view illustrating an example of a configuration of a filter unit and an image sensor according to an embodiment of the disclosed technique. [Figure 4] 1 is a front view showing an example of a configuration of a main part of an image sensor according to an embodiment of the disclosed technology; [Figure 5] 1 is a block diagram showing an example of the configuration of a surveillance camera body according to an embodiment of the technology of the present disclosure. [Figure 6] 1 is a block diagram illustrating an example of a configuration of a lens device according to an embodiment of the technology of the present disclosure. [Figure 7] FIG. 10 is a comparative diagram comparing an example of the optical characteristics of a blur correction lens and an example of the optical characteristics of a shift lens according to an embodiment of the disclosed technique. [Figure 8] FIG. 10 is a side view showing an example of details of optical characteristics of a shift lens according to an embodiment of the disclosed technique. [Figure 9] 2 is a block diagram showing an example of a functional configuration of a CPU of a lens device according to an embodiment of the technology of the present disclosure. FIG. [Figure 10] FIG. 10 is a block diagram illustrating an example of a configuration for executing a filter change process according to an embodiment of the technology of the present disclosure. [Figure 11]FIG. 1 is a block diagram illustrating an example of a configuration for executing a shake correction process according to an embodiment of the technology of the present disclosure. [Figure 12] FIG. 10 is a block diagram illustrating an example of a configuration for executing a shift process according to an embodiment of the technology of the present disclosure. [Figure 13] 1 is a block diagram illustrating an example of a configuration for obtaining a composite image in a surveillance camera according to an embodiment of the technology of the present disclosure. [Figure 14] 10 is a flowchart illustrating an example of the flow of a filter change process according to an embodiment of the technology of the present disclosure. [Figure 15] 10 is a flowchart illustrating an example of the flow of a blur correction process according to an embodiment of the technology of the present disclosure. [Figure 16] 10 is a flowchart illustrating an example of the flow of a shift process according to an embodiment of the technology of the present disclosure. [Figure 17] 10 is a side view showing an example of the configuration of an optical system of a surveillance camera according to a first modified example. FIG. [Figure 18] FIG. 10 is a side view showing an example of the configuration of an optical system of a surveillance camera according to a second modified example. [Figure 19] FIG. 11 is a side view showing an example of the configuration of an optical system of a surveillance camera according to a third modified example. DETAILED DESCRIPTION OF THE INVENTION

[0025] Hereinafter, examples of embodiments of a lens device, an imaging device, a method for operating a lens device, a method for operating an imaging device, and a program according to the techniques of the present disclosure will be described with reference to the accompanying drawings.

[0026] First, the terms used in the following description will be explained.

[0027] CPU is an abbreviation for "Central Processing Unit". GPU is an abbreviation for "Graphics Processing Unit". NVM is an abbreviation for "Non-Volatile Memory". RAM is an abbreviation for "Random Access Memory". IC is an abbreviation for "Integrated Circuit". ASIC is an abbreviation for "Application Specific Integrated Circuit". PLD is an abbreviation for "Programmable Logic Device". FPGA is an abbreviation for "Field-Programmable Gate Array". SoC is an abbreviation for "System-on-a- C hip". SSD is an abbreviation for "Solid State Drive". HDD is an abbreviation for "Hard Disk Drive". EEPROM is an abbreviation for "Electrically Erasable and Programmable Read Only Memory". SRAM is an abbreviation for "Static Random Access Memory". I / F is an abbreviation for "Interface". UI is an abbreviation for "User Interface". USB is an abbreviation for "Universal Serial Bus". CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor". CCD is an abbreviation for "Charge Coupled Device". LAN is an abbreviation for "Local Area Network". WAN is an abbreviation for "Wide Area Network". BPF is an abbreviation for "Band Pass Filter". Ir is an abbreviation for "Infrared Rays".

[0028] In the description of this specification, "vertical" refers to vertical in the sense of including, in addition to perfectly vertical, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "horizontal" refers to horizontal in the sense of including, in addition to perfectly horizontal, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "parallel" refers to parallel in the sense of including, in addition to perfectly parallel, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "orthogonal" refers to orthogonal in the sense of including, in addition to perfectly perpendicular, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "coincidence" refers to coincidence in the sense of including, in addition to perfect coincidence, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "equally spaced" refers to not only perfectly evenly spaced intervals, but also equal intervals that include errors that are generally acceptable in the technical field to which the technology of the present disclosure belongs and that do not contradict the spirit of the technology of the present disclosure.

[0029] An embodiment of the technology of the present disclosure will be described below.

[0030] (Monitoring system) 1, a monitoring system S includes a monitoring camera 10 and a management device 11. The monitoring camera 10 is an example of an "imaging device" according to the technology of the present disclosure.

[0031] The surveillance camera 10 is installed on a pillar or wall indoors or outdoors, captures an image of a subject to be monitored, and generates a video image by capturing the image. The video image includes multiple frame images obtained by capturing the image. The surveillance camera 10 transmits the video image obtained by capturing the image to the management device 11 via a communication line 12. The management device 11 receives the video image transmitted by the surveillance camera 10, and displays the received video image on a display 13 or stores it in a storage device 14.

[0032] 1 corresponds to the pitch axis of the surveillance camera 10, the Y axis corresponds to the yaw axis of the surveillance camera 10, and the Z axis corresponds to the roll axis of the surveillance camera 10. Hereinafter, the direction along the X axis will be referred to as the X axis direction, the direction along the Y axis will be referred to as the Y axis direction, and the direction along the Z axis will be referred to as the Z axis direction. The X axis direction, Y axis direction, and Z axis direction are perpendicular to each other. The XY coordinate plane used in the following description is defined by the X axis direction and the Y axis direction.

[0033] (Surveillance camera) As an example, as shown in FIG. 2 , a surveillance camera 10 includes a surveillance camera body 20 and a lens device 70. The surveillance camera body 20 is an example of an "imaging device body" according to the technology of the present disclosure. The surveillance camera body 20 includes a lens mount 22. The lens device 70 is separate from the surveillance camera body 20 and is detachably attached to the lens mount 22. The lens device 70 is provided in the surveillance camera body 20 by being attached to the lens mount 22.

[0034] The surveillance camera body 20 includes an image sensor 24. The image sensor 24 is, for example, a CMOS image sensor that photoelectrically converts received light and outputs an electrical signal corresponding to the received light. The CMOS image sensor is merely one example, and the image sensor 24 may be an image sensor that operates in a different manner from a CMOS image sensor, such as a CCD image sensor.

[0035] The image sensor 24 has a light receiving surface 24A. The imaging area light incident on the lens device 70 is focused on the light receiving surface 24A by the lens device 70. An image is obtained by focusing the imaging area light on the light receiving surface 24A. A plurality of photodiodes are arranged in a matrix on the light receiving surface 24A. Each photodiode receives the imaging area light. The image sensor 24 captures an image of the imaging area by receiving the imaging area light. As an example, the plurality of photodiodes include silicon photodiodes sensitive to visible light and indium gallium arsenide photodiodes sensitive to near-infrared light. The image sensor 24 captures images of each of the visible light and near-infrared light contained in the imaging area light focused on the light receiving surface 24A.

[0036] The lens device 70 has an optical axis OA. For example, the optical axis OA passes through the center of the light-receiving surface 24A and is perpendicular to the light-receiving surface 24A. The optical axis OA is parallel to the Z axis. For example, the lens device 70 includes a focus lens 72, a zoom lens 74, an aperture 76, a filter unit 78, a blur correction lens 80, and a shift lens 82. The optical axis OA is an axis passing through the centers of the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82. The optical axis OA is also the optical axis of the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82.

[0037] Along the optical axis OA, a focus lens 72, a zoom lens 74, an aperture 76, a filter unit 78, a blur correction lens 80, and a shift lens 82 are arranged in this order from the subject side to the image side. As an example, the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the zoom lens 74. As an example, the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the focus lens 72. As an example, the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the aperture 76. The filter unit 78 is arranged closer to the subject side than the image sensor 24. As an example, the filter unit 78 is arranged between the aperture 76 and the blur correction lens 80.

[0038] The blur correction lens 80 is an example of a "moving lens" and a "first lens" according to the technology of the present disclosure, and the shift lens 82 is an example of a "moving lens" and a "second lens" according to the technology of the present disclosure. The multiple lenses including the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82 are an example of a "lens" according to the technology of the present disclosure. The optical axis OA is an example of an "optical axis of a lens" according to the technology of the present disclosure, and the XY coordinate plane is an example of a "coordinate plane intersecting the optical axis of a lens" according to the technology of the present disclosure. The X-axis direction is an example of a "first direction" according to the technology of the present disclosure, and the Y-axis direction is an example of a "second direction intersecting the first direction" according to the technology of the present disclosure.

[0039] Light from the imaging area is incident on the focus lens 72. The focus lens 72 guides the incident light from the imaging area to the zoom lens 74. The zoom lens 74 is made up of a lens group having a plurality of lenses that are movable along the optical axis OA, and is used for zooming the imaging area.

[0040] The diaphragm 76 has an opening 76A. The imaging area light guided by the zoom lens 74 passes through the opening 76A. The diaphragm 76 is a movable diaphragm that can change the diameter of the opening 76A. That is, the amount of imaging area light is changed by the diaphragm 76.

[0041] The imaging region light that has passed through the diaphragm 76 is incident on the filter unit 78. As will be described in detail later, the filter unit 78 has a plurality of optical filters that are translucent, and by switching between optical filters that transmit light among the plurality of optical filters, light of a plurality of wavelength bands included in the imaging region light (for example, visible light and near-infrared light of different wavelength bands within the near-infrared wavelength band) is selectively transmitted. The filter unit 78 is an example of a "switching mechanism for switching the wavelength band of light that passes through a lens" according to the technology of the present disclosure.

[0042] The blur correction lens 80 is a lens for correcting blur of an image obtained by focusing imaging area light on the image sensor 24, as will be described later, and the shift lens 82 is a lens for shifting the image along the light receiving surface 24A of the image sensor 24. The blur correction lens 80 and the shift lens 82 form a master lens group. The master lens group may include lenses other than the blur correction lens 80 and the shift lens 82.

[0043] The imaging area light incident on the shift lens 82 is imaged on the light receiving surface 24A. In this way, the imaging area light incident on the lens device 70 is guided to the image sensor 24 by the multiple lenses provided in the lens device 70, and is imaged on the light receiving surface 24A of the image sensor 24. Note that each of the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82 may be a single lens or a lens group having multiple lenses. Furthermore, the lens device 70 may include other lenses in addition to the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82. Furthermore, the order of the focus lens 72, the zoom lens 74, the aperture 76, the filter unit 78, the blur correction lens 80, and the shift lens 82 may be arranged in a manner other than that described above.

[0044] (Filter unit 78) 3, the filter unit 78 includes a circular plate 84. As an example, the circular plate 84 is provided with a plurality of optical filters, including an Ir cut filter 86, a first BPF 88A, a second BPF 88B, a third BPF 88C, and a fourth BPF 88D, arranged at equal intervals along the circumferential direction. Hereinafter, unless there is a need to distinguish between them, the Ir cut filter 86, the first BPF 88A, the second BPF 88B, the third BPF 88C, and the fourth BPF 88D will be referred to as optical filters. Hereinafter, unless there is a need to distinguish between them, the first BPF 88A, the second BPF 88B, the third BPF 88C, and the fourth BPF 88D will be referred to as BPFs 88.

[0045] The filter unit 78 uses a turret system to selectively insert and remove a plurality of optical filters into and from the optical path (hereinafter simply referred to as the "optical path") of imaging area light within the lens device 70. Specifically, the filter unit 78 rotates in the circumferential direction (for example, the direction of the dashed arc arrow shown in FIG. 3), thereby selectively inserting and removing the Ir cut filter 86, the first BPF 88A, the second BPF 88B, the third BPF 88C, and the fourth BPF 88D into and from the optical path (the optical axis OA in the example shown in FIG. 3). As a result, the Ir cut filter 86, the first BPF 88A, the second BPF 88B, the third BPF 88C, and the fourth BPF 88D transmit light of different wavelength bands.

[0046] When an optical filter is inserted into the optical path, the optical axis OA passes through the center of the optical filter, and the center of the optical filter inserted into the optical path coincides with the center of the light-receiving surface 24 A. In the example shown in Fig. 3, since the Ir cut filter 86 is inserted into the optical path, the optical axis OA passes through the center of the Ir cut filter 86, and the center of the Ir cut filter 86 coincides with the center of the light-receiving surface 24 A.

[0047] The infrared cut filter 86 is an optical filter that cuts infrared light and transmits only light other than infrared light. The BPF 88 is an optical filter that transmits near-infrared light. The first BPF 88A, the second BPF 88B, the third BPF 88C, and the fourth BPF 88D each transmit near-infrared light of a different wavelength band.

[0048] The first BPF 88A is an optical filter corresponding to a band near 1000 nm (nanometers). That is, the first BPF 88A transmits only near-infrared light in a band near 1000 nm. The second BPF 88B is an optical filter corresponding to a band near 1250 nm. That is, the second BPF 88B transmits only near-infrared light in a band near 1250 nm. The third BPF 88C is an optical filter corresponding to a band near 1550 nm. That is, the third BPF 88C transmits only near-infrared light in a band near 1550 nm. The fourth BPF 88D is an optical filter corresponding to a band near 2150 nm. That is, the fourth BPF 88D transmits only near-infrared light in a band near 2150 nm. Note that each of the bands listed here includes errors that are generally acceptable in the technical field to which the technology of the present disclosure belongs and that do not deviate from the spirit of the technology of the present disclosure. Also, each of the wavelength bands listed here is merely an example, and each may be a different wavelength band.

[0049] (Image sensor) 4, the image sensor 24 includes a light receiving section 26 and a color filter section 28. The light receiving section 26 includes a plurality of first light receiving elements 30 and a plurality of second light receiving elements 32. An example of the first light receiving elements 30 is an indium gallium arsenide photodiode. An example of the second light receiving elements 32 is a silicon photodiode.

[0050] A color filter section 28 is disposed above the plurality of first light receiving elements 30 and the plurality of second light receiving elements 32. The color filter section 28 has an Ir filter, an R filter, a G filter, and a B filter. The Ir filter is a filter that transmits near-infrared (Ir) component light. The R filter is a filter that transmits red (R) component light. The G filter is a filter that transmits green (G) component light. The B filter is a filter that transmits blue (B) component light. The filters disposed in the color filter section 28 can be freely changed, and all may be filters that transmit Ir component light.

[0051] The first light receiving element 30 is a light receiving element sensitive to Ir component light. The second light receiving element 32 is broadly divided into a light receiving element 32R sensitive to R component light, a light receiving element 32G sensitive to G component light, and a light receiving element 32B sensitive to B component light.

[0052] An Ir filter is disposed on the first light receiving element 30. An R filter is disposed on the light receiving element 32R. A G filter is disposed on the light receiving element 32G. A B filter is disposed on the light receiving element 32B. Each of the light receiving elements 32R, 36G, and 36B is further provided with a filter that blocks near-infrared light.

[0053] In the image sensor 24 configured in this manner, the multiple first light receiving elements 30 receive near-infrared light that has passed through any of the multiple BPFs 88, and generate and output a near-infrared light image 62 based on the received near-infrared light, while the multiple second light receiving elements 32 receive visible light that has passed through the IR cut filter 86, and generate and output a visible light image 60 based on the received visible light.

[0054] (Surveillance camera body) As an example, as shown in FIG. 5, the surveillance camera main body 20 includes a controller 40 and a UI device 50.

[0055] The controller 40 controls the operation of the surveillance camera main body 20. The controller 40 includes a CPU 42, an NVM 44, and a RAM 46. The CPU 42, the NVM 44, and the RAM 46 are connected to a bus 48.

[0056] The NVM 44 stores various parameters and various programs. An example of the NVM 44 is an EEPROM (for example, a flash EEPROM). The EEPROM is merely an example of the NVM 44. The NVM 44 may be any of various non-volatile storage devices such as an SSD and / or an HDD. The RAM 46 temporarily stores various information and is used as a work memory. An example of the RAM 46 is a DRAM. The DRAM is merely an example of the RAM 46. The RAM 46 may be an SRAM or any of various volatile storage devices.

[0057] Various programs are stored in the NVM 44. The CPU 42 reads out necessary programs from the NVM 44 and executes the read programs on the RAM 46. The CPU 42 executes various processes in accordance with the programs executed on the RAM 46.

[0058] The UI device 50 is also connected to the bus 48. Under the control of the CPU 42, the UI device 50 receives instructions from the user and presents to the user various information obtained through processing by the surveillance camera 10.

[0059] The surveillance camera body 20 also includes an image sensor driver 52, a signal processing device 54, a blur amount detection sensor 56, and a communication I / F 58. The image sensor driver 52, the signal processing device 54, the blur amount detection sensor 56, and the communication I / F 58 are connected to the bus 48.

[0060] 2, the image sensor 24 is located on the optical axis OA after the shift lens 82, i.e., closer to the image side than the shift lens 82. As shown in FIG. 3, with an Ir cut filter 86 located on the optical axis OA, the image sensor 24 captures an image of the imaging area based on visible light focused on the light receiving surface 24A by the shift lens 82, thereby generating a visible light image 60 shown in FIG. 4, and outputs the generated visible light image 60 to a subsequent stage. The visible light image 60 is an image that shows the imaging area captured by visible light.

[0061] With the BPF 88 (see FIG. 3) disposed on the optical axis OA, the image sensor 24 captures an image of the imaging area based on near-infrared light focused on the light receiving surface 24A by the shift lens 82, thereby generating a near-infrared image 62 shown in FIG. 4, and outputs the generated near-infrared image 62 to a subsequent stage. The near-infrared image 62 is an image showing the imaging area captured by near-infrared light. Note that, hereinafter, unless it is necessary to distinguish between the near-infrared image 62 and the visible light image 60, they will be referred to as "captured image" without being assigned reference numerals.

[0062] 5, an image sensor driver 52 and a signal processing device 54 are connected to the image sensor 24. Under the control of the CPU 42, the image sensor driver 52 outputs a timing control signal to the image sensor 24. The timing control signal is a signal that controls image capture by the image sensor 24. The frame rate of image capture by the image sensor 24 is determined by the timing control signal.

[0063] The timing control signals include a vertical synchronization signal and a horizontal synchronization signal. The vertical synchronization signal is a signal that determines the timing to start transmitting one frame of analog image. The horizontal synchronization signal is a signal that determines the timing to start outputting one horizontal line of analog image. The image sensor 24 starts outputting the captured image to the signal processing device 54 in frame units in accordance with the vertical synchronization signal input from the image sensor driver 52. Also, the image sensor 24 starts outputting the captured image to the signal processing device 54 in horizontal line units in accordance with the horizontal synchronization signal input from the image sensor driver 52.

[0064] Under the control of the CPU 42, the signal processing device 54 performs signal processing such as demosaic processing, noise removal processing, gradation correction processing, and color correction processing on the captured image input from the image sensor 24. The signal-processed captured image is output to the CPU 42 by the signal processing device 54. The CPU 42 stores the captured image input from the signal processing device 54 in a predetermined storage area (for example, the NVM 44 and / or the RAM 46).

[0065] The blur amount detection sensor 56 detects the amount of blur (hereinafter simply referred to as "blur amount") of the surveillance camera 10 shown in FIG. 2, for example. Blur of the surveillance camera 10 refers to a phenomenon in which the positional relationship between the optical axis OA and the light receiving surface 24A of the surveillance camera 10 fluctuates. When blur occurs in the surveillance camera 10, image blur occurs. Examples of images include an image obtained by capturing an image with an image sensor and / or an optical image obtained by focusing on the light receiving surface 24A (hereinafter simply referred to as "image" or "subject image"). In this embodiment, "image blur" refers to a phenomenon in which the subject image is displaced from the reference position due to tilting of the optical axis OA caused by vibration, i.e., a phenomenon in which the subject image is displaced from the reference position due to movement of the optical axis OA relative to the subject. The vibration phenomenon refers to a phenomenon in which the lens device 70 vibrates due to vibrations transmitted to the lens device 70 from outside the surveillance camera 10 (e.g., a hand, wind, and / or a vehicle, etc.) and / or inside the surveillance camera 10 (e.g., a motor mounted on the surveillance camera 10). Furthermore, "the optical axis OA tilts" means, for example, that the optical axis OA tilts with respect to a reference axis (e.g., the optical axis OA before the vibration phenomenon occurs (i.e., the optical axis OA when the surveillance camera 10 is stationary)). Furthermore, the "reference position" refers, for example, to the position of the subject image obtained when no vibration is applied to the lens device 70 (e.g., the position of the subject image within the light receiving surface 24A).

[0066] 5 is, for example, a gyro sensor. The gyro sensor detects the amount of rotational shake around each of the X, Y, and Z axes. The shake amount detection sensor 56 detects the amount of shake of the surveillance camera 10 by converting the amount of rotational shake around the X axis and the amount of rotational shake around the Y axis detected by the gyro sensor into the amount of shake in a two-dimensional plane parallel to the X and Y axes. Note that in this embodiment, the meaning of "parallel" includes not only perfect parallelism but also approximately parallelism that includes tolerances allowed in design and manufacturing.

[0067] Here, a gyro sensor is given as an example of shake amount detection sensor 56, but this is merely an example, and shake amount detection sensor 56 may also be an acceleration sensor. The acceleration sensor detects the amount of shake in a two-dimensional plane parallel to the X-axis and Y-axis. Shake amount detection sensor 56 outputs the detected amount of shake to CPU 42.

[0068] Also, while an example is given here in which the amount of blur is detected by a physical sensor called the blur amount detection sensor 56, the technology of the present disclosure is not limited to this. For example, a motion vector obtained by comparing successive captured images stored in the NVM 44 or the RAM 46 in chronological order may be used as the amount of blur. Furthermore, the amount of blur that is ultimately used may be derived based on the amount of blur detected by the physical sensor and the motion vector obtained by image processing.

[0069] The communication I / F 58 is, for example, a network interface, and controls the transmission of various information between the management device 11 and the monitoring camera 10 via a network. An example of a network is a WAN such as the Internet or a public communication network. The communication I / F 58 controls communication between the monitoring camera 10 and the management device 11 shown in FIG. 1.

[0070] (lens device) As an example, as shown in Fig. 6, the lens device 70 includes a controller 90. The controller 90 controls the operation of the lens device 70. The controller 90 includes a CPU 92, an NVM 94, and a RAM 96. The controller 90 is an example of a "computer applied to the lens device," the CPU 92 is an example of a "processor" according to the technology of the present disclosure, and the RAM 96 is an example of a "memory" according to the technology of the present disclosure. The CPU 92, the NVM 94, and the RAM 96 are connected to a bus 98.

[0071] 2, when the lens device 70 is attached to the lens mount 22 of the surveillance camera body 20, a connector (not shown) provided on the surveillance camera body 20 and a connector (not shown) provided on the lens device 70 are connected. Then, via a connection path including the connector of the surveillance camera body 20 and the connector of the lens device 70, the CPU 42 of the surveillance camera body 20 shown in FIG. 5 and the CPU 92 of the lens device 70 shown in FIG. 6 are communicatively connected. The CPU 92 of the lens device 70 controls the operation of the lens device 70 in accordance with instructions given from the CPU 42 of the surveillance camera body 20.

[0072] The NVM 94 stores various parameters and various programs. An example of the NVM 94 is an EEPROM (for example, a flash EEPROM). The EEPROM is merely an example of the NVM 94. The NVM 94 may be any of various non-volatile storage devices such as an SSD and / or an HDD. The RAM 96 temporarily stores various information and is used as a work memory. An example of the RAM 96 is a DRAM. The DRAM is merely an example of the RAM 96. The RAM 96 may be an SRAM or any of various volatile storage devices.

[0073] Various programs are stored in the NVM 94. The CPU 92 reads out necessary programs from the NVM 94 and executes the read programs on the RAM 96. The CPU 92 executes various processes in accordance with the programs executed on the RAM 96. The "various programs" mentioned here also include an imaging support processing program 100 (see FIG. 9) described below.

[0074] In the lens device 70, three mutually orthogonal axial directions are defined as the X-axis direction, the Y-axis direction, and the Z-axis direction. As shown in FIG. 2 as an example, when the lens device 70 is attached to the lens mount 22 of the surveillance camera body 20, the X-axis direction, the Y-axis direction, and the Z-axis direction of the lens device 70 may be misaligned with the X-axis direction, the Y-axis direction, and the Z-axis direction of the surveillance camera 10, respectively, due to the influence of rattles and the like. However, for the sake of convenience, hereinafter, it is assumed that the X-axis direction, the Y-axis direction, and the Z-axis direction of the lens device 70 are identical to the X-axis direction, the Y-axis direction, and the Z-axis direction of the surveillance camera 10, respectively. The X-axis direction and the Y-axis direction are directions orthogonal to the optical axis OA of the lens device 70, and the Z-axis direction is a direction parallel to the optical axis OA.

[0075] 6 , the lens device 70 includes a first motor driver 102, a second motor driver 104, a third motor driver 106, a fourth motor driver 108, a fifth motor driver 110, and a sixth motor driver 112. The lens device 70 also includes a first motor 118, a second motor 120, a third motor 122, a fourth motor 124, a fifth motor 126, and a sixth motor 128. The lens device 70 also includes a first position sensor 134, a second position sensor 136, a third position sensor 138, a fourth position sensor 140, a fifth position sensor 142, and a sixth position sensor 144.

[0076] The first motor driver 102, the second motor driver 104, the third motor driver 106, the fourth motor driver 108, the fifth motor driver 110, the sixth motor driver 112, the first position sensor 134, the second position sensor 136, the third position sensor 138, the fourth position sensor 140, the fifth position sensor 142, and the sixth position sensor 144 are connected to the bus 98.

[0077] An example of each of the first position sensor 134, the second position sensor 136, the third position sensor 138, the fourth position sensor 140, the fifth position sensor 142, and the sixth position sensor 144 is a potentiometer.

[0078] The first position sensor 134 detects the position of the focus lens 72 in the Z-axis direction. The second position sensor 136 detects the position of the zoom lens 74 in the Z-axis direction. The third position sensor 138 detects the diameter of the opening 76A formed in the diaphragm 76. The fourth position sensor 140 detects the rotational position of the filter unit 78 with respect to the optical axis OA. The fifth position sensor 142 detects the position of the blur correction lens 80 on the XY coordinate plane. The sixth position sensor 144 detects the position of the shift lens 82 on the XY coordinate plane.

[0079] The detection result by the first position sensor 134 is output to the CPU 92 by the first position sensor 134. The detection result by the second position sensor 136 is output to the CPU 92 by the second position sensor 136. The detection result by the third position sensor 138 is output to the CPU 92 by the third position sensor 138. The detection result by the fourth position sensor 140 is output to the CPU 92 by the fourth position sensor 140. The detection result by the fifth position sensor 142 is output to the CPU 92 by the fifth position sensor 142. The detection result by the sixth position sensor 144 is output to the CPU 92 by the sixth position sensor 144.

[0080] The focus lens 72 is attached to a first slide mechanism (not shown). The first slide mechanism is mechanically connected to the drive shaft of a first motor 118, and receives power from the first motor 118 to move the focus lens 72 along the Z-axis direction. The first motor driver 102 is connected to the first motor 118 and controls the first motor 118 in accordance with instructions from the CPU 92. The CPU 92 controls the first motor 118 via the first motor driver 102 based on the detection result of the first position sensor 134, thereby controlling the position of the focus lens 72 in the Z-axis direction.

[0081] The zoom lens 74 is attached to a second slide mechanism (not shown). The second slide mechanism is mechanically connected to the drive shaft of a second motor 120, and receives power from the second motor 120 to move the zoom lens 74 along the Z-axis direction. The second motor driver 104 is connected to the second motor 120 and controls the second motor 120 in accordance with instructions from the CPU 92. The CPU 92 controls the position of the zoom lens 74 in the Z-axis direction by controlling the second motor 120 via the second motor driver 104 based on the detection result from the second position sensor 136.

[0082] The diaphragm 76 has multiple blades (not shown) that can open and close the opening 76A. The multiple blades are mechanically connected to the drive shaft of a third motor 122 and open and close the opening 76A by receiving power from the third motor 122. A third motor driver 106 is connected to the third motor 122 and controls the third motor 122 in accordance with instructions from the CPU 92. The CPU 92 adjusts the opening degree of the opening 76A by controlling the third motor 122 via the third motor driver 106 shown in FIG. 6 based on the detection result by the third position sensor 138 and the amount of light received by the light receiving surface 24A shown in FIG. 5.

[0083] The filter unit 78 is attached to a rotation mechanism (not shown). The rotation mechanism is mechanically connected to the drive shaft of a fourth motor 124, and receives power from the fourth motor 124 to rotate the filter unit 78 (see FIG. 3) in the circumferential direction, thereby inserting and removing multiple optical filters into and from the optical path. The fourth motor driver 108 is connected to the fourth motor 124 and controls the fourth motor 124 in accordance with instructions from the CPU 92. The CPU 92 controls the fourth motor 124 via the fourth motor driver 108 based on the detection result of the fourth position sensor 140, thereby controlling the rotational position of the filter unit 78 relative to the optical axis OA.

[0084] The blur correction lens 80 is attached to a fifth slide mechanism (not shown). The fifth slide mechanism is mechanically connected to the drive shaft of a fifth motor 126 and receives power from the fifth motor 126 to move the blur correction lens 80 along the XY coordinate plane. In other words, the blur correction lens 80 moves along both the X-axis and the Y-axis. A fifth motor driver 110 is connected to the fifth motor 126 and controls the fifth motor 126 according to instructions from the CPU 92. The CPU 92 controls the fifth motor 126 via the fifth motor driver 110 based on the detection result of the fifth position sensor 142, thereby controlling the position of the blur correction lens 80 on the XY coordinate plane. The fifth motor 126 is an example of a "drive mechanism" and a "first drive mechanism" according to the technology of the present disclosure.

[0085] Note that fifth motor 126, which moves blur correction lens 80 along the XY coordinate plane, specifically includes an X-axis motor that moves blur correction lens 80 along the X-axis direction, and a Y-axis motor that moves blur correction lens 80 along the Y-axis direction. The X-axis motor and Y-axis motor that form fifth motor 126 are, for example, voice coil motors. Furthermore, fifth position sensor that detects the position of blur correction lens 80 on the XY coordinate plane specifically includes an X-axis position sensor that detects the position of blur correction lens 80 in the X-axis direction, and a Y-axis position sensor that detects the position of blur correction lens 80 in the Y-axis direction.

[0086] The shift lens 82 is attached to a sixth slide mechanism (not shown). The sixth slide mechanism is mechanically connected to the drive shaft of a sixth motor 128 and moves the shift lens 82 along the XY coordinate plane by receiving power from the sixth motor 128. In other words, the shift lens 82 moves along both the X-axis and the Y-axis. The sixth motor driver 112 is connected to the sixth motor 128 and controls the sixth motor 128 according to instructions from the CPU 92. The CPU 92 controls the sixth motor 128 via the sixth motor driver 112 based on the detection result of the sixth position sensor 144, thereby controlling the position of the shift lens 82 on the XY coordinate plane. The sixth motor 128 is an example of a "drive mechanism" and a "second drive mechanism" according to the technology of the present disclosure.

[0087] The sixth motor 128, which moves the shift lens 82 along the XY coordinate plane, specifically includes an X-axis motor that moves the shift lens 82 along the X-axis direction and a Y-axis motor that moves the shift lens 82 along the Y-axis direction. The X-axis motor and Y-axis motor that form the sixth motor 128 are, for example, DC motors. Piezoelectric elements, for example, may be used instead of the X-axis motor and Y-axis motor that form the sixth motor 128. The sixth position sensor that detects the position of the shift lens 82 on the XY coordinate plane specifically includes an X-axis position sensor that detects the position of the shift lens 82 in the X-axis direction and a Y-axis position sensor that detects the position of the shift lens 82 in the Y-axis direction.

[0088] In the lens device 70 configured as described above, in order to suppress transmission of vibrations between the fifth motor 126 and the sixth motor 128, the fifth motor 126 and the sixth motor 128 are preferably spaced apart from each other to an extent that vibrations are not transmitted between them. Furthermore, the fifth motor 126 is preferably fixed to the housing of the lens device 70 via a vibration-isolating elastic member such as a rubber sheet. Similarly, the sixth motor 128 is preferably fixed to the housing of the lens device 70 via a vibration-isolating elastic member such as a rubber sheet.

[0089] (Comparison of the optical characteristics of a blur correction lens and a shift lens) 7 shows an example of a comparison of the optical characteristics of the blur correction lens 80 and the optical characteristics of the shift lens 82. The optical characteristics of the blur correction lens 80 and the optical characteristics of the shift lens 82 are different. The optical characteristics referred to here are, for example, characteristics resulting from the thickness, diameter, material, etc. of the lens, and are optical characteristics including, for example, the refractive index. Below, the differences between the optical characteristics of the blur correction lens 80 and the optical characteristics of the shift lens 82 will be explained based on the differences in the blur correction sensitivity of the blur correction lens 80 and the shift sensitivity of the shift lens 82.

[0090] 7, the blur correction lens 80 indicated by the two-dot chain line represents the blur correction lens 80 before image blur is corrected, and the blur correction lens 80 indicated by the solid line represents the blur correction lens 80 after it has been moved to a position where image blur is corrected. Furthermore, the optical axis OA represents the optical axis OA that passes through the center of the light-receiving surface 24A of the image sensor 24 and is perpendicular to the light-receiving surface 24A, and the optical axis OA1 represents the optical axis of the blur correction lens 80 before image blur is corrected. When the blur correction lens 80 is moved to a position where image blur is corrected, a central ray E1 that passes through the blur correction lens 80 after it has moved on the optical axis OA1 is imaged at the center of the light-receiving surface 24A.

[0091] In this description, the blur correction sensitivity of the blur correction lens 80 refers to the ratio of the image blur correction amount B1 on the light receiving surface 24A of the image sensor 24 to the unit movement amount A of the blur correction lens 80. The unit movement amount A of the blur correction lens 80 refers to a predetermined fixed movement amount when the blur correction lens 80 moves in the X-axis direction or the Y-axis direction. The image blur correction amount B1 refers to the movement amount of the image center that occurs when image blur is corrected, and corresponds to the distance between the optical axes OA1 and OA on the light receiving surface 24A of the image sensor 24. In this description, correcting image blur means returning the center of the blurred image to the optical axis OA before the blur occurred.

[0092] In the lower part of FIG. 7, the shift lens 82 indicated by the two-dot chain line represents the shift lens 82 before shifting the image, and the shift lens 82 indicated by the solid line represents the shift lens 82 before shifting the image. Shift Lens 82 represents the shift lens 82 moved to a position where the image is shifted. Furthermore, the optical axis OA represents the optical axis OA that passes through the center of the light-receiving surface 24A of the image sensor 24 and is perpendicular to the light-receiving surface 24A, and the optical axis OA2 represents the optical axis of the shift lens 82 before the image is shifted. When the shift lens 82 moves to a position where the image is shifted, a central ray E2 that passes through the shift lens 82 after movement on the optical axis OA2 (optical axis OA) is imaged at a position shifted by a shift amount B2 from the center of the light-receiving surface 24A.

[0093] In this description, the shift sensitivity of the shift lens 82 refers to the ratio of the shift amount B2 of the image on the light receiving surface 24A of the image sensor 24 to the unit movement amount A of the shift lens 82. The unit movement amount A of the shift lens 82 refers to a predetermined constant movement amount when the shift lens 82 moves in the X-axis direction or the Y-axis direction. The shift amount B2 of the image refers to the movement amount of the center of the image as the image is shifted.

[0094] In this explanation, we will specifically explain the difference between the blur correction sensitivity of the blur correction lens 80 and the shift sensitivity of the shift lens 82, assuming that the distance D1 from the center C1 in the thickness direction of the blur correction lens 80 to the light receiving surface 24A of the image sensor 24 and the distance D2 from the center C2 in the thickness direction of the shift lens 82 to the light receiving surface 24A of the image sensor 24 are the same.

[0095] 7 , assuming that distances D1 and D2 are the same, the shift sensitivity of shift lens 82 is lower than the blur correction sensitivity of blur correction lens 80. In other words, when unit movement amount A of blur correction lens 80 and unit movement amount A of shift lens 82 are the same, shift amount B2 of the image on light receiving surface 24A of image sensor 24 in response to movement of shift lens 82 by unit movement amount A is smaller than blur correction amount B1 of the image on light receiving surface 24A of image sensor 24 in response to movement of blur correction lens 80 by unit movement amount A. In other words, the optical characteristic values of blur correction lens 80 and shift lens 82 are set to values that make the shift sensitivity of shift lens 82 lower than the blur correction sensitivity of blur correction lens 80.

[0096] In this explanation, convenience It was assumed above that the distance D1 from the center C1 of the blur correction lens 80 in the thickness direction to the light receiving surface 24A of the image sensor 24 is the same as the distance D2 from the center C2 of the shift lens 82 in the thickness direction to the light receiving surface 24A of the image sensor 24. However, as shown in Figure 2, the blur correction lens 80 and the shift lens 82 are arranged with a deviation on the optical axis OA. Therefore, with the arrangement of the blur correction lens 80 and the shift lens 82 shown in Figure 2, the distance from the center of the blur correction lens 80 in the thickness direction to the light receiving surface 24A of the image sensor 24 is different from the distance from the center of the shift lens 82 in the thickness direction to the light receiving surface 24A of the image sensor 24.

[0097] Next, the optical characteristics of the shift lens 82 will be described in more detail. An example of the optical characteristics of the shift lens 82 is shown in more detail in Fig. 8. In Fig. 8, the shift lens 82 shown by the two-dot chain line represents the shift lens 82 before shifting the image, and the shift lens 82 shown by the solid line represents the shift lens 82 before shifting the image. Shift Lens 82 represents the shift lens 82 moved to a position where the image is shifted. Also, the optical axis OA represents the optical axis that passes through the center of the light receiving surface 24A of the image sensor 24 and is perpendicular to the light receiving surface 24A.

[0098] The shift amount S1 is the shift amount at the light-receiving surface 24A of the image sensor 24 of the central ray F1 passing through the shift lens 82 after movement on the optical axis OA with respect to the movement of the shift lens 82 by the single displacement amount A. The shift amount S2 is the shift amount at the light-receiving surface 24A of the image sensor 24 of the peripheral ray F2 passing through the shift lens 82 after movement at a position other than on the optical axis OA with respect to the movement of the shift lens 82 by the single displacement amount A. And in the shift lens 82, the relationship of 0.8 ≦ S2 / S1 ≦ 1.2 holds. In other words, the optical characteristic value of the shift lens 82 is set to a value for which the relationship of 0.8 ≦ S2 / S1 ≦ 1.2 holds.

[0099] Here, when the value of S2 / S1 is outside the above-specified range, that is, when S2 / S1 < 0.8 or 1.2 < S2 / S1, the continuity of the image pixel values of the captured image obtained by imaging with the image sensor 24 is lost, the boundary portion of the image pixels becomes unnatural (for example, jagged), and the image quality of the captured image becomes unacceptable. Also, when image processing such as edge enhancement is applied to the captured image, the image processing does not work well and the resolution of the captured image decreases. On the other hand, when the optical characteristic value of the shift lens 82 is set to a value for which the relationship of 0.8 ≦ S2 / S1 ≦ 1.2 holds, the image quality of the captured image is within the acceptable range. Also, compared to the case where the value of S2 / S1 is outside the above-specified range, the resolution of the captured image is improved.

[0100] (Functional configuration of the CPU of the lens device) As an example, as shown in FIG. 9, the imaging support process is realized by the imaging support processing program 100 being executed by the CPU 92 of the lens device 70. The imaging support processing program 100 is an example of the "program" according to the technology of the present disclosure. In the example shown in FIG. 9, the imaging support processing program 100 is stored in the NVM 94, and the CPU 92 reads out the imaging support processing program 100 from the NVM 94 and executes it on the RAM 96.

[0101] The CPU 92 performs imaging support processing in accordance with an imaging support processing program 100 executed on the RAM 96. By executing the imaging support processing program 100 on the RAM 96, the CPU 92 operates as an acquisition unit 150, a filter control unit 152, a blur correction amount calculation unit 154, a blur correction control unit 156, a shift amount calculation unit 158, and a shift control unit 160. Note that, although described in detail below, the imaging support processing is processing including a filter change process (see FIG. 14), a blur correction process (see FIG. 15), and a shift process (see FIG. 16).

[0102] As an example, as shown in FIG. 10 , the acquisition unit 150 acquires filter designation information as information transmitted from the CPU 42 of the surveillance camera body 20. The filter designation information is command information that designates an optical filter to be used from among a plurality of optical filters. The optical filter to be used is an optical filter that is arranged on the optical axis OA from among the plurality of optical filters provided in the filter unit 78. The acquisition unit 150 also acquires a position detection result from the fourth position sensor 140. The position detection result from the fourth position sensor 140 is information that represents the result of detecting the rotational position of the filter unit 78 relative to the optical axis OA.

[0103] Based on the filter designation information sent from the CPU 42 and the position detection result by the fourth position sensor 140, the filter control unit 152 outputs a control command to the fourth motor driver 108 to position the optical filter designated by the filter designation information on the optical axis OA.

[0104] Upon receiving the control command, the fourth motor driver 108 controls the fourth motor 124 in accordance with the control command. As a result, the optical filter designated by the filter designation information is positioned on the optical axis OA. For example, if the optical filter designated by the filter designation information is the Ir cut filter 86, the filter unit 78 rotates to position the Ir cut filter 86 on the optical axis OA. FIG. 10 shows, as an example, a state in which the Ir cut filter 86 is positioned on the optical axis OA. In this way, the filter unit 78 rotates to switch the filter positioned on the optical axis OA among the multiple optical filters, thereby switching the wavelength band of light passing through the blur correction lens 80 and the shift lens 82.

[0105] When the filter control unit 152 performs control to position the optical filter designated by the above-described filter designation information on the optical axis OA, the filter control unit 152 stores the filter designation information in the RAM 96. For example, when the filter control unit 152 positions the Ir cut filter 86 on the optical axis OA, the filter control unit 152 stores filter designation information indicating that the Ir cut filter 86 has been designated in the RAM 96.

[0106] 11 , the acquisition unit 150 acquires a blur correction command and a blur amount detection result by the blur amount detection sensor 56 as information transmitted from the CPU 42 of the surveillance camera body 20. The blur correction command is command information requesting blur correction, and the blur amount detection result by the blur amount detection sensor 56 is information representing the result of detecting the amount of blur of the surveillance camera 10. The acquisition unit 150 also acquires a position detection result by the fifth position sensor 142. The position detection result by the fifth position sensor 142 is information representing the result of detecting the position of the blur correction lens 80 on the XY coordinate plane. The acquisition unit 150 also acquires filter designation information stored in the RAM 96.

[0107] The blur correction amount calculation unit 154 determines the operation direction for correcting image blur for the fifth motor 126 based on the blur amount detection result by the blur amount detection sensor 56. The operation direction for correcting image blur is determined to be the opposite direction to the direction in which the image is blurred. Furthermore, the blur correction amount calculation unit 154 calculates the operation amount for correcting image blur for the fifth motor 126 based on the blur amount detection result by the blur amount detection sensor 56. Specifically, the blur correction amount calculation unit 154 calculates the operation amount for the fifth motor 126 that returns the position of the image blurred by the shake of the surveillance camera 10 to the position of the image before the shake of the surveillance camera 10 occurred.

[0108] Incidentally, when the light passing through the blur correction lens 80 is visible light and when the light passing through the blur correction lens 80 is near-infrared light, the wavelength bands are different, and therefore the position of the image-side focal point shifts, causing the blur correction sensitivity of the blur correction lens 80 to change. In other words, as shown in Fig. 11, when the light passing through the blur correction lens 80 is visible light and when the light passing through the blur correction lens 80 is near-infrared light, the movement amount A1 of the blur correction lens 80 required for the same blur correction amount B1 on the light receiving surface 24A of the image sensor 24 differs. Specifically, when compared for the same blur correction amount B1, the movement amount A1 required when the light passing through the blur correction lens 80 is visible light is smaller than the movement amount A1 required when the light passing through the blur correction lens 80 is near-infrared light.

[0109] Therefore, the blur correction amount calculation unit 154 calculates the amount of operation of the fifth motor 126, which corrects image blur, that corresponds to the optical filter specified by the filter specification information. For example, if the optical filter specified by the filter specification information is the Ir cut filter 86, the blur correction amount calculation unit 154 calculates the amount of operation that corresponds to the Ir cut filter 86 based on the blur amount detection result by the blur amount detection sensor 56. Furthermore, if the optical filter specified by the filter specification information is the BPF 88, the blur correction amount calculation unit 154 calculates the amount of operation that corresponds to the BPF 88 based on the blur amount detection result by the blur amount detection sensor 56. In other words, if the wavelength band of light that passes through the blur correction lens 80 changes, the blur correction sensitivity of the blur correction lens 80 changes. However, the blur correction amount calculation unit 154 calculates the amount of operation that will obtain a blur correction amount B1 that is proportional to the detection result by the blur amount detection sensor 56, even if the wavelength band of light that passes through the blur correction lens 80 changes. The operating amount corresponding to the optical filter specified by the filter specification information may be predetermined for each of the multiple optical filters according to the blur amount detection result by the blur amount detection sensor 56, or may be calculated using various calculation formulas.

[0110] Upon acquiring the operation direction of the fifth motor 126 determined by the shake correction amount calculation unit 154 and the operation amount of the fifth motor 126 calculated by the shake correction amount calculation unit 154, the shake correction control unit 156 sets the acquired operation direction and operation amount of the fifth motor 126 as target values and generates a control command based on the position detection result by the fifth position sensor 142. The control command is output to the fifth motor driver 110.

[0111] The fifth motor driver 110 generates an actuation signal based on a control command generated by the blur correction control unit 156. The actuation signal is, for example, a continuous wave. The fifth motor 126 operates in an actuation direction and by an actuation amount according to the actuation signal. As a result, power is applied to the blur correction lens 80 in a direction in which image blur is corrected, thereby moving the blur correction lens 80. For example, if the optical filter specified by the filter designation information is the Ir cut filter 86, the blur correction lens 80 moves by an amount of movement A1 corresponding to the Ir cut filter 86. If the optical filter specified by the filter designation information is the BPF 88, the blur correction lens 80 moves by an amount of movement A1 corresponding to the BPF 88.

[0112] In this way, blur correction control unit 156 controls fifth motor 126 to change amount of movement A1 of blur correction lens 80 based on the wavelength band of light passing through blur correction lens 80. Therefore, even if the wavelength band of light passing through blur correction lens 80 changes, the effect of changes in the blur correction sensitivity of blur correction lens 80 is suppressed, and a blur correction amount B1 proportional to the detection result by blur amount detection sensor 56 is obtained. Note that correcting image blur here includes not only matching the position of an image blurred by shaking of surveillance camera 10 to the position of the image before shaking of surveillance camera 10 occurred, but also bringing the position of an image blurred by shaking of surveillance camera 10 closer to the position of the image before shaking of surveillance camera 10 occurred.

[0113] The control by the blur correction control unit 156 described above is feedback control based on the blur amount detection result by the blur amount detection sensor 56 (that is, the amount of blur of the surveillance camera 10).

[0114] 12, the acquisition unit 150 acquires an image shift command and frame period information as information transmitted from the CPU 42 of the surveillance camera body 20. The image shift command is command information requesting an image shift, and is information indicating the image shift direction and shift amount. The acquisition unit 150 also acquires the position detection result from the sixth position sensor 144. Furthermore, the acquisition unit 150 acquires filter designation information stored in the RAM 96.

[0115] The image shift amount B2 is defined, for example, as a pitch equal to or greater than the pixel pitch of the image sensor 24, or a pitch less than the pixel pitch of the image sensor 24. A pitch equal to or greater than the pixel pitch of the image sensor 24 is, for example, 1 pitch, 1.5 pitches, 2.5 pitches, or 3.5 pitches. When the pixel pitch of the image sensor 24 is p, n is a natural number, and d is a pure decimal, a pitch greater than the pixel pitch of the image sensor 24 is defined as (n+d)×p. Furthermore, a pitch less than the pixel pitch of the image sensor 24 is, for example, 0.25 pitches, 0.5 pitches, or 0.75 pitches. When the pixel pitch of the image sensor 24 is p and D is a decimal less than 1, a pitch less than the pixel pitch of the image sensor 24 is defined as D×p.

[0116] The frame period information is information that defines a frame period synchronized with a timing control signal output from the CPU 42 to the image sensor driver 52 (see FIG. 5). The frame period is a period in which imaging is performed in frame units.

[0117] The shift amount calculation unit 158 determines the operation direction of the sixth motor 128 for each frame period based on the image shift direction indicated by the image shift command, the frame period indicated by the frame period information, and the position detection result by the sixth position sensor 144. The operation direction of the sixth motor 128 is determined based on the image shift direction indicated by the image shift command and the position detection result by the sixth position sensor 144.

[0118] Furthermore, the shift amount calculation unit 158 calculates the operation amount of the sixth motor 128 for each frame period based on the image shift amount represented by the image shift command, the frame period represented by the frame period information, and the position detection result by the sixth position sensor 144. For example, when the image shift amount represented by the image shift command is the same as the pixel pitch of the image sensor 24, the shift amount calculation unit 158 calculates the operation amount of the sixth motor 128 for shifting the image by the same pitch as the pixel pitch of the image sensor 24. When the image shift amount represented by the image shift command is larger than the pixel pitch of the image sensor 24, the shift amount calculation unit 158 calculates the operation amount of the sixth motor 128 for shifting the image by (n+d)×p. When the image shift amount represented by the image shift command is smaller than the pixel pitch of the image sensor 24, the shift amount calculation unit 158 calculates the operation amount of the sixth motor 128 for shifting the image by D×p.

[0119] Incidentally, as in the case of the above-described blur correction lens 80, when the light passing through the shift lens 82 is visible light and when the light passing through the shift lens 82 is near-infrared light, the wavelength bands are different, and therefore the position of the image-side focal point shifts, causing a change in the shift sensitivity of the shift lens 82. In other words, as shown in Fig. 12, when the light passing through the shift lens 82 is visible light and when the light passing through the shift lens 82 is near-infrared light, the movement amount A2 of the shift lens 82 required for the same shift amount B2 on the light receiving surface 24A of the image sensor 24 differs. Specifically, when compared for the same shift amount B2, the movement amount A2 required when the light passing through the shift lens 82 is visible light is smaller than the movement amount A2 required when the light passing through the shift lens 82 is near-infrared light.

[0120] Therefore, the shift amount calculation unit 158 calculates the operation amount of the sixth motor 128 that shifts the image, corresponding to the optical filter specified by the filter specification information. For example, when the optical filter specified by the filter specification information is the Ir cut filter 86, the shift amount calculation unit 158 calculates the operation amount corresponding to the Ir cut filter 86 based on the image shift amount represented by the image shift command. Furthermore, when the optical filter specified by the filter specification information is the BPF 88, the shift amount calculation unit 158 calculates the operation amount corresponding to the BPF 88 based on the image shift amount represented by the image shift command. In other words, when the wavelength band of light passing through the shift lens 82 changes, the shift sensitivity of the shift lens 82 changes. However, even when the wavelength band of light passing through the shift lens 82 changes, the shift amount calculation unit 158 calculates the operation amount by which the image is shifted to a position corresponding to the image shift amount represented by the image shift command. The operating amount corresponding to the optical filter specified by the filter specification information may be predetermined for each of the multiple optical filters according to the image shift amount represented by the image shift command, or may be calculated using various calculation formulas.

[0121] The shift control unit 160 generates a control command for each frame period according to the operation direction of the sixth motor 128 determined by the shift amount calculation unit 158 and the operation amount of the sixth motor 128 calculated by the shift amount calculation unit 158. The control command is output to the sixth motor driver 112.

[0122] The sixth motor driver 112 generates an actuation signal based on a control command generated by the shift control unit 160. The actuation signal is, for example, a pulse wave. The period of the actuation signal is synchronized with the frame period defined by the frame period information. The sixth motor 128 operates by an actuation amount corresponding to the actuation signal. As a result, power is applied to the shift lens 82 in the direction that shifts the image for each frame period, thereby moving the shift lens 82. For example, if the optical filter specified by the filter designation information is the Ir cut filter 86, the blur correction lens 80 moves by the movement amount A2 corresponding to the Ir cut filter 86, and if the optical filter specified by the filter designation information is the BPF 88, the blur correction lens 80 moves by the movement amount A2 corresponding to the BPF 88.

[0123] In this way, the shift control unit 160 controls the sixth motor 128 to change the movement amount A2 of the shift lens 82 based on the wavelength band of light that passes through the shift lens 82. Therefore, even if the wavelength band of light that passes through the blur correction lens 80 changes, the influence of changes in the shift sensitivity of the shift lens 82 is suppressed, and the image is shifted to a position corresponding to the image shift amount indicated by the image shift command.

[0124] The control by the shift control unit 160 described above is not based on the blur amount detection result by the blur amount detection sensor 56 (that is, the blur amount of the surveillance camera 10), but is a sequence control based on a predetermined shift order.

[0125] The image is shifted in this manner for each frame period, and each time the image is shifted, the CPU 42 of the surveillance camera main body 20 controls the image sensor 24 to capture an image. As a result, a plurality of frame images 162 corresponding to each frame period are obtained, as shown in Fig. 13 as an example. The CPU 42 of the surveillance camera main body 20 then combines the plurality of frame images 162 to obtain a composite image 164.

[0126] The composite image 164 is obtained, for example, in the following manner. That is, when the image shift amount is the same as the pixel pitch of the image sensor 24, a plurality of image pixels forming one image of the images 162 of the multiple frames are superimposed on a plurality of image pixels forming another image of the images 162 of the multiple frames, thereby obtaining the composite image 164 from the images 162 of the multiple frames. The composite image 164 obtained in this manner does not require demosaicing. Furthermore, when the image shift amount is larger than the pixel pitch of the image sensor 24 or smaller than the pixel pitch of the image sensor 24, a plurality of image pixels forming one image of the images 162 of the multiple frames are allocated between a plurality of image pixels forming one image of the images 162 of the multiple frames, thereby obtaining the composite image 164 from the images 162 of the multiple frames. The composite image 164 obtained in this manner has a higher resolution than the images 162 of the multiple frames.

[0127] Next, the function of the surveillance camera 10 according to this embodiment (that is, the operation of the surveillance camera 10) will be described.

[0128] First, the filter change process of the imaging support process will be described with reference to Fig. 10 and Fig. 14. When filter designation information transmitted from the CPU 42 of the surveillance camera body 20 is received by the transmission / reception interface (not shown) of the lens device 70, the CPU 92 of the lens device 70 executes the filter change process shown in Fig. 14.

[0129] First, in step ST100, the acquisition unit 150 acquires the filter designation information transmitted from the CPU 42 of the monitoring camera main body 20. The acquisition unit 150 also acquires the position detection result obtained by the fourth position sensor 140.

[0130] In the next step ST102, the filter control unit 152 outputs a control command to the fourth motor driver 108 to position the optical filter specified by the filter specification information on the optical axis OA based on the filter specification information transmitted from the CPU 42 and the position detection result by the fourth position sensor 140.

[0131] Upon receiving the control command, the fourth motor driver 108 controls the fourth motor 124 in accordance with the control command. As a result, the optical filter designated by the filter designation information is positioned on the optical axis OA. For example, if the optical filter designated by the filter designation information is the Ir cut filter 86, the filter unit 78 rotates and the Ir cut filter 86 is positioned on the optical axis OA. In this way, the filter unit 78 rotates and the filter positioned on the optical axis OA among the multiple optical filters is switched, thereby switching the wavelength band of light passing through the blur correction lens 80 and the shift lens 82.

[0132] In the next step ST104, the filter control unit 152 stores the filter designation information in the RAM 96. For example, when the Ir cut filter 86 is positioned on the optical axis OA, the filter control unit 152 stores in the RAM 96 the filter designation information indicating that the Ir cut filter 86 has been designated.

[0133] Next, the blur correction process of the imaging support process will be described with reference to Fig. 11 and Fig. 15. When a blur correction command transmitted from the CPU 42 of the surveillance camera body 20 is received by the transmission / reception interface (not shown) of the lens device 70, the CPU 92 of the lens device 70 executes the blur correction process shown in Fig. 15.

[0134] First, in step ST110, the acquisition unit 150 acquires a blur correction command transmitted from the CPU 42 of the surveillance camera body 20. Then, in step ST112, the acquisition unit 150 acquires the blur amount detection result transmitted from the CPU 42 of the surveillance camera body 20. Then, in step ST114, the acquisition unit 150 acquires the filter designation information stored in RAM 96. Then, the acquisition unit 150 acquires the position detection result by the fifth position sensor 142.

[0135] In the next step ST116, the blur correction amount calculation unit 154 determines the operation direction for correcting image blur for the fifth motor 126, based on the blur amount detection result by the blur amount detection sensor 56. The operation direction for correcting image blur is determined to be the opposite direction to the direction in which the image is blurred.

[0136] Furthermore, in step ST116, the blur correction amount calculation unit 154 calculates an operation amount for correcting image blur for the fifth motor 126, based on the blur amount detection result by the blur amount detection sensor 56. Specifically, the blur correction amount calculation unit 154 calculates an operation amount for the fifth motor 126 that returns the position of the image blurred by the shaking of the surveillance camera 10 to the position of the image before the shaking of the surveillance camera 10 occurred.

[0137] At this time, the blur correction amount calculation unit 154 calculates the amount of operation of the fifth motor 126, which corrects image blur, that corresponds to the optical filter specified by the filter specification information. For example, if the optical filter specified by the filter specification information is the Ir cut filter 86, the blur correction amount calculation unit 154 calculates the amount of operation that corresponds to the Ir cut filter 86 based on the blur amount detection result by the blur amount detection sensor 56. Furthermore, if the optical filter specified by the filter specification information is the BPF 88, the blur correction amount calculation unit 154 calculates the amount of operation that corresponds to the BPF 88 based on the blur amount detection result by the blur amount detection sensor 56. In other words, if the wavelength band of light that passes through the blur correction lens 80 changes, the blur correction sensitivity of the blur correction lens 80 changes. However, the blur correction amount calculation unit 154 calculates the amount of operation that will obtain a blur correction amount B1 that is proportional to the detection result by the blur amount detection sensor 56, even if the wavelength band of light that passes through the blur correction lens 80 changes.

[0138] In the next step ST118, the shake correction control unit 156 acquires the operation direction of the fifth motor 126 determined by the shake correction amount calculation unit 154 and the operation amount of the fifth motor 126 calculated by the shake correction amount calculation unit 154, and sets the acquired operation direction and operation amount of the fifth motor 126 as target values, and generates a control command based on the position detection result by the fifth position sensor 142. The control command is output to the fifth motor driver 110.

[0139] The fifth motor driver 110 generates an actuation signal based on a control command generated by the blur correction control unit 156. The actuation signal is, for example, a continuous wave. The fifth motor 126 operates in an actuation direction and by an actuation amount according to the actuation signal. As a result, power is applied to the blur correction lens 80 in a direction in which image blur is corrected, thereby moving the blur correction lens 80. For example, if the optical filter specified by the filter designation information is the Ir cut filter 86, the blur correction lens 80 moves by an amount of movement A1 corresponding to the Ir cut filter 86. If the optical filter specified by the filter designation information is the BPF 88, the blur correction lens 80 moves by an amount of movement A1 corresponding to the BPF 88.

[0140] In this way, the blur correction control unit 156 controls the fifth motor 126 to change the movement amount A1 of the blur correction lens 80 based on the wavelength band of light that passes through the blur correction lens 80. Therefore, even if the wavelength band of light that passes through the blur correction lens 80 changes, the influence of changes in the blur correction sensitivity of the blur correction lens 80 is suppressed, and a blur correction amount B1 that is proportional to the detection result by the blur amount detection sensor 56 is obtained.

[0141] Next, the shift processing of the imaging support processing will be described with reference to Fig. 12 and Fig. 16. The CPU 92 of the lens device 70 determines whether or not an image shift command transmitted from the CPU 42 of the surveillance camera body 20 has been received by a transmission / reception interface (not shown) of the lens device 70, and if the determination is affirmative, executes the shift processing shown in Fig. 16.

[0142] First, in step ST120, the acquisition unit 150 acquires an image shift command transmitted from the CPU 42 of the surveillance camera body 20. Also, in step ST122, the acquisition unit 150 acquires frame period information transmitted from the CPU 42 of the surveillance camera body 20. Furthermore, in step ST124, the acquisition unit 150 acquires filter designation information stored in the RAM 96. Also, the acquisition unit 150 acquires the position detection result by the sixth position sensor 144.

[0143] In the next step ST126, the shift amount calculation unit 158 determines the operation direction of the sixth motor 128 for each frame period based on the image shift direction indicated by the image shift command, the frame period indicated by the frame period information, and the position detection result by the sixth position sensor 144. The operation direction of the sixth motor 128 is determined based on the image shift direction indicated by the image shift command and the position detection result by the sixth position sensor 144. Furthermore, the shift amount calculation unit 158 calculates the operation amount of the sixth motor 128 for each frame period based on the image shift amount indicated by the image shift command, the frame period indicated by the frame period information, and the position detection result by the sixth position sensor 144.

[0144] At this time, the shift amount calculation unit 158 calculates the operation amount of the sixth motor 128 that shifts the image, corresponding to the optical filter specified by the filter specification information. For example, if the optical filter specified by the filter specification information is the Ir cut filter 86, the shift amount calculation unit 158 calculates the operation amount corresponding to the Ir cut filter 86 based on the image shift amount indicated by the image shift command. Furthermore, if the optical filter specified by the filter specification information is the BPF 88, the shift amount calculation unit 158 calculates the operation amount corresponding to the BPF 88 based on the image shift amount indicated by the image shift command. In other words, when the wavelength band of light passing through the shift lens 82 changes, the shift sensitivity of the shift lens 82 changes. However, even when the wavelength band of light passing through the shift lens 82 changes, the shift amount calculation unit 158 calculates the operation amount by which the image is shifted to a position corresponding to the image shift amount indicated by the image shift command.

[0145] In the next step ST128, the shift control unit 160 generates, for each frame period, a control command according to the operation direction of the sixth motor 128 determined by the shift amount calculation unit 158 and the operation amount of the sixth motor 128 calculated by the shift amount calculation unit 158. The control command is output to the sixth motor driver 112.

[0146] The sixth motor driver 112 generates an actuation signal based on a control command generated by the shift control unit 160. The actuation signal is, for example, a pulse wave. The period of the actuation signal is synchronized with the frame period defined by the frame period information. The sixth motor 128 operates with an actuation amount corresponding to the actuation signal. As a result, power is applied to the shift lens 82 in a direction that shifts the image for each frame period, thereby moving the shift lens 82. Specifically, if the optical filter specified by the filter designation information is the Ir cut filter 86, the shift lens 82 moves by an amount of movement A2 corresponding to the Ir cut filter 86. If the optical filter specified by the filter designation information is the BPF 88, the shift lens 82 moves by an amount of movement A2 corresponding to the BPF 88.

[0147] In this way, the shift control unit 160 controls the sixth motor 128 to change the movement amount A2 of the shift lens 82 based on the wavelength band of light that passes through the shift lens 82. Therefore, even if the wavelength band of light that passes through the blur correction lens 80 changes, the influence of changes in the shift sensitivity of the shift lens 82 is suppressed, and the image is shifted to a position corresponding to the image shift amount indicated by the image shift command.

[0148] The method of operating the surveillance camera 10 described above with reference to FIGS. 14, 15, and 16 is an example of a "method of operating an imaging device" according to the technology of the present disclosure. Also, the method of operating the lens device 70 included in the method of operating the surveillance camera 10 described above with reference to FIGS. 14, 15, and 16 is an example of a "method of operating an imaging device" according to the technology of the present disclosure. of the equipment This is an example of an "operation method."

[0149] Next, the effects of the surveillance camera 10 according to this embodiment will be described.

[0150] 6, lens device 70 separately includes blur correction lens 80 for correcting image blur, and shift lens 82 for shifting the image along light receiving surface 24A of image sensor 24. Therefore, compared to the case where a common motor is used to perform both image blur correction and image shifting with blur correction lens 80, it is easier to control fifth motor 126 that moves blur correction lens 80 and sixth motor 128 that moves shift lens 82.

[0151] Furthermore, since the fifth motor 126 that moves the blur correction lens 80 and the sixth motor 128 that moves the shift lens 82 are separate, the weight can be distributed between the fifth motor 126 and the sixth motor 128 compared to when the blur correction lens 80, which performs both image blur correction and image shifting, is moved by a common motor.

[0152] 11, the CPU 92 of the lens device 70 controls the fifth motor 126 to change the movement amount A1 of the blur correction lens 80 based on the wavelength band of light that passes through the blur correction lens 80. Therefore, even if the wavelength band of light that passes through the blur correction lens 80 changes, the influence of changes in the blur correction sensitivity of the blur correction lens 80 is suppressed, and it is possible to obtain a blur correction amount B1 that is proportional to the detection result by the blur amount detection sensor 56.

[0153] 12, the CPU 92 of the lens device 70 controls the sixth motor 128 to change the movement amount A2 of the shift lens 82 based on the wavelength band of light passing through the shift lens 82. Therefore, even if the wavelength band of light passing through the blur correction lens 80 changes, the influence of changes in the shift sensitivity of the shift lens 82 is suppressed, and the image can be shifted to a position corresponding to the image shift amount indicated by the image shift command.

[0154] Also, as shown in FIG. 7, the shift sensitivity of the shift lens 82 is lower than the shake correction sensitivity of the shake correction lens 80. That is, the shift amount B2 of the image on the light-receiving surface 24A of the image sensor 24 with respect to the movement of the shift lens 82 by the single displacement amount A is smaller than the shake correction amount B1 of the image on the light-receiving surface 24A of the image sensor 24 with respect to the movement of the shake correction lens 80 by the single displacement amount A. Therefore, for example, compared with the case where the shift sensitivity of the shift lens 82 is higher than the shake correction sensitivity of the shake correction lens 80, the error of the shift amount of the image with respect to the error of the movement amount of the shift lens 82 can be reduced.

[0155] Also, as shown in FIG. 8, when the shift amount of the central ray F1 passing through the shifted shift lens 82 on the optical axis OA with respect to the movement of the shift lens 82 by the single displacement amount A on the light-receiving surface 24A of the image sensor 24 is defined as S1, and the shift amount of the peripheral ray F2 passing through the shifted shift lens 82 outside the optical axis OA with respect to the movement of the shift lens 82 by the single displacement amount A on the light-receiving surface 24A of the image sensor 24 is defined as S2, the relationship of 0.8 ≦ S2 / S1 ≦ 1.2 holds. Here, when the value of S2 / S1 is outside the above-defined range, that is, when S2 / S1 < 0.8 or 1.2 < S2 / S1, the continuity of the image pixel values of the captured image obtained by imaging with the image sensor 24 is lost, the boundary portion of the image pixels becomes unnatural (e.g., jagged), and the image quality of the captured image becomes unacceptable. Also, when image processing such as edge enhancement is applied to the captured image, the image processing fails and the resolution of the captured image decreases. In contrast, when the relationship of 0.8 ≦ S2 / S1 ≦ 1.2 holds, the image quality of the captured image can be kept within the allowable range. Also, compared with the case where the value of S2 / S1 is outside the above-defined range, the resolution of the captured image can be improved.

[0156] 2, the blur correction lens 80 and the shift lens 82 are positioned closer to the image sensor 24 than the zoom lens 74. If the blur correction lens 80 and the shift lens 82 were positioned closer to the subject than the zoom lens 74, light that has passed through the blur correction lens 80 and the shift lens 82 would form an image on the image sensor 24 via the zoom lens 74, and the blur correction sensitivity of the blur correction lens 80 and the shift sensitivity of the shift lens 82 would change as the zoom lens 74 moved in the Z axis direction. Therefore, when the zoom lens 74 moves in the Z axis direction, it is necessary to perform control to adjust the movement amount A1 of the blur correction lens 80 and the movement amount A2 of the shift lens 82 in accordance with the movement of the zoom lens 74 in the Z axis direction, but such control would be complicated. In contrast, if the blur correction lens 80 and the shift lens 82 are positioned closer to the image sensor 24 than the zoom lens 74, it is possible to eliminate the need for control to adjust the movement amount A1 of the blur correction lens 80 and the movement amount A2 of the shift lens 82 in accordance with movement of the zoom lens 74 in the Z-axis direction.

[0157] Furthermore, since the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the zoom lens 74, the diameters of the blur correction lens 80 and the shift lens 82 can be made smaller than when the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the zoom lens 74.

[0158] Furthermore, by reducing the diameters of the blur correction lens 80 and the shift lens 82, it is possible to reduce the weight of the blur correction lens 80 and the shift lens 82. This reduces the drive load of the fifth motor 126 that moves the blur correction lens 80 and the drive load of the sixth motor 128 that moves the shift lens 82.

[0159] 3, the filter unit 78 of the lens device 70 includes a plurality of BPFs 88. The filter unit 78 is disposed closer to the subject than the image sensor 24, and each of the plurality of BPFs 88 transmits near-infrared light contained in the light. Therefore, a near-infrared light image can be obtained by forming an image of the near-infrared light on the image sensor 24.

[0160] 12, the CPU 92 of the lens device 70 controls the sixth motor 128 to move the shift lens 82 to a position where the image is shifted at a pitch equal to or greater than the pixel pitch of the image sensor 24 or at a pitch less than the pixel pitch of the image sensor 24. Therefore, as shown in FIG. 13, a composite image 164 can be obtained by combining the obtained images 162 of multiple frames.

[0161] Furthermore, the blur correction lens 80 and the shift lens 82 are positioned closer to the image sensor 24 than the focus lens 72. If the blur correction lens 80 and the shift lens 82 were positioned closer to the subject than the focus lens 72, light passing through the blur correction lens 80 and the shift lens 82 would form an image on the image sensor 24 via the focus lens 72, and the blur correction sensitivity of the blur correction lens 80 and the shift sensitivity of the shift lens 82 would change as the focus lens 72 moved in the Z axis direction. Therefore, when the focus lens 72 moves in the Z axis direction, control must be performed to adjust the movement amount A1 of the blur correction lens 80 and the movement amount A2 of the shift lens 82 in accordance with the movement of the focus lens 72 in the Z axis direction, but such control becomes complicated. In contrast, if the blur correction lens 80 and the shift lens 82 are positioned closer to the image sensor 24 than the focus lens 72, control to adjust the movement amount A1 of the blur correction lens 80 and the movement amount A2 of the shift lens 82 in accordance with the movement of the focus lens 72 in the Z axis direction can be eliminated.

[0162] Furthermore, the blur correction lens 80 and the shift lens 82 are disposed closer to the image sensor 24 than the aperture 76. If the blur correction lens 80 and the shift lens 82 were disposed between the aperture 76 and the zoom lens 74, a fifth slide mechanism (not shown) that supports the blur correction lens 80 slidably along the XY coordinate plane and a sixth slide mechanism (not shown) that supports the shift lens 82 slidably along the XY coordinate plane would be disposed adjacent to a second slide mechanism (not shown) that supports the zoom lens 74 slidably in the Z axis direction, which would complicate the structure of the lens device 70. Therefore, as the structure of the lens device 70 becomes more complex, there is a risk that the movement accuracy of the blur correction lens 80 and the shift lens 82 will decrease. In contrast, if the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the aperture 76, the movement accuracy of the blur correction lens 80 and the movement accuracy of the shift lens 82 can be improved compared to when, for example, the blur correction lens 80 and the shift lens 82 are arranged between the aperture 76 and the zoom lens 74.

[0163] The lens device 70 also includes a filter unit 78 that switches the wavelength band of light that passes through the blur correction lens 80 and the shift lens 82. Therefore, compared to the case where, for example, one optical filter out of a plurality of optical filters is selectively attached to the lens device 70 in order to change the wavelength band of light that passes through the blur correction lens 80 and the shift lens 82, it is possible to easily switch the wavelength band of light that passes through the blur correction lens 80 and the shift lens 82.

[0164] Next, a modified example of the surveillance camera 10 according to this embodiment will be described.

[0165] In the above embodiment, the CPU 92 of the lens device 70 performs both control to change the movement amount A1 of the blur correction lens 80 and control to change the movement amount A2 of the shift lens 82, based on the wavelength bands of light transmitted through the blur correction lens 80 and the shift lens 82. However, the CPU 92 of the lens device 70 may perform only one of the control to change the movement amount A1 of the blur correction lens 80 and the control to change the movement amount A2 of the shift lens 82.

[0166] Furthermore, in the above embodiment, a rotary filter unit 78 is used in which a plurality of optical filters are arranged in a ring shape and which rotates to switch between the optical filters arranged on the optical axis OA among the plurality of optical filters in order to change the wavelength band of light passing through the blur correction lens 80 and the shift lens 82. However, for example, a sliding filter unit may be used in which a plurality of optical filters are arranged in a line and which slides to switch between the optical filters arranged on the optical axis OA among the plurality of optical filters. Furthermore, one of the plurality of optical filters may be selectively attached to the lens device 70 in order to change the wavelength band of light passing through the blur correction lens 80 and the shift lens 82.

[0167] Furthermore, the control for changing the movement amount A1 of the blur correction lens 80 based on the wavelength band of light passing through the blur correction lens 80 is not limited to the above-described embodiment, and various other embodiments are possible. Similarly, the control for changing the movement amount A2 of the shift lens 82 based on the wavelength band of light passing through the shift lens 82 is not limited to the above-described embodiment, and various other embodiments are possible.

[0168] Furthermore, in the above embodiment, the focus lens 72, zoom lens 74, aperture 76, filter unit 78, blur correction lens 80, and shift lens 82 are arranged in this order from the subject side to the image side along the optical axis OA, but as an example, as shown in FIG. 17, the zoom lens 74, aperture 76, filter unit 78, blur correction lens 80, focus lens 72, and shift lens 82 may be arranged in this order from the subject side to the image side along the optical axis OA.

[0169] Furthermore, the focus lens 72, zoom lens 74, diaphragm 76, filter unit 78, blur correction lens 80, and shift lens 82 may be arranged in an order other than that shown in FIG. 2 and that shown in FIG.

[0170] Furthermore, in the above embodiment, the lens device 70 is provided on the surveillance camera body 20 by being attached to the surveillance camera body 20 having the image sensor 24, but as an example, as shown in Figure 18, the lens device 70 may be provided on the surveillance camera body 20 by being mounted on the surveillance camera body 20 having the image sensor 24.

[0171] The surveillance camera 10 may also be configured as follows. That is, as an example, in a modified example of the surveillance camera 10 shown in Fig. 19, the lens device 70 includes a first optical system 202, a second optical system 204, a color separation prism 206, a third optical system 208, and a fourth optical system 210. The surveillance camera body 20 also includes a first image sensor 214 and a second image sensor 216. The color separation prism 206 is an example of a "light separation mechanism" according to the technology of the present disclosure, and the first image sensor 214 and the second image sensor 216 are examples of "image sensors" according to the technology of the present disclosure.

[0172] The first optical system 202 has a plurality of lenses 218, 220, 222, and 224, and a first aperture 230. The second optical system 204 is disposed between the first optical system 202 and the color separation prism 206. The second optical system 204 has a lens 228. The color separation prism 206 separates light into a first light G1 and a second light G2. For example, the first light G1 is infrared light, and the second light G2 is visible light. The optical axis OA is split into a first optical axis OAa and a second optical axis OAb by the color separation prism 206.

[0173] The third optical system 208 is disposed between the color separation prism 206 and the first image sensor 214. The third optical system 208 has a first filter unit 231, a first blur correction lens 232, and a first shift lens 234. Like the blur correction lens 80 (see FIG. 6) described above, the first blur correction lens 232 is moved along the XY coordinate plane by being powered by a first drive mechanism (not shown). Like the shift lens 82 (see FIG. 6) described above, the first shift lens 234 is moved along the XY coordinate plane by being powered by a second drive mechanism (not shown). The first blur correction lens 232 and the first shift lens 234 are examples of the "first optical lens" and the "moving lens" according to the technology of the present disclosure, respectively.

[0174] The fourth optical system 210 is disposed between the color separation prism 206 and the second image sensor 216. The fourth optical system 210 includes a second aperture 236, a second filter unit 238, a second blur correction lens 240, and a second shift lens 242. Similar to the blur correction lens 80 (see FIG. 6 ) described above, the second blur correction lens 240 is moved along the XZ coordinate plane by being powered by a third drive mechanism (not shown). Similar to the shift lens 82 (see FIG. 6 ), the second shift lens 242 is moved along the XZ coordinate plane by being powered by a fourth drive mechanism (not shown). The second blur correction lens 240 and the second shift lens 242 are examples of the "second optical lens" and the "moving lens" according to the technology of the present disclosure, respectively.

[0175] On the light receiving surface 214A of the first image sensor 214, the first light G1 that has passed through the first blur correction lens 232 and the first shift lens 234 is formed, and on the light receiving surface 216A of the second image sensor 216, the second light G2 that has passed through the second blur correction lens 240 and the second shift lens 242 is formed.

[0176] 19, similar to the above embodiment, control is performed to change the movement amount of the first shake correction lens 232 and control is performed to change the movement amount of the first shift lens 234, based on the wavelength band of the first light G1 that passes through the first shake correction lens 232 and the first shift lens 234. Also, in the modified example shown in Fig. 19, similar to the above embodiment, control is performed to change the movement amount of the second shake correction lens 240 and control is performed to change the movement amount of the second shift lens 242, based on the wavelength band of the second light G2 that passes through the second shake correction lens 240 and the second shift lens 242.

[0177] In the modified example shown in FIG. 19, only one of the combination of the control to change the amount of movement of the first shake correction lens 232 and the control to change the amount of movement of the first shift lens 234 and the combination of the control to change the amount of movement of the second shake correction lens 240 and the control to change the amount of movement of the second shift lens 242 may be performed.

[0178] 19, only one of the above-described control to change the movement amount of the first shake correction lens 232 and control to change the movement amount of the first shift lens 234 may be performed. Also, in the modification shown in Fig. 19, only one of the above-described control to change the movement amount of the second shake correction lens 240 and control to change the movement amount of the second shift lens 242 may be performed.

[0179] 19, one of the first blur correction lens 232 and the first shift lens 234 may be a fixed lens. Similarly, one of the second blur correction lens 240 and the second shift lens 242 may be a fixed lens.

[0180] Furthermore, in the above embodiment, the lens device 70 is provided with a controller 90 separate from the controller 40 of the surveillance camera body 20, but the lens device 70 does not have to be provided with a controller 90. Furthermore, the functions of the controller 90 of the lens device 70 may be integrated into the controller 40 of the surveillance camera body 20, and the lens device 70 may be controlled by the controller 40 of the surveillance camera body 20. In this case, the controller 90 is an example of a "computer applied to an imaging device."

[0181] Furthermore, in the above embodiment, an example in which the image capture process is executed by the controller 40 of the surveillance camera 10 has been described, but the technology of the present disclosure is not limited to this. For example, the image capture process may be executed by a computer in an external device communicably connected to the surveillance camera 10 via a network such as a LAN or WAN. Furthermore, the image capture process may be distributed between the above-mentioned external device and the surveillance camera 10, or may be executed by multiple devices including the above-mentioned external device and the surveillance camera 10. Place The imaging process may be executed in a distributed manner.

[0182] Furthermore, in the above embodiment, the surveillance camera 10 has been described as an example of an imaging device, but the technology of the present disclosure is not limited thereto, and the technology described in the above embodiment can be applied to various imaging devices. Examples of imaging devices include digital cameras with interchangeable lenses and no reflex mirror, digital cameras with fixed lenses, digital cameras with reflex mirrors, and digital cameras built into various electronic devices such as smart devices, wearable devices, cell observation devices, ophthalmic observation devices, and surgical microscopes. Furthermore, the technology described in the above embodiment may be applied to imaging devices equipped with image sensors sensitive to light having wavelength bands other than the near-infrared wavelength band.

[0183] In the above embodiment, an example has been described in which the imaging support processing program 100 is stored in the NVM 94, but the imaging support processing program 100 may be stored in a portable storage medium such as an SSD or a USB memory, and the imaging support processing program 100 may be stored in a non-transitory storage medium. The imaging support processing program 100 stored in a non-transitory storage medium is installed in, for example, the lens device 70 and used.

[0184] Furthermore, in the above embodiment, an example is shown in which the controller 40 is built into the surveillance camera 10, but the technology of the present disclosure is not limited to this, and for example, the controller 40 may be provided outside the surveillance camera 10.

[0185] In the above embodiment, the CPU 42 of the surveillance camera body 20 is a single CPU, but it may be multiple CPUs. Also, a GPU may be used instead of the CPU 42. Similarly, the CPU 92 of the lens device 70 is a single CPU, but it may be multiple CPUs. Also, a GPU may be used instead of the CPU 92.

[0186] Furthermore, in the above embodiment, the surveillance camera body 20 includes the controller 40, but the technology of the present disclosure is not limited to this, and a device including an ASIC, FPGA, and / or PLD may be applied instead of the controller 40. Furthermore, instead of the controller 40, a combination of a hardware configuration and a software configuration may be used.

[0187] Furthermore, in the above embodiment, the lens device 70 includes the controller 90, but the technology of the present disclosure is not limited to this, and a device including an ASIC, an FPGA, and / or a PLD may be applied instead of the controller 90. Furthermore, instead of the controller 90, a combination of a hardware configuration and a software configuration may be used.

[0188] The hardware resources for executing the imaging support processing described in the above embodiments can be various processors, as listed below. Examples of processors include a CPU, which is a general-purpose processor that functions as a hardware resource for executing imaging support processing by executing software, i.e., a program. Examples of processors include dedicated electrical circuits, such as FPGAs, PLDs, or ASICs, which are processors with circuit configurations designed specifically for executing specific processing. Each processor has built-in or connected memory, and each processor executes the imaging support processing by using the memory.

[0189] The hardware resource that executes the imaging support process may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the imaging support process may be a single processor.

[0190] As an example of a system configured with one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes the imaging support process. Second, there is a system that uses a processor that realizes the functions of the entire system, including multiple hardware resources that execute the imaging support process, on a single IC chip, as typified by SoCs. In this way, the imaging support process is realized using one or more of the various processors described above as hardware resources.

[0191] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The above-described imaging support process is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the process.

[0192] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[0193] In this specification, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0194] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

Claims

1. A lens device provided in an imaging device body having an image sensor, a processor; a memory connected to or embedded in said processor; a lens including a moving lens that focuses incident light onto the image sensor; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; Equipped with The processor: based on a detection result by a blur amount detection sensor that detects the amount of blur of the imaging device, control is performed on the drive mechanism to move the movable lens in a direction that corrects blur of an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light that passes through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that can obtain a blur correction amount proportional to the detection result by the blur amount detection sensor even when the wavelength band of the light that passes through the movable lens changes. Lens device.

2. A lens device provided in an imaging device body having an image sensor, a processor; a memory connected to or embedded in said processor; a lens including a moving lens that focuses incident light onto the image sensor; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; Equipped with The processor: based on an image shift command that is a command to shift an image, control is performed on the drive mechanism to move the movable lens in a direction that shifts an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light transmitted through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that shifts the image to a position corresponding to the shift amount of the image represented by the image shift command, even when the wavelength band of the light transmitted through the movable lens changes. Lens device.

3. The processor controls the drive mechanism to move the moving lens to a position where the image shifts at a pitch equal to or greater than the pixel pitch of the image sensor or at a pitch less than the pixel pitch of the image sensor. The lens device according to claim 2 .

4. A first lens that is moved in a direction in which the image blur is corrected; a second lens as the moving lens; Equipped with 4. The lens device according to claim 2 or 3.

5. A shift amount of the image on the light receiving surface of the image sensor with respect to a unit movement amount of the second lens is smaller than a blur correction amount of the image on the light receiving surface of the image sensor with respect to a unit movement amount of the first lens. The lens device according to claim 4 .

6. When a shift amount on the light receiving surface of the image sensor of a central ray passing through the second lens after movement on the optical axis relative to a unit movement amount of the second lens is defined as S1, and a shift amount on the light receiving surface of the image sensor of a peripheral ray passing through the second lens after movement other than on the optical axis relative to the unit movement amount of the second lens is defined as S2, The relationship 0.8≦S2 / S1≦1.2 holds 6. The lens device according to claim 4 or claim 5.

7. A processor; a memory connected to or embedded in said processor; An image sensor; a lens including a moving lens that focuses incident light onto the image sensor; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; Equipped with The processor: based on a detection result by a blur amount detection sensor that detects the amount of blur of the imaging device, control is performed on the drive mechanism to move the movable lens in a direction that corrects blur of an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light that passes through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that can obtain a blur correction amount proportional to the detection result by the blur amount detection sensor even when the wavelength band of the light that passes through the movable lens changes. Imaging device.

8. A processor; a memory connected to or embedded in said processor; An image sensor; a lens including a moving lens that focuses incident light onto the image sensor; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; Equipped with The processor: based on an image shift command that is a command to shift an image, control is performed on the drive mechanism to move the movable lens in a direction that shifts an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light transmitted through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that shifts the image to a position corresponding to the shift amount of the image represented by the image shift command, even when the wavelength band of the light transmitted through the movable lens changes. Imaging device.

9. The processor: controlling the drive mechanism to move the movable lens to a position where an image obtained by focusing the light on the image sensor is shifted at a pitch equal to or greater than the pixel pitch of the image sensor or at a pitch less than the pixel pitch of the image sensor; causing the image sensor to capture an image each time the image is shifted; The plurality of frames of images obtained by the imaging are synthesized. The imaging device according to claim 8 .

10. A lens including a moving lens that focuses incident light onto an image sensor of an imaging device body; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; A method of operating a lens device comprising: based on a detection result by a blur amount detection sensor that detects the amount of blur of the imaging device, control is performed on the drive mechanism to move the movable lens in a direction that corrects blur of an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light that passes through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that can obtain a blur correction amount proportional to the detection result by the blur amount detection sensor even when the wavelength band of the light that passes through the movable lens changes. A method of operating a lens apparatus, comprising:

11. A lens including a moving lens that focuses incident light onto an image sensor of an imaging device body; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; A method of operating a lens device comprising: based on an image shift command that is a command to shift an image, control is performed on the drive mechanism to move the movable lens in a direction that shifts an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light transmitted through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that shifts the image to a position corresponding to the shift amount of the image represented by the image shift command, even when the wavelength band of the light transmitted through the movable lens changes. A method of operating a lens apparatus, comprising:

12. An image sensor; a lens including a moving lens that focuses incident light onto the image sensor; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; A method for operating an imaging device comprising: based on a detection result by a blur amount detection sensor that detects the amount of blur of the imaging device, control is performed on the drive mechanism to move the movable lens in a direction that corrects blur of an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light that passes through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that can obtain a blur correction amount proportional to the detection result by the blur amount detection sensor even when the wavelength band of the light that passes through the movable lens changes. A method of operating an imaging device, comprising:

13. An image sensor; a lens including a moving lens that focuses incident light onto the image sensor; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; A method for operating an imaging device comprising: based on an image shift command that is a command to shift an image, control is performed on the drive mechanism to move the movable lens in a direction that shifts an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light transmitted through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that shifts the image to a position corresponding to the shift amount of the image represented by the image shift command, even when the wavelength band of the light transmitted through the movable lens changes. A method of operating an imaging device, comprising:

14. A lens including a moving lens that focuses incident light onto an image sensor of an imaging device body; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; A computer applied to a lens apparatus comprising: based on a detection result by a blur amount detection sensor that detects the amount of blur of the imaging device, control is performed on the drive mechanism to move the movable lens in a direction that corrects blur of an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light that passes through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that can obtain a blur correction amount proportional to the detection result by the blur amount detection sensor even when the wavelength band of the light that passes through the movable lens changes. A program for executing processes including the above.

15. A lens including a moving lens that focuses incident light onto an image sensor of an imaging device body; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; A computer applied to a lens apparatus comprising: based on an image shift command that is a command to shift an image, control is performed on the drive mechanism to move the movable lens in a direction that shifts an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light transmitted through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that shifts the image to a position corresponding to the shift amount of the image represented by the image shift command, even when the wavelength band of the light transmitted through the movable lens changes. A program for executing processes including the above.

16. An image sensor; a lens including a moving lens that focuses incident light onto the image sensor; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; A computer applied to an imaging device comprising: based on a detection result by a blur amount detection sensor that detects the amount of blur of the imaging device, control is performed on the drive mechanism to move the movable lens in a direction that corrects blur of an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light that passes through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that can obtain a blur correction amount proportional to the detection result by the blur amount detection sensor even when the wavelength band of the light that passes through the movable lens changes. A program for executing processes including the above.

17. An image sensor; a lens including a moving lens that focuses incident light onto the image sensor; a drive mechanism that applies power to the movable lens along a coordinate plane that intersects with the optical axis of the lens, thereby moving the movable lens; A computer applied to an imaging device comprising: based on an image shift command that is a command to shift an image, control is performed on the drive mechanism to move the movable lens in a direction that shifts an image obtained by focusing the light on the image sensor; Based on the wavelength band of the light transmitted through the movable lens, the driving mechanism is controlled to change the movement amount of the movable lens to a movement amount that shifts the image to a position corresponding to the shift amount of the image represented by the image shift command, even when the wavelength band of the light transmitted through the movable lens changes. A program for executing processes including the above.

Images