Control device, imaging device, control method, and program

Abstract

This control device comprises: a processor; and a memory which is connected to or built into the processor. The processor is provided with: a first mode in which an image is captured on the basis of light received by an image sensor of an imaging device; and a second mode in which the temperature is derived on the basis of near-infrared light received by the image sensor. Different control factors are used in the first mode and in the second mode.

Description

[Technical Field]

[0001] The technology disclosed herein relates to a control device, an imaging device, a control method, and a program. [Background technology]

[0002] Japanese Patent Application Laid-Open Publication No. 10-134272 discloses a monitoring system for large-space disaster prevention and the like, which is used to detect fires and intruders from thermal images of large spaces and to control the environment, and which is characterized by comprising an infrared camera for extracting thermal images of a specific temperature range using a temperature filter, a temperature filter selection means having a plurality of temperature filters with different temperature ranges from room temperature to the temperature range required for fire monitoring and selecting a temperature filter for the infrared camera from the plurality of temperature filters, an image data storage means for storing thermal image data extracted from the infrared camera and processed, and a control processing means for controlling the temperature filter selection means to select a temperature filter for the infrared camera according to the switching timing of a plurality of preset monitoring modes, extracting thermal image data from the infrared camera for each monitoring mode, and executing processing for each monitoring mode.

[0003] International Publication No. 2005 / 71372 discloses an image processing system comprising an image capturing unit configured to acquire spectral images, the image capturing unit having a photographing optical system for forming an image of a subject, an image sensor unit for capturing the subject image formed by the photographing optical system and outputting an image signal, and a photographing operation unit for performing operations related to photographing the image, and further comprising a mode display means for displaying mode-related information corresponding to each of a plurality of modes that the image processing system can take.

[0004] JP 2004-534941 A discloses a handheld infrared camera including a lens assembly, the lens assembly being supported by a housing configured to hold an electrical energy source and processing means for recording and processing information received via the lens assembly, and user control means for manually and visually controlling the device being provided on the housing, the housing having a substantially elongated shape, one end to which the lens assembly is mounted and the opposite end formed as a user handle, one side of the housing being provided with a collection of manual control means intended to be operated with the user's thumb and visual control means, the visual control means being positioned between the collection of manual control means and the lens assembly and adapted to be visible when the infrared camera is held away from the user's eyes and body, and the infrared camera being intended to be operated with one hand. Summary of the Invention

[0005] One embodiment of the technique of the present disclosure provides a control device, an imaging device, a control method, and a program that can make the control content of a control target different between a first mode and a second mode. [Means for solving the problem]

[0006] A first aspect of the technology of the present disclosure is a control device comprising a processor and a memory connected to or built into the processor, wherein the processor has a first mode for capturing an image based on light received by an image sensor of an imaging device, and a second mode for deriving temperature based on near-infrared light received by the image sensor, and wherein the control factors differ between the first mode and the second mode.

[0007] A second aspect of the technique of the present disclosure is the control device according to the first aspect, wherein the control factor includes a display control factor that causes a display to be displayed.

[0008] A third aspect of the technology of the present disclosure is a control device in which, in the control device of the second aspect, the processor sets, as the display control factor, an imaged image display factor that causes an imaged image obtained by receiving light by an image sensor to be displayed on a display, and in the second mode, sets, as the display control factor, a temperature information display factor that causes temperature information indicating a temperature to be displayed on a display.

[0009] A fourth aspect of the technology of the present disclosure is a control device according to any one of the first to third aspects, wherein the control factor includes a light-projection control factor that operates a light-projector, and the processor, in the second mode, sets a light-projection suppression control factor that suppresses light projection by the light-projector as the light-projection control factor.

[0010] A fifth aspect of the technique of the present disclosure is the control device according to any one of the first to fourth aspects, wherein the control factors include an imaging setting factor related to imaging settings.

[0011] A sixth aspect of the technology of the present disclosure is a control device according to the fifth aspect, wherein the imaging settings include at least one of settings related to a floodlight, settings related to a shutter speed, settings related to an aperture, settings related to photometry, settings related to the sensitivity of the image sensor, settings related to a high dynamic range, and settings related to vibration isolation control.

[0012] A seventh aspect of the technique of the present disclosure is the control device according to any one of the first to sixth aspects, wherein the control factors include image processing setting factors related to image processing settings.

[0013] An eighth aspect of the technology of the present disclosure is a control device according to the seventh aspect, wherein the image processing settings include at least one of settings related to noise reduction, settings related to sharpness, settings related to contrast, and settings related to tone.

[0014] A ninth aspect of the technology of the present disclosure is a control device comprising a processor and a memory connected to or built into the processor, wherein the processor has a first mode for capturing an image based on light received by an image sensor of an imaging device, and a second mode for deriving temperature based on near-infrared light received by the image sensor, and sets the first mode when the floodlight is on, and sets the second mode when the floodlight is off.

[0015] A tenth aspect of the technique of the present disclosure is the control device according to the ninth aspect, wherein the processor switches from the second mode to the first mode in response to temperature in the second mode.

[0016] An eleventh aspect of the technology of the present disclosure is a control device according to the tenth aspect, wherein the floodlight emits pulsed light, and the processor repeats the operation of setting a first mode during a light emission period of the pulsed light and setting a second mode during a light emission stop period of the pulsed light in accordance with the light emission timing of the pulsed light.

[0017] A twelfth aspect of the technology of the present disclosure is a control device according to any one of the first to eleventh aspects, wherein the processor outputs a composite image that combines a first captured image obtained by receiving light by an image sensor with temperature information indicating the temperature.

[0018] A thirteenth aspect of the technique of the present disclosure is an imaging device including the control device according to any one of the first to twelfth aspects and an image sensor.

[0019] A fourteenth aspect of the technology of the present disclosure is a control method that includes switching between a first mode in which an image is captured based on light received by an image sensor of an imaging device and a second mode in which a temperature is derived based on near-infrared light received by the image sensor, and differentiating control factors between the first mode and the second mode.

[0020] A fifteenth aspect of the technology of the present disclosure is a control method that includes switching between a first mode in which an image is captured based on light received by an image sensor of an imaging device and a second mode in which a temperature is derived based on near-infrared light received by the image sensor, and setting the first mode when the operation of the floodlight is on, and setting the second mode when the operation of the floodlight is off.

[0021] A sixteenth aspect of the technology of the present disclosure is a program for causing a computer to execute processing including switching between a first mode in which an image is captured based on light received by an image sensor of an imaging device and a second mode in which temperature is derived based on near-infrared light received by the image sensor, and differentiating control factors between the first mode and the second mode.

[0022] A seventeenth aspect of the technology of the present disclosure is a program for causing a computer to execute processing including switching between a first mode in which an image is captured based on light received by an image sensor of an imaging device and a second mode in which temperature is derived based on near-infrared light received by the image sensor, and setting the first mode when the operation of the floodlight is on, and setting the second mode when the operation of the floodlight is off. [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a perspective view showing an example of a camera according to a first embodiment. [Figure 2] 1 is a block diagram showing an example of the internal configuration of a camera according to a first embodiment. [Figure 3] 1 is a block diagram showing an example of the electrical configuration of a camera according to a first embodiment. [Figure 4] 2A to 2C are explanatory diagrams showing an example of the configuration and operation of the turret filter according to the first embodiment. [Figure 5] FIG. 2 is a block diagram showing an example of the functional configuration of a CPU according to the first embodiment. [Figure 6]3 is a block diagram showing an example of the configuration of a CPU as a mode switching processing unit according to the first embodiment. FIG. [Figure 7] 3 is a block diagram showing an example of the configuration of a CPU as an imaging processing unit according to the first embodiment. FIG. [Figure 8] FIG. 2 is a front view showing an example of a captured image obtained by imaging processing according to the first embodiment. [Figure 9] 3 is a block diagram showing an example of the configuration of a temperature measurement processing unit of a CPU according to the first embodiment. FIG. [Figure 10] FIG. 2 is an explanatory diagram showing an example of a function of a CPU as a wavelength selection unit according to the first embodiment. [Figure 11] FIG. 4 is a front view showing a first example of a composite image obtained in the temperature measurement process according to the first embodiment. [Figure 12] FIG. 10 is a front view showing a second example of a composite image obtained in the temperature measurement process according to the first embodiment. [Figure 13] FIG. 10 is a front view showing a third example of a composite image obtained in the temperature measurement process according to the first embodiment. [Figure 14] FIG. 10 is a front view showing a fourth example of a composite image obtained in the temperature measurement process according to the first embodiment. [Figure 15] 6 is a flowchart showing an example of the flow of a mode switching process according to the first embodiment. [Figure 16] 5 is a flowchart showing an example of the flow of imaging processing according to the first embodiment. [Figure 17] 5 is a flowchart showing an example of the flow of a temperature measurement process according to the first embodiment. [Figure 18] FIG. 10 is a front view showing a modified example of a captured image obtained by the imaging process according to the first embodiment. [Figure 19] FIG. 10 is a front view showing a modified example of a composite image obtained by the temperature measurement process according to the first embodiment. [Figure 20] FIG. 11 is a block diagram showing an example of the configuration of a CPU as a mode switching processing unit according to the second embodiment. [Figure 21] 10 is a flowchart showing an example of the flow of a mode switching process according to the second embodiment. [Figure 22] FIG. 11 is a block diagram showing an example of the configuration of a CPU as a parameter change processing unit according to the third embodiment. [Figure 23] FIG. 11 is a block diagram showing an example of the configuration of a CPU as an imaging processing unit according to the third embodiment. [Figure 24] FIG. 11 is a block diagram showing an example of the configuration of a temperature measurement processing unit of a CPU according to a third embodiment. [Figure 25] 11 is a flowchart showing an example of the flow of a parameter change process according to the third embodiment. [Figure 26] FIG. 13 is a block diagram showing an example of the configuration of a CPU as a mode switching processing unit according to the fourth embodiment. [Figure 27] 13 is a flowchart showing an example of the flow of a mode switching process according to the fourth embodiment. [Figure 28] FIG. 13 is a block diagram showing an example of the configuration of a CPU serving as an integrated display processing unit according to the fifth embodiment. [Figure 29] 13 is a flowchart showing an example of the flow of an integrated display process according to the fifth embodiment. [Figure 30] FIG. 10 is a block diagram showing an example of the electrical configuration of an imaging device according to a first modified example. [Figure 31] FIG. 10 is a block diagram showing an example of the electrical configuration of an imaging device according to a second modified example. DETAILED DESCRIPTION OF THE INVENTION

[0024] Hereinafter, exemplary embodiments of a control device, an imaging device, a control method, and a program according to the techniques of the present disclosure will be described with reference to the accompanying drawings.

[0025] First, the terms used in the following description will be explained.

[0026] CPU is an abbreviation for "Central Processing Unit". GPU is an abbreviation for "Graphics Processing Unit". NVM is an abbreviation for "Non-Volatile Memory". RAM is an abbreviation for "Random Access Memory". IC is an abbreviation for "Integrated Circuit". ASIC is an abbreviation for "Application Specific Integrated Circuit". PLD is an abbreviation for "Programmable Logic Device". FPGA is an abbreviation for "Field-Programmable Gate Array". SoC is an abbreviation for "System-on-a-chip". SSD is an abbreviation for "Solid State Drive". HDD is an abbreviation for "Hard Disk Drive". EEPROM is an abbreviation for "Electrically Erasable and Programmable Read Only Memory". SRAM is an abbreviation for "Static Random Access Memory". I / F is an abbreviation for "Interface". USB is an abbreviation for "Universal Serial Bus". CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor". CCD is an abbreviation for "Charge Coupled Device". LAN is an abbreviation for "Local Area Network". WAN is an abbreviation for "Wide Area Network". BPF is an abbreviation for "Band Pass Filter". Ir is an abbreviation for "Infrared Rays". EL is an abbreviation for "Electro Luminescence".

[0027] In the description of this specification, "vertical" refers to vertical in the sense of including, in addition to perfectly vertical, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "horizontal" refers to horizontal in the sense of including, in addition to perfectly horizontal, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "parallel" refers to parallel in the sense of including, in addition to perfectly parallel, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "orthogonal" refers to orthogonal in the sense of including, in addition to perfectly perpendicular, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "coincidence" refers to coincidence in the sense of including, in addition to perfect coincidence, an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not violate the spirit of the technology of the present disclosure. In the description of this specification, "equally spaced" refers to not only perfectly evenly spaced intervals, but also equal intervals that include errors that are generally acceptable in the technical field to which the technology of the present disclosure belongs and that do not contradict the spirit of the technology of the present disclosure.

[0028] [First embodiment] First, a first embodiment will be described. As an example, as shown in FIG. 1, camera 1 includes a camera body 10 and a lens unit 20. Camera 1 has a function of capturing visible light to obtain a visible light image, a function of capturing near-infrared light to obtain a near-infrared light image, and a function of measuring the temperature of a subject based on electromagnetic waves emitted by thermal radiation from the subject. Camera 1 is an example of an "imaging device" according to the technology of the present disclosure.

[0029] A camera-side mount 12 for attaching the lens unit 20 is provided on the front surface 11 of the camera body 10. An illumination window 13 for irradiating illumination light IL toward the subject is also provided on the front surface 11 of the camera body 10.

[0030] The camera body 10 is equipped with a projector 14 that generates illumination light IL. The projector 14 is, for example, an LED that emits near-infrared light with a peak wavelength of 1550 nm as the illumination light IL. The projector 14 may also be a halogen light. The illumination light IL generated by the projector 14 passes through an irradiation window 13 and is emitted forward from the camera body 10. The projector 14 is an example of a "projector" according to the technology of the present disclosure.

[0031] The camera body 10 also includes an image sensor 15. The image sensor 15 captures light L incident from a subject via a lens unit 20. The image sensor 15 has a light receiving surface 15A. The light L incident on the lens unit 20 is focused on the light receiving surface 15A by the lens unit 20. An image is obtained by focusing the light L on the light receiving surface 15A. A plurality of photodiodes are arranged in a matrix on the light receiving surface 15A.

[0032] As an example, the multiple photodiodes include multiple silicon photodiodes sensitive to visible light and multiple indium gallium arsenide photodiodes sensitive to near-infrared light. Hereinafter, the silicon photodiodes will be referred to as Si diodes, and the indium gallium arsenide photodiodes will be referred to as InGaAs diodes. The multiple Si diodes generate and output analog image data corresponding to the visible light they receive. The multiple InGaAs diodes generate and output analog image data corresponding to the near-infrared light they receive. Hereinafter, unless there is a need to distinguish between the visible light and near-infrared light, the visible light and near-infrared light incident on the image sensor 15 will be referred to as light.

[0033] In the first embodiment, a CMOS image sensor is exemplified as the image sensor 15, but the technology of the present disclosure is not limited to this, and the technology of the present disclosure is also valid even if the image sensor 15 is another type of image sensor such as a CCD image sensor. The image sensor 15 is an example of an "image sensor of an imaging device" according to the technology of the present disclosure.

[0034] The lens unit 20 includes a lens barrel 21 and a lens side mount 22. The lens side mount 22 is provided at the rear end of the lens barrel 21. The lens side mount 22 is configured to be connectable to the camera side mount 12 of the camera body 10. The lens unit 20 is detachably attached to the camera body 10 by the lens side mount 22. Note that the lens unit 20 may also be fixed to the camera body 10 in an undetachable manner.

[0035] 2, the lens unit 20 includes an objective lens 30, a focus lens 31, a zoom lens 32, an aperture 33, a blur correction lens 34, a turret filter 35, and an adjustment lens 37. The objective lens 30, the focus lens 31, the zoom lens 32, the aperture 33, the blur correction lens 34, the turret filter 35, and the adjustment lens 37 are arranged in this order from the subject side to the image side along the optical axis OA of the lens unit 20.

[0036] The objective lens 30 is fixed to the tip of the lens barrel 21 and is a lens that focuses light. The focus lens 31 is a lens that adjusts the focal position of the image. The zoom lens 32 is a lens that adjusts the zoom magnification.

[0037] The diaphragm 33 is an optical element for adjusting the amount of light. The diaphragm 33 has an opening 33A. Light guided by the zoom lens 32 passes through the opening 33A. The diaphragm 33 is a movable diaphragm in which the diameter of the opening 33A is variable. The amount of light guided by the zoom lens 32 is changed by the diaphragm 33. The blur correction lens 34 is a lens for correcting image blur.

[0038] The turret filter 35 has a plurality of optical filters. The turret filter 35 is an optical element that selectively transmits light of a plurality of wavelength bands contained in the light (for example, visible light and near-infrared light of different wavelength bands within the near-infrared wavelength band) by switching an optical filter inserted into the optical path of the light within the lens unit 20 from among the plurality of optical filters. The optical path of the light within the lens unit 20 is located, for example, on the optical axis OA. Hereinafter, the optical path of the light within the lens unit 20 will be simply referred to as the optical path. The configuration of the turret filter 35 will be described in detail later using FIG. 4.

[0039] The adjustment lens 37 is a lens for adjusting the difference in focal length when switching between the plurality of optical filters provided in the turret filter 35.

[0040] The order of the focus lens 31, zoom lens 32, diaphragm 33, blur correction lens 34, turret filter 35, and adjustment lens 37 may be other than that described above. Each of the objective lens 30, focus lens 31, zoom lens 32, blur correction lens 34, and adjustment lens 37 may be a single lens or a lens group having multiple lenses. The lens unit 20 may include other lenses in addition to the focus lens 31, zoom lens 32, blur correction lens 34, and adjustment lens 37. The lens unit 20 may also include optical elements such as a half mirror or a polarizing element.

[0041] 2, the lens unit 20 includes a zoom drive mechanism 42, an aperture drive mechanism 43, a blur correction drive mechanism 44, a turret drive mechanism 45, and an adjustment drive mechanism 47. The zoom drive mechanism 42, the aperture drive mechanism 43, the blur correction drive mechanism 44, the turret drive mechanism 45, and the adjustment drive mechanism 47 are electrically connected to an electrical contact 38 provided at the rear end of the lens barrel 21.

[0042] The camera body 10 includes a control circuit 50. The control circuit 50 is electrically connected to an electrical contact 58 provided on the camera-side mount 12. When the lens-side mount 22 is connected to the camera-side mount 12 and the lens unit 20 is attached to the camera body 10, the electrical contact 38 is connected to the electrical contact 58, and the control circuit 50 is electrically connected to the zoom drive mechanism 42, the aperture drive mechanism 43, the image blur correction drive mechanism 44, the turret drive mechanism 45, and the adjustment drive mechanism 47.

[0043] The zoom drive mechanism 42, the aperture drive mechanism 43, the shake correction drive mechanism 44, the turret drive mechanism 45, and the adjustment drive mechanism 47 are all drive mechanisms that include actuators such as motors.

[0044] 3, the control circuit 50 includes a computer 60, a zoom drive circuit 52, an aperture drive circuit 53, a shake correction drive circuit 54, a turret drive circuit 55, and an adjustment drive circuit 57. The zoom drive circuit 52, the aperture drive circuit 53, the shake correction drive circuit 54, the turret drive circuit 55, and the adjustment drive circuit 57 are connected to the computer 60 via an input / output I / F 59.

[0045] The computer 60 includes a CPU 61, an NVM 62, and a RAM 63. The CPU 61, the NVM 62, and the RAM 63 are connected to one another via a bus 64, and the bus 64 is connected to the input / output I / F 59.

[0046] The NVM 62 is a non-transitory storage medium that stores various parameters and programs. For example, the NVM 62 is an EEPROM. However, this is merely an example, and instead of or together with the EEPROM, an HDD and / or an SSD may be used as the NVM 62. The RAM 63 temporarily stores various information and is used as a work memory. The CPU 61 reads necessary programs from the NVM 62 and executes the read programs in the RAM 63. The CPU 61 controls the entire camera 1 in accordance with the programs executed on the RAM 63.

[0047] The CPU 61 is an example of a "processor" according to the technology of the present disclosure, the RAM 63 is an example of a "memory" according to the technology of the present disclosure, and the computer 60 is an example of a "control device" according to the technology of the present disclosure.

[0048] The zoom drive circuit 52 adjusts the positions of the focus lens 31 and the zoom lens 32 by driving the zoom drive mechanism 42 in accordance with instructions from the computer 60. The focus lens 31 and the zoom lens 32 are moved along the optical axis OA of the lens unit 20 by being powered by the zoom drive mechanism 42.

[0049] The diaphragm driving circuit 53 drives the diaphragm driving mechanism 43 in accordance with instructions from the computer 60, thereby changing the diameter of the aperture 33A (see FIG. 2) provided in the diaphragm 33.

[0050] The blur correction drive circuit 54 adjusts the position of the blur correction lens 34 by driving the blur correction drive mechanism 44 in accordance with instructions from the computer 60 and feedback signals output from a feedback circuit 75 (described later). The blur correction lens 34 moves along a plane perpendicular to the optical axis OA of the lens unit 20 when power is applied from the blur correction drive mechanism 44. Specifically, the blur correction lens 34 moves in a direction that corrects blur in the image obtained by focusing light on the image sensor 15.

[0051] The turret drive circuit 55 adjusts the rotational position of the turret filter 35 by driving the turret drive mechanism 45 in accordance with instructions from the computer 60. The turret filter 35 rotates along a plane perpendicular to the optical axis OA of the lens unit 20 when power is applied from the turret drive mechanism 45. The rotational operation of the turret filter 35 will be described in detail later using FIG. 4.

[0052] The adjustment drive circuit 57 adjusts the position of the adjustment lens 37 by driving the adjustment drive mechanism 47 in accordance with instructions from the computer 60. The adjustment lens 37 moves along the optical axis OA of the lens unit 20 when power is applied from the adjustment drive mechanism 47.

[0053] 3 , the camera body 10 includes an image sensor driver 71, a signal processing circuit 72, a light projection control circuit 73, a vibration sensor 74, a feedback circuit 75, a display 76, a display control circuit 77, an input device 78, an input circuit 79, and an external I / F 80. The image sensor driver 71, the signal processing circuit 72, the light projection control circuit 73, the feedback circuit 75, the display control circuit 77, the input circuit 79, and the external I / F 80 are connected to the computer 60 via the input / output I / F 59.

[0054] The image sensor driver 71 causes the image sensor 15 to capture light in accordance with instructions from the computer 60. The signal processing circuit 72 performs various signal processing on the analog image data output from the image sensor 15 to generate and output digital image data.

[0055] The light-projection control circuit 73 switches the light projector 14 on and off in accordance with instructions from the computer 60. The light projector 14 outputs illumination light when switched on, and stops outputting illumination light when switched off.

[0056] The vibration sensor 74 is, for example, a gyro sensor, and detects vibrations of the camera 1. The gyro sensor included in the vibration sensor 74 detects vibrations around the pitch axis and yaw axis of the camera 1. The vibration sensor 74 converts the vibrations around the pitch axis and the yaw axis detected by the gyro sensor into vibrations in a two-dimensional plane parallel to the pitch axis and the yaw axis, thereby detecting vibrations acting on the camera 1 in the direction of the pitch axis and vibrations acting in the direction of the yaw axis. The vibration sensor 74 outputs a vibration detection signal corresponding to the detected vibrations.

[0057] The vibration sensor 74 may be an acceleration sensor. Also, instead of the vibration sensor 74, a motion vector obtained by comparing successive captured images in time series stored in the NVM 62 and / or the RAM 63 may be used as the vibration. Also, the vibration that is ultimately used may be derived based on the vibration detected by a physical sensor and the motion vector obtained by image processing.

[0058] Feedback circuit 75 generates a feedback signal by performing various signal processing on the vibration detection signal output from vibration sensor 74. Feedback circuit 75 is connected to blur correction drive circuit 54 via input / output I / F 59, and outputs the feedback signal to blur correction drive circuit 54 in accordance with instructions from computer 60.

[0059] The display 76 is, for example, a liquid crystal display or an EL display, and displays images and / or text information, etc. The display control circuit 77, in accordance with instructions from the computer 60, causes the display 76 to display images.

[0060] The input device 78 is, for example, a device such as a touch panel and / or a switch, and receives instructions given by a user. The input circuitry 79 outputs an input signal according to the instructions given by the user to the input device 78. The external I / F 80 is an interface communicably connected to an external device.

[0061] 4, the turret filter 35 includes a disk 81. The disk 81 is provided with a plurality of optical filters, namely, an Ir cut filter 82, a first BPF 83A, a second BPF 83B, a third BPF 83C, and a fourth BPF 83D, at equal intervals along the circumferential direction of the disk 81. Hereinafter, unless there is a need to distinguish between them, the Ir cut filter 82, the first BPF 83A, the second BPF 83B, the third BPF 83C, and the fourth BPF 83D will be referred to as optical filters. Hereinafter, unless there is a need to distinguish between them, the first BPF 83A, the second BPF 83B, the third BPF 83C, and the fourth BPF 83D will be referred to as BPFs 83.

[0062] The turret filter 35 selectively inserts and removes a plurality of optical filters into and from the optical path using a turret system. Specifically, the turret filter 35 rotates in the direction of the arc arrow R shown in Fig. 4, thereby selectively inserting and removing the Ir cut filter 82, the first BPF 83A, the second BPF 83B, the third BPF 83C, and the fourth BPF 83D into and from the optical path (for example, the optical path on the optical axis OA). When an optical filter is inserted into the optical path, the optical axis OA passes through the center of the optical filter, and the center of the optical filter inserted into the optical path coincides with the center of the light receiving surface of the image sensor 15.

[0063] The infrared cut filter 82 is an optical filter that cuts infrared light and transmits only light other than infrared light. The BPF 83 is an optical filter that transmits near-infrared light. The first BPF 83A, the second BPF 83B, the third BPF 83C, and the fourth BPF 83D each transmit near-infrared light in a different wavelength band.

[0064] The first BPF 83A is an optical filter that corresponds to a wavelength band around 1000 nm (nanometers). As an example, the first BPF 83A transmits only near-infrared light in a wavelength band from 950 nm to 1100 nm. Hereinafter, the near-infrared light that has transmitted through the first BPF 83A will be referred to as first near-infrared light.

[0065] The second BPF 83B is an optical filter corresponding to a wavelength band around 1250 nm. As an example, the second BPF 83B transmits only near-infrared light in the wavelength band from 1150 nm to 1350 nm. Hereinafter, the near-infrared light transmitted through the second BPF 83B will be referred to as second near-infrared light.

[0066] The third BPF 83C is an optical filter corresponding to a wavelength band around 1550 nm. As an example, the third BPF 83C transmits only near-infrared light in the wavelength band from 1500 nm to 1750 nm. Hereinafter, the near-infrared light transmitted through the third BPF 83C will be referred to as third near-infrared light.

[0067] The fourth BPF 83D is an optical filter corresponding to a wavelength band around 2150 nm. As an example, the fourth BPF 83D transmits only near-infrared light in a wavelength band from 2000 nm to 2400 nm. Hereinafter, the near-infrared light transmitted through the fourth BPF 83D will be referred to as fourth near-infrared light.

[0068] Hereinafter, unless there is a need to distinguish between them, the first near-infrared light, the second near-infrared light, the third near-infrared light, and the fourth near-infrared light will be referred to as near-infrared light. Note that each of the bands listed here includes an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and that does not deviate from the spirit of the technology of the present disclosure. Furthermore, each of the wavelength bands listed here is merely an example, and each may be a different wavelength band.

[0069] When the Ir cut filter 82 is inserted into the optical path and visible light transmitted through the Ir cut filter 82 is focused on the light-receiving surface of the image sensor 15, the multiple Si diodes arranged on the light-receiving surface output analog image data obtained by capturing the received visible light. This realizes the function of obtaining a visible light image by capturing the visible light. Furthermore, when the BPF 83 is inserted into the optical path and near-infrared light transmitted through the BPF 83 is focused on the light-receiving surface of the image sensor 15, the multiple InGaAs diodes arranged on the light-receiving surface output analog image data obtained by capturing the received near-infrared light. This realizes the function of obtaining a near-infrared light image by capturing the near-infrared light.

[0070] As described above, the camera 1 has the function of capturing visible light to obtain a visible light image and the function of capturing near-infrared light to obtain a near-infrared light image. In addition to the functions of capturing visible light images and near-infrared light images, the camera 1 also has the function of measuring the temperature of a subject based on electromagnetic waves emitted by the subject due to thermal radiation. In the first embodiment, a two-color thermometry method is used to improve measurement accuracy. To achieve temperature measurement using the two-color thermometry method, it is necessary to capture light of two different wavelength bands, for example. In the first embodiment, a turret filter 35 is used as a means for generating light of two different wavelength bands, and, as an example, near-infrared light of two wavelength bands is used for temperature measurement.

[0071] 5, the imaging support processing is realized by the CPU 61 executing an imaging support processing program 100. The imaging support processing program 100 is an example of a "program" according to the technology of the present disclosure. In the example shown in FIG. 5, the imaging support processing program 100 is stored in the NVM 62, and the CPU 61 reads out the imaging support processing program 100 from the NVM 62 and executes it on the RAM 63.

[0072] The CPU 61 performs imaging support processing in accordance with an imaging support processing program 100 executed on the RAM 63. By executing the imaging support processing program 100 on the RAM 63, the CPU 61 functions as a mode switching processing unit 110, an imaging processing unit 120, and a temperature measurement processing unit 130.

[0073] The CPU 61 has an imaging mode and a temperature measurement mode as its operation modes, and switches between the imaging mode and the temperature measurement mode. The imaging processing unit 120 is a processing unit that operates when the operation mode of the CPU 61 is switched to the imaging mode. The imaging processing unit 120 is a processing unit that executes imaging processing to display on the display 76 a visible light image obtained by the image sensor 15 capturing visible light, or a near-infrared light image obtained by the image sensor 15 capturing near-infrared light.

[0074] The temperature measurement processing unit 130 is a processing unit that operates when the operation mode of the CPU 61 is switched to the temperature measurement mode. The temperature measurement processing unit 130 is a processing unit that executes a temperature measurement process to calculate the temperature distribution of the subject based on a near-infrared light image obtained by capturing near-infrared light with the image sensor 15, and to display temperature information created based on the temperature distribution of the subject on the display 76.

[0075] The mode switching processing unit 110 is a processing unit that executes mode switching processing to switch the operation mode of the CPU 61 between an imaging mode and a temperature measurement mode. The mode switching processing unit 110, the imaging processing unit 120, and the temperature measurement processing unit 130 will be described below in order.

[0076] The mode switching processing unit 110 includes a mode selection information acquisition unit 111 , a mode determination unit 112 , a flag setting unit 113 , a light projection control unit 114 , and a mode setting unit 115 .

[0077] 6, the mode selection information acquisition unit 111 selectively acquires, for example, via a receiving device, image capture mode selection information that selects the image capture mode as the operation mode and temperature measurement mode selection information that selects the temperature measurement mode as the operation mode. The receiving device accepts various types of information and outputs the accepted information to the CPU 61. Examples of the accepting device include the input circuit 79 and the external I / F 80. For ease of explanation, hereinafter, the image capture mode selection information and the temperature measurement mode selection information will be referred to as mode selection information unless there is a need to distinguish between them.

[0078] Various instructions are input to the input device 78 from the user. The input circuit 79 outputs information according to the instructions input to the input device 78 to the CPU 61. The input circuit 79 outputs mode selection information to the CPU 61 according to a mode selection instruction given to the input device 78 by the user. The mode selection information acquisition unit 111 acquires the mode selection information input from the input circuit 79. The external I / F 80 receives mode selection information output from an external device (not shown) and outputs the received mode selection information to the CPU 61. The mode selection information acquisition unit 111 acquires the mode selection information input from the external I / F 80.

[0079] The mode determination unit 112 determines whether the operation mode selected by the mode selection information acquired by the mode selection information acquisition unit 111 is the image capture mode or the temperature measurement mode. If the mode selection information acquired by the mode selection information acquisition unit 111 is image capture mode selection information, the mode determination unit 112 determines that the operation mode selected by the mode selection information is the image capture mode. If the mode selection information acquired by the mode selection information acquisition unit 111 is temperature measurement mode selection information, the mode determination unit 112 determines that the operation mode selected by the mode selection information is the temperature measurement mode.

[0080] The RAM 63 has a display control flag storage area 141 and a light projection control flag storage area 142. The display control flag storage area 141 stores a display control flag 151 that specifies an image to be displayed on the display 76. The light projection control flag storage area 142 stores a light projection control flag 152 that specifies the operation of the light projector 14.

[0081] When the mode determination unit 112 determines that the operation mode is the imaging mode, the flag setting unit 113 sets a captured image display flag 151A as the display control flag 151 in the display control flag storage area 141, and sets a light-projection-on control flag 152A as the light-projection control flag 152 in the light-projection control flag storage area 142. When the mode determination unit 112 determines that the operation mode is the temperature measurement mode, the flag setting unit 113 sets a composite image display flag 151B as the display control flag 151 in the display control flag storage area 141, and sets a light-projection-off control flag 152B as the light-projection control flag 152 in the light-projection control flag storage area 142. Hereinafter, unless there is a need to particularly distinguish between them, the display control flag 151 and the light-projection control flag 152 will be referred to as control flags.

[0082] The light-projection control unit 114 outputs an ON command to the light-projection control circuit 73 when the light-projection ON control flag 152A is set by the flag setting unit 113. The ON command is a command to switch the projector 14 ON. Furthermore, the light-projection control unit 114 outputs an OFF command to the light-projection control circuit 73 when the light-projection OFF control flag 152B is set by the flag setting unit 113. The OFF command is a command to switch the projector 14 OFF. Note that ON refers to a setting in which the projector 14 projects light, and OFF refers to a setting in which the projector 14 does not project light.

[0083] When the captured image display flag 151A is set as the display control flag 151, the mode setting unit 115 sets the capture mode as the operation mode of the CPU 61. When the composite image display flag 151B is set as the display control flag 151, the mode setting unit 115 sets the temperature measurement mode as the operation mode of the CPU 61.

[0084] In the first embodiment, the imaging mode is an example of a "first mode" according to the technology of the present disclosure, and the temperature measurement mode is an example of a "second mode" according to the technology of the present disclosure. Furthermore, the display control flag 151 and the light-projection control flag 152 are examples of a "control factor" according to the technology of the present disclosure. Furthermore, the display 76 and the light-projector 14 are examples of a "controlled object" according to the technology of the present disclosure, and the image displayed on the display 76 and the operation of the light-projector 14 are examples of "control content for a controlled object" according to the technology of the present disclosure. Furthermore, the display control flag 151 is an example of a "display control factor" according to the technology of the present disclosure, the captured image display flag 151A is an example of a "captured image display factor" according to the technology of the present disclosure, and the composite image display flag 151B is an example of a "temperature information display factor" according to the technology of the present disclosure. Furthermore, the light-projection-on control flag 152A and the light-projection-off control flag 152B are examples of a "light-projection control factor" according to the technology of the present disclosure, the light-projection-on control flag 152A is an example of a "light-projection-on control factor" according to the technology of the present disclosure, and the light-projection-off control flag 152B is an example of a "light-projection suppression control factor" according to the technology of the present disclosure.

[0085] As an example, as shown in FIG. 7, the imaging processing unit 120 includes a wavelength selection unit 121, a turret control unit 122, an imaging control unit 123, and a display control unit .

[0086] The wavelength selection unit 121 selects one wavelength band to be used for imaging from a plurality of wavelength bands in accordance with a wavelength selection instruction received by the input device 78. As an example, the wavelength selection unit 121 selects one wavelength band from the wavelength band of visible light, the first wavelength band of near-infrared light from 950 nm to 1100 nm, the second wavelength band of near-infrared light from 1150 nm to 1350 nm, the third wavelength band of near-infrared light from 1500 nm to 1750 nm, and the fourth wavelength band of near-infrared light from 2000 nm to 2400 nm. Note that, although an example in which a wavelength band is selected in accordance with a wavelength selection instruction received by the input device 78 has been described here, a wavelength band may also be selected in accordance with various conditions (e.g., the temperature of the subject and / or the imaging conditions).

[0087] The turret control unit 122 outputs a rotation command to the turret drive circuit 55 to insert into the optical path an optical filter corresponding to the wavelength band selected by the wavelength selection unit 121 from among the plurality of optical filters. Upon receiving the rotation command, the turret drive circuit 55 drives the turret drive mechanism 45 to rotate the turret filter 35 to a position where the optical filter corresponding to the rotation command is inserted into the optical path.

[0088] The imaging control unit 123 outputs an imaging command to the image sensor driver 71. The imaging command is a command to cause the image sensor 15 to capture light. The image sensor 15 captures light emitted from a subject and outputs analog image data obtained by capturing the light. The signal processing circuit 72 performs various signal processes on the analog image data output from the image sensor 15 to generate and output digital image data.

[0089] The display control unit 124 causes the display 76 to display the captured image 161A based on the digital image data generated by the signal processing circuit 72. The captured image 161A is displayed as, for example, a moving image, but may also be displayed as a still image.

[0090] Fig. 8 shows an example of a captured image 161A displayed on the display 76 as a result of the imaging process being executed by the imaging processing unit 120. In the example shown in Fig. 8, the captured image 161A displayed on the display 76 shows a fire 164 on a curtain 163 installed on the indoor side of a window 162 of a building.

[0091] As an example, as shown in FIG. 9, the temperature measurement processing unit 130 has a wavelength selection unit 131, a first turret control unit 132, a first imaging control unit 133, a second turret control unit 134, a second imaging control unit 135, a temperature derivation unit 136, and a display control unit 137.

[0092] 10 , the wavelength selection unit 131 selects two wavelength bands to be used in two-color thermometry, i.e., a first wavelength band and a second wavelength band. For example, the wavelength selection unit 131 selects two wavelength bands from a first near-infrared light wavelength band of 950 nm to 1100 nm, a second near-infrared light wavelength band of 1150 nm to 1350 nm, a third near-infrared light wavelength band of 1500 nm to 1750 nm, and a fourth near-infrared light wavelength band of 2000 nm to 2400 nm, as the first wavelength band and the second wavelength band. For example, the wavelength selection unit 131 selects two adjacent wavelength bands from the first near-infrared light wavelength band, the second near-infrared light wavelength band, the third near-infrared light wavelength band, and the fourth near-infrared light wavelength band, as the first wavelength band and the second wavelength band.

[0093] As another example, the wavelength selection unit 131 selects two wavelength bands as the first and second wavelength bands from the wavelength band of the first near-infrared light, the wavelength band of the second near-infrared light, the wavelength band of the third near-infrared light, and the wavelength band of the fourth near-infrared light based on the temperature of the subject. As another example, the wavelength selection unit 131 selects, as the first and second wavelength bands, shorter wavelength bands from the wavelength band of the first near-infrared light, the wavelength band of the second near-infrared light, the wavelength band of the third near-infrared light, and the wavelength band of the fourth near-infrared light, as the temperature of the subject increases.

[0094] For example, in the case of a fire, the temperature of the subject is predicted based on information about the temperature predicted from the fire situation and / or information input by the user to the input device 78. The information about the temperature predicted from the fire situation is acquired through the external I / F 80 shown in FIG. 9. The information about the temperature predicted from the fire situation may be information about the standard fire temperature with respect to the elapsed time since the fire broke out. The standard fire temperature is defined in ISO 834. Note that the wavelength selection unit 131 may switch the wavelength band according to a wavelength selection instruction received by the input device 78 shown in FIG. 9.

[0095] 9, the first turret control unit 132 outputs a first rotation command to the turret drive circuit 55 to insert into the optical path the BPF 83 corresponding to the first wavelength band selected by the wavelength selection unit 131 from among the multiple BPFs 83 (see FIG. 4). Upon receiving the first rotation command, the turret drive circuit 55 drives the turret drive mechanism 45 to rotate the turret filter 35 to a position where the BPF corresponding to the first rotation command is inserted into the optical path.

[0096] The first imaging control unit 133 outputs a first imaging command to the image sensor driver 71. The first imaging command is a command to cause the image sensor 15 to capture light. The image sensor 15 captures an image of first near-infrared light that has passed through the BPF 83 corresponding to the first wavelength band, and outputs first analog image data obtained by capturing the first near-infrared light. The signal processing circuit 72 performs various signal processes on the first analog image data output from the image sensor 15, thereby generating and outputting first digital image data.

[0097] The second turret control unit 134 outputs a second rotation command to the turret drive circuit 55 to insert into the optical path the BPF 83 corresponding to the second wavelength band selected by the wavelength selection unit 131 from the multiple BPFs 83. Upon receiving the second rotation command, the turret drive circuit 55 drives the turret drive mechanism 45 to rotate the turret filter 35 to a position where the BPF corresponding to the second rotation command is inserted into the optical path.

[0098] The second imaging control unit 135 outputs a second imaging command to the image sensor driver 71. The second imaging command is a command to cause the image sensor 15 to capture an image of the light L. The image sensor 15 captures an image of the second near-infrared light that has passed through the BPF corresponding to the second wavelength band, and outputs second analog image data obtained by capturing the second near-infrared light. The signal processing circuit 72 performs various signal processes on the second analog image data output from the image sensor 15, thereby generating and outputting second digital image data.

[0099] The temperature derivation unit 136 calculates the temperature distribution of the subject using two-color thermometry based on the first digital image data and the second digital image data. Specifically, for each of the physical pixels included in the image sensor 15, the temperature derivation unit 136 extracts the value of a first signal output by the physical pixel from the first digital image data and extracts the value of a second signal output by the physical pixel from the second digital image data. Then, for each of the physical pixels, the temperature derivation unit 136 derives the temperature measured by the physical pixel based on the value of the first signal and the value of the second signal using two-color thermometry. To derive the temperature, a calculation formula based on two-color thermometry or a data matching table may be used. The temperature derivation unit 136 then calculates the temperature distribution of the subject by deriving the temperature measured by each of the physical pixels.

[0100] The display control unit 137 generates temperature information related to temperature based on the temperature distribution of the subject obtained by the temperature derivation unit 136. Then, the display control unit 137 outputs a composite image 161B in which the temperature information is combined with a captured image obtained based on the first digital image data or the second digital image data, and causes the composite image 161B to be displayed on the display 76. Examples of the temperature information include information indicating an area where the temperature is equal to or higher than a predetermined threshold, information indicating specific temperature values, information indicating a plurality of sections divided into predetermined temperature ranges together with specific temperature values, and information indicating the temperature distribution in a color tone according to the temperature.

[0101] FIG. 11 shows a first example of a composite image 161B displayed on the display 76 as a result of the temperature measurement processing performed by the temperature measurement processing unit 130. The composite image 161B according to the first example is an image in which temperature information 166 indicating an area where the temperature is equal to or higher than a predetermined threshold is composited with the captured image 165. In the first example, the temperature information 166 is, for example, information indicating a rectangular frame, but information other than a frame may also be used. The frame may also have a shape other than a rectangular shape. The frame may also be displayed in a color corresponding to the temperature. When the frame is displayed in a color corresponding to the temperature, a scale indicating the temperature corresponding to the color may also be displayed together with the frame. The temperature information 166 may also include a character string indicating a specific temperature value. The specific temperature value may be the maximum and / or minimum temperature value. The temperature information 166 may be displayed statically or flashing.

[0102] 12 shows a second example of a composite image 161B displayed on the display 76 as a result of the temperature measurement processing performed by the temperature measurement processing unit 130. The composite image 161B according to the second example is an image in which a plurality of pieces of temperature information 167A, 167B, and 167C indicating specific temperature values ​​are composited with the captured image 165. The specific temperature values ​​may be maximum and / or minimum temperature values. The plurality of pieces of temperature information 167A, 167B, and 167C may be displayed statically or flashing.

[0103] 13 shows a third example of a composite image 161B displayed on the display 76 as a result of the temperature measurement processing performed by the temperature measurement processing unit 130. The composite image 161B according to the third example is an image in which temperature information 168 indicating a plurality of sections divided into predetermined temperature ranges together with specific numerical values ​​of the temperatures is composited with the captured image 165. The specific numerical values ​​of the temperatures may be maximum and / or minimum values ​​of the temperatures. The temperature information 168 may be displayed statically or flashing.

[0104] FIG. 14 shows a fourth example of a composite image 161B displayed on the display 76 as a result of the temperature measurement processing performed by the temperature measurement processing unit 130. The composite image 161B according to the fourth example is an image in which temperature information 169, which indicates the temperature distribution using a color tone according to the temperature, is composited with the captured image 165. The temperature distribution of the fourth example shown in FIG. 14 is an image in which the temperature of each section of the third example shown in FIG. 13 is displayed using a color tone corresponding to the temperature. The color tone is, for example, defined at a certain hue angle (e.g., 0.01° per 1°C) centered on a reference temperature (e.g., 3000°C). Alternatively, the temperature distribution may be visualized using achromatic shades instead of a color tone. The temperature information 169 may include an indicator indicating the temperature corresponding to the color tone. The temperature information 169 may also include a character string indicating a specific temperature value. The specific temperature value may be the maximum and / or minimum temperature value. The temperature information 169 may be displayed statically or flashing.

[0105] Temperature information 166, 167A, 167B, 167C, 168, and 169 are examples of "temperature information" according to the technology of the present disclosure. Captured image 161A obtained in imaging mode is an example of a "captured image" and a "first captured image" according to the technology of the present disclosure. Composite image 161B obtained in temperature measurement mode is an example of a "composite image" according to the technology of the present disclosure. Note that, hereinafter, unless there is a need to particularly distinguish between them, captured image 161A obtained in imaging mode and composite image 161B obtained in temperature measurement mode will be referred to as images.

[0106] Next, as an operation of the first embodiment, a method for controlling the camera 1 will be described.

[0107] First, with reference to FIG. 15, the mode switching process executed by the mode switching processing unit 110 (see FIG. 6) among the imaging support processes executed by the CPU 61 will be described.

[0108] In step S11, the mode selection information acquisition unit 111 acquires mode selection information.

[0109] In step S12, the mode determination unit 112 determines whether the operation mode selected by the mode selection information is the image capture mode or the temperature measurement mode, based on the mode selection information acquired by the mode selection information acquisition unit 111. If it is determined in step S12 that the operation mode is the image capture mode, the process shown in Fig. 15 proceeds to step S13, and if it is determined that the operation mode is the temperature measurement mode, the process shown in Fig. 15 proceeds to step S16.

[0110] In step S13, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag storage area 141, and sets the light emission ON control flag 152A as the light emission control flag 152 in the light emission control flag storage area 142.

[0111] In step S14, the light-projection control unit 114 turns on the light-projector 14.

[0112] In step S15, the mode setting unit 115 sets the operation mode of the CPU 61 to the imaging mode.

[0113] In step S16, the flag setting unit 113 sets the composite image display flag 151B as the display control flag 151 in the display control flag storage area 141, and sets the light emission off control flag 152B as the light emission control flag 152 in the light emission control flag storage area 142.

[0114] In step S17, the light-projection control unit 114 turns off the light-projector 14.

[0115] In step S18, the mode setting unit 115 sets the operation mode of the CPU 61 to the temperature measurement mode.

[0116] Next, with reference to FIG. 16, the imaging process executed by the imaging processing unit 120 (see FIG. 7) among the imaging support processes executed by the CPU 61 will be described.

[0117] In step S21, the wavelength selector 121 selects one wavelength band to be used for imaging from among a plurality of wavelength bands in accordance with a wavelength selection instruction received by the input device 78.

[0118] In step S22, the turret control unit 122 rotates the turret filter 35 to a position where an optical filter corresponding to the wavelength band selected by the wavelength selection unit 121 from among the plurality of optical filters is inserted into the optical path.

[0119] In step S23, the imaging control unit 123 causes the image sensor 15 to capture an image of the light. The image sensor 15 outputs analog image data obtained by capturing the image of the light, and the signal processing circuit 72 performs various signal processes on the analog image data to generate and output digital image data.

[0120] In step S24, the display control unit 124 causes the display 76 to display the captured image 161A based on the digital image data generated by the signal processing circuit 72.

[0121] Next, with reference to FIG. 17, the temperature measurement process executed by the temperature measurement processing unit 130 (see FIG. 9) among the imaging support processes executed by the CPU 61 will be described.

[0122] In step S31, the wavelength selector 131 selects two wavelength bands to be used in the two-color thermometry, that is, a first wavelength band and a second wavelength band.

[0123] In step S32, the first turret control unit 132 rotates the turret filter 35 to a position where the BPF 83 corresponding to the first wavelength band selected by the wavelength selection unit 131 from among the multiple BPFs 83 (see FIG. 4) is inserted into the optical path.

[0124] In step S33, the first imaging control unit 133 causes the image sensor 15 to capture an image of the first near-infrared light that has passed through the BPF 83 corresponding to the first wavelength band. The image sensor 15 outputs first analog image data obtained by capturing the image of the first near-infrared light, and the signal processing circuit 72 performs various types of signal processing on the first analog image data to generate and output first digital image data.

[0125] In step S34, the second turret control unit 134 rotates the turret filter 35 to a position where the BPF 83 corresponding to the second wavelength band selected by the wavelength selection unit 131 from the plurality of BPFs 83 is inserted into the optical path.

[0126] In step S35, the second imaging control unit 135 causes the image sensor 15 to capture an image of the second near-infrared light that has passed through the BPF 83 corresponding to the second wavelength band. The image sensor 15 outputs second analog image data obtained by capturing the image of the second near-infrared light, and the signal processing circuit 72 performs various signal processes on the second analog image data to generate and output second digital image data.

[0127] In step S36, the temperature derivation unit 136 calculates the temperature distribution of the subject by two-color thermometry based on the first digital image data and the second digital image data.

[0128] In step S37, the display control unit 137 generates temperature information related to temperature based on the temperature distribution of the subject obtained by the temperature derivation unit 136. Then, the display control unit 137 outputs a composite image 161B obtained by combining the temperature information with a captured image obtained based on the first digital image data or the second digital image data, and causes the display 76 to display the composite image 161B.

[0129] In each of the imaging mode and the temperature measurement mode, the CPU 61 controls the zoom drive mechanism 42 to adjust the focus position by moving the focus lens 31 along the optical axis OA, and controls the zoom lens 32 to adjust the zoom magnification. In each of the imaging mode and the temperature measurement mode, the CPU 61 also controls the blur correction drive mechanism 44 to correct image blur by moving the blur correction lens 34. In each of the imaging mode and the temperature measurement mode, the CPU 61 also controls the diaphragm drive mechanism 43 to adjust the amount of light passing through the diaphragm 33 by changing the diameter of the opening 33A provided in the diaphragm 33. In each of the imaging mode and the temperature measurement mode, the CPU 61 also controls the adjustment drive mechanism 47 to adjust the focus position by moving the adjustment lens 37.

[0130] The control method for camera 1 according to the first embodiment is an example of the "control method" according to the technique of the present disclosure.

[0131] Next, the effects of the first embodiment will be described.

[0132] In the first embodiment, the CPU 61 has an imaging mode in which the image sensor 15 captures an image of light, and a temperature measurement mode in which the temperature is derived based on the near-infrared light received by the image sensor 15. The imaging mode and the temperature measurement mode have different control flags. Therefore, the control content of the control target can be made different between the imaging mode and the temperature measurement mode.

[0133] For example, in the first embodiment, the control flag includes a display control flag 151 to be displayed on the display 76. Therefore, as an example of making the control content of the control target different between the imaging mode and the temperature measurement mode, the image displayed on the display 76 can be made different.

[0134] In the first embodiment, the control flag includes a light-projection control flag 152 that operates the light projector 14. Therefore, as an example of making the control content of the control target different between the image capture mode and the temperature measurement mode, the operation of the light projector 14 can be made different.

[0135] In this way, in the first embodiment, the control content of the controlled object can be made different between the imaging mode and the temperature measurement mode, so that the operation of the imaging device can be controlled to be appropriate for each mode, compared to, for example, when the control flag is the same for the imaging mode and the temperature measurement mode.

[0136] Furthermore, in the imaging mode, the CPU 61 sets, as the display control flag 151, a captured image display flag 151A that causes the display 76 to display a captured image 161A obtained by receiving light by the image sensor 15. As a result, the captured image 161A that does not include temperature information is displayed on the display 76. Therefore, in the imaging mode, the visibility of the captured image 161A can be improved compared to when the captured image 161A includes temperature information, for example.

[0137] Furthermore, in the temperature measurement mode, the CPU 61 sets, as the display control flag 151, a composite image display flag 151B that causes a composite image 161B including temperature information indicating the temperature to be displayed on the display 76. As a result, the composite image 161B including the temperature information is displayed on the display 76. Therefore, in the temperature measurement mode, the user can accurately grasp the temperature of the subject, compared to, for example, a case where temperature information is not displayed on the display 76.

[0138] Furthermore, in the imaging mode, the CPU 61 sets the light projection control flag 152 to a light projection ON control flag 152A that switches the projector 14 ON. This switches the projector 14 ON in the imaging mode. Therefore, in the imaging mode, the amount of light emitted from the subject can be secured. This allows the user to check the indoor environment through the captured image 161A, for example, even in a situation where the room is filled with smoke due to a fire.

[0139] Furthermore, in the temperature measurement mode, the CPU 61 sets the light-projection control flag 152 to a light-projection-off control flag 152B that switches off the projector 14. This switches the projector 14 off in the temperature measurement mode. This makes it possible to prevent the illumination light from the projector 14 from being mixed with the near-infrared light emitted from the subject. Furthermore, the measurement accuracy of the temperature can be improved compared to, for example, a case in which the illumination light from the projector 14 is mixed with the near-infrared light emitted from the subject.

[0140] Furthermore, the CPU 61 switches the projector 14 on and off in response to switching between the image capture mode and the temperature measurement mode, which improves convenience compared to a case where the user needs to switch the projector 14 on and off, for example.

[0141] In the temperature measurement mode, the CPU 61 outputs a composite image 161B obtained by combining a captured image obtained by receiving light by the image sensor 15 with temperature information indicating the temperature. Therefore, by displaying the composite image 161B on the display 76, the user can easily grasp the condition and temperature of the subject.

[0142] Next, a modification of the first embodiment will be described.

[0143] In the first embodiment, as shown in Fig. 8, an example is shown in which a captured image 161A of a fire 164 on a curtain 163 provided on the indoor side of a window 162 of a building is displayed on the display 76, but the captured image 161A may be any image. For example, as shown in Fig. 18, the captured image 161A may be an image obtained by capturing an image of a person's arm 170.

[0144] 11 to 14, the first embodiment shows an example in which a composite image 161B is displayed on the display 76, which is a composite image of a captured image of a curtain on the indoor side of a window of a building that is on fire and temperature information. However, the composite image 161B may be any image in which a captured image and temperature information are combined. For example, as shown in FIG. 19, the composite image 161B may be an image in which temperature information 172 indicating a temperature distribution is combined with a captured image 171 obtained by capturing an image of a person's arm 170. The combination may be, for example, superimposing a plurality of images using alpha blending, or embedding temperature information in the captured image.

[0145] 6 , a light-projection suppression control flag may be set by the flag setting unit 113. When the light-projection suppression control flag is set by the flag setting unit 113, the light-projection control unit 114 outputs a light-projection suppression command to the light-projection control circuit 73, and the light-projection control circuit 73 may suppress light projection by the projector 14 (i.e., suppress the amount of light projected from the projector 14) in accordance with the light-projection suppression command. The suppression refers to, for example, an operation of reducing the amount of light below a reference amount. The reference amount may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions).

[0146] [Second embodiment] Next, a second embodiment will be described.

[0147] In the second embodiment, the configuration of the camera 1 is changed as follows compared to the first embodiment: The following describes the differences between the second embodiment and the first embodiment.

[0148] As an example, as shown in FIG. 20, the mode switching processing unit 110 includes a status signal acquisition unit 181, a status signal determination unit 182, a flag setting unit 113, a light projection control unit 114, and a mode setting unit 115.

[0149] The status signal acquisition unit 181 acquires a status signal output from the light-projection control circuit 73 in accordance with the operating status of the projector 14. When the projector 14 is in an on state, the light-projection control circuit 73 outputs an on-state signal representing the on state of the projector 14 as a status signal, and when the projector 14 is in an off state, the light-projection control circuit 73 outputs an on-state signal representing the off state of the projector 14 as a status signal.

[0150] The status signal determination unit 182 determines whether or not the status signal acquired by the status signal acquisition unit 181 is an ON status signal indicating that the projector 14 is in an ON state.

[0151] When the status signal determination unit 182 determines that the status signal is an ON status signal, the flag setting unit 113 sets a captured image display flag 151A as the display control flag 151 in the display control flag storage area 141. When the status signal determination unit 182 determines that the status signal is not an ON status signal, the flag setting unit 113 sets a composite image display flag 151B as the display control flag 151 in the display control flag storage area 141.

[0152] When the captured image display flag 151A is set as the display control flag 151, the mode setting unit 115 sets the capture mode as the operation mode of the CPU 61. When the composite image display flag 151B is set as the display control flag 151, the mode setting unit 115 sets the temperature measurement mode as the mode of the CPU 61.

[0153] In the second embodiment, the imaging mode is an example of a "first mode" according to the technology of the present disclosure, and the temperature measurement mode is an example of a "second mode" according to the technology of the present disclosure. The display control flag 151 is an example of a "control factor" according to the technology of the present disclosure. The display 76 is an example of a "control object" according to the technology of the present disclosure, and the image displayed on the display 76 is an example of a "control content for the control object" according to the technology of the present disclosure. The display control flag 151 is an example of a "display control factor" according to the technology of the present disclosure, the captured image display flag 151A is an example of a "captured image display factor" according to the technology of the present disclosure, and the composite image display flag 151B is an example of a "temperature information display factor" according to the technology of the present disclosure.

[0154] Next, as an operation of the second embodiment, a method for controlling the camera 1 will be described.

[0155] In the second embodiment, the imaging process performed by the imaging processing unit 120 and the temperature measurement process performed by the temperature measurement processing unit 130 are the same as those in the first embodiment. In the second embodiment, the mode switching process performed by the mode switching processing unit 110 is different from that in the first embodiment. Hereinafter, the mode switching process performed by the mode switching processing unit 110 according to the second embodiment will be described with reference to FIG. 21 .

[0156] In step S41, the status signal acquisition unit 181 acquires the status signal output from the light-projection control circuit 73 in accordance with the operating status of the projector 14.

[0157] In step S42, the status signal determination unit 182 determines whether the status signal is an ON status signal. If it is determined in step S42 that the status signal is an ON status signal, the process shown in Fig. 21 proceeds to step S43, and if it is determined that the status signal is not an ON status signal, the process shown in Fig. 21 proceeds to step S45.

[0158] In step S43, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag storage area 141.

[0159] In step S44, the mode setting unit 115 sets the operation mode of the CPU 61 to the imaging mode.

[0160] In step S45, the flag setting unit 113 sets the composite image display flag 151B as the display control flag 151 in the display control flag storage area 141.

[0161] In step S46, the mode setting unit 115 sets the operation mode of the CPU 61 to the temperature measurement mode.

[0162] The control method for camera 1 according to the second embodiment is an example of the "control method" according to the technique of the present disclosure.

[0163] Next, the effects of the second embodiment that differ from the first embodiment will be described.

[0164] In the second embodiment, the CPU 61 sets the imaging mode when the projector 14 is on, and sets the temperature measurement mode when the projector 14 is off. Therefore, it is possible to improve convenience compared to a case where the imaging mode and the temperature measurement mode are not switched in response to the on / off operation of the projector 14, for example.

[0165] [Third embodiment] Next, a third embodiment will be described.

[0166] In the third embodiment, the configuration of the camera 1 is changed as follows compared to the first embodiment: The following describes the differences between the third embodiment and the first embodiment.

[0167] 22, the CPU 61 functions as a parameter change processing unit 190 in addition to the above-mentioned mode switching processing unit 110, image capture processing unit 120, and temperature measurement processing unit 130. The parameter change processing unit 190 is a processing unit that operates when the CPU 61 is in the image capture mode and when the CPU 61 is in the temperature measurement mode. The parameter change processing unit 190 is a processing unit that sets different mode-specific parameters 211 for the image capture mode and the temperature measurement mode. The parameter change processing unit 190 has a mode determination unit 191 and a mode-specific parameter setting unit 192.

[0168] The mode determination unit 191 determines whether the operation mode of the CPU 61 is the imaging mode or the temperature measurement mode.

[0169] The RAM 63 is provided with a parameter storage area 201 for storing mode-specific parameters 211 .

[0170] When the mode determination unit 191 determines that the operation mode of the CPU 61 is the imaging mode, the mode-specific parameter setting unit 192 derives imaging mode parameters 211A corresponding to the imaging mode by performing various parameter setting processes based on the imaging conditions, etc. Then, the mode-specific parameter setting unit 192 sets the imaging mode parameters 211A as the mode-specific parameters 211 in the parameter storage area 201.

[0171] Furthermore, when the mode determination unit 191 determines that the operation mode of the CPU 61 is the temperature measurement mode, the mode-specific parameter setting unit 192 derives temperature measurement mode parameters 211B corresponding to the temperature measurement mode by performing various parameter setting processes based on the temperature measurement conditions, etc. Then, the mode-specific parameter setting unit 192 sets the temperature measurement mode parameters 211B in the parameter storage area 201 as the mode-specific parameters 211.

[0172] The imaging mode parameters 211A include a first imaging setting parameter 212A set for imaging and a first image processing setting parameter 213A set for image processing of the captured image. Similarly, the temperature measurement mode parameters 211B include a second imaging setting parameter 212B set for imaging and a second image processing setting parameter 213B set for image processing of the captured image.

[0173] The first imaging setting parameters 212A and the second imaging setting parameters 212B include parameters related to the projector 14, parameters related to the shutter speed, parameters related to the aperture 33, parameters related to photometry, parameters related to the sensitivity of the image sensor 15, parameters related to a high dynamic range, and parameters related to vibration isolation control. The parameters related to the sensitivity of the image sensor 15 include parameters related to the gain of the image sensor 15 and / or parameters related to the conversion efficiency of the image sensor 15.

[0174] The first image processing setting parameters 213A and the second image processing setting parameters 213B include parameters relating to noise reduction, parameters relating to sharpness, parameters relating to contrast, and parameters relating to tone.

[0175] The first imaging setting parameters 212A included in the imaging mode parameters 211A are set as follows, for example. The parameters relating to the projector 14 are set to parameters that allow the projector 14 to project light. The shutter speed parameters are set to parameters that set the shutter speed to a reference speed or higher. The shutter speed is defined by the time from when the front curtain of a mechanical shutter begins to open until the rear curtain finishes closing, the time from when the electronic front curtain shutter operates until the rear curtain of a mechanical shutter finishes closing, or the time from when the electronic shutter starts to operate until it finishes operating. The reference speed may be a fixed value or a variable value that is changed according to instructions input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions, etc.). The parameters related to the aperture 33 are set to parameters that make the aperture amount equal to or greater than the reference aperture amount. The aperture amount is proportional to the diameter of the opening 33A provided in the aperture 33. The reference aperture amount may be a fixed value, or may be a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (for example, the temperature of the subject and / or the imaging conditions). The photometry parameters are set to parameters that perform photometry using the average photometry method or the multi-pattern photometry method. Photometry is the measurement of the brightness of a subject. The parameter related to the gain of the image sensor 15 is set to a parameter that makes the gain of the image sensor 15 equal to or greater than a reference gain. The gain of the image sensor 15 refers to, for example, the analog gain of an A / D converter (not shown) connected to the photodiode of the image sensor 15. The reference gain may be a fixed value, or may be a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (for example, the temperature of the subject and / or the imaging conditions). The parameters related to the conversion efficiency of the image sensor 15 are set to parameters that make the conversion efficiency of the image sensor 15 equal to or greater than a reference conversion efficiency. The conversion efficiency of the image sensor 15 refers to the efficiency of converting the charge accumulated in a variable capacitor (not shown) connected to a photodiode included in the image sensor 15 into a voltage. The reference conversion efficiency may be a fixed value, or may be a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameters related to the high dynamic range are set to parameters that turn on the high dynamic range. The high dynamic range is a display technology that improves the contrast between light and dark areas (i.e., the light-to-dark ratio) of the captured image 161A. Turning on the high dynamic range means widening the dynamic range beyond the reference range. The reference range may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the capture conditions). The parameters related to vibration reduction control are set to parameters that turn on vibration reduction control. Vibration reduction control is a control that moves the vibration reduction lens 34 in a direction that corrects image blur. Turning vibration reduction control on means performing control that moves the vibration reduction lens 34.

[0176] The noise reduction parameters are set to parameters that increase the degree of noise reduction beyond a first reference degree. Noise reduction is image processing that reduces noise appearing in a captured image, and the level of noise reduction refers to increasing or decreasing the rate at which noise appearing in a captured image is reduced. The first reference degree may be a fixed value or a variable value that is changed in accordance with an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the image capturing conditions). The parameter related to sharpness is set to a parameter that increases the degree of sharpness greater than the second reference degree. Sharpness refers to the enhancement of the contours of a captured image, and the enhancement of sharpness refers to increasing or decreasing the degree to which the contours of a captured image are enhanced. The second reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameter related to contrast is set to a parameter that makes the degree of contrast greater than a third reference degree. Contrast refers to the difference in brightness and / or color of a captured image, and the strength of contrast refers to increasing or decreasing the difference in brightness and / or color of a captured image. The third reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameter related to tone is set to a parameter that makes the degree of tone intensity greater than the fourth reference degree. Tone refers to the color tone of the captured image, and tone intensity refers to increasing or decreasing the degree of color tone of the captured image. The fourth reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the image capturing conditions).

[0177] Further, the second imaging setting parameters 212B included in the temperature measurement mode parameters 211B are set as follows, for example. The parameters relating to the projector 14 are set to parameters that prevent the projector 14 from projecting light. The shutter speed parameter is set to a parameter that sets the shutter speed below a reference speed. The reference speed may be a fixed value or may be a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameters related to the aperture 33 are set to parameters that make the aperture amount less than a reference amount. The reference aperture amount may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The photometry parameters are set to parameters for performing photometry in highlight-weighted, center-weighted, or spot metering. The parameter related to the gain of the image sensor 15 is set to a parameter that makes the gain of the image sensor 15 less than a reference gain. The reference gain may be a fixed value, or may be a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (for example, the temperature of the subject and / or the imaging conditions). The parameters related to the conversion efficiency of the image sensor 15 are set to parameters that make the photoelectric conversion efficiency of the image sensor 15 less than the reference conversion efficiency. The reference conversion efficiency may be a fixed value, or may be a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameters related to the high dynamic range are set to parameters that turn off the high dynamic range. Turning off the high dynamic range means setting the dynamic range to a reference range. The reference range may be a fixed value or may be a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameters relating to the vibration reduction control are set to parameters that turn off the vibration reduction control.

[0178] Further, the second image processing setting parameters 213B included in the temperature measurement mode parameters 211B are set as follows, for example. The noise reduction parameters are set to parameters that set the degree of noise reduction to a first reference degree or less. The first reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameter related to sharpness is set to a parameter that sets the degree of sharpness to a second reference degree or less. The second reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameter relating to contrast is set to a parameter that sets the degree of contrast strength to a third reference degree or less. The third reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions). The parameter related to the tone is set to a parameter that sets the degree of tone intensity to a fourth reference degree or less. The fourth reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and / or various conditions (e.g., the temperature of the subject and / or the imaging conditions).

[0179] As an example, as shown in FIG. 23, when the CPU 61 is in the imaging mode, the imaging control unit 123 performs imaging settings related to imaging in accordance with the first imaging setting parameters 212A included in the imaging mode parameters 211A stored in the parameter storage area 201. (1) The imaging control unit 123 sets the light projector 14 to project light, and outputs an ON command to the light projection control circuit 73. (2) The imaging control unit 123 adjusts the shutter speed by setting the shutter speed to a value equal to or higher than the reference speed as a setting related to the shutter speed. (3) The imaging control unit 123 sets the aperture amount to a reference amount or more as a setting related to the aperture 33, and outputs an aperture command corresponding to the set aperture amount to the aperture drive circuit 53. (4) The imaging control unit 123 sets the photometry method to the average photometry method or the multi-pattern photometry method as a setting related to photometry. (5) The imaging control unit 123 sets the gain of the image sensor 15 to a value equal to or greater than the reference gain. (6) The imaging control unit 123 sets the photoelectric conversion efficiency of the image sensor 15 to a reference photoelectric conversion efficiency or higher as a setting related to the photoelectric conversion efficiency of the image sensor 15. The imaging control unit 123 outputs a sensitivity command corresponding to the set gain and photoelectric conversion efficiency to the image sensor driver 71. (7) The imaging control unit 123 sets the high dynamic range to ON as a setting related to the high dynamic range. (8) The imaging control unit 123 sets the anti-shake control to ON as a setting related to the anti-shake control, and outputs a shake correction command to the shake correction drive circuit 54.

[0180] Also, as an example, as shown in FIG. 23, when the CPU 61 is in the imaging mode, the display control unit 124 performs image processing settings related to image processing in accordance with the first image processing setting parameters 213A included in the imaging mode parameters 211A stored in the parameter storage area 201. (9) As a setting related to noise reduction, the display control unit 124 sets the degree of noise reduction to be greater than the first reference degree. (10) The display control unit 124 sets the degree of sharpness greater than the second reference degree as a setting related to sharpness. (11) The display control unit 124 sets the contrast-related setting such that the degree of contrast is greater than the third reference degree. (12) As a setting related to tone, the display control unit 124 sets the degree of tone intensity to be greater than the fourth reference degree.

[0181] As an example, as shown in FIG. 24, when the CPU 61 is in the temperature measurement mode, the first imaging control unit 133 and the second imaging control unit 135 perform imaging settings related to imaging in accordance with the second imaging setting parameters 212B included in the temperature measurement mode parameters 211B stored in the parameter memory area 201. (1) The first imaging control unit 133 and the second imaging control unit 135 set the light projector 14 so that the light projector 14 does not project light, and output an OFF command to the light projection control circuit 73. (2) The first imaging control unit 133 and the second imaging control unit 135 adjust the shutter speed by setting the shutter speed to a value less than the reference speed as the setting related to the shutter speed. (3) The first imaging control unit 133 and the second imaging control unit 135 set the aperture amount to less than the reference amount as the setting related to the aperture 33, and output to the aperture drive circuit 53 an aperture command corresponding to the set aperture amount. (4) The first imaging control unit 133 and the second imaging control unit 135 set the metering method to highlight-weighted metering, center-weighted metering, or spot metering as a setting related to metering. (5) The first imaging control unit 133 and the second imaging control unit 135 set the gain of the image sensor 15 to a value less than the reference gain. (6) The first imaging control unit 133 and the second imaging control unit 135 set the photoelectric conversion efficiency of the image sensor 15 to less than the reference photoelectric conversion efficiency as a setting related to the photoelectric conversion efficiency of the image sensor 15. The first imaging control unit 133 and the second imaging control unit 135 output, to the image sensor driver 71, a sensitivity command corresponding to the set gain and photoelectric conversion efficiency. (7) The first imaging control unit 133 and the second imaging control unit 135 set the high dynamic range to off as a setting related to the high dynamic range. (8) The first imaging control unit 133 and the second imaging control unit 135 set the anti-shake control to OFF as the setting related to the anti-shake control, and output a command to stop the anti-shake operation to the anti-shake drive circuit .

[0182] Also, as an example, as shown in FIG. 24, when the CPU 61 is in the temperature measurement mode, the display control unit 137 performs image processing settings related to image processing in accordance with the second image processing setting parameters 213B included in the temperature measurement mode parameters 211B stored in the parameter storage area 201. (9) The display control unit 137 sets the degree of noise reduction strength to a first reference degree or less as a setting related to noise reduction. (10) The display control unit 137 sets the degree of sharpness to a second reference degree or less as a setting related to sharpness. (11) The display control unit 137 sets the contrast level to a third reference level or less as a setting related to contrast. (12) As a setting related to tone, the display control unit 137 sets the degree of tone intensity to a fourth reference degree or less.

[0183] In the third embodiment, the settings related to the projector 14, the settings related to the shutter speed, the settings related to the aperture 33, the settings related to the photometry, the settings related to the sensitivity of the image sensor 15, the settings related to the high dynamic range, and the settings related to image stabilization control are examples of "imaging settings" according to the technology of the present disclosure. The first imaging setting parameter 212A and the second imaging setting parameter 212B are examples of "imaging setting factors related to imaging settings" and "control factors" according to the technology of the present disclosure. The settings related to noise reduction, the settings related to sharpness, the settings related to contrast, and the settings related to tone are examples of "image processing settings" according to the technology of the present disclosure. The first image processing setting parameter 213A and the second image processing setting parameter 213B are examples of "image processing setting factors related to image processing settings" and "control factors" according to the technology of the present disclosure.

[0184] Next, as an operation of the third embodiment, a method for controlling the camera 1 will be described.

[0185] In the third embodiment, the mode switching process performed by the mode switching processing unit 110, the imaging process performed by the imaging processing unit 120, and the temperature measurement process performed by the temperature measurement processing unit 130 are the same as those in the first embodiment. The third embodiment differs from the first embodiment in that the parameter change processing is performed by the parameter change processing unit 190. Hereinafter, the parameter change processing performed by the parameter change processing unit 190 according to the third embodiment will be described with reference to FIG. 25 .

[0186] In step S51, the mode determination unit 112 determines whether the operation mode of the CPU 61 is the image capture mode or the temperature measurement mode. If it is determined in step S51 that the operation mode is the image capture mode, the process shown in Fig. 25 proceeds to step S52, and if it is determined that the operation mode is the temperature measurement mode, the process shown in Fig. 25 proceeds to step S53.

[0187] In step S52, the mode-specific parameter setting unit 192 derives the imaging mode parameters 211A corresponding to the imaging mode, and sets the imaging mode parameters 211A in the parameter storage area 201 as the mode-specific parameters 211.

[0188] In step S53, the mode-specific parameter setting unit 192 derives the temperature measurement mode parameters 211B corresponding to the temperature measurement mode, and sets the temperature measurement mode parameters 211B in the parameter storage area 201 as the mode-specific parameters 211.

[0189] The control method for camera 1 according to the third embodiment is an example of the "control method" according to the technique of the present disclosure.

[0190] Next, the effects of the third embodiment that differ from the first embodiment will be described.

[0191] In the third embodiment, imaging setting parameters related to imaging settings are different between the imaging mode and the temperature measurement mode. That is, as an example, a first imaging setting parameter 212A is set in the imaging mode, and a second imaging setting parameter 212B is set in the temperature measurement mode. Therefore, compared to a case where the imaging setting parameters are the same in the imaging mode and the temperature measurement mode, for example, it is possible to obtain good image quality for the captured image in the imaging mode, and it is possible to ensure measurement accuracy while reducing the load on the CPU 61 in the temperature measurement mode.

[0192] The imaging settings also include settings related to the projector 14. In the imaging mode, the CPU 61 sets the projector 14 to project light, and in the temperature measurement mode, the CPU 61 sets the projector 14 not to project light. Therefore, in the imaging mode, a higher amount of light is emitted from the subject than when the projector 14 projects light, thereby enabling a captured image of better quality. On the other hand, in the temperature measurement mode, a higher measurement accuracy is achieved by suppressing the mixing of the illumination light from the projector 14 with the near-infrared light emitted from the subject than when the projector 14 projects light.

[0193] The imaging settings also include a setting related to the shutter speed. In the imaging mode, the CPU 61 sets the shutter speed to a reference speed or higher, and in the temperature measurement mode, sets the shutter speed to a speed lower than the reference speed. That is, the CPU 61 sets the shutter speed in the imaging mode to be longer than the shutter speed in the temperature measurement mode. This ensures a sufficient amount of light incident on the image sensor 15 in the imaging mode, thereby obtaining good image quality for the captured image. Meanwhile, in the temperature measurement mode, measurement accuracy can be ensured by suppressing noise in the first analog image data and second analog image data output from the image sensor 15.

[0194] The imaging settings also include settings related to the aperture 33. In imaging mode, the CPU 61 sets the aperture amount to a reference amount or more, and in temperature measurement mode, sets the aperture amount to less than the reference amount. That is, the CPU 61 sets the aperture amount in imaging mode to be greater than the aperture amount in temperature measurement mode. This ensures a sufficient amount of light incident on the image sensor 15 in imaging mode, thereby obtaining good image quality for the captured image. Meanwhile, in temperature measurement mode, measurement accuracy can be ensured by suppressing noise in the first analog image data and second analog image data output from the image sensor 15.

[0195] The imaging settings also include settings related to photometry. In imaging mode, the CPU 61 sets the photometry method to average photometry or multi-pattern photometry, and in temperature measurement mode, it sets the photometry method to highlight-weighted photometry, center-weighted photometry, or spot photometry. This ensures that the amount of light radiated from the entire subject and incident on the image sensor 15 is sufficient in imaging mode, thereby obtaining a good quality image for the captured image. On the other hand, in temperature measurement mode, measurement accuracy is ensured by preventing the amount of light radiated from the hottest area of ​​the subject and incident on the image sensor 15 from becoming saturated.

[0196] The imaging settings also include settings related to the sensitivity of the image sensor 15. Parameters related to the sensitivity of the image sensor 15 include parameters related to the gain of the image sensor 15 and parameters related to the conversion efficiency of the image sensor 15. In the imaging mode, the CPU 61 sets the gain of the image sensor 15 to a reference gain or higher, and in the temperature measurement mode, sets the gain of the image sensor 15 to a value less than the reference gain. That is, the CPU 61 sets the gain in the imaging mode higher than the gain in the temperature measurement mode. This allows analog image data corresponding to the exposure to be obtained in the imaging mode, thereby achieving good image quality for the captured image. Meanwhile, in the temperature measurement mode, measurement accuracy can be ensured by suppressing noise in the first analog image data and second analog image data output from the image sensor 15 and suppressing saturation of the peak values ​​of the first analog image data and second analog image data with respect to light emitted from the hottest area of ​​the subject.

[0197] Furthermore, in the imaging mode, the CPU 61 sets the conversion efficiency of the image sensor 15 to a reference conversion efficiency or higher, and in the temperature measurement mode, the CPU 61 sets the conversion efficiency of the image sensor 15 to a value lower than the reference conversion efficiency. That is, the CPU 61 sets the conversion efficiency in the imaging mode higher than the conversion efficiency in the temperature measurement mode. As a result, in the imaging mode, analog image data according to the exposure can be obtained, thereby obtaining good image quality for the captured image. Meanwhile, in the temperature measurement mode, measurement accuracy can be ensured by suppressing the inclusion of noise in the first analog image data and second analog image data output from the image sensor 15 and suppressing saturation of the peak values ​​of the first analog image data and second analog image data with respect to light emitted from the hottest area of ​​the subject.

[0198] The imaging settings also include settings related to the high dynamic range. The CPU 61 sets the high dynamic range to ON in the imaging mode and to OFF in the temperature measurement mode. This allows the dynamic range to be wider than the standard range in the imaging mode, thereby obtaining good image quality for the captured image. On the other hand, in the temperature measurement mode, the dynamic range is set to the standard range, thereby ensuring measurement accuracy.

[0199] The imaging settings also include settings related to vibration isolation control. The CPU 61 turns vibration isolation control on in imaging mode and turns vibration isolation control off in temperature measurement mode. This suppresses image blurring in imaging mode, thereby enabling good image quality to be obtained for captured images. Meanwhile, in temperature measurement mode, the amount of calculation processing by the CPU 61 required to suppress image blurring can be reduced, thereby reducing the burden on the CPU 61.

[0200] Furthermore, in the third embodiment, the image processing setting parameters related to image processing settings are different between the image capture mode and the temperature measurement mode. That is, as an example, a first image processing setting parameter 213A is set in the image capture mode, and a second image processing setting parameter 213B is set in the temperature measurement mode. Therefore, compared to a case where the image processing setting parameters are the same in the image capture mode and the temperature measurement mode, for example, it is possible to obtain a better image quality for the captured image in the image capture mode, and to reduce the load on the CPU 61 in the temperature measurement mode, for example.

[0201] The image processing settings also include settings related to noise reduction. In the image capture mode, the CPU 61 sets the noise reduction level to be greater than a first reference level, and in the temperature measurement mode, the noise reduction level is set to be equal to or less than the first reference level. That is, the CPU 61 sets the noise reduction level in the image capture mode to be stronger than the noise reduction level in the temperature measurement mode. This reduces the noise contained in the captured image in the image capture mode, thereby achieving good image quality for the captured image. Meanwhile, in the temperature measurement mode, the load on the CPU 61 can be reduced by reducing the amount of calculation processing required by the CPU 61 to reduce noise.

[0202] The image processing settings also include settings related to sharpness. In the image capture mode, the CPU 61 sets the degree of sharpness to a level greater than the second reference level, and in the temperature measurement mode, the CPU 61 sets the degree of sharpness to a level equal to or less than the second reference level. That is, the CPU 61 sets the sharpness in the image capture mode to be stronger than the sharpness in the temperature measurement mode. This increases the sharpness of the captured image in the image capture mode, thereby enabling the captured image to have good image quality. Meanwhile, in the temperature measurement mode, the amount of calculation processing by the CPU 61 required to adjust the sharpness is reduced, thereby reducing the burden on the CPU 61.

[0203] The image processing settings also include settings related to contrast. In the image capture mode, the CPU 61 sets the contrast level to be greater than the third reference level, and in the temperature measurement mode, the CPU 61 sets the contrast level to be equal to or less than the third reference level. That is, the CPU 61 sets the contrast in the image capture mode to be stronger than the contrast in the temperature measurement mode. This increases the contrast of the captured image in the image capture mode, thereby enabling the captured image to have good image quality. Meanwhile, in the temperature measurement mode, the amount of calculation processing by the CPU 61 required to adjust the contrast is reduced, thereby reducing the burden on the CPU 61.

[0204] The image processing settings also include settings related to tone. In the image capture mode, the CPU 61 sets the tone intensity to a level greater than the fourth reference level, and in the temperature measurement mode, the CPU 61 sets the tone intensity to a level equal to or less than the fourth reference level. That is, the CPU 61 sets the tone in the image capture mode to be stronger than the tone in the temperature measurement mode. This increases the contrast of the captured image in the image capture mode, thereby achieving good image quality for the captured image. Meanwhile, in the temperature measurement mode, the amount of calculation processing by the CPU 61 required to adjust the contrast is reduced, thereby reducing the burden on the CPU 61.

[0205] Next, a modification of the third embodiment will be described.

[0206] In the third embodiment, the settings related to the projector 14, the shutter speed, the aperture 33, the photometry, the sensitivity of the image sensor 15, the high dynamic range, and the vibration isolation control are different between the imaging mode and the temperature measurement mode, but the combination of imaging settings that are made different between the imaging mode and the temperature measurement mode may be other than those described above. For example, the high dynamic range setting may be set to on in both the imaging mode and the temperature measurement mode. Furthermore, the vibration isolation control setting may be set to on in both the imaging mode and the temperature measurement mode.

[0207] Furthermore, the imaging settings that are made different between the imaging mode and the temperature measurement mode may be other than those described above as long as they include at least one of the settings related to the projector 14, the shutter speed, the aperture 33, the photometry, the sensitivity of the image sensor 15, the high dynamic range, and the vibration isolation control. Furthermore, the imaging settings that are made different between the imaging mode and the temperature measurement mode may include various imaging settings related to the camera 1, in addition to the settings related to the projector 14, the shutter speed, the aperture 33, the photometry, the sensitivity of the image sensor 15, the high dynamic range, and the vibration isolation control.

[0208] In addition, in the third embodiment, the settings related to noise reduction, sharpness, contrast, and tone are different between the imaging mode and the temperature measurement mode, but the combination of image processing settings that are made different between the imaging mode and the temperature measurement mode may be other than those described above.

[0209] The image processing settings that are made different between the image capture mode and the temperature measurement mode may be other than those described above as long as they include at least one of a noise reduction setting, a sharpness setting, a contrast setting, and a tone setting. The image processing settings that are made different between the image capture mode and the temperature measurement mode may include various image processing settings related to the camera 1 in addition to a noise reduction setting, a sharpness setting, a contrast setting, and a tone setting.

[0210] In addition, in the third embodiment, the CPU 61 sets the projector 14 not to emit light in the temperature measurement mode, but may also set the projector 14 to suppress light emission (i.e., to suppress the amount of light emitted from the projector 14).

[0211] [Fourth embodiment] Next, a fourth embodiment will be described.

[0212] In the fourth embodiment, the configuration of the camera 1 is changed as follows compared to the first embodiment: The following describes the differences between the fourth embodiment and the first embodiment.

[0213] As an example, as shown in FIG. 26, the mode switching processing unit 110 includes a mode determination unit 112, a measured temperature acquisition unit 221, a temperature measurement mode termination determination unit 222, a flag setting unit 113, a light projection control unit 114, and a mode setting unit 115.

[0214] The mode determination unit 112 determines whether the operation mode of the CPU 61 is the imaging mode or the temperature measurement mode.

[0215] When the mode determination unit 112 determines that the operating mode of the CPU 61 is the temperature measurement mode, the measured temperature acquisition unit 221 acquires the temperature of the subject measured in the temperature measurement mode (hereinafter referred to as the measured temperature). The measured temperature may be any of the value of the temperature distribution of the subject, the maximum value of the temperature distribution of the subject, the mode value of the temperature distribution of the subject, the median value of the temperature distribution of the subject, and the average value of the temperature distribution of the subject.

[0216] The temperature measurement mode termination determination unit 222 determines whether to terminate the temperature measurement mode based on the measured temperature acquired by the measured temperature acquisition unit 221. As an example, the temperature measurement mode termination determination unit 222 derives a value based on the measured temperature acquired by the measured temperature acquisition unit 221 and determines whether the derived value is equal to or less than a threshold value, thereby determining whether to terminate the measurement mode. The value based on the measured temperature may be any value derived from the measured temperature, such as the measured temperature itself, or a value such as the amount of radiant heat calculated based on the measured temperature. A calculation formula or a data matching table may be used to derive the value based on the measured temperature. If the value based on the measured temperature is equal to or less than the threshold value, the temperature measurement mode termination determination unit 222 determines to terminate the temperature measurement mode.

[0217] When the temperature measurement mode termination determination unit 222 determines that the temperature measurement mode is to be terminated, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag storage area 141, and sets the light projection on control flag 152A as the light projection control flag 152 in the light projection control flag storage area 142.

[0218] When the light-projection-on control flag 152A is set by the flag setting unit 113, the light-projection control unit 114 outputs an ON command to the light-projection control circuit 73. The ON command is a command to switch the light emitter 14 on.

[0219] The mode setting unit 115 sets the imaging mode as the mode of the CPU 61 .

[0220] Next, as an operation of the fourth embodiment, a method for controlling the camera 1 will be described.

[0221] In the fourth embodiment, the imaging process performed by the imaging processing unit 120 and the temperature measurement process performed by the temperature measurement processing unit 130 are the same as those in the first embodiment. In the third embodiment, the mode switching process performed by the mode switching processing unit 110 is different from that in the first embodiment. Hereinafter, the mode switching process performed by the mode switching processing unit 110 according to the fourth embodiment will be described with reference to FIG. 27.

[0222] In step S61, the mode determination unit 112 determines whether the mode of the CPU 61 is the image capture mode or the temperature measurement mode. If it is determined in step S61 that the mode is the image capture mode, the process shown in Fig. 27 proceeds to step S62, and if it is determined that the mode is the temperature measurement mode, the process shown in Fig. 27 ends.

[0223] In step S62, the measured temperature acquisition unit 221 acquires the measured temperature measured in the temperature measurement mode.

[0224] In step S63, the temperature measurement mode termination determination unit 222 determines whether or not to terminate the temperature measurement mode based on the measured temperature acquired by the measured temperature acquisition unit 221. If it is determined in step S63 that the temperature measurement mode is to be terminated, the processing shown in Fig. 27 proceeds to step S64, and if it is determined that the temperature measurement mode is not to be terminated, the processing shown in Fig. 27 terminates.

[0225] In step S64, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag storage area 141, and sets the light emission ON control flag 152A as the light emission control flag 152 in the light emission control flag storage area 142.

[0226] In step S65, the light-projection control unit 114 switches the light-projector 14 on.

[0227] In step S66, the mode setting unit 115 sets the mode of the CPU 61 to the imaging mode.

[0228] The control method for camera 1 according to the fourth embodiment is an example of the "control method" according to the technique of the present disclosure.

[0229] Next, the effects of the fourth embodiment that differ from the first embodiment will be described.

[0230] In the fourth embodiment, the CPU 61 switches from the temperature measurement mode to the image capture mode in accordance with the temperature of the subject in the temperature measurement mode, which improves convenience compared to a case where the mode is not switched from the temperature measurement mode to the image capture mode in accordance with the temperature of the subject, for example.

[0231] [Fifth embodiment] Next, a fifth embodiment will be described.

[0232] In the fifth embodiment, the configuration of the camera 1 is changed as follows compared to the first embodiment: The following describes the differences between the fifth embodiment and the first embodiment.

[0233] 28, the CPU 61 functions as an integrated display processing unit 230. The integrated display processing unit 230 is a processing unit that, while causing the projector 14 to emit pulsed light, sets the image capture mode during the light emission period of the pulsed light emission and sets the temperature measurement mode during the light emission stop period of the pulsed light emission, and repeats this operation in accordance with the light emission timing of the pulsed light emission. The projector 14 emits pulsed light to perform intermittent light projection. The integrated display processing unit 230 has a pulsed light emission control unit 241, an image capture processing unit 120, a pulsed light emission stop control unit 242, a temperature measurement processing unit 130, and an integrated display control unit 243.

[0234] The pulse light emission control section 241 outputs a pulse light emission command to the light projection control circuit 73, and controls the light projector 14 to emit pulse light.

[0235] The imaging processing unit 120 has a wavelength selection unit 121, a turret control unit 122, and an imaging control unit 123. The functions of the wavelength selection unit 121, the turret control unit 122, and the imaging control unit 123 are the same as those in the first embodiment. The imaging processing unit 120 executes imaging processing to obtain a captured image by causing the image sensor 15 to capture visible light or near-infrared light.

[0236] The pulse emission stop control section 242 outputs a pulse emission stop command to the light projection control circuit 73, and controls the light projector 14 to stop emitting pulsed light.

[0237] The temperature measurement processing unit 130 has a wavelength selection unit 131, a first turret control unit 132, a first imaging control unit 133, a second turret control unit 134, a second imaging control unit 135, and a temperature derivation unit 136. The functions of the wavelength selection unit 131, the first turret control unit 132, the first imaging control unit 133, the second turret control unit 134, the second imaging control unit 135, and the temperature derivation unit 136 are the same as those in the first embodiment. The temperature measurement processing unit 130 calculates the temperature distribution of the subject based on a near-infrared light image obtained by capturing an image of near-infrared light with the image sensor 15, and executes a temperature measurement process to generate temperature information based on the temperature distribution of the subject.

[0238] The integrated display control unit 243 outputs an integrated image 251 obtained by integrating the captured image obtained by the imaging processing unit 120 and the temperature information obtained by the temperature measurement processing unit 130, and causes the integrated image 251 to be displayed on the display 76. The integrated image 251 may be an image obtained by combining the captured image obtained by the imaging processing unit 120 with the temperature information obtained by the temperature measurement processing unit 130, or may be an image in which the captured image obtained by the imaging processing unit 120 and the temperature information obtained by the temperature measurement processing unit 130 are displayed side by side. The temperature information may be, for example, information indicating an area where the temperature is equal to or higher than a predetermined threshold, information indicating a specific temperature value, information indicating a plurality of zones divided into predetermined temperature ranges together with specific temperature values, or information indicating a temperature distribution in a color tone according to the temperature.

[0239] In the fifth embodiment, the captured image is an example of a "captured image" and a "first captured image" according to the technology of the present disclosure, the temperature information is an example of "temperature information" according to the technology of the present disclosure, and the integrated image 251 is an example of a "composite image" according to the technology of the present disclosure.

[0240] Next, as an operation of the fifth embodiment, a method for controlling the camera 1 will be described.

[0241] The fifth embodiment differs from the first embodiment in that the integrated display processing is performed by the integrated display processing unit 230. Hereinafter, the integrated display processing performed by the integrated display processing unit 230 according to the fifth embodiment will be described with reference to FIG.

[0242] In step S71, the pulse light emission control unit 241 causes the projector 14 to emit pulse light.

[0243] In step S72, the image capturing processing unit 120 obtains a captured image by causing the image sensor 15 to capture visible light or near-infrared light.

[0244] In step S73, the pulse light emission stop control unit 242 causes the projector 14 to stop emitting pulse light.

[0245] In step S74, the temperature measurement processing unit 130 calculates the temperature distribution of the object based on the near-infrared light image obtained by causing the image sensor 15 to capture near-infrared light, and generates temperature information based on the temperature distribution of the object.

[0246] In step S75, the integrated display control unit 243 outputs an integrated image 251 that integrates the captured image obtained by the imaging processing unit 120 and the temperature information obtained by the temperature measurement processing unit 130, and displays the integrated image 251 on the display 76.

[0247] The control method for camera 1 according to the fifth embodiment is an example of the "control method" according to the technique of the present disclosure.

[0248] Next, the effects of the fifth embodiment that differ from the first embodiment will be described.

[0249] In the fifth embodiment, the projector 14 emits pulsed light, and the CPU 61 repeats the operation of setting the imaging mode during the light emission period of the pulsed light and setting the temperature measurement mode during the light emission stop period of the pulsed light in accordance with the light emission timing of the pulsed light. This makes it possible to obtain an integrated image by integrating the captured image obtained in the imaging mode with the temperature information obtained in the temperature measurement mode.

[0250] Furthermore, the CPU 61 outputs an integrated image 251 that integrates the captured image obtained by the imaging processing unit 120 and the temperature information obtained by the temperature measurement processing unit 130. Therefore, even without switching between the imaging mode and the temperature measurement mode, the integrated image 251 that integrates the captured image with the temperature information is displayed on the display 76, allowing the user to visually grasp the relationship between the state of the subject and the temperature.

[0251] Next, a modified example common to the first to fifth embodiments will be described.

[0252] In the first to fifth embodiments, the CPU 61 has an imaging mode and a temperature measurement mode, but may have modes other than the imaging mode and the temperature measurement mode.

[0253] In addition, in the first to fifth embodiments, the CPU 61 sets the display control flag 151 and the light projection control flag 152 differently between the imaging mode and the temperature measurement mode, but the CPU 61 may set control flags other than the display control flag 151 and the light projection control flag 152 differently.

[0254] Furthermore, in the first to fifth embodiments, a captured image display flag 151A that causes a captured image 161A to be displayed on the display 76, and a composite image display flag 151B that causes a composite image 161B in which temperature information is composited with a captured image to be displayed on the display 76 are set as the display control flag 151. However, a display control flag 151 other than the captured image display flag 151A and the composite image display flag 151B may be set. Furthermore, in the temperature measurement mode, instead of the composite image display flag 151B, a temperature information display flag that causes temperature information to be displayed on the display 76 may be set, and the temperature information may be displayed on the display 76. The temperature information display flag is an example of a "temperature information display factor" according to the technology of the present disclosure.

[0255] Furthermore, in the first to fifth embodiments, image blur is corrected by moving the blur correction lens 34, but image blur may also be corrected by moving the image sensor 15, which is an example of the "optical element" according to the technology of the present disclosure. Image blur may also be corrected by an image processing technique based on multiple captured images.

[0256] In addition, in the first to fifth embodiments, when measuring temperature using two-color thermometry, two wavelength bands are selected from the wavelength bands of 950 nm to 1100 nm, 1150 nm to 1350 nm, 1500 nm to 1750 nm, and 200 nm to 2400 nm, but two wavelength bands may be selected from wavelength bands other than these.

[0257] Furthermore, in the first to fifth embodiments, near-infrared light is used in temperature measurement by two-color thermometry, but light other than near-infrared light, such as visible light, may also be used.

[0258] Furthermore, in the first to fifth embodiments, the camera 1 is given as an example of an imaging device, but the technology of the present disclosure is not limited to this, and may be a digital camera built into various electronic devices such as a smart device, a wearable terminal, a cell observation device, an ophthalmic observation device, or a surgical microscope.

[0259] Furthermore, in the first to fifth embodiments, the functional configuration of the CPU 61 and the order of the processes executed by the CPU 61 are merely examples and may be modified in various ways.

[0260] Furthermore, among the techniques in the first to fifth embodiments, techniques that can be combined may be combined as appropriate.

[0261] Furthermore, in the first to fifth embodiments, an example in which the imaging support processing is executed by the computer 60 in the camera 1 has been described, but the technology of the present disclosure is not limited to this. For example, as shown in Fig. 30, the imaging support processing may be executed by a computer 314 in an external device 312 that is communicatively connected to the camera 1 via a network 310 such as a LAN or a WAN. In the example shown in Fig. 30, the computer 314 includes a CPU 316, a storage 318, and a memory 320. The storage 318 stores an imaging support processing program 100.

[0262] The camera 1 requests the external device 312 to execute imaging support processing via the network 310. In response to this, the CPU 316 of the external device 312 reads the imaging support processing program 100 from the storage 318 and executes the imaging support processing program 100 on the memory 320. The CPU 316 performs imaging support processing in accordance with the imaging support processing program 100 executed on the memory 320. The CPU 316 then provides the processing results obtained by executing the imaging support processing to the camera 1 via the network 310.

[0263] Furthermore, the imaging support process may be distributed and executed between the camera 1 and the external device 312, or may be distributed and executed between a plurality of devices including the camera 1 and the external device 312. In the example shown in Fig. 30, the camera 1 and the external device 312 are an example of an "imaging device" according to the technology of the present disclosure.

[0264] Furthermore, in the first to fifth embodiments, an example in which the imaging support processing program 100 is stored in the NVM 62 has been described, but the technology of the present disclosure is not limited to this. For example, as shown in Fig. 31, the imaging support processing program 100 may be stored in a storage medium 330. The storage medium 330 is a non-transitory storage medium. An example of the storage medium 330 is any portable storage medium such as an SSD or a USB memory.

[0265] The imaging support processing program 100 stored in the storage medium 330 is installed in the computer 60. The CPU 61 executes imaging support processing in accordance with the imaging support processing program 100.

[0266] In addition, the image capture support processing program 100 may be stored in a memory unit of another computer or server device connected to the computer 60 via a communication network (not shown), and the image capture support processing program 100 may be downloaded and installed on the computer 60 in response to a request from the camera 1.

[0267] It is not necessary to store the entire image capture support processing program 100 in the memory unit of another computer or server device connected to the computer 60, or in the NVM 62; only a portion of the image capture support processing program 100 may be stored therein.

[0268] Furthermore, in the example shown in FIG. 31, an example is shown in which the computer 60 is built into the camera 1, but the technology of the present disclosure is not limited to this, and for example, the computer 60 may be provided outside the camera 1.

[0269] 31, the CPU 61 is a single CPU, but it may be a plurality of CPUs. Also, a GPU may be used instead of the CPU 61.

[0270] 31 illustrates a computer 60, the technology of the present disclosure is not limited to this, and a device including an ASIC, an FPGA, and / or a PLD may be applied instead of the computer 60. Furthermore, a combination of a hardware configuration and a software configuration may be used instead of the computer 60.

[0271] The hardware resources for executing the imaging support processing described in the first to fifth embodiments can be various processors, as listed below. Examples of processors include a CPU, which is a general-purpose processor that functions as a hardware resource for executing imaging support processing by executing software, i.e., a program. Examples of processors include dedicated electrical circuits, such as FPGAs, PLDs, or ASICs, which are processors with circuit configurations designed specifically for executing specific processing. Each processor has a built-in or connected memory, and each processor executes the imaging support processing by using the memory.

[0272] The hardware resource that executes the imaging support process may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the imaging support process may be a single processor.

[0273] As an example of a system configured with one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes the imaging support process. Second, there is a system that uses a processor that realizes the functions of the entire system, including multiple hardware resources that execute the imaging support process, on a single IC chip, as typified by SoCs. In this way, the imaging support process is realized using one or more of the various processors described above as hardware resources.

[0274] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor elements. The above-described imaging support process is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the process.

[0275] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[0276] In this specification, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0277] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

Claims

1. a processor; a memory connected to or embedded in the processor; The processor: a first mode for capturing an image of light incident from a subject onto an image sensor of an imaging device and received by the image sensor, and a second mode for deriving a temperature based on near-infrared light incident from the subject onto the image sensor and received by the image sensor, When a projector that irradiates illumination light toward the subject is in an on state, the first mode is set, and when the projector is in an off state, the second mode is set. Control device.

2. The control factors are different between the first mode and the second mode. The control device according to claim 1 .

3. The control factors include display control factors that cause a display to be displayed. The control device according to claim 2 .

4. The processor: In the first mode, a captured image display factor is set as the display control factor, which causes the display to display a captured image obtained by receiving the light by the image sensor; In the second mode, a temperature information display factor is set as the display control factor, which causes the display to display temperature information indicating the temperature. The control device according to claim 3 .

5. the control factor includes a light projecting control factor that operates a light projector; In the second mode, the processor sets a light-projection suppression control factor that suppresses light projection from the projector as the light-projection control factor. The control device according to any one of claims 2 to 4.

6. The control factors include imaging setting factors related to imaging settings. The control device according to any one of claims 2 to 4.

7. The imaging settings include at least one of a setting related to a projector, a setting related to a shutter speed, a setting related to an aperture, a setting related to photometry, a setting related to the sensitivity of the image sensor, a setting related to a high dynamic range, and a setting related to vibration isolation control. The control device according to claim 6.

8. The control factors include image processing setting factors related to image processing settings. The control device according to any one of claims 2 to 6.

9. The image processing settings include at least one of a noise reduction setting, a sharpness setting, a contrast setting, and a tone setting. The control device according to claim 8.

10. The processor switches from the second mode to the first mode in response to the temperature in the second mode. The control device according to any one of claims 1 to 9.

11. The light projector emits pulsed light, The processor repeats an operation of setting the first mode during a light emission period of the pulsed light emission and setting the second mode during a light emission stop period of the pulsed light emission in accordance with a light emission timing of the pulsed light emission. The control device according to claim 10.

12. The processor outputs a composite image obtained by combining a first captured image obtained by receiving light by the image sensor with temperature information indicating the temperature. The control device according to any one of claims 1 to 11.

13. A control device according to any one of claims 1 to 12; the image sensor; An imaging device comprising:

14. Switching between a first mode in which light incident from a subject onto an image sensor of an imaging device and received by said image sensor is captured, and a second mode in which temperature is derived based on near-infrared light incident from said subject onto said image sensor and received by said image sensor; and When an operation of a projector that irradiates illumination light toward the subject is on, the first mode is set, and when the operation of the projector is off, the second mode is set. A control method comprising:

15. On the computer, Switching between a first mode in which light incident from a subject onto an image sensor of an imaging device and received by the image sensor is captured, and a second mode in which temperature is derived based on near-infrared light incident from the subject onto the image sensor and received by the image sensor; and When an operation of a projector that irradiates illumination light toward the subject is on, the first mode is set, and when the operation of the projector is off, the second mode is set. A program for executing a process including:

Images