Sensor, measurement device, measurement method, artificial satellite, and program

Abstract

To provide a technique that enhances target object detection accuracy.SOLUTION: A sensor comprises an image sensor having sequentially arranged multiple imaging areas for separately imaging light of different wavelengths. Temperature of an imaging target is derived using signals obtained from two of the multiple imaging areas.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a sensor, a measurement device, a measurement method, an artificial satellite, and a program. [Background technology]

[0002] There is a known technology for calculating the surface temperature of an imaged object using the radiance of light of multiple wavelengths obtained by a detector from the object. Specifically, this temperature calculation method is called the two-color method (two-color thermometry). A technology for calculating temperature using the two-color method is disclosed in Patent Document 1. The technology in Patent Document 1 describes the use of a camera in which two-wavelength filters are installed in a mosaic pattern on each pixel of a CCD or C-MOS sensor. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-162526 Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for a technology that can further improve the accuracy of target detection in the above-mentioned technology.

[0005] An object of the present disclosure is to provide a sensor, a measuring device, a measuring method, an artificial satellite, and a program that solve the above-mentioned problems. [Means for solving the problem]

[0006] A sensor according to one embodiment of the present disclosure includes an imaging element having a plurality of imaging areas arranged in sequence to separately image light of a plurality of different wavelengths, and a temperature calculation means for calculating the temperature of the imaging target using signals obtained from two of the plurality of imaging areas.

[0007] A measurement device according to one embodiment of the present disclosure includes an imaging element having a plurality of imaging areas arranged in sequence to separately image light of a plurality of different wavelengths, and a temperature calculation means for calculating the temperature of the object to be imaged using signals obtained from two of the plurality of imaging areas.

[0008] A measurement method according to one embodiment of the present disclosure processes information about an object to be imaged using signals obtained from two of a plurality of imaging regions of an imaging element that are arranged in sequence and that separately image light of a plurality of different wavelengths.

[0009] A satellite according to one embodiment of the present disclosure includes a sensor having an imaging element in which a plurality of imaging areas that separately image light of a plurality of different wavelengths are arranged in sequence, and a temperature calculation means that calculates the temperature of the imaging target using signals obtained from two of the plurality of imaging areas.

[0010] A program according to one embodiment of the present disclosure causes a computer of a temperature measuring device having an imaging element in which multiple imaging areas that separately image multiple different wavelengths of light are arranged in sequence to function as a temperature calculation means that calculates the temperature of the object to be imaged using signals obtained from two of the multiple imaging areas.

[0011] A circuit according to one embodiment of the present disclosure includes an imaging element having a plurality of imaging areas arranged in sequence to separately image light of a plurality of different wavelengths, and a temperature calculation means for calculating the temperature of the imaging target using signals obtained from two of the plurality of imaging areas.

[0012] An imaging element according to one aspect of the present disclosure includes a plurality of imaging regions arranged in sequence, each of which separately forms an image of light of a plurality of different wavelengths. [Effects of the Invention]

[0013] According to the above aspect, it is possible to provide a sensing technique that can further improve the accuracy of detecting an object. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is a first diagram illustrating a configuration of an imaging element according to the present disclosure. [Figure 2] FIG. 10 illustrates another example of a sensor according to the present disclosure. [Figure 3] FIG. 2 is a first diagram showing functional blocks of a signal processing unit according to the present disclosure. [Figure 4] FIG. 10 is a first diagram showing a processing flow of a signal processing unit according to the present disclosure. [Figure 5] FIG. 2 is a second diagram illustrating the configuration of an imaging element according to the present disclosure. [Figure 6] FIG. 2 is a second diagram showing functional blocks of the signal processing unit according to the present disclosure. [Figure 7] FIG. 10 is a second diagram showing the processing flow of the signal processing unit according to the present disclosure. [Figure 8] FIG. 10 is a third diagram illustrating the configuration of an imaging element according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0015] The sensor, measuring device, measuring method, satellite, program, circuit, and imaging element of the present disclosure will be described below.

[0016] FIG. 1 is a first diagram showing the configuration of an imaging element. As shown in FIG. 1, the image sensor 1 is composed of a large number of pixels. The image sensor may be any device that converts focused light into an electrical signal, such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The image sensor 1 of the present disclosure has multiple imaging areas. An imaging area is an area of ​​an imaging range in an image sensor that includes multiple pixels. In the present disclosure, two rectangular imaging areas are arranged side by side in one direction, as shown in FIG. 1. The image sensor 1 shown in FIG. 1 has two imaging areas: a λ1 imaging area 11 that focuses light of wavelength λ1, and a λ2 imaging area 12 that focuses light of wavelength λ2. Note that wavelength λ1 may refer to a predetermined wavelength band including λ1. Wavelength λ2 may refer to a predetermined wavelength band including λ2.

[0017] The image sensor 1 constitutes a sensor 100. Light that has passed through a corresponding BPF (band pass filter) 2 forms an image in a λ1 imaging region 11 and a λ2 imaging region 12 of the image sensor 1 included in the sensor 100. That is, in the sensor 100, a BPF 21 is provided corresponding to the λ1 imaging region 11. Also, in the sensor 100, a BPF 22 is provided corresponding to the λ2 imaging region. The BPFs 21 and 22 will be collectively referred to as BPF2.

[0018] FIG. 2 is a diagram showing another example of the sensor. The sensor 100 may be provided with a signal processing unit 3. The signal processing unit 3 may be provided outside the sensor 100. The signal processing unit 3 receives signals output from each pixel in the λ1 imaging region 11 and the λ2 imaging region. The signal processing unit 3 performs information processing using the signals output from each pixel in the λ1 imaging region 11 and the λ2 imaging region. The signal processing unit 3 may be configured to process images. The signal processing unit 3 may also be configured to calculate the temperature of the object to be imaged. As an example, the signal processing unit 3 processes information on the light signals imaged by the image sensor 1 using a TDI (Time Delay Integration) technique. The signal processing unit 3 may be configured with an electronic circuit.

[0019] The sensor 100 is located at a position where light incident via the optical system of a camera attached to a flying object such as a satellite and passing through a BPF 2 forms an image. Light of a predetermined wavelength λ (or wavelength band) from the target object that falls within the camera's imaging range and passes through the corresponding BPF 2 forms an image in each imaging area of ​​the image sensor 1 of the sensor 100. Pixels are arranged vertically and horizontally on the plane of each imaging area. In FIG. 2, when a satellite equipped with the sensor moves upward in the drawing, light across the scanning width of the target object (the width of the image sensor 1 in the horizontal direction in FIG. 2) forms an image on pixels from the upper pixels to the lower pixels in the drawing. That is, in the image sensor 1, light of wavelength λ1 from the light across the scanning width that enters the camera forms an image on pixels in the λ1 imaging area in the direction of satellite movement (the upper pixels in FIG. 2) to the pixels in the opposite direction of the satellite movement (the lower pixels in FIG. 2). In addition, light of wavelength λ2 out of the light within the scanning width that enters the camera is imaged in the λ2 imaging area 12 in order from the pixels in the direction of the satellite's movement (the upper pixels in Figure 2) to the pixels in the opposite direction of the movement (the lower pixels in Figure 2).

[0020] As shown in Patent Document 1, if each pixel of the image sensor 1 is provided with a BPF2 that passes two different wavelengths alternately so that the wavelengths of light formed on adjacent pixels of the image sensor 1 are different, the wavelengths of light formed on adjacent pixels will be different, but there is a possibility that light will leak into the adjacent pixel and light of a wavelength that should not be combined will be formed on the adjacent pixel.

[0021] On the other hand, the image sensor 1 of the present disclosure has multiple imaging regions that separately image light of multiple different wavelengths, thereby reducing the proportion of light of a wavelength that should be imaged at a pixel in one imaging region being imaged at a pixel in another imaging region. Furthermore, since it is sufficient to provide one BPF2 for a combination region that includes many pixels that combine one wavelength, the manufacturing costs of the image sensor 1 can be reduced.

[0022] Furthermore, as disclosed herein, the width of each of the multiple imaging regions in one direction (from top to bottom in the drawing) in the image sensor 1, which separately image light of multiple different wavelengths, is shorter than the width of the image sensor. Assume that the signal processing unit 3 performs signal processing using TDI. TDI captures a bright, blur-free image of the object by accumulating light from the pixels that combine the light in the corresponding imaging region while moving it sequentially, for example, from top to bottom in FIG. 2, as the imaging region moves. Here, consider that the image sensor 1 experiences a certain amount of shaking. In this case, the time it takes for the light from the object to be imaged from one end of the narrow imaging region to the other end in one direction is shorter than the time it takes for the light from the object to be imaged from one end to the other end in that direction. Therefore, in TDI, a shorter light accumulation time for each pixel that combines corresponding light from the object increases the likelihood that light accumulation in other parts of the object will not be included, thereby generating a more accurate (less blurred) image of the object.

[0023] FIG. 3 is a first diagram showing functional blocks of the signal processing unit. FIG. 4 is a first diagram showing the processing flow of the signal processing unit. The signal processing unit 3 may include an image processing unit 31 and a temperature calculation unit 32. The image processing unit 31 generates an image of the object for each wavelength based on the signal of the object imaged in the imaging region for each wavelength through the TDI processing described above (step S101). The temperature calculation unit 32 calculates the temperature of the object based on the radiance of the image of the object for each wavelength. Specifically, the temperature calculation unit 32 acquires a first image generated by the image processing unit 31 based on the light imaged in the λ1 imaging region 11 and a second image generated by the image processing unit 31 based on the light imaged in the λ2 imaging region 12 (step S102). The temperature calculation unit 32 identifies the radiance of the object in the first and second images, and calculates the temperature of the object from the ratio of the radiance (amount of infrared radiation) using the radiance and a known two-color method (two-color thermometry) (step S103).

[0024] The signal processing unit 3 may simply generate an image of each wavelength, or may perform other information processing other than calculating the temperature of the imaged object.

[0025] FIG. 5 is a second diagram showing the configuration of the imaging element. 5 has three or more imaging areas. As an example, the imaging element 1 may have imaging areas corresponding to 16 wavelengths (wavelength bands) from λ1 to λ16. In this case, the sensor 100 is also provided with BPF2 (BPF21, BPF22, . . ., BPF28, . . .) corresponding to λ1 to λ16.

[0026] FIG. 6 is a second diagram showing functional blocks of the signal processing unit. FIG. 7 is a second diagram showing the processing flow of the signal processing unit. 6 further includes a wavelength specifying unit 33. The wavelength specifying unit 33 specifies two wavelengths for calculating the temperature of the imaging target.

[0027] 5, the wavelength specifying unit 33 of the information processing unit 3 specifies two wavelengths out of the three or more wavelengths based on an external signal or the like (step S201).The wavelength specifying unit 33 then outputs information on the specified two wavelengths to the image processing unit 31 and the temperature calculation unit 32.

[0028] The image processing unit 31 generates images of the object for each wavelength based on the signals of the object imaged in the imaging regions of the two identified wavelengths through the TDI processing described above (step S202). The temperature calculation unit 32 calculates the temperature of the object based on the radiance of the images of the object at the two wavelengths. For example, the temperature calculation unit 32 acquires a seventh image generated by the image processing unit 31 based on the light imaged in the λ7 imaging region 17 and an eighth image generated by the image processing unit 31 based on the light imaged in the λ8 imaging region 18 (step S203). The temperature calculation unit 32 identifies the radiance of the object in the seventh and eighth images, and calculates the temperature of the object from the ratio of the radiance (amount of infrared radiation) using the radiance and a known two-color method (two-color thermometry) (step S204).

[0029] The above-described image sensor 1 and sensor 100 including the image sensor 1 can provide sensing technology that can further improve the accuracy of detecting an object. Furthermore, the above-described image sensor 1 and sensor 100 including the image sensor 1 can arbitrarily select an appropriate pair of wavelengths according to the temperature of the object. More specifically, the wavelength specifying unit 33 of the signal processing unit 3 acquires information on the temperature of the object from the storage unit and specifies two wavelengths according to the temperature in the above-described step S201. Then, if the output of the sensor becomes saturated when a certain wavelength is selected, the wavelength specifying unit 33 may select another wavelength that is not saturated.

[0030] FIG. 8 is a third diagram showing the configuration of the imaging element. In another example, the image sensor may have multiple imaging regions arranged in sequence in the left-right direction as shown in Fig. 8, or multiple imaging regions may be arranged in sequence in the up-down direction in addition to the left-right direction in Fig. 8. In this case, the optical system may be configured so that light corresponding to each wavelength is imaged in sequence from above to below on the pixels of each imaging region.

[0031] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure.

[0032] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0033] (Appendix 1) An image sensor in which multiple imaging areas that separately image multiple light beams of different wavelengths are arranged in sequence A sensor equipped with

[0034] (Appendix 2) a temperature calculation means for calculating a temperature of the imaging target using signals obtained from two of the plurality of imaging regions; 2. The sensor of claim 1, comprising:

[0035] (Appendix 3) The sensor according to claim 1 or 2, wherein a bandpass filter that passes light in a specific wavelength range among the plurality of different wavelengths of light is provided corresponding to each of the imaging areas.

[0036] (Appendix 4) 4. The sensor according to claim 1, wherein the imaging area is composed of a plurality of pixels.

[0037] (Appendix 5) 5. The sensor according to claim 1, wherein two of the imaging areas are arranged in sequence.

[0038] (Appendix 6) 5. The sensor according to claim 1, wherein three or more of the imaging areas are arranged in sequence.

[0039] (Appendix 7) a plurality of sets of the plurality of imaging areas, the number of which is a multiple of 2, each set forming an image of light of a corresponding wavelength; an imaging area specifying means for specifying a predetermined set from the sets of imaging areas based on the temperature of the imaging target, The temperature calculation means calculates the temperature of the imaging target using signals obtained from the predetermined set of imaging areas. 1. A sensor as described in Appendix 2.

[0040] (Appendix 8) An image sensor in which multiple imaging areas that separately image multiple light beams of different wavelengths are arranged in sequence A measuring device comprising:

[0041] (Appendix 9) a temperature calculation means for calculating a temperature of the imaging target using signals obtained from two of the plurality of imaging regions; 9. The measuring device according to claim 8, comprising:

[0042] (Appendix 10) 10. The measuring device according to claim 8 or 9, wherein a bandpass filter that passes light in a specific wavelength range among the plurality of different wavelengths of light is provided corresponding to each of the imaging regions.

[0043] (Appendix 11) 11. The measuring device according to claim 8, wherein the imaging area is composed of a plurality of pixels.

[0044] (Appendix 12) 12. The measuring device according to claim 8, wherein two of the imaging regions are arranged in sequence.

[0045] (Appendix 13) 12. The measuring device according to claim 8, wherein three or more of the imaging regions are arranged in sequence.

[0046] (Appendix 14) a plurality of sets of the plurality of imaging areas, the number of which is a multiple of 2, each set forming an image of light of a corresponding wavelength; an imaging area specifying means for specifying a predetermined set from the sets of imaging areas based on the temperature of the imaging target, The temperature calculation means calculates the temperature of the imaging target using signals obtained from the predetermined set of imaging areas. 10. The measuring device according to claim 9.

[0047] (Appendix 15) An imaging device has a plurality of imaging areas that are arranged in order to separately image light of a plurality of different wavelengths, and performs information processing on the imaging target using signals obtained from two of the plurality of imaging areas. Measurement method.

[0048] (Appendix 16) Calculating the temperature of the imaged object using signals obtained from two of the plurality of image-forming areas Measurement method described in Appendix 15.

[0049] (Appendix 17) 17. The measurement method according to claim 15, wherein a bandpass filter that passes light in a specific wavelength range among the plurality of different wavelengths of light is provided corresponding to each of the imaging areas.

[0050] (Appendix 18) 18. The measurement method according to any one of claims 15 to 17, wherein the imaging area is composed of a plurality of pixels.

[0051] (Appendix 19) 19. The measurement method according to any one of claims 15 to 18, wherein two of the imaging areas are arranged in sequence.

[0052] (Appendix 20) 19. The measurement method according to any one of claims 15 to 18, wherein three or more of the imaging areas are arranged in sequence.

[0053] (Appendix 21) Identifying a predetermined set from a plurality of sets of the imaging areas, the number of which is a multiple of 2, that form images of light of corresponding wavelengths, based on the temperature of the imaging target; Calculating the temperature of the imaged object using signals obtained from the predetermined set of imaging regions Measurement method described in Appendix 16.

[0054] (Appendix 22) An artificial satellite equipped with one or more sensors equipped with an imaging element that has multiple imaging areas arranged in sequence to separately image multiple different wavelengths of light.

[0055] (Appendix 23) a temperature calculation means for calculating a temperature of the imaging target using signals obtained from two of the plurality of imaging regions; 23. The satellite according to claim 22, comprising the sensor.

[0056] (Appendix 24) 24. The satellite according to claim 22 or 23, wherein the sensor is equipped with a bandpass filter that passes light in a specific wavelength range among the plurality of different wavelengths of light, the bandpass filter being provided corresponding to each of the imaging areas.

[0057] (Appendix 25) 25. The satellite according to any one of claims 22 to 24, wherein the imaging area is equipped with the sensor composed of a plurality of pixels.

[0058] (Appendix 26) 26. The satellite according to any one of appendices 22 to 25, comprising the sensor having two of the imaging areas arranged in sequence.

[0059] (Appendix 27) 26. The satellite according to any one of claims 22 to 25, comprising the sensor having three or more of the imaging areas arranged in sequence.

[0060] (Appendix 28) a plurality of sets of the plurality of imaging areas, the number of which is a multiple of 2, each set forming an image of light of a corresponding wavelength; an imaging area specifying means for specifying a predetermined set from the sets of imaging areas based on the temperature of the imaging target, The temperature calculation means calculates the temperature of the imaging target using signals obtained from the predetermined set of imaging areas. 24. The satellite according to claim 23, comprising the sensor.

[0061] (Appendix 29) a computer of a measuring device having an image sensor in which a plurality of imaging areas that separately form images of light of a plurality of different wavelengths are arranged in order, an information processing means for performing information processing on the imaging target using signals obtained from two of the plurality of imaging regions; A program that functions as a

[0062] (Appendix 30) a temperature calculation means for calculating a temperature of the image capture target using signals obtained from two of the plurality of image capture areas; 29. The program according to claim 29,

[0063] (Appendix 31) 31. The program according to claim 29 or 30, causing a computer of the measuring device, which is provided with an imaging element having a bandpass filter that passes light in a specific wavelength region among the plurality of different wavelengths of light, provided corresponding to each of the imaging regions, to function as the information processing means.

[0064] (Appendix 32) 32. The program according to any one of claims 29 to 31, which causes a computer of the measuring device, which is equipped with the imaging element in which the imaging area is composed of a plurality of pixels, to function as the information processing means.

[0065] (Appendix 33) 33. The program according to any one of claims 29 to 32, which causes a computer of the measuring device, which has the imaging element with the two imaging areas arranged in sequence, to function as the information processing means.

[0066] (Appendix 34) 33. The program according to any one of claims 29 to 32, which causes a computer of the measuring device, which is provided with the imaging element having three or more of the imaging areas arranged in sequence, to function as the information processing means.

[0067] (Appendix 35) a computer of the measurement device including the image sensor having a plurality of sets of the plurality of image forming areas, the number of sets of the image forming areas being a multiple of 2, the plurality of sets of the image forming areas forming images of light of corresponding wavelengths; functioning as an imaging area specifying means for specifying a predetermined set of the imaging areas based on the temperature of the imaging object; The temperature calculation means calculates the temperature of the imaging target using signals obtained from the predetermined set of imaging areas. 30. The program described in Appendix 30.

[0068] (Appendix 36) an imaging element having a plurality of imaging regions arranged in sequence, each of which separately forms an image of light of a plurality of different wavelengths; A circuit comprising:

[0069] (Appendix 37) a temperature calculation means for calculating a temperature of the imaging target using signals obtained from two of the plurality of imaging regions; 37. The circuit of claim 36, comprising:

[0070] (Appendix 38) 38. The circuit according to claim 36 or 37, including the imaging element having a bandpass filter that passes light in a specific wavelength range among the plurality of different wavelengths of light provided corresponding to each of the imaging areas.

[0071] (Appendix 39) 39. The circuit of any one of claims 36 to 38, wherein the imaging area includes the imaging element configured with a plurality of pixels.

[0072] (Appendix 40) 40. The circuit of any one of claims 36 to 39, including the imaging element having two of the imaging areas arranged in sequence.

[0073] (Appendix 41) 40. The circuit of any one of claims 36 to 39, including the imaging element having three or more of the imaging areas arranged in sequence.

[0074] (Appendix 42) a plurality of sets of the plurality of imaging areas, the number of which is a multiple of 2, each set forming an image of light of a corresponding wavelength; an imaging area specifying means for specifying a predetermined set from the sets of imaging areas based on the temperature of the imaging target, The temperature calculation means calculates the temperature of the imaging target using signals obtained from the predetermined set of imaging areas. 38. The circuit described in claim 37.

[0075] (Appendix 43) An imaging element that has multiple imaging areas arranged in sequence to separately image light of multiple different wavelengths. [Explanation of symbols]

[0076] 1. Image sensor 2. BPF (band pass filter) 3. Signal Processing Section 11 λ1 imaging region 12 λ2 imaging region 31 Image processing unit 32...Temperature calculation section

Claims

1. an imaging element having a plurality of imaging regions arranged in sequence, each of which separately images light of a plurality of different wavelengths; a temperature calculation means for calculating a temperature of the imaging target using signals obtained from two of the plurality of imaging regions; A sensor equipped with

2. 2. The sensor according to claim 1, wherein a band-pass filter that passes light in a specific wavelength range among the plurality of different wavelengths is provided corresponding to each of the imaging regions.

3. 3. The sensor according to claim 2, wherein the imaging area is composed of a plurality of pixels.

4. 4. The sensor according to claim 3, wherein two of said imaging areas are arranged side by side.

5. 4. The sensor according to claim 3, wherein three or more of said imaging areas are arranged in sequence.

6. a plurality of sets of the plurality of imaging areas, the number of which is a multiple of 2, each set forming an image of light of a corresponding wavelength; an imaging area specifying means for specifying a predetermined set from the sets of imaging areas based on the temperature of the imaging target, The temperature calculation means calculates the temperature of the imaging target using signals obtained from the predetermined set of imaging areas. The sensor of claim 5.

7. an imaging element having a plurality of imaging regions arranged in sequence, each of which separately images light of a plurality of different wavelengths; a temperature calculation means for calculating a temperature of the imaging target using signals obtained from two of the plurality of imaging regions; A measuring device comprising:

8. An imaging device has a plurality of imaging areas arranged in sequence, each of which separately forms an image of light of a plurality of different wavelengths, and performs information processing on the imaging target using signals obtained from two of the plurality of imaging areas. Measurement method.

9. A satellite comprising the sensor according to any one of claims 1 to 6.

10. a computer of a temperature measuring device having an image sensor in which a plurality of imaging areas that separately form images of light of a plurality of different wavelengths are arranged in order, a temperature calculation means for calculating a temperature of the imaging target using signals obtained from two of the plurality of imaging regions; A program that functions as a

Images