Electromagnetic wave detection device, program, and information acquisition system

Abstract

The electromagnetic wave detection device (10) includes a switching unit (16), a first detection unit (19), and a second detection unit (20). The switching unit (16) has an operating surface (as) on which multiple pixels (px) are arranged. The switching unit (16) can switch each pixel (px) between a first state and a second state. In the first state, electromagnetic waves incident on the operating surface (as) are made to travel along a first direction (d1). In the second state, electromagnetic waves incident on the operating surface (as) are made to travel along a second direction (d2). The first detection unit (19) detects the electromagnetic waves traveling along the first direction (d1). The second detection unit (20) detects the electromagnetic waves traveling along the second direction (d2).

Description

[0001] This application is a divisional application of the invention patent application filed on January 26, 2018, with application number 201880011352.3 and entitled "Electromagnetic Wave Detection Device, Program and Information Acquisition System".

[0002] Cross-references between related applications

[0003] This application claims priority to Japanese Patent Application No. 2017-025375, filed in Japan on February 14, 2017, the entire contents of which are incorporated herein by reference. Technical Field

[0004] This invention relates to an electromagnetic wave detection device, a program, and an information acquisition system. Background Technology

[0005] In recent years, devices have been developed that obtain information related to the surroundings from detection results obtained by multiple detectors that detect electromagnetic waves. For example, a device is known that uses lidar to measure the position of an object in an image captured by an infrared camera (see Patent Document 1).

[0006] Existing technical documents

[0007] Patent Literature

[0008] Patent document 1: Japanese Patent Application Publication No. 2011-220732. Summary of the Invention

[0009] The electromagnetic wave detection device of the first point of view includes:

[0010] The switching unit includes an operating surface configured with multiple pixels, which enables each pixel to switch between a first state in which an electromagnetic wave incident on the operating surface travels along a first direction and a second state in which the wave travels along a second direction.

[0011] A first detection unit detects the electromagnetic wave traveling along the first direction; and,

[0012] The second detection unit detects the electromagnetic wave traveling along the second direction.

[0013] In addition, the information acquisition system for the second viewpoint includes:

[0014] The switching unit is capable of switching each of the plurality of pixels constituting the working surface between a first state in which electromagnetic waves incident on the working surface travel in a first direction and a second state in which they travel in a second direction.

[0015] The first detection unit detects the electromagnetic wave traveling along the first direction;

[0016] The second detection unit detects the electromagnetic wave traveling along the second direction; and

[0017] The control unit acquires information related to the surrounding environment based on the electromagnetic waves detected by the first detection unit and the second detection unit, respectively.

[0018] In addition, the third-view procedure causes the device to perform the following steps:

[0019] Each pixel of the plurality of pixels constituting the action surface is switched between a first state that causes the electromagnetic wave incident on the action surface to travel in a first direction and a second state that causes it to travel in a second direction.

[0020] Detect the electromagnetic wave traveling along the first direction;

[0021] The electromagnetic wave traveling along the second direction is detected. Attached Figure Description

[0022] Figure 1 This is a structural diagram showing a schematic structure of an information acquisition system including an electromagnetic wave detection device according to the first embodiment.

[0023] Figure 2 It is used for explanation Figure 1 The diagram shows the structure of a system for acquiring information about the direction of electromagnetic wave propagation in the switching section of an electromagnetic wave detection device, where pixels in the first and second states are located.

[0024] Figure 3 This is shown for illustration. Figure 1 The timing diagram of the electromagnetic wave emission and detection times of the ranging sensor, which is composed of the irradiation unit, the second detection unit, and the control unit 14, is shown.

[0025] Figure 4 This is a timing diagram used to explain the control of each part of the control unit to repeatedly acquire image information and distance information in the first embodiment.

[0026] Figure 5 This is a structural diagram illustrating the information acquisition system for the propagation state of electromagnetic waves when any pixel of the switching unit in the first embodiment is in the first state.

[0027] Figure 6 It is used to illustrate only Figure 5 The structural diagram of the system for acquiring information on the propagation state of electromagnetic waves when any pixel is in the second state.

[0028] Figure 7 This is a structural diagram showing a schematic structure of an information acquisition system including an electromagnetic wave detection device according to the second embodiment.

[0029] Figure 8 This is a timing diagram used to explain the control of various parts of the control unit to alternately and repeatedly acquire image information from the first detection unit and the second detection unit in the second embodiment.

[0030] Figure 9 This is a structural diagram showing a schematic structure of an information acquisition system including an electromagnetic wave detection device according to the third embodiment. Detailed Implementation

[0031] Hereinafter, embodiments of the electromagnetic wave detection apparatus applied to the present invention will be described with reference to the accompanying drawings. In a structure in which electromagnetic waves are detected by multiple detectors, the detection axes of each detector are different. Therefore, even if each detector detects the same area as an object, the coordinate system in the detection result is different in each detector. Therefore, it is beneficial to reduce the difference in the coordinate system in the detection result of each detector. However, it is impossible or difficult to reduce this difference by correcting it. Therefore, the electromagnetic wave detection apparatus of the present invention is configured to reduce the difference in the detection axes of each detector, thereby reducing the difference in the coordinate system in the detection result of each detector.

[0032] like Figure 1 As shown, the information acquisition system 11 of the first embodiment of this disclosure, which includes an electromagnetic wave detection device 10, is configured to include an electromagnetic wave detection device 10, an irradiation unit 12, a reflection unit 13, and a control unit 14.

[0033] In the following diagrams, the dashed lines connecting the functional blocks represent the flow of control signals or communication information. The communication shown by the dashed lines can be wired or wireless. Additionally, the solid lines protruding from each functional block represent beam-shaped electromagnetic waves.

[0034] The electromagnetic wave detection device 10 includes: a front optical system 15, a switching unit 16, a first rear optical system 17, a second rear optical system 18, a first detection unit 19, and a second detection unit 20.

[0035] The front optical system 15 includes, for example, at least one of a lens and a mirror, to image the object ob, which is the subject being photographed.

[0036] The switching unit 16 only needs to be located at or near a primary imaging position, which is the imaging position of an image of an object ob located away from a predetermined position by the front optical system 15. In the first embodiment, the switching unit 16 is located at this primary imaging position. The switching unit 16 has an action surface as on which electromagnetic waves passing through the front optical system 15 are incident. The action surface as is composed of a plurality of pixels px arranged in a two-dimensional pattern. The action surface as is a surface that causes electromagnetic waves to have effects such as reflection and transmission in at least one of the first and second states described later.

[0037] The switching unit 16 can switch each pixel px to a first state and a second state. The first state causes electromagnetic waves incident on the action surface as to travel along a first direction d1, and the second state causes electromagnetic waves incident on the action surface as to travel along a second direction d2. In the first embodiment, the first state is a first reflection state that reflects electromagnetic waves incident on the action surface as along the first direction d1. The second state is a second reflection state that reflects electromagnetic waves incident on the action surface as along the second direction d2.

[0038] In the first embodiment, more specifically, the switching unit 16 includes a reflective surface for reflecting electromagnetic waves on each pixel px. The switching unit 16 switches each pixel px to a first reflection state and a second reflection state by changing the direction of the reflective surface of each pixel px. In the first embodiment, the switching unit 16 includes, for example, a DMD (Digital Micromirror Device). The DMD drives the tiny reflective surface constituting the operating surface as, enabling each pixel px to switch the reflective surface to a state tilted at +12° or -12° relative to the operating surface as. It should be noted that the operating surface as is parallel to the surface of the substrate in the DMD on which the tiny reflective surface is mounted.

[0039] The switching unit 16, based on the control of the control unit 14 (described later), switches between a first state and a second state for each pixel px. For example, as... Figure 2 As shown, the switching unit 16 simultaneously switches a portion of pixels px1 to a first state, thereby enabling electromagnetic waves incident on pixel px1 to travel along a first direction d1, and switches another portion of pixels px2 to a second state, thereby enabling electromagnetic waves incident on pixel px2 to travel along a second direction d2. Furthermore, by switching the same pixel px from a first state to a second state, the switching unit 16 enables electromagnetic waves incident on pixel px to travel along a second direction d2 after the first direction d1.

[0040] like Figure 1As shown, a first rear optical system 17 is disposed in a first direction d1 from the switching unit 16. The first rear optical system 17 includes at least one of, for example, a lens and a mirror. The first rear optical system 17 images an object ob, which is an electromagnetic wave whose direction of travel has been switched in the switching unit 16.

[0041] The second rear optical system 18 is provided in the second direction d2 from the switching unit 16. The second rear optical system 18 includes at least one, such as a lens and a mirror. The second rear optical system 18 images an object ob, which is an electromagnetic wave whose direction of travel has been switched in the switching unit 16.

[0042] The first detection unit 19 is disposed on the path of the electromagnetic wave that travels along the first direction d1 after passing through the switching unit 16 and then through the first rear optical system 17. The first detection unit 19 detects the electromagnetic wave that travels through the first rear optical system 17, that is, it detects the electromagnetic wave that travels along the first direction d1.

[0043] In the first embodiment, the first detection unit 19 is a passive sensor. More specifically, in the first embodiment, the first detection unit 19 includes an array of elements. For example, the first detection unit 19 includes an image sensor or imaging array, etc., which captures an image of electromagnetic waves imaged on the detection surface and generates image information corresponding to the captured object ob. It should be noted that, more specifically, in the first embodiment, the first detection unit 19 captures an image of visible light. In the first embodiment, the first detection unit 19 sends the generated image information as a signal to the control unit 14.

[0044] It should be noted that the first detection unit 19 can capture images other than visible light, such as infrared images. Furthermore, the first detection unit 19 may include a temperature sensor. In this configuration, the electromagnetic wave detection device 10 can acquire temperature information through the first detection unit 19.

[0045] Thus, in the first embodiment, the first detection unit 19 includes an array of elements. Therefore, in the first embodiment, if the incident electromagnetic wave images on the detection surface, the first detection unit 19 can improve the resolution because the imaging electromagnetic wave is incident on each element. Therefore, the first detection unit 19 only needs to be set at the secondary imaging position of the imaging position of the first rear optical system 17.

[0046] The second detection unit 20 is positioned on the path of the electromagnetic wave that travels along the second direction d2 after passing through the switching unit 16 and then through the second rear optical system 18. The second detection unit 20 detects the electromagnetic wave after passing through the second rear optical system 18, that is, it detects the electromagnetic wave traveling along the second direction d2.

[0047] In the first embodiment, the second detection unit 20 is an active sensor that detects the reflected wave from the object ob of the electromagnetic wave irradiated by the irradiation unit 12. It should be noted that in the first embodiment, the second detection unit 20 detects the reflected wave from the object ob of the electromagnetic wave irradiated by the irradiation unit 12 and reflected by the reflection unit 13. As will be described later, the electromagnetic wave irradiated by the irradiation unit 12 is infrared radiation, and the second detection unit 20 detects a different type of electromagnetic wave than the first detection unit 19.

[0048] In the first embodiment, more specifically, the second detection unit 20 includes elements constituting a ranging sensor. For example, the second detection unit 20 may include a single element such as an APD (Avalanche Photo Diode), a PD (Photo Diode), or a ranging image sensor. Alternatively, the second detection unit 20 may include an array of elements such as an APD array, a PD array, a ranging imaging array, and a ranging image sensor. In the first embodiment, the second detection unit 20 sends detection information indicating the detection of reflected waves from the subject to the control unit 14 as a signal. More specifically, the second detection unit 20 detects electromagnetic waves in the infrared band.

[0049] It should be noted that in the structure where the second detection unit 20 is a single element constituting the ranging sensor, it is sufficient to detect electromagnetic waves; imaging on the detection surface is not required. Therefore, the second detection unit 20 does not need to be located at the secondary imaging position of the imaging position of the second rear optical system 18. That is, in this structure, as long as electromagnetic waves from all viewing angles can be incident on the detection surface, the second detection unit 20 can be positioned at any position on the path of the electromagnetic wave that travels along the second direction d2 via the switching unit 16 and then through the second rear optical system 18.

[0050] The irradiation unit 12 emits at least one of infrared rays, visible light, ultraviolet rays, and radio waves. In the first embodiment, the irradiation unit 12 emits infrared rays. The irradiation unit 12 irradiates the object ob directly or indirectly via the reflector 13. In the first embodiment, the irradiation unit 12 irradiates the object ob indirectly via the reflector 13.

[0051] In the first embodiment, the irradiation unit 12 emits a narrow beam of electromagnetic waves, for example, 0.5°. Furthermore, in the first embodiment, the irradiation unit 12 can emit electromagnetic waves in a pulsed manner. For example, the irradiation unit 12 includes LEDs (Light Emitting Diodes) and LDs (Laser Diodes). The irradiation unit 12 switches between emitting and stopping the electromagnetic waves based on the control of the control unit 14, which will be described later.

[0052] The reflector 13 changes the direction of the electromagnetic waves emitted from the irradiation unit 12 and reflects them, thereby changing the irradiation position of the electromagnetic waves irradiating the object ob. That is, the reflector 13 scans the object ob using the electromagnetic waves emitted from the irradiation unit 12. Therefore, in the first embodiment, the second detection unit 20 and the reflector 13 cooperate to form a scanning range sensor. It should be noted that the reflector 13 scans the object ob along a one-dimensional or two-dimensional direction. In the first embodiment, the reflector 13 scans the object ob along a two-dimensional direction.

[0053] The reflector 13 is configured such that at least a portion of the irradiation area of ​​the electromagnetic waves emitted and reflected from the irradiation unit 12 is included within the electromagnetic wave detection range of the electromagnetic wave detection device 10. Therefore, at least a portion of the electromagnetic waves irradiated onto the object ob via the reflector 13 can be detected in the electromagnetic wave detection device 10.

[0054] It should be noted that, in the first embodiment, the reflector 13 is configured such that at least a portion of the irradiation area of ​​the electromagnetic waves emitted from the irradiation unit 12 and reflected by the reflector 13 is included within the detection range of the second detection unit 20. Therefore, in the first embodiment, the second detection unit 20 can detect at least a portion of the electromagnetic waves irradiated onto the object ob via the reflector 13.

[0055] The reflective portion 13 includes, for example, a MEMS (Micro Electro Mechanical Systems) mirror, a prism, and a current mirror. In the first embodiment, the reflective portion 13 includes a MEMS mirror.

[0056] The reflector 13, under the control of the control unit 14 (described later), can change the direction of the reflected electromagnetic wave. Furthermore, the reflector 13 may include an angle sensor, such as an encoder, which can transmit the angle detected by the angle sensor as direction information of the reflected electromagnetic wave to the control unit 14. In this configuration, the control unit 14 can calculate the illumination position based on the direction information obtained from the reflector 13. Additionally, the control unit 14 can calculate the illumination position based on a drive signal input to cause the reflector 13 to change the direction of the reflected electromagnetic wave.

[0057] The control unit 14 includes one or more processors and memory. The processor may include at least one of a general-purpose processor that reads a specific program and performs a specific function, and a dedicated processor that performs specific processing. The dedicated processor may include an Application Specific Integrated Circuit (ASIC). The processor may include a Programmable Logic Device (PLD). The PLD may include a Field-Programmable Gate Array (FPGA). The control unit 14 may include at least one of a System-on-a-Chip (SoC) and a System-in-a-Package (SiP) in which one or more processors operate in coordination.

[0058] The control unit 14 acquires information related to the surroundings of the electromagnetic wave detection device 10 based on the electromagnetic waves detected by the first detection unit 19 and the second detection unit 20. This surroundings-related information includes, for example, image information, distance information, and temperature information. In the first embodiment, as described above, the control unit 14 acquires the electromagnetic waves detected by the first detection unit 19 as image information. Furthermore, in the first embodiment, the control unit 14 acquires distance information of the irradiated position illuminated by the irradiation unit 12 based on the detection information detected by the second detection unit 20, using a Time-of-Flight (ToF) method, as described below.

[0059] like Figure 3 As shown, the control unit 14 inputs an electromagnetic wave emission signal to the irradiation unit 12, causing the irradiation unit 12 to emit pulsed electromagnetic waves (see the "Electromagnetic Wave Emission Signal" column). The irradiation unit 12 irradiates the electromagnetic waves based on the input electromagnetic wave emission signal (see the "Irradiation Unit Emission Amount" column). The electromagnetic waves emitted by the irradiation unit 12 and reflected by the reflection unit 13, irradiating any irradiation area, are reflected in the irradiation area. Then, when the reflected electromagnetic waves in the irradiation area are detected (see the "Electromagnetic Wave Detection Amount" column), as described above, the second detection unit 20 notifies the control unit 14 of the detection information.

[0060] The control unit 14 includes, for example, a large-scale integrated circuit (LSI) for measuring time, ΔT, from the moment T1 when the irradiation unit 12 emits electromagnetic waves to the moment T2 when detection information is acquired (see the "Detection Information Acquisition" column). The control unit 14 calculates the distance to the irradiation position by multiplying the speed of light by this time ΔT and dividing by 2. It should be noted that, as described above, the control unit 14 calculates the irradiation position based on the direction information acquired from the reflector 13 or the drive signal output to the reflector 13 itself. The control unit 14 changes the irradiation position and calculates the distance to each irradiation position, thereby creating distance information in the image information acquired from the first detection unit 19.

[0061] It should be noted that, in this embodiment, as Figure 3 As shown, the information acquisition system 11 uses a Direct Time-of-Flight (ToF) structure to create distance information by directly measuring the time to return from irradiating a laser. However, the information acquisition system 11 is not limited to this structure. For example, the information acquisition system 11 can create distance information using a Flash Time-of-Flight (ToF) structure, which indirectly measures the time to return from the phase difference between the irradiated and returned electromagnetic waves by irradiating electromagnetic waves at a certain period. Alternatively, the information acquisition system 11 can also create distance information using other ToF methods, such as Phased ToF.

[0062] Furthermore, the control unit 14 controls the illumination unit 12, the reflection unit 13, the switching unit 16, the first detection unit 19, and the second detection unit 20 to repeatedly acquire image information and distance information. The following uses... Figure 4 The timing diagram illustrates the control of various parts used to repeatedly acquire image and distance information.

[0063] At time t1, the control unit 14 causes the first detection unit 19 to begin electromagnetic wave detection for generating image information of the first frame. It should be noted that at time t1, all pixels (px) of the switching unit 16 are in the first state, and the electromagnetic waves incident on the front optical system 15 reach the first detection unit 19 (see reference). Figure 5 Additionally, such as Figure 4 As shown, at time t1, the control unit 14 causes the first pixel px in the switching unit 16 to start switching from the first state to the second state (refer to the "Switching Unit First Pixel Drive Signal" column). It should be noted that at time t1, all other pixels px remain in the first state (refer to the "Switching Unit Second Pixel State" and "Switching Unit Nth Pixel State" columns).

[0064] At time t2 (refer to the "First Pixel State of Switching Unit" column), when the first pixel px of switching unit 16 completes its transition from the first state to the second state, control unit 14 causes illumination unit 12 to emit electromagnetic waves (refer to the "Electromagnetic Wave Emission Time" column). It should be noted that at time t2, the first pixel px of switching unit 16 transitions from the first state (refer to...) Figure 5 The electromagnetic wave, incident on the front optical system 15 and imaged in the first pixel px of the switching unit 16, travels from the first direction d1 to the second direction d2 (refer to...). Figure 6 ).

[0065] like Figure 4 As shown, at time t2, the control unit 14 causes the second detection unit 20 to detect electromagnetic waves (see the "Second Detection Unit Detection Time" column). It should be noted that the time taken from the start of electromagnetic wave irradiation by the illumination unit 12 until the waves reach the electromagnetic wave detection device 10 is extremely short compared to the detection time used to generate image information, for example, on the order of nanoseconds. Therefore, the detection of electromagnetic waves by the second detection unit 20 ends within a tiny timeframe considered to be time t2. Based on the detection information acquired at time t2, the control unit 14 obtains distance information by calculating the distance information between the irradiation position corresponding to the first pixel px of the switching unit 16.

[0066] Furthermore, at time t2, the control unit 14 causes the first pixel px of the switching unit 16 to start switching from the second state to the first state (refer to the "Switching Unit First Pixel Drive Signal" column). In this way, since the first pixel px of the switching unit 16 is switched from the second state to the first state, the control unit 14 can again cause the element in the first detection unit 19 corresponding to the first pixel px to detect electromagnetic waves (visible light).

[0067] At time t3 (refer to the "First Pixel State of Switching Unit" column), after the first pixel px of switching unit 16 completes its transition from the second state to the first state, control unit 14 causes the second pixel px of switching unit 16 to begin transitioning from the first state to the second state (refer to the "Second Pixel Drive Signal of Switching Unit" column). It should be noted that at time t3, all other pixels px remain in the first state (refer to the "First Pixel State of Switching Unit" and "Nth Pixel State of Switching Unit" columns).

[0068] At time t4 (refer to the "Second Pixel State of Switching Unit" column), after the second pixel px of switching unit 16 completes its transition from the first state to the second state, control unit 14 causes illumination unit 12 to emit electromagnetic waves (refer to the "Electromagnetic Wave Emission Time" column). It should be noted that at time t4, as the second pixel px of switching unit 16 transitions from the first state to the second state, the electromagnetic waves incident on the front optical system 15 and imaged in the second pixel px of switching unit 16 travel in the first direction d1 and then in the second direction d2. Additionally, at time t4, control unit 14 causes second detection unit 20 to detect the electromagnetic waves (refer to the "Second Detection Time" column). Based on the detection information acquired at time t4, control unit 14 obtains distance information by calculating the distance information to the illumination position corresponding to the second pixel px of switching unit 16.

[0069] Furthermore, at time t4, the control unit 14 causes the second pixel px of the switching unit 16 to start switching from the second state to the first state (refer to the "Second Pixel Drive Signal of Switching Unit" column). In this way, since the second pixel px of the switching unit 16 is switched from the second state to the first state, the control unit 14 can again cause the element of the first detection unit 19 corresponding to the second pixel px to detect electromagnetic waves (visible light).

[0070] Subsequently, in the switching unit 16, from the third pixel px to the Nth pixel px, the control unit 14 sequentially switches from the first state to the second state and from the second state to the first state in the same manner as the first pixel px, in order to acquire the image information of the first frame and at the same time acquire the distance information of the illumination position corresponding to each pixel px.

[0071] It should be noted that, as described above, in the structure where the control unit 14 executes control to start the transition of the Mth pixel px from the first state to the second state at the moment when the (M-1)th pixel px completes its transition from the second state, the time T used to generate image information for one frame is... img In the middle, the switching unit 16 can switch T img / T dis The number of pixels (px) switches from the first state to the second state. That is, the control unit 14 can switch at time T. img Internal generation T img / T dis Distance information in pixels (px). It should be noted that M is an integer satisfying 2 ≤ M ≤ N. Additionally, T... dis It is the total time taken to switch the pixel px of the switching unit 16 from the first state to the second state, plus the time taken to return from the second state to the first state. That is, T dis It is the time required for any pixel px to switch between the first state, the second state, and the first state in that order. In the first embodiment, for example, Timg It's 1 / 60 of a second, T dis It is 1 / 3000 of a second.

[0072] In T img / T dis In a structure where the number of pixels is less than the number of pixels in the switching unit 16, the control unit 14 operates at time T. img The control unit 14 cannot switch all pixels (px) in the switching unit 16. Therefore, during the generation of one frame of image information, the control unit 14 cannot generate distance information corresponding to that one frame of image information. That is, during the generation of one frame of image information, the control unit 14 can only generate distance information corresponding to frames with image information shorter than one frame (e.g., 0.5 frames).

[0073] Therefore, in T img / T dis In structures where the value is less than the number of pixels in the switching unit 16, the control unit 14 selects T from all pixels (px) in the switching unit 16. img / T dis The number of pixels (px) less than a certain number are selected as the switching targets. Furthermore, the control unit 14 controls the reflection unit 13 to irradiate the area within the irradiation region corresponding to each selected pixel (px) into the second state at the moment when the selected pixel (px) is switched to the second state.

[0074] Or, in T img / T dis In a structure where the number of pixels is less than that of the switching unit 16, the control unit 14 can control the time P×T used to generate image information for multiple frames (P frames: P is a positive number satisfying P>1). img In the process, the switching of all pixels px in the switching unit 16 is completed. Further, the control unit 14 controls the reflection unit 13 to irradiate the area within the irradiation area corresponding to each pixel px at the switching moment of the switching unit 16.

[0075] Or, in T img / T dis In structures where the number of pixels in the switching unit 16 is less than the number of pixels in the switching unit 16, the control unit 14 divides all the pixels (px) in the switching unit 16 into T. img / T dis For groups of less than a certain number, the pixels px are switched together for each group. Furthermore, the control unit 14 can control the reflective unit 13 to irradiate the area within the irradiation region corresponding to the pixel px at the switching moment of the pixel px representing the position of each group (e.g., the center position of each group).

[0076] Or, in T img / T disIn structures where the number of pixels in the switching unit 16 is less than the number of pixels in the switching unit 16, the control unit 14 divides all the pixels (px) in the switching unit 16 into T. img / T dis For groups with a quantity less than a certain number, only one pixel (px) is switched for each group. Furthermore, the control unit 14 can control the reflective unit 13 to irradiate the area within the irradiation region corresponding to the switched pixel (px) with electromagnetic waves at the switching moment of the switched pixel (px).

[0077] It should be noted that during the time it takes to capture one frame of an image, the pixel in the first detection unit 19 corresponding to the pixel px of the switching unit 16 that switches to the second state cannot receive light during the period when that pixel px is switched to the second state. Therefore, the signal strength of that pixel in the first detection unit 19 decreases. Therefore, the control unit 14 can compensate for the decreased signal strength by multiplying the gain by the signal value of that pixel in the first detection unit 19. It should be noted that the time it takes to capture one frame of an image is equivalent to the time it takes for the first detection unit 19 to detect electromagnetic waves to generate one frame of image information.

[0078] It should be noted that the scanning speed performed by the reflective part 13 is faster than the switching speed of pixels (px), that is, in T... scn T dis In a shorter structure, before the (M-1)th pixel px completes its transition from the second state to the first state, the control unit 14 can cause the Mth pixel px to begin transitioning from the first state to the second state. It should be noted that T... scn This refers to the time required for the illumination position of the electromagnetic wave emitted from the illumination unit 12 and reflected by the reflection unit 13 to change from one illumination position to the next, or the time required to change from one illumination position to an adjacent illumination position. Compared to controlling other pixels to switch to the second state after any pixel px has switched from the second state to the first state, this structure can generate distance information for more pixels in a shorter time.

[0079] like Figure 4 As shown, from time t1, the time T used to generate the image information of the first frame... img At time t5 (refer to the "Detection Time of the First Detection Unit" column), the control unit 14 begins electromagnetic wave detection to generate the second frame of image information. Furthermore, after the electromagnetic wave detection by the first detection unit 19 ends between time t1 and t5, the control unit 14 acquires the image information of the first frame based on the electromagnetic waves detected during this period. Thereafter, the control unit 14 controls the illumination unit 12, the reflection unit 13, the switching unit 16, the first detection unit 19, and the second detection unit 20 in the same manner as the control performed between time t1 and t5 to acquire image information and distance information.

[0080] The electromagnetic wave detection device 10 of the first embodiment with such a structure can switch each pixel px disposed on the working surface as of the switching unit 16 between a first state and a second state. With this structure, the electromagnetic wave detection device 10 of the first embodiment can align the optical axis of the front optical system 15 with the optical axis of the first rear optical system 17 in the first direction d1 of electromagnetic wave propagation in the first state, and with the optical axis of the second rear optical system 18 in the second direction d2 of electromagnetic wave propagation in the second state. Therefore, by switching the pixel px of the switching unit 16 to either the first state or the second state, the electromagnetic wave detection device 10 of the first embodiment can reduce the deviation of the optical axes of the first detection unit 19 and the second detection unit 20. Thus, the electromagnetic wave detection device 10 of the first embodiment can reduce the deviation of the detection axes in the first detection unit 19 and the second detection unit 20. Therefore, the electromagnetic wave detection device 10 of the first embodiment can reduce the deviation of the coordinate system in the detection results detected by the first detection unit 19 and the second detection unit 20. It should be noted that this structure and effect are the same as those of the electromagnetic wave detection device 100 of the second embodiment and the electromagnetic wave detection device 101 of the third embodiment described later.

[0081] Furthermore, the electromagnetic wave detection device 10 of the first embodiment can switch a portion of the pixels (px) of the switching unit 16 to a first state and switch another portion of the pixels (px) to a second state. Therefore, the electromagnetic wave detection device 10 of the first embodiment can enable the first detection unit 19 to detect electromagnetic waves in a portion of the pixels (px), while the second detection unit 20 simultaneously detects electromagnetic waves in another portion of the pixels (px). Thus, the electromagnetic wave detection device 10 of the first embodiment can simultaneously acquire information related to different regions. It should be noted that this structure and effect are the same as those of the electromagnetic wave detection device 100 of the second embodiment and the electromagnetic wave detection device 101 of the third embodiment, which will be described later.

[0082] Furthermore, the electromagnetic wave detection device 10 of the first embodiment can switch the same pixel px in the switching unit 16 from a first state to a second state. In this structure, when the pixel px in the switching unit 16 is in the first state, electromagnetic waves can be detected by the first detection unit 19, and then when the pixel px is in the second state, electromagnetic waves can be detected by the second detection unit 20. Therefore, the electromagnetic wave detection device 10 of the first embodiment can reduce the deviation in the detection time of electromagnetic waves by the first detection unit 19 and the second detection unit 20 caused by the same pixel px in the switching unit 16. As a result, the electromagnetic wave detection device 10 of the first embodiment can reduce the deviation in the acquisition time of information related to the same area. It should be noted that this structure and effect are the same as those of the electromagnetic wave detection device 100 of the second embodiment and the electromagnetic wave detection device 101 of the third embodiment, which will be described later.

[0083] Furthermore, the information acquisition system 11 of the first embodiment includes an illumination unit 12. Therefore, by irradiating the object ob with electromagnetic waves, the information acquisition system 11 of the first embodiment enables the second detection unit 20 to function as an active sensor. Additionally, the information acquisition system 11 of the first embodiment enables the first detection unit 19 to function as a passive sensor. In this configuration, the electromagnetic wave detection device 10 of the first embodiment allows both the active and passive sensors to acquire information related to the same area by switching at least one of the pixels px in the switching unit 16 from a first state to a second state. Furthermore, in this configuration, the electromagnetic wave detection device 10 of the first embodiment can divide the area where the active sensor acquires information and the area where the passive sensor acquires information by switching a portion of the pixels px in the switching unit 16 to the first state and another portion of the pixels px to the second state.

[0084] Furthermore, the information acquisition system 11 of the first embodiment includes a reflective section 13. With this structure, the information acquisition system 11 can scan the object ob using electromagnetic waves emitted by the irradiation section 12. That is, the information acquisition system 11 of the first embodiment enables the second detection section 20 to cooperate with the reflective section 13, functioning as a scanning active sensor. Therefore, the information acquisition system 11 of the first embodiment can acquire information from the second detection section 20 based on its position in a one-dimensional or two-dimensional direction.

[0085] The electromagnetic wave detection apparatus according to the second embodiment of this disclosure will now be described. In the second embodiment, the absence of a reflective part and an irradiation part, as well as the structure and function of the second detection part, differ from those of the first embodiment. Hereinafter, the second embodiment will be described focusing on the differences from the first embodiment. It should be noted that parts having the same structure as those in the first embodiment are given the same reference numerals.

[0086] like Figure 7 As shown, the information acquisition system 110 including the electromagnetic wave detection device 100 of the second embodiment is configured to include the electromagnetic wave detection device 100 and the control unit 14.

[0087] The electromagnetic wave detection device 100, like the first embodiment, includes a front-end optical system 15, a switching unit 16, a first rear-end optical system 17, a second rear-end optical system 18, a first detection unit 19, and a second detection unit 200. In the second embodiment, the structure and function of the front-end optical system 15, the switching unit 16, the first rear-end optical system 17, the second rear-end optical system 18, and the first detection unit 19 are the same as in the first embodiment.

[0088] Similar to the first embodiment, the second detection unit 200 is positioned on the path of the electromagnetic wave that travels along the second direction d2 after passing through the switching unit 16 and then through the second rear optical system 18. Furthermore, similar to the first embodiment, the second detection unit 200 detects the electromagnetic wave traveling through the second rear optical system 18, that is, it detects the electromagnetic wave traveling along the second direction d2.

[0089] In the second embodiment, the second detection unit 200 has the same structure and function as the first detection unit 19, and captures images of the same type of electromagnetic waves as the first detection unit 19. Therefore, in the second embodiment, the second detection unit 200, like the first detection unit 19, can be located at or near the secondary imaging position, which is the imaging position of the second rear optical system 18 for the image that is imaged by the front optical system 15 at or near the switching unit 16 and travels along the second direction d2.

[0090] Similar to the first embodiment, the control unit 14 acquires information related to the surroundings of the electromagnetic wave detection device 100 based on the electromagnetic waves detected by the first detection unit 19 and the second detection unit 200, respectively. In the second embodiment, as described above, the control unit 14 acquires the electromagnetic waves detected by the first detection unit 19 and the second detection unit 200 as image information.

[0091] The control unit 14 controls the switching unit 16, the first detection unit 19, and the second detection unit 200, and alternately and repeatedly acquires image information from the first detection unit 19 and the second detection unit 200. (The following uses...) Figure 8 The timing diagram illustrates the control of each part used to alternately and repeatedly acquire image information.

[0092] At the moment t6 when all pixels px of the switching unit 16 have switched to the first state (refer to the columns "first pixel state of the switching unit", "second pixel state of the switching unit", "Nth pixel state of the switching unit"), the control unit 14 starts the first detection unit 19 to perform electromagnetic wave detection for generating the first frame image information.

[0093] At t7 (refer to the "Detection Time of First Detection Unit" column), after the detection time of the electromagnetic wave used to generate one frame of image information has elapsed from time t6, the control unit 14 causes all pixels px of the switching unit 16 to start switching from the first state to the second state (refer to the "First Pixel Drive Signal of Switching Unit", "Second Pixel Drive Signal of Switching Unit", "Nth Pixel Drive Signal of Switching Unit" columns).

[0094] At time t8 (refer to the columns “Switch Unit First Pixel State”, “Switch Unit Second Pixel State”, “Switch Unit Nth Pixel State”) when all pixels px of the switching unit 16 have switched to the second state, the control unit 14 causes the second detection unit 200 to start electromagnetic wave detection for generating second frame image information, and at the same time starts acquiring first frame image information based on the electromagnetic waves detected by the first detection unit 19 between time t6 and t7.

[0095] At t9 (refer to the "Detection Time of Second Detection Unit" column), after the detection time of the electromagnetic wave used to generate the second frame image information has elapsed from time t8, the control unit 14 causes all pixels px of the switching unit 16 to start switching from the second state to the first state (refer to the "First Pixel Drive Signal of Switching Unit", "Second Pixel Drive Signal of Switching Unit", "Nth Pixel Drive Signal of Switching Unit" columns).

[0096] At time t10 (refer to the columns "First Pixel State of Switching Unit", "Second Pixel State of Switching Unit", and "Nth Pixel State of Switching Unit"), after all pixels (px) of the switching unit 16 have switched to the first state, the control unit 14 causes the first detection unit 19 to begin electromagnetic wave detection for generating the third frame image information, and simultaneously begins acquiring the second frame image information based on the electromagnetic waves detected by the second detection unit 200 between time t8 and t9. Afterwards, the control unit 14 controls the switching unit 16, the first detection unit 19, and the second detection unit 200 for acquiring image information in the same manner as the control performed between time t6 and t10.

[0097] As described above, in the electromagnetic wave detection apparatus 100 of the second embodiment, it is possible to output image information based on the electromagnetic wave detected by the first detection unit 19 during the process of the second detection unit 200 detecting electromagnetic waves, or it is possible to output image information based on the electromagnetic wave detected by the second detection unit 200 during the process of the first detection unit 19 detecting electromagnetic waves. Therefore, the electromagnetic wave detection apparatus 100 of the second embodiment can double the frame rate of the apparatus as a whole from the frame rate of the first detection unit 19 and the second detection unit 200 itself.

[0098] It should be noted that, as described above, in the control where information from one of the first detection unit 19 and the second detection unit 200 is output while the other is detecting electromagnetic waves, the time to detect one frame of image is shorter than when detecting individually at the frame rate of either the first detection unit 19 or the second detection unit 200. Therefore, the amount of light received by each pixel in the first detection unit 19 and the second detection unit 200 is lower than when detecting individually at their own frame rates, resulting in a decrease in signal strength. Therefore, the control unit 14 can compensate for the reduced signal strength by multiplying the signal value of each pixel in the first detection unit 19 and the second detection unit 200 by a gain.

[0099] Next, the electromagnetic wave detection apparatus according to the third embodiment of this disclosure will be described. In the third embodiment, the presence of multiple irradiation sections, as well as the structure and function of the first detection section, differ from those in the first embodiment. The third embodiment will be described below focusing on the differences from the first embodiment. It should be noted that parts having the same structure as those in the first embodiment are given the same reference numerals.

[0100] like Figure 9 As shown, the information acquisition system 111, including the electromagnetic wave detection device 101 of the third embodiment, is configured to include the electromagnetic wave detection device 101, a first irradiation unit 211, a second irradiation unit 221, a first mirror 231, a second mirror 241, a reflector 13, and a control unit 14. In the third embodiment, the structure and function of the reflector 13 are similar to those of the first embodiment. The difference between the third embodiment and the first embodiment is that the reflector 13 reflects electromagnetic waves emitted from the first irradiation unit 211 and the second irradiation unit 221.

[0101] Furthermore, in the third embodiment, the functions of the first detection unit 191, the reflector 13, and the control unit 14 are similar to those in the first embodiment. The difference in the third embodiment is that the first detection unit 191 detects the reflected wave from the object ob after being irradiated by the first irradiation unit 211 and reflected by the reflector 13. That is, in the third embodiment, the first detection unit 191 and the reflector 13 cooperate to form a scanning active sensor.

[0102] The electromagnetic wave detection device 101, like in the first embodiment, includes a front-end optical system 15, a switching unit 16, a first rear-end optical system 17, a second rear-end optical system 18, a first detection unit 191, and a second detection unit 20. In the third embodiment, the structure and function of the front-end optical system 15, the switching unit 16, the first rear-end optical system 17, the second rear-end optical system 18, and the second detection unit 20 are the same as in the first embodiment.

[0103] In the third embodiment, the first irradiation unit 211 emits electromagnetic waves of a different type than those of the second irradiation unit 221. More specifically, in the third embodiment, the first irradiation unit 211 emits visible light. Furthermore, the first irradiation unit 211 emits a narrow beam of electromagnetic waves, for example, 0.5°. Additionally, the first irradiation unit 211 emits electromagnetic waves in a pulsed or continuous manner. For example, the first irradiation unit 211 is an LED or LD. The first irradiation unit 211 switches between emitting and stopping electromagnetic waves under the control of the control unit 14, which will be described later.

[0104] In the third embodiment, the second irradiation unit 221 is the same as the irradiation unit 12 in the first embodiment, and emits infrared rays.

[0105] The first mirror 231 is positioned in the direction in which the first irradiation unit 211 emits electromagnetic waves. The first mirror 231 reflects the electromagnetic waves emitted by the first irradiation unit 211.

[0106] The second mirror 241 is positioned in the emission direction of the electromagnetic waves emitted by the second irradiation unit 221, and in the reflection direction of the electromagnetic waves emitted by the first irradiation unit 211 reflected by the first mirror 231. The second mirror 241 reflects the electromagnetic waves emitted by the first irradiation unit 211 and reflected by the first mirror 231, allowing the electromagnetic waves emitted by the second irradiation unit 221 to pass through. The second mirror 241 is implemented using a half-mirror and a dichroic mirror, etc.

[0107] The first irradiation unit 211, the second irradiation unit 221, the first mirror 231, and the second mirror 241 can be configured such that the beam-shaped electromagnetic wave emitted by the first irradiation unit 211 reflected by the second mirror 241 coincides with or does not coincide with the beam-shaped electromagnetic wave emitted by the second irradiation unit 221 transmitted through the second mirror 241. In the third embodiment, the first irradiation unit 211, the second irradiation unit 221, the first mirror 231, and the second mirror 241 are configured such that the beam-shaped electromagnetic wave emitted by the first irradiation unit 211 reflected by the second mirror 241 coincides with the beam-shaped electromagnetic wave emitted by the second irradiation unit 221 transmitted through the second mirror 241.

[0108] As described above, the electromagnetic wave detection device 101 of the third embodiment can simultaneously scan the same area using electromagnetic waves irradiated from different irradiation units by having the reflector 13 scan the beam-shaped electromagnetic waves emitted from the first irradiation unit 211 and the second irradiation unit 221.

[0109] Although the invention has been described with reference to the accompanying drawings and embodiments, it should be noted that those skilled in the art can readily make various modifications and variations based on this disclosure. Therefore, it should be understood that such modifications and variations are included within the scope of the invention.

[0110] For example, in the first embodiment, although the irradiation unit 12, the reflection unit 13, and the control unit 14 together with the electromagnetic wave detection device 10 constitute the information acquisition system 11, the electromagnetic wave detection device 10 may also be configured to include at least one of these components. Similarly, in the second embodiment, although the control unit 14 together with the electromagnetic wave detection device 100 constitutes the information acquisition system 110, the electromagnetic wave detection device 100 may also include the control unit 14. Furthermore, similarly, in the third embodiment, although the first irradiation unit 211, the second irradiation unit 221, the first mirror 231, the second mirror 241, the reflection unit 13, and the control unit 14 together with the electromagnetic wave detection device 101 constitute the information acquisition system 111, the electromagnetic wave detection device 101 may also be configured to include at least one of these components.

[0111] Furthermore, in the first embodiment to the third embodiment, although the switching unit 16 can switch the direction of travel of the electromagnetic wave incident on the action surface as to two directions, namely the first direction d1 and the second direction d2, it may not switch to either of the two directions, but may switch to three or more directions.

[0112] Furthermore, in the switching unit 16 from the first embodiment to the third embodiment, the first state and the second state are respectively the first reflection state of the electromagnetic wave reflected along the first direction d1 and incident on the action surface as, and the second reflection state of the electromagnetic wave reflected along the second direction d2 and incident on the action surface as, but other methods may also be used.

[0113] For example, the second state can be a transmission state in which electromagnetic waves incident on the action surface as pass through and travel along the second direction d2. More specifically, the switching unit 16 may include an on / off switch with a reflective surface that reflects electromagnetic waves in each pixel px. In a switching unit 16 with such a structure, by opening and closing the on / off switch of each pixel px, it is possible to switch each pixel px between a first reflection state and a transmission state that is a second reflection state. Examples of switching units 16 with such a structure include, for example, switching units that include MEMS on / off switches arranged in an array of multiple on / off switches. In addition, examples of switching units 16 include switching units that include liquid crystal on / off switches that can switch between a reflection state that reflects electromagnetic waves and a transmission state that transmits electromagnetic waves based on liquid crystal orientation. In a switching unit 16 with such a structure, by switching the liquid crystal orientation of each pixel px, it is possible to switch each pixel px between a reflection state that is a first state and a transmission state that is a second state.

[0114] Furthermore, in the first embodiment, the information acquisition system 11 has a structure in which the second detection unit 20 works in conjunction with the reflector 13 to function as a scanning active sensor by having the reflector 13 scan the beam-shaped electromagnetic waves emitted from the irradiation unit 12. However, the information acquisition system 11 is not limited to such a structure. For example, even if the information acquisition system 11 does not have the reflector 13, but emits radial electromagnetic waves from the irradiation unit 12 and acquires information without scanning, it can still achieve similar effects to the first embodiment.

[0115] Furthermore, in the first embodiment, the information acquisition system 11 has a structure where the first detection unit 19 is a passive sensor and the second detection unit 20 is an active sensor. However, the information acquisition system 11 is not limited to this structure. For example, even if both the first detection unit 19 and the second detection unit 20 are active sensors or both are passive sensors, the information acquisition system 11 can achieve similar effects to the first embodiment.

[0116] Furthermore, in the second embodiment, the electromagnetic wave detection device 100 has a structure in which the first detection unit 19 and the second detection unit 200 capture images of the same type of electromagnetic wave. However, the electromagnetic wave detection device 100 is not limited to this structure. For example, even if the electromagnetic wave detection device 100 has a structure in which the first detection unit 19 and the second detection unit 200 detect different types of electromagnetic waves, it can still achieve similar effects to the second embodiment.

[0117] Furthermore, in the second embodiment, the electromagnetic wave detection device 100 has a structure where both the first detection unit 19 and the second detection unit 200 are passive sensors. However, the electromagnetic wave detection device 100 is not limited to this structure. For example, even if one of the first detection unit 19 and the second detection unit 200 is a passive sensor and the other is an active sensor, even if both are active sensor structures, similar effects to the second embodiment can be obtained.

[0118] Furthermore, in the third embodiment, the information acquisition system 111 has a structure in which the first detection unit 19 and the second detection unit 20 function as scanning active sensors by having the reflector 13 scan the beam-shaped electromagnetic waves emitted from the first irradiation unit 211 and the second irradiation unit 221. However, the information acquisition system 111 is not limited to this structure. For example, even if the information acquisition system 111 does not have the reflector 13, it can still achieve similar effects to the third embodiment by emitting radial electromagnetic waves from the first irradiation unit 211 and the second irradiation unit 221 to acquire image information without scanning.

[0119] Furthermore, in the third embodiment, the information acquisition system 111 has a structure in which the first detection unit 19 and the second detection unit 20 function as scanning active sensors by having the reflector 13 scan the beam-shaped electromagnetic waves emitted from the first irradiation unit 211 and the second irradiation unit 221. However, the information acquisition system 111 is not limited to such a structure. For example, even if the information acquisition system 111 acquires image information by emitting radial electromagnetic waves only from one of the first irradiation unit 211 and the second irradiation unit 221, without the other being scanned by the reflector 13, it can achieve similar effects to the third embodiment.

[0120] Furthermore, in the third embodiment, the information acquisition system 111 has a structure in which the same area is scanned by different irradiation units by having the reflector 13 scan the electromagnetic waves emitted from the first irradiation unit 211 and the second irradiation unit 221. However, the information acquisition system 111 is not limited to such a structure. For example, the information acquisition system 111 may have only one of the first irradiation unit 211 and the second irradiation unit 221, and the electromagnetic waves emitted from only that one unit are divided into multiple directions, and the reflector 13 scans the divided electromagnetic waves. With such a structure, the information acquisition system 111 can scan different areas simultaneously with a single irradiation unit.

[0121] Furthermore, in the third embodiment, the information acquisition system 111 uses a first mirror 231 and a second mirror 241 to direct electromagnetic waves emitted from the first irradiation unit 211 and the second irradiation unit 221 onto a single reflector 13, thereby changing the irradiation position on the object ob. However, the information acquisition system 111 is not limited to this structure. For example, even if the information acquisition system 111 is structured such that the electromagnetic waves emitted from the first irradiation unit 211 and the second irradiation unit 221 are respectively directed onto multiple reflectors 13, similar effects to the third embodiment can be obtained.

[0122] Furthermore, in the third embodiment, the information acquisition system 111 is a structure in which the first irradiation unit 211 and the second irradiation unit 221 emit different types of electromagnetic waves. However, the information acquisition system 111 is not limited to such a structure. For example, even if the first irradiation unit 211 and the second irradiation unit 221 emit the same type of electromagnetic waves, the information acquisition system 111 can achieve similar effects to the third embodiment.

[0123] It should be noted that this disclosure describes a system with various modules and / or units performing specific functions. These modules and units are shown schematically for the purpose of briefly illustrating their functionality and do not necessarily represent specific hardware and / or software. In this sense, these modules, units, and other components are simply hardware and / or software installed in a manner that substantially performs the specific functions described herein. The various functions of different components can be any combination or separation of hardware and / or software, and can be used individually or in any combination. Furthermore, input / output or I / O devices or user interfaces, including but not limited to keyboards, displays, touchscreens, pointing devices, etc., can be connected to the system directly or via an intermediate I / O controller. Thus, various aspects of this disclosure can be implemented in many different ways, all of which are included within the scope of this disclosure.

[0124] Explanation of symbols

[0125] Electromagnetic wave detection devices 10, 100, 101

[0126] 11, 110, 111 Information Acquisition System

[0127] 12 Irradiation Department

[0128] 13 Reflector

[0129] 14 Control Department

[0130] 15. Front-end optical system

[0131] 16 Switching Unit

[0132] 17 First Rear Optical System

[0133] 18 Second rear optical system

[0134] 19, 191 First Testing Department

[0135] 20, 200 Second Inspection Department

[0136] 211 First Irradiation Section

[0137] 221 Second Irradiation Section

[0138] 231 First Shot

[0139] 241 Second Frame

[0140] as the working surface

[0141] d1 First direction

[0142] d2 Second direction

[0143] ob object

[0144] px, px1, px2 pixels.

Claims

1. An electromagnetic wave detection device, comprising: An irradiating part that irradiates electromagnetic waves; A first detection unit having a plurality of elements for detecting electromagnetic waves; A second detection unit for detecting electromagnetic waves; The switching unit includes an electromagnetic wave, which is reflected by the electromagnetic wave irradiated by the irradiation unit at the object, and an electromagnetic wave that is incident on the working surface of the switching unit. According to each incident area of ​​the working surface, the incident electromagnetic wave is made to travel to the corresponding element in the first detection unit or the second detection unit. as well as The control unit compensates for the signal strength of the element corresponding to the incident region of the second detection unit when the incident electromagnetic wave travels to it.

2. The electromagnetic wave detection device as described in claim 1, characterized in that, The switching unit causes the electromagnetic wave incident on the reflected wave incident region in the action surface to travel to the second detection unit.

3. The electromagnetic wave detection device as described in claim 1 or 2, characterized in that, Also includes: The reflective part changes the irradiation position of the electromagnetic waves irradiating the object by reflecting the electromagnetic waves irradiated by the irradiation part in a different direction.

4. The electromagnetic wave detection device as described in claim 3, characterized in that, The working surface is configured with multiple pixels, and the electromagnetic wave incident on the working surface is directed to the first detection unit or the second detection unit according to each pixel. The control unit compensates for the signal strength of the element corresponding to the pixel of the second detection unit as the electromagnetic wave incident on the action surface travels to the second detection unit.

5. The electromagnetic wave detection device as described in claim 4, characterized in that, The pixel can switch between a first state that causes the reflected wave to travel in a first direction and a second state that causes the reflected wave to travel in a second direction. Multiple pixels that change according to the irradiation position of the electromagnetic wave after being changed by the reflector are switched to the second state, and the remaining pixels are switched to the first state, so that the reflected wave travels to the second detection unit.

6. The electromagnetic wave detection device as described in claim 1 or 2, characterized in that, The first detection unit is an image sensor, and the second detection unit is a ranging sensor.

Images