OBJECT CAPTURE SYSTEM AND OBJECT CAPTURE PROCEDURES

Abstract

Object acquisition system (100), comprising: a first main laser (111) for emitting laser light of a first wavelength and a second main laser (112) for emitting laser light of a second wavelength, wherein the first main laser (111) and the second main laser (112) alternately emit the laser light; a dummy laser (113) for emitting laser light of a third wavelength; a first light receiving element (114) that is sensitive to light of the first wavelength, wherein the first light receiving element (114) detects laser light and outputs a first received light signal which is a signal of the detected laser light; a second light receiving element (115) that is sensitive to light of the second wavelength, wherein the second light receiving element (115) detects laser light and outputs a second received light signal which is a signal of the detected laser light; an attack detection unit (121) for receiving the first emitted receive light signal and the second emitted receive light signal, determining a signal-to-noise ratio of each of the first received receive light signal and the second received receive light signal, and determining whether the first received light signal and the second received light signal were received simultaneously; and an object detection unit (131) for performing object detection when it is not determined that the first received light signal and the second received light signal were received simultaneously, wherein the object detection is performed using at least one of the first received light signal, the signal-to-noise ratio of which is determined to be good, and the second received light signal, the signal-to-noise ratio of which is determined to be good.

Description

Technical field

[0001] The present disclosure relates to object detection using lasers. Background on the state of the art

[0002] The measurement using LiDAR includes the measurement using the ToF principle.

[0003] LiDAR is an abbreviation for Light Detection and Ranging.

[0004] ToF is an abbreviation for Time of Flight.

[0005] Measurement using the ToF principle refers to a method for calculating a distance based on a time interval from the emission of the laser light until the reception of the laser light, which is reflected after striking a subject (reflected light), by a sensor.

[0006] LiDARs primarily use near-infrared light with a wavelength of 903 or 905 nanometers. A LiDAR with a wavelength of 1550 nanometers has also been developed. The longer the wavelength, the farther the measurement can reach.

[0007] In a 900-nanometer LiDAR, silicon (Si) is used as the light receiving element.

[0008] In a 1550-nanometer LiDAR, indium gallium arsenide (InGaAs) is used as the light receiving element.

[0009] A well-known attack on infrared sensors that measure the surrounding environment, such as LiDAR, is a spoofing attack that uses a fake reflection wave. Countermeasures against this spoofing attack include redundancy and sensor fusion.

[0010] However, one known attack against self-driving cars is an attack that deceives the processing of object detection signals of a sensor fusion using a camera and a LiDAR.

[0011] Therefore, it is important to implement not only countermeasures through sensor fusion using multiple sensors, but also countermeasures against attacks on individual sensors.

[0012] Known countermeasures against attacks on sensors include random modulation, the use of multiple wavelengths, and narrowing the light reception angle.

[0013] Although FMCW LiDARs are designed with random modulation, rotation is difficult, resulting in a narrow measurement range. Multiple LiDARs are required to perform a 360-degree measurement, making them unsuitable for compact devices like drones.

[0014] The use of multiple wavelengths enables cost-effective attacks for attackers using multiple wavelengths.

[0015] Narrowing the light reception angle can reduce the scope for attacks. However, this requires installing multiple LiDARs, which is costly. There are use cases where a cost-effective countermeasure against sensor attacks is needed without increasing the number of LiDARs.

[0016] Patent literature 1 discloses a countermeasure against deception attacks on sensors. In this countermeasure, deceptive signals are prepared and an attacker is tricked into mistaking the deceptive signals for genuine measurement signals and attacking them. Reference list patent literature

[0017] Patent Literature 1: JP H9-281397 A

[0018] WO 2019 / 058 679 A1 discloses a distance measuring device with a first light source for light pulses and a second light source for continuous light.

[0019] US patent 2020 / 0200874A1 discloses a multi-wavelength LIDAR with a first laser source for generating a first optical beam with a first wavelength and a second laser source for generating a second optical beam with a second wavelength.

[0020] JP 2000 - 266 851 A discloses a distance measuring device with a plurality of pulsed light sources, the optical axes of which are aligned parallel by means of an optical element.

[0021] JP 2001 / 183 460 A discloses a device for displaying an infrared image.

[0022] JP 2017 / 125682A discloses a laser radar device comprising a light projection unit for pulsed light and a light receiving unit for receiving light of the same wavelength. Distance is determined using a time-of-flight (TOF) measurement.

[0023] The JP S61 28 082 U also reveals a laser radar device.

[0024] US Patent 2021 / 0149028A1 discloses a method for determining the distance of an object in a multi-user environment, in which the environment is exposed to a series of light pulses with at least two different wavelengths.

[0025] CN 1 09 597 090 A also discloses a measuring device for a distance to an object.

[0026] JP H08 15 434 A discloses a device for determining the risk associated with the precise determination of an object to be measured under different working conditions.

[0027] DE 10 2022 134 936 A1 is an unpublished document. It discloses various methods and systems for improving the detection probability of runtime lidar systems by generating real-time background signals for individual pixels of a sensor of the lidar detection system and using the background signals for dynamic control of the lidar's detection system. Summary of the invention: Technical problem

[0028] Conventional countermeasures against spoofing attacks require multiple LiDARs and cannot be applied to small devices like UAVs. They also incur additional financial and technical costs.

[0029] UAV is an abbreviation for unmanned aerial vehicle.

[0030] No countermeasures were proposed against attacks that deceive the signal processing of sensor fusion.

[0031] One objective of the present disclosure is to prevent faulty object detection under the influence of a spoofing attack. Solution to the problem

[0032] A laser sensor of the present disclosure comprises a main laser for emitting laser light of a specific wavelength; a dummy laser for emitting laser light with a wavelength different from the specific wavelength; and a light-receiving element that is sensitive to light of a specific wavelength. Advantageous effects of the invention

[0033] According to the present disclosure, it is possible to prevent faulty object detection under the influence of a spoofing attack. Brief description of the drawings Fig. Figure 1 is a configuration diagram of an object detection system 100 in embodiment 1. Fig. Figure 2 is a configuration diagram of a laser sensor 110 in embodiment 1. Fig. Figure 3 is a configuration diagram of an attack detection device 120 in embodiment 1. Fig. Figure 4 is a configuration diagram of an object detection device 130 in embodiment 1. Fig. Figure 5 is a functional configuration diagram of the object detection system 100 in embodiment 1. Fig. Figure 6 is a flowchart of an object detection method in embodiment 1. Fig. Figure 7 is a flowchart of the object detection method in embodiment 1. Description of embodiments

[0034] In the embodiments and drawings, identical or corresponding elements are designated with the same reference numerals. The description of an element designated with the same reference numeral as an element already described is omitted or simplified as appropriate. Arrows in diagrams primarily indicate signal, data, or processing flows. Design 1.

[0035] An object detection system 100 is based on the Fig. 1, Fig. 2, Fig. 3, Fig. 4, Fig. 5, Fig. 6 to Fig. 7 described. *** Configuration Description ***

[0036] Based on Fig. Section 1 describes a configuration of the object acquisition system 100.

[0037] The object detection system 100 is a system that uses a laser sensor 110 to detect a subject 101.

[0038] Subject 101 is an object to be grasped. In other words: Subject 101 is a target to be recognized.

[0039] The object detection system 100 includes a laser sensor 110, an attack detection device 120 and an object detection device 130.

[0040] The laser sensor 110 is specifically a LiDAR. The LiDAR is an infrared sensor. The attack detection device 120 and the object detection device 130 are computers.

[0041] Based on Fig. Section 2 describes a configuration of the laser sensor 110.

[0042] The laser sensor 110 includes three types of lasers (111, 112, 113).

[0043] A first main laser 111 and a second main laser 112 are measuring lasers and emit laser light with different wavelengths.

[0044] The first main laser 111 emits laser light of a first wavelength. Specifically, the first main laser 111 emits laser light of approximately 900 nanometers.

[0045] The second main laser 112 emits laser light of a second wavelength. Specifically, the second main laser 112 emits laser light of approximately 1550 nanometers.

[0046] A dummy laser 113 emits laser light of a third wavelength. The third wavelength is a wavelength between the first and second wavelengths. Specifically, the dummy laser 113 emits laser light of approximately 1000 nanometers.

[0047] The laser sensor 110 comprises two types of light receiving elements (114, 115).

[0048] A first light-receiving element 114 is a light-receiving element that is sensitive to light of the first wavelength. In particular, the first light-receiving element 114 is a light-receiving element that uses a silicon (Si) semiconductor.

[0049] A second light-receiving element 115 is a light-receiving element that is sensitive to light of the second wavelength. In particular, the second light-receiving element 115 is a light-receiving element that uses a compound semiconductor made of indium gallium arsenide (InGaAs).

[0050] The laser sensor 110 has a mechanism by which all three types of lasers (111, 112, 113) and the two types of light receiving elements (114, 115) can be rotated to perform a measurement in a large environmental area.

[0051] The laser sensor 110, for example, has a rotation mechanism to perform measurements in a 360-degree environment. The rotation mechanism rotates all three lasers and the two light-receiving elements by 360 degrees.

[0052] Based on Fig. Section 3 describes a configuration of the attack detection device 120.

[0053] The attack detection device 120 includes hardware referred to as the processing circuit 129.

[0054] The attack detection device 120 includes an element referred to as the attack detection unit 121.

[0055] The processing circuit 129 is hardware that implements the attack detection unit 121.

[0056] The processing circuit 129 can be special hardware or a processor that executes programs stored in main memory.

[0057] The dedicated hardware might be, for example, a single circuit, a compound circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0058] ASIC is an abbreviation for Application Specific Integrated Circuit.

[0059] FPGA is an abbreviation for Field Programmable Gate Array.

[0060] Based on Fig. Section 4 describes a configuration of the object detection device 130.

[0061] The object detection device 130 includes hardware referred to as the processing circuit 139.

[0062] The object detection device 130 includes an element referred to as object detection unit 131.

[0063] The processing circuit 139 is hardware that implements the object detection unit 131.

[0064] The processing circuit 139 can be special hardware or a processor that executes programs stored in main memory.

[0065] Fig. Figure 5 shows the relationships between the elements of the object acquisition system 100.

[0066] The three types of lasers (111, 112, 113) emit laser light. It should be noted that the two main types of lasers (111, 112) emit laser light alternately.

[0067] The two types of light receiving elements (114, 115) receive (detect) the laser light reflected from the subject 101 and output received light signals.

[0068] Receiving light means receiving light and converting the received light into an electrical signal.

[0069] Acquisition means treating an electrical signal as point cloud data. If the amount of light exceeds a certain threshold, the electrical signal is considered point cloud data. Electrical signals that are not considered point cloud data are discarded as unnecessary data.

[0070] A received light signal is an electrical signal obtained by receiving and capturing light and represents laser light.

[0071] The attack detection unit 121 receives received light signals, detects an attack by the attack device 109 and outputs received light signals that are not under attack.

[0072] The object detection unit 131 processes received light signals that are not attacked in order to detect the subject 101.

[0073] Attack device 109 is a device that performs a spoofing attack.

[0074] The attack device 109 captures the laser light emitted by the three types of lasers and emits laser light for interference. *** Description of a business ***

[0075] A process for operating the object acquisition system 100 corresponds to an object acquisition procedure.

[0076] Based on the Fig. 6 and Fig. Section 7 describes the object acquisition procedure.

[0077] Based on Fig. Section 6 describes the operation of the laser sensor 110 in the object detection method.

[0078] In step S101, the first main laser 111 and the second main laser 112 alternately emit laser light. Additionally, the dummy laser 113 continues to emit laser light.

[0079] The first main laser 111 emits laser light of the first wavelength. The laser light with the first wavelength is referred to as the first laser light.

[0080] The second main laser, 112, emits laser light of the second wavelength. This laser light with the second wavelength is referred to as the second laser light.

[0081] The dummy laser 113 emits laser light of the third wavelength. This laser light with the third wavelength is referred to as dummy laser light.

[0082] Each of the first laser light, the second laser light, and the dummy laser light is reflected upon hitting subject 101.

[0083] When the first laser light, the second laser light, or the third laser light is detected, the attacking device emits 109 laser light for interference. The laser light for interference is referred to as attack laser light.

[0084] In step S102, the first light receiving element 114 and the second light receiving element 115 receive laser light.

[0085] The first light-receiving element 114 detects the first laser light. If the wavelength of the attack laser light is close to the first wavelength, the first light-receiving element 114 detects both the first laser light and the attack laser light. The second laser light and the dummy laser light, however, are not detected by the first light-receiving element 114.

[0086] The second light-receiving element 115 detects the second laser light. If the wavelength of the attack laser light is close to the second wavelength, the second light-receiving element 115 detects both the second laser light and the attack laser light. The first laser light and the dummy laser light, however, are not detected by the second light-receiving element 115.

[0087] In step S103, the first light receiving element 114 and the second light receiving element 115 output received light signals.

[0088] The received light signal emitted by the first light receiving element 114 is referred to as the first received light signal.

[0089] The received light signal emitted by the second light receiving element 115 is referred to as the second received light signal.

[0090] Based on Fig.Section 7 describes the operation of the attack detection device 120 and the object detection device 130 in the object detection procedure.

[0091] In step S111, the attack detection unit 121 receives the received light signals from the first light receiving element 114 and the second light receiving element 115.

[0092] In step S112, the attack detection unit 121 determines a signal-to-noise ratio (S / N ratio) for each of the received light signals.

[0093] The signal-to-noise ratio of the received light signal is determined as follows.

[0094] First, the attack detection unit 121 calculates the signal-to-noise ratio of the received light signal.

[0095] Then the attack detection unit 121 compares the signal-to-noise ratio with a threshold value.

[0096] If the S / N ratio is equal to or greater than the threshold, the attack detection unit 121 determines that the S / N ratio is good.

[0097] If the S / N ratio is below the threshold, the attack detection unit 121 determines that the S / N ratio is poor.

[0098] If the signal-to-noise ratio is good, the process proceeds to step S113.

[0099] If the signal-to-noise ratio is poor, the received light signal is treated as the dummy laser light signal. Therefore, the received light signal is eliminated as an unnecessary point cloud. That is, the received signal is eliminated as an electrical signal that is not converted into point cloud data. The process then terminates without any object acquisition.

[0100] In step S113, the attack detection unit 121 determines whether the first received light signal from the first light receiving element 114 and the second received light signal from the second light receiving element 115 were received simultaneously.

[0101] If the first and second received light signals are not received simultaneously, the process proceeds to step S114.

[0102] If the first and second received light signals are received simultaneously, one of the received light signals is considered an attack signal. Therefore, the received light signal is processed as a false reflection wave. This means that although the received light signal contains valid point cloud data, it is considered an attack signal, and the point cloud is therefore removed to prevent it from interfering with subsequent applications. Subsequent applications include, for example, processing by processing circuit 139. The process then terminates.

[0103] In step S114, the attack detection unit 121 determines whether both the first received light signal from the first light receiving element 114 and the second received light signal from the second light receiving element 115 have been received.

[0104] Once both the first and second light reception signals have been received, the attack detection unit 121 outputs both the first and second light reception signals. The process then continues with step S121.

[0105] If at least one of the first and second received light signals is not received, the received light signal is considered an attack signal. Therefore, the process ends without object detection.

[0106] In step S121, the object detection unit 131 receives the first received light signal and the second received light signal.

[0107] The object detection unit 131 then performs object detection using at least one of the first received light signals and the second received light signal. The result is that subject 101 is detected.

[0108] The following processing is carried out during object detection.

[0109] The object detection unit 131 calculates a relative distance at a measurement time based on the flight time of laser light.

[0110] The relative distance is a distance from the laser sensor 110 to the subject 101 and is calculated by multiplying the speed of light by the flight time.

[0111] The flight time is the time from the emission of the laser light until its reception (detection). The flight time is measured, for example, by the number of clock cycles in an internal circuit.

[0112] The measurement time is the time at which the laser light is emitted or the time at which the laser light is received (detected).

[0113] The process ends after step S121.

[0114] Steps S101 to S121 are executed repeatedly. *** Effects of embodiment 1 ***

[0115] Embodiment 1 enables countermeasures against deception attacks on sensors and advanced attacks, such as those that deceive sensor fusion.

[0116] Embodiment 1 makes it possible to significantly reduce an attacker's deception attack capability. The attacker can reconfigure a mechanism for eliminating signals with a poor signal-to-noise ratio. However, an attack that overcomes sensor fusion requires inserting a point cloud at a specific location and is difficult to implement when the attacker's freedom is restricted. Furthermore, since the attacker must add a new mechanism in addition to an existing attack mechanism, the attacker's attack costs are likely to increase. ***Summary of Implementation 1 ***

[0117] In the following description, the elements corresponding to the elements of embodiment 1 are placed in parentheses, and the reference numerals of the elements of embodiment 1 are given in the parentheses.

[0118] An infrared sensor (110) is characterized by its configuration and the detection signal processing.

[0119] A laser (111) of approximately 900 nm and a laser (112) of approximately 1550 nm alternately emit light. It should be noted that at the moment when laser light of approximately 900 nm is emitted, laser light of approximately 1550 nm is received but not processed as a point cloud. Likewise, at the moment when laser light of approximately 1550 nm is emitted, laser light of approximately 900 nm is received but not processed as a point cloud.

[0120] Laser light of approximately 1000 nm is emitted but treated as dummy light, which is not received as actual light. A silicon light receiving element (114) and an InGaAs light receiving element (115) respond to light with a wavelength of approximately 1000 nm, but the signal-to-noise ratio of this signal is poor. For this reason, the signal from light with a wavelength of approximately 1000 nm is eliminated during the point cloud processing phase.

[0121] In signal processing for attack detection, a distinction is made between genuine reflection waves and false reflection waves (signals from an attacker).

[0122] First, if light of the same wavelength arrives from the same position during each of the alternating measurements, the incoming light is considered a false reflection wave. This can prevent laser-emitting attacks using one wavelength of approximately 900 nm and another of approximately 1550 nm.

[0123] Next, if the light from laser (111) at approximately 900 nm and the light from laser (112) at approximately 1550 nm arrive simultaneously, the incoming light is considered a false reflection wave. This is because light at approximately 900 nm and light at approximately 1550 nm are emitted alternately, so normally only one of these two types of light is detected at any given time. Even if the attacker prepares a laser-emitting attack device (109) that supports both wavelengths, an attacker's light-receiving mechanism responds to dummy light at approximately 1000 nm, causing the laser-emitting attack device to emit laser light of both wavelengths. This allows an attack to be detected. This is because the attacker lacks a signal processing mechanism to eliminate signals with a poor signal-to-noise ratio.

[0124] Embodiment 1 is characterized in that dummy light is used for which the light receiving elements (114, 115) have a low measurement sensitivity.

[0125] By using measurable light as dummy light instead of using completely invisible light as dummy light, it is possible to provoke an attack by the attacker and eliminate false signals. *** Supplement to embodiment 1 ***

[0126] The received light signals emitted by the attack detection unit 121 are used for object detection and for mapping the environment based on a collection of point clouds.

[0127] To execute an attack that overcomes sensor fusion, simply emitting light is insufficient; it is necessary to emit light in such a way that a specific location and point clouds appear in a specific pattern. For example, the specific location might be behind an obstacle such as a car. The specific pattern could involve positioning the light so that the point clouds appear to form a cone. Directing light onto a moving object is difficult, and executing a sophisticated attack requires a high degree of freedom (few conditions for success). Reducing the attack's degrees of freedom therefore makes its implementation more difficult.

[0128] Embodiment 1 is an example of a preferred embodiment and is not intended to limit the technical scope of this disclosure. Embodiment 1 can be implemented partially or in combination with another embodiment.

[0129] The laser sensor 110 can be without the first main laser 111 or the second main laser 112.

[0130] The attack detection device 120 and the object detection device 130 can be implemented as separate devices.

[0131] The processes described in the flowcharts or similar documents can be modified as appropriate.

[0132] The order of step S112, step S113 and step S114 can be exchanged.

[0133] The “unit” of the individual elements of the attack detection device 120 and the object detection device 130 can be interpreted as “process”, “step”, “circuit” or “circuit”.

[0134] The programs can be recorded (stored) in a computer-readable format on a non-volatile recording medium, such as an optical disc or flash memory. Reference symbol list

[0135] 100: Object detection system; 101: Subject; 109: Attack device; 110: Laser sensor; 111: First main laser; 112: Second main laser; 113: Dummy laser; 114: First light receiving element; 115: Second light receiving element; 120: Attack detection device; 121: Attack detection unit; 129: Processing circuit; 130: Object detection device; 131: Object detection unit; 139: Processing circuit.

Claims

Object detection system (100), comprising: a first main laser (111) for emitting laser light of a first wavelength and a second main laser (112) for emitting laser light of a second wavelength, wherein the first main laser (111) and the second main laser (112) emit the laser light alternately; a dummy laser (113) for emitting laser light of a third wavelength; a first light receiving element (114) sensitive to light of the first wavelength, wherein the first light receiving element (114) detects laser light and outputs a first received light signal which is a signal of the detected laser light; a second light receiving element (115) sensitive to light of the second wavelength, wherein the second light receiving element (115) detects laser light and outputs a second received light signal which is a signal of the detected laser light;an attack detection unit (121) for receiving the first emitted receive light signal and the second emitted receive light signal, determining a signal-to-noise ratio of each of the first received receive light signal and the second received receive light signal, and determining whether the first received light signal and the second received light signal were received simultaneously; and an object detection unit (131) for performing object detection if it is not determined that the first received light signal and the second received light signal were received simultaneously, the object detection being performed using at least one of the first received light signal, the signal-to-noise ratio of which is determined to be good, and the second received light signal, the signal-to-noise ratio of which is determined to be good. Object detection method comprising: alternately emitting laser light of a first wavelength and laser light of a second wavelength; emitting laser light of a third wavelength; exhibiting sensitivity to light of the first wavelength, detecting laser light and outputting a first received light signal which is a signal of the detected laser light; exhibiting sensitivity to light of the second wavelength, detecting laser light and outputting a second received light signal which is a signal of the detected laser light; receiving the first output received light signal and the second output received light signal, determining a signal-to-noise ratio of each of the first received received light signal and the second received received light signal, and determining whether the first received light signal and the second received light signal were received simultaneously;and performing object detection, unless it is determined that the first received light signal and the second received light signal were received simultaneously, wherein the object detection is performed using at least one of the first received light signal, whose signal-to-noise ratio is determined to be good, and the second received light signal, whose signal-to-noise ratio is determined to be good.

Images