Sensor system, movable body, control method of sensor system, control program of sensor system, and computer readable recording medium recording computer program
The sensor system dynamically adjusts sensor orientations and angles to compensate for malfunctioning sensors, ensuring continuous and accurate sensing coverage by increasing overlap areas between adjacent sensors.
Patent Information
- Application Number
- JP2024021650
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-16
- Publication Date
- 2025-08-28
AI Technical Summary
Conventional sensor systems with multiple reflective sensors having different fields of view require a separate complementary sensor, which is inefficient and leaves room for improvement.
A sensor system that includes a controller to dynamically adjust the orientation and field of view angle of reflective sensors based on detection results, allowing one sensor to compensate for the field of view of a malfunctioning sensor by increasing the overlap area between adjacent sensors.
Ensures continuous and comprehensive sensing coverage around a vehicle by dynamically adjusting sensor orientations and angles to maintain sensing accuracy and coverage even when individual sensors fail.
Smart Images

Figure 2025125616000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology disclosed in this specification relates to a sensor system. [Background technology]
[0002] With the advancement of AD (Autonomous Driving) and ADAS (Advanced Driver-Assistance Systems), research and development is underway into LiDAR (Light Detection and Ranging) as a measurement device used to understand the surrounding environment and estimate the vehicle's position while driving. LiDAR is equipped with a reflective sensor. The reflective sensor projects (irradiates) a laser beam onto the object to be measured and receives the light that is reflected back from the object. LiDAR outputs information about the object by measuring the distance to the object based on the time difference between when the reflective sensor projects the laser beam and when it receives the reflected light.
[0003] A sensor system including, for example, a first reflective sensor and a second reflective sensor is disposed in a moving body (e.g., a vehicle). The field of view of the first reflective sensor is different from the field of view of the second reflective sensor. Therefore, if, for example, the second reflective sensor is unable to perform sensing normally due to a malfunction or the like, sensing of the field of view of the second reflective sensor cannot be performed. Therefore, a technique of separately disposing a complementary sensor having a complementary field of view has been known. The complementary sensor has a field of view that complements the field of view of the second reflective sensor. Therefore, even if the second reflective sensor fails or the like, the field of view of the second reflective sensor can be complemented by the complementary sensor (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Special Publication No. 2022-512092 Summary of the Invention [Problem to be solved by the invention]
[0005] The conventional sensor system described above requires the provision of a separate complementary sensor, leaving room for improvement. Note that this issue is not limited to sensor systems installed on moving objects, but is a common issue in sensor systems equipped with multiple reflective sensors with different fields of view.
[0006] This specification discloses a technique that can solve the above-mentioned problems. [Means for solving the problem]
[0007] The technology disclosed in this specification can be realized, for example, in the following forms.
[0008] (1) A sensor system disclosed in this specification includes a first reflective sensor, a second reflective sensor, and a controller. The controller senses a measurement target based on detection results from the first reflective sensor and the second reflective sensor in a first field of view pattern in which the fields of view of the first reflective sensor and the second reflective sensor are adjacent to each other in a first direction, and sets the field of view pattern to a second field of view pattern when a predetermined change condition is satisfied. The second field of view pattern is a pattern in which at least one of the orientation of the field of view center and the field of view angle of the first reflective sensor is changed in the first direction, and an overlap area between the changed field of view of the first reflective sensor and the field of view of the second reflective sensor in the first field of view pattern is increased compared to the first field of view pattern. The controller senses the measurement target based on detection results from the first reflective sensor in the second field of view pattern. According to this sensor system, when a predetermined change condition is satisfied, at least one of the direction of the center of the field of view and the field of view angle of the first reflective sensor can be changed to compensate for the field of view of the second reflective sensor.
[0009] (2) In the sensor system, the predetermined change condition may include the controller detecting an abnormality in the second reflective sensor. According to this sensor system, when an abnormality occurs in the second reflective sensor, at least one of the direction of the center of the field of view and the field of view angle of the first reflective sensor can be changed to compensate for the field of view of the second reflective sensor.
[0010] (3) In the above sensor system, the controller may be configured to widen the field of view angle of the first reflective sensor relative to the first field of view pattern and set it to the second field of view pattern, and the angular resolution of the first reflective sensor in the first field of view pattern may be higher than the angular resolution of the first reflective sensor in the second field of view pattern. According to this sensor system, for example, the sensing accuracy of the first reflective sensor in the first field of view pattern can be improved compared to when the angular resolution of the first reflective sensor in the first field of view pattern is the same as that in the second field of view pattern.
[0011] (4) The above sensor system may further include a third reflective sensor located on the opposite side of the first reflective sensor from the second reflective sensor in the first direction, and the controller may change the orientation of the center of the field of view of the first reflective sensor to set it to the second field of view pattern, and change at least one of the orientation of the center of the field of view and the field of view angle of the third reflective sensor to increase the overlap area between the changed field of view of the third reflective sensor and the field of view of the first reflective sensor in the first field of view pattern compared to the first field of view pattern. This sensor system can change at least one of the orientation of the center of the field of view and the field of view angle of the third reflective sensor in the second field of view pattern to supplement the field of view of the first reflective sensor.
[0012] The technology disclosed in this specification can be realized in various forms, such as a sensor system, a mobile object, a control method for a sensor system, a control program for a sensor system, and a computer-readable recording medium on which a computer program is recorded. [Brief explanation of the drawings]
[0013] [Figure 1] 1 is a schematic diagram showing a basic pattern of a plurality of reflective sensors 10 provided on a vehicle 1 in an embodiment. [Figure 2] 1 is a block diagram showing a schematic configuration of a reflective sensor 10. [Figure 3] Schematic diagram showing a configuration for changing the direction of the center of the field of view of the reflective sensor 10. [Figure 4] Schematic diagram showing a configuration for changing the viewing angle of the reflective sensor 10. [Figure 5] An explanatory diagram showing the relationship between the field of view and the measurement period [Figure 6] Flowchart showing surroundings monitoring processing [Figure 7] Schematic diagram showing change patterns of multiple reflective sensors 10 DETAILED DESCRIPTION OF THE INVENTION
[0014] A. Implementation: A-1. Vehicle 1 configuration: FIG. 1 is a schematic diagram showing a basic pattern of a plurality of reflective sensors 10 provided on a vehicle 1 in this embodiment. In FIG. 1 and FIG. 7 described later, arrows are shown indicating each direction based on the position of the vehicle 1. More specifically, each diagram shows arrows indicating the front (FRONT), rear (REAR), left (LEFT), and right (RIGHT), respectively. The front-to-rear direction and the left-to-right direction are directions that are perpendicular to each other. The vehicle 1 is an example of a moving body.
[0015] As shown in Fig. 1, the vehicle 1 is a four-wheeled automobile. The vehicle 1 is equipped with a sensor system 11. The sensor system 11 includes a plurality of reflective sensors 10 and a controller 60 (see Fig. 2, which will be described later).
[0016] The multiple reflective sensors 10 include a front center sensor 10A, a front right sensor 10B, a front left sensor 10C, a rear center sensor 10D, a rear right sensor 10E, and a rear left sensor 10F. FIG. 1 shows the fields of view (FOVs) of each of the reflective sensors 10A to 10F in the basic pattern (the sector-shaped shaded areas in FIG. 1). Of the multiple reflective sensors 10, three reflective sensors 10 whose fields of view V are adjacent to each other are examples of a first reflective sensor, a second reflective sensor, and a third reflective sensor. The basic pattern is an example of a first field of view pattern.
[0017] The front center sensor 10A is disposed in the center of the front end of the vehicle 1. For example, the front center sensor 10A is disposed between the right front lamp 2 and the left front lamp 2. The field of view Va1 of the front center sensor 10A in the basic pattern is the front, front side of the vehicle 1. The front light sensor 10B is disposed on the right side of the front end of the vehicle 1. For example, the front light sensor 10B may be disposed near the right front lamp 2 or may be built into the right front lamp 2. The field of view Vb1 of the front light sensor 10B in the basic pattern is the front, right side of the vehicle 1. The front left sensor 10C is disposed on the left side of the front end of the vehicle 1. For example, the front left sensor 10C may be disposed near the left front lamp 2 or may be built into the left front lamp 2. The field of view Vc1 of the front left sensor 10C in the basic pattern is the front, left side of the vehicle 1.
[0018] The rear center sensor 10D is disposed in the center of the rear end of the vehicle 1. For example, the rear center sensor 10D is disposed between the right rear lamp 4 and the left rear lamp 4. The field of view Vd1 of the rear center sensor 10D in the basic pattern is rear of the vehicle 1. The rear light sensor 10E is disposed on the right side of the rear end of the vehicle 1. For example, the rear light sensor 10E may be disposed near the right rear lamp 4 or may be built into the right rear lamp 4. The field of view Ve1 of the rear light sensor 10E in the basic pattern is the right side of the vehicle 1. The rear left sensor 10F is disposed on the left side of the rear end of the vehicle 1. For example, the rear left sensor 10F may be disposed near the left rear lamp 4 or may be built into the left rear lamp 4. The field of view Vf1 of the rear left sensor 10F in the basic pattern is the left side of the vehicle 1.
[0019] A-2. Structure of the reflective sensor 10: Fig. 2 is a block diagram showing a schematic configuration of the reflective sensor 10. Fig. 2 shows one reflective sensor 10 of the sensor system 11 and a controller 60. Each of the plurality of reflective sensors 10 is connected to the controller 60 so as to be able to communicate with each other.
[0020] As shown in Fig. 2, the reflective sensor 10 functions as a LiDAR and includes a projector 20 that irradiates a measurement object W with emitted light L1 (e.g., a light beam (laser light)) and a photoreceiver 30 that receives reflected light L2 (return light) that is generated when the emitted light L1 is reflected back from the measurement object W. The reflective sensor 10 measures the difference between the timing at which the projector 20 emits the emitted light L1 and the timing at which the photoreceiver 30 receives the reflected light L2 (time of flight of the laser light, hereinafter referred to as "TOF" (Time of Flight)) to acquire information about the measurement object W.
[0021] The reflective sensor 10 assists in detecting objects such as people and other vehicles while the vehicle 1 is traveling, and provides various information to other devices and users that is useful for ensuring the safety of the vehicle driver and those around the vehicle, and for reducing damage to surrounding objects while the vehicle is being driven.
[0022] The light projector 20 includes a light source 22, a light projecting optical system 24, a light projecting control device 26, and a current source 28.
[0023] The light source 22 includes a light-emitting source having one or more light-emitting elements (not shown), or one or more light-emitting element arrays (for example, light-emitting elements arranged linearly (one-dimensionally) or planarly (two-dimensionally)). The light-emitting element is, for example, a laser diode, a surface-emitting laser light-emitting element (for example, a VCSEL (Vertical Cavity Surface Emitting Laser), hereinafter referred to as a "surface-emitting element"), a surface-emitting element array (for example, a VCSEL array) in which a plurality of surface-emitting elements are arranged one-dimensionally or two-dimensionally on a substrate (semiconductor substrate, ceramic substrate, etc.), etc.
[0024] The current source 28 supplies a current corresponding to a control signal input from the light projection control device 26 to the light emitting element that constitutes the light source 22. The current source 28 supplies, for example, a periodic square wave current to the light emitting element for turning on and off the current flowing through the light emitting element.
[0025] The light-projection control device 26 generates a control signal for the current source 28 and inputs it to the current source 28, thereby controlling the current (drive current) supplied to the light-emitting element from the current source 28. The light-projection control device 26 inputs a signal indicating the timing at which the light-emitting element emits light (the timing at which the light-emitting element emits light; hereinafter referred to as "light-projection timing") to the TOF measurement device 40. The light-projection control device 26 periodically controls the on / off of the current flowing through the light-emitting element, for example, to cause the light-emitting element to periodically emit light.
[0026] The light projection optical system 24 adjusts the light distribution of the emitted light L1 by, for example, applying optical effects (such as refraction, scattering, or diffraction) to the light emitted by the light source 22. The light projection optical system 24 is configured using optical components such as various lenses, such as collimating lenses, and reflecting mirrors (mirrors).
[0027] The light receiver 30 includes a light receiving section 32 and a light receiving optical system 34 .
[0028] The light receiving optical system 34 collects reflected light L2, which is light L1 emitted from the projector 20 and reflected by the measurement target W or the like, onto the light receiving unit 32. The light receiving optical system 34 is configured using optical components such as various lenses, including a condensing lens, various filters, including a wavelength filter, and a reflecting mirror.
[0029] The light receiving unit 32 has a plurality of light receiving elements. The light receiving elements are, for example, photodiodes, SPADs (Single Photon Avalanche Diodes), balanced photodetectors, etc. The light receiving unit 32 performs photoelectric conversion on the reflected light L2 incident from the light receiving optical system 34 to generate a light receiving signal with a current level or voltage level corresponding to the intensity of the reflected light L2. The light receiving unit 32 inputs to the TOF measurement device 40 a signal indicating the timing at which the light receiving elements constituting the light receiving unit 32 receive the reflected light L2 (hereinafter referred to as "light receiving timing"), and the light receiving signal generated by the light receiving elements.
[0030] The reflective sensor 10 further includes a TOF measurement device 40, a control circuit 42, and a communication I / F (Interface) 50.
[0031] The TOF measurement device 40 determines the TOF based on a signal indicating the light projection timing input from the light projection control device 26 and a signal indicating the light reception timing input from the light receiving unit 32. The TOF measurement device 40 has, for example, a time measurement IC (Integrated Circuit) equipped with a TDC (Time to Digital Converter) circuit. The TOF measurement device 40 inputs the determined TOF and the light reception signal input from the light receiving unit 32 to the control circuit 42.
[0032] The control circuit 42 has a processor (such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), and DSP (Digital Signal Processor)). Based on the TOF and the light reception signal input from the TOF measurement device 40, the control circuit 42 generates information used for various measurements such as detection and distance measurement of the measurement target W. This information includes, for example, a histogram used in time-correlated signal photon counting, distances to each point on the measurement target W, and a point cloud (point cloud information). The control circuit 42 also controls the light-projection control device 26 and the light-receiving unit 32. For example, the control circuit 42 controls the light-projection control device 26 and the light-receiving unit 32 to control the light-projection timing and light-receiving timing described above so as to speed up or optimize the process for generating the histogram. The information generated by the control circuit 42 is provided (transmitted) via the communication I / F 50 to the controller 60 and devices that use the information (hereinafter referred to as "various use devices").
[0033] Various utilization devices perform, for example, the creation of environmental maps using point clouds, and self-location estimation (SLAM (Simultaneous Localization and Mapping)) using scan matching algorithms (NDT (Normal Distributions Transform), ICP (Iterative Closest Point), etc.).
[0034] The controller 60 is configured using, for example, a CPU, a multi-core CPU, or a programmable device (for example, a field programmable gate array (FGPA) or a programmable logic device (PLD)). The controller 60 controls the operations of the multiple reflective sensors 10.
[0035] The controller 60 individually determines whether or not each of the multiple reflective sensors 10 is in an abnormal state. An abnormal state of the reflective sensor 10 is a state in which the reflective sensor 10 cannot perform sensing normally, such as the following states: The reflective sensor 10 may stop working due to a malfunction or disconnection. When the light emission intensity of the light source 22 of the projector 20 exceeds a specified value, the feel-safe function stops the sensing (light emitting and receiving operation) of the reflective sensor 10. The reflective sensor 10 operates normally, but if dust or other foreign matter adheres to or is damaged in the light projecting optical system 24 or the light receiving optical system 34, sensing cannot be performed normally (for example, the field of view is restricted). The controller 60 can determine whether or not the above-mentioned abnormal state exists by detecting that the amount of light received by the light receiving unit 32 is below a predetermined level or by receiving a detection signal from a central control device (not shown) of the vehicle 1.
[0036] The controller 60 includes a storage device. The storage device is configured, for example, with a ROM, a RAM, a hard disk drive (HDD), and a solid-state drive (SSD). The storage device stores various programs and data, and is used as a work area and a data storage area when executing various processes. For example, the storage device stores a computer program for executing a measurement process and an ambient monitoring process (described later). This computer program is provided in a state stored on a computer-readable recording medium (not shown), such as a CD-ROM, a DVD-ROM, or a USB memory, or is provided in a state that can be obtained from an external device via a communication interface (not shown), and is stored in the storage device in a state that is operable on the sensor system 11.
[0037] A-3. Configuration for changing the orientation of the field of view center O and the field of view angle of the reflective sensor 10: 3 is a schematic diagram showing a configuration for changing the orientation of the field of view center of the reflective sensor 10. As shown in FIG. 3, the reflective sensor 10 is installed on the vehicle 1 so as to be rotatable about an axis Q along the vertical direction. Therefore, when the reflective sensor 10 is rotated, the field of view of the reflective sensor 10 is changed from a first field of view V1 to a second field of view V2. The first field of view V1 and the second field of view V2 have the same field of view angle θ but have different orientations of the field of view center O. In other words, the reflective sensor 10 is configured so that the orientation of the field of view center O can be changed without changing the field of view angle θ of the reflective sensor 10.
[0038] FIG. 4 is a schematic diagram showing a configuration for changing the field of view of the reflective sensor 10. As shown in FIG. 4, the reflective sensor 10 is configured to be able to change the field of view angle θ (width of the horizontal field of view). In FIG. 4, the field of view of the reflective sensor 10 is changed from a third field of view V3 to a fourth field of view V4. The third field of view V3 and the fourth field of view V4 have the same orientation of the field of view center O but have different field of view angles θ (θ1<θ2). In other words, the reflective sensor 10 is configured to be able to change the field of view angle θ of the reflective sensor 10 without changing the orientation of the field of view center O. For example, the control circuit 42 can change the field of view angle θ of the reflective sensor 10 by changing at least one of the light projection range of the projector 20 and the light reception range of the photoreceiver 30.
[0039] Fig. 5 is an explanatory diagram showing the relationship between the field of view V and the measurement period. The upper part of Fig. 5 shows a virtual third field of view V3, and the lower part shows a virtual fourth field of view V4. The light receiver 30 (light receiving unit 32) has a plurality of light receiving elements arranged two-dimensionally, and each of the plurality of light receiving elements corresponds to a measurement point P in the third field of view V3.
[0040] The horizontal field of view angle θ1 of the third field of view V3 is narrower than the horizontal field of view angle θ2 of the fourth field of view V4 (see FIG. 4). Therefore, as shown in FIG. 5, the horizontal field of view of the third field of view V3 is narrower than the horizontal field of view of the fourth field of view V4. The angular resolution of the reflective sensor 10 in the third field of view V3 is higher than the angular resolution of the reflective sensor 10 in the fourth field of view V4. In other words, in the third field of view V3, the distance R1 between adjacent measurement points P (hereinafter referred to as the "inter-measurement distance") is narrower than the inter-measurement distance R2 in the fourth field of view V4.
[0041] The number of measurement points P in the horizontal field of view of the third field of view V3 is the same as the number of measurement points P in the horizontal field of view of the fourth field of view V4. Therefore, the measurement period of the horizontal field of view of the third field of view V3 in one frame is the same as the measurement period of the horizontal field of view of the fourth field of view V4 in one frame. In other words, although the third field of view V3 has a narrower field of view angle than the fourth field of view V4, it is possible to perform high-precision sensing with high angular resolution while maintaining the measurement period. Note that the third field of view V3 and the fourth field of view V4 have the same vertical field of view.
[0042] A-4. Periphery monitoring process: FIG. 6 is a flowchart showing the surroundings monitoring process. The surroundings monitoring process is a process in which a plurality of reflective sensors 10 are used to sense objects and the like around the vehicle 1. When the controller 60 receives an instruction to start measurement, for example, from a device to be used, the controller 60 executes the surroundings monitoring process shown in FIG. 6. The controller 60 determines whether or not the sensing timing has arrived (S110). The sensing timing is the timing that triggers the start of measurement processing for each reflective sensor 10 in one frame unit. Sensing (measurement processing) includes, for example, detecting the measurement target, measuring the distance to the measurement target, measuring the shape of the measurement target, etc. If the controller 60 determines that the sensing timing has not arrived (S110: NO), it waits.
[0043] When the controller 60 determines that the sensing timing has arrived (S110: YES), it sets the field of view patterns of the multiple reflective sensors 10 to a reference pattern and causes each of the multiple reflective sensors 10 to perform sensing (S120). The reference pattern is the field of view pattern shown in FIG. 1. The reference pattern is an example of a first field of view pattern. The reference pattern is a pattern in which sensing is performed all around the vehicle 1 using six reflective sensors 10 (sensors 10A to 10F), and the fields of view of two adjacent reflective sensors 10 barely overlap each other.
[0044] The controller 60 determines whether or not there is an abnormal reflective sensor 10 (hereinafter, sometimes referred to as an "abnormal sensor") among the multiple reflective sensors 10 (S130). The controller 60 determines whether or not there is an abnormal sensor based on, for example, the light reception results of each reflective sensor 10 in the sensing executed immediately before, a notification signal from an external device, etc. If the controller 60 determines that there is no abnormal sensor (S130: NO), it returns to S110, and when the next sensing timing arrives (S110: YES), it causes each of the multiple reflective sensors 10 to execute sensing while maintaining the reference pattern (S120).
[0045] When the controller 60 determines that there is an abnormal sensor (S130: YES), it changes the field of view patterns of the multiple reflective sensors 10 from the reference pattern to a modified pattern (S140). The modified pattern is an example of a second field of view pattern. The modified pattern is a pattern in which at least one of the orientation of the field of view center and the field of view angle of a reflective sensor 10 in a normal state (hereinafter sometimes referred to as a "normal sensor") is changed relative to the reference pattern, and the overlapping area between the field of view of the normal sensor after the change and the field of view of the abnormal sensor in the reference pattern is increased. By setting the modified pattern, the field of view missing due to the abnormal sensor is complemented.
[0046] Fig. 7 is a schematic diagram showing change patterns for multiple reflective sensors 10. Fig. 7 illustrates an example of a change pattern when the rear center sensor 10D becomes an abnormal sensor. In the reference pattern, the reflective sensors 10 whose fields of view are adjacent to the rear center sensor 10D in the horizontal direction are the rear right sensor 10E and the rear left sensor 10F.
[0047] 7, in the change pattern, the orientation of the field of view center O of the rear light sensor 10E is changed relative to the reference pattern, thereby increasing the overlapping area between the changed field of view Ve2 of the rear light sensor 10E and the field of view Vd1 of the rear center sensor 10D (abnormal sensor). In other words, the orientation of the field of view center O of the rear light sensor 10E is changed toward the field of view Vd1 of the rear center sensor 10D, so that the changed field of view Ve2 of the rear light sensor 10E complements a portion of the field of view Vd1 of the rear center sensor 10D. In the change pattern, the orientation of the field of view center O of the rear left sensor 10F is changed relative to the reference pattern, thereby increasing the overlapping area between the changed field of view Vf2 of the rear left sensor 10F and the field of view Vd1 of the rear center sensor 10D (abnormal sensor). In other words, by changing the orientation of the field of view center O of the rear left sensor 10F toward the field of view Vd1 of the rear center sensor 10D, the changed field of view Ve2 of the rear left sensor 10F complements part of the field of view Vd1 of the rear center sensor 10D.
[0048] In the changed pattern, the orientation of the field of view center O of the front light sensor 10B is changed relative to the reference pattern, thereby increasing the overlapping area between the changed field of view Vb2 of the front light sensor 10B and the pre-change field of view Ve1 of the rear light sensor 10E. In other words, the orientation of the field of view center O of the front light sensor 10B is changed toward the field of view Ve1 of the rear light sensor 10E, so that the changed field of view Vb2 of the front light sensor 10B complements a portion of the pre-change field of view Ve1 of the rear light sensor 10E. In the changed pattern, the orientation of the field of view center O of the front left sensor 10C is changed relative to the reference pattern, thereby increasing the overlapping area between the changed field of view Vc2 of the front left sensor 10C and the pre-change field of view Vf1 of the rear left sensor 10F. In other words, by changing the orientation of the field of view center O of the front left sensor 10C toward the field of view Vf1 of the rear left sensor 10F, the field of view Vf2 after the change of the rear left sensor 10F complements a portion of the field of view Vf1 before the change of the rear left sensor 10F.
[0049] In the changed pattern, the field of view angle θ of the front center sensor 10A is wider than that of the reference pattern, which increases the overlapping area between the changed field of view Va2 of the front center sensor 10A and the pre-change field of view Vb1 of the front right sensor 10B. In other words, the field of view of the front center sensor 10A has expanded toward the field of view Vb1 of the front right sensor 10B, so the changed field of view Va2 of the front center sensor 10A complements a portion of the pre-change field of view Vb1 of the front right sensor 10B. In the changed pattern, the field of view angle θ of the front center sensor 10A is wider than that of the reference pattern, which increases the overlapping area between the changed field of view Va2 of the front center sensor 10A and the pre-change field of view Vc1 of the front left sensor 10C. In other words, the field of view of the front center sensor 10A has expanded toward the field of view Vc1 of the front left sensor 10C, so the changed field of view Va2 of the front center sensor 10A complements a portion of the pre-change field of view Vc1 of the front left sensor 10C.
[0050] As described above, in the change pattern, by changing at least one of the orientation of the field of view center O of the normal sensor and the field of view angle θ, the field of view lost by the abnormal sensor is complemented and sensing (field of view) is maintained all around the vehicle 1.
[0051] In the modified pattern, the viewing angle θ of the front center sensor 10A is wider than in the reference pattern, and the measurement period is maintained.
[0052] B. Variations: The technology disclosed in this specification is not limited to the above-described embodiments, and can be modified into various forms without departing from the spirit thereof, for example, the following modifications are also possible.
[0053] The configurations of the vehicle 1, sensor system 11, and reflective sensor 10 in the above embodiment are merely examples and can be modified in various ways. For example, the mobile object may be a vehicle other than a four-wheeled vehicle (such as a two-wheeled vehicle), or may be a mobile object other than a vehicle (such as a mobile robot). The sensor system 11 is not limited to a mobile object, and may be fixedly installed at a predetermined location. The sensor system 11 may be configured to include at least two reflective sensors.
[0054] In the above embodiment, in the configuration shown in FIG. 4 , at least one of the light projection range of the projector 20 and the light reception range of the receiver 30 may be changed within the range of the maximum field of view of the reflective sensor 10, thereby changing at least one of the field of view angle θ and the orientation of the field of view center O of the reflective sensor 10. Furthermore, in the above embodiment, the first direction is the horizontal direction, but this is not limited thereto and may be a direction other than the horizontal direction (for example, the vertical direction or a direction inclined relative to the vertical direction). For example, in a sensor system in which the field of view of a first reflective sensor and the field of view of a second reflective sensor are adjacent to each other in the vertical (perpendicular) direction, at least one of the orientation of the vertical field of view center and the vertical field of view angle of the first reflective sensor may be changed. Furthermore, both the orientation of the vertical field of view center and the vertical field of view angle of the first reflective sensor may be changed.
[0055] In the surroundings monitoring process of the above embodiment, the detection of an abnormal sensor is exemplified as the change condition, but this is not limiting and the change condition may be, for example, when an input operation by the driver or a change instruction is received from a control device on the vehicle side. In the above embodiment, in the change pattern, the measurement period of the front center sensor 10A may be lengthened compared to the reference pattern to maintain the angular resolution. [Explanation of symbols]
[0056] 1: Vehicle 10: Reflective sensor 10A (10A to 10F): Front center sensor 11: Sensor system 20: Emitter 22: Light source 24: Emitter optical system 26: Emitter control device 28: Current source 30: Receiver 32: Light receiving section 34: Receiving optical system 40: TOF measurement device 42: Control circuit 50: Communication I / F 60: Controller CPU: Multi-core IC: Time measurement L1: Emitted light L2: Reflected light O: Center of field of view P: Measurement point Q: Axis along W: Measurement object
Claims
1. a first reflective sensor; a second reflective sensor; a controller; and a sensor system comprising: The controller sensing the measurement object based on a detection result by the first reflective sensor and a detection result by the second reflective sensor in a first field of view pattern in which a field of view of the first reflective sensor and a field of view of the second reflective sensor are adjacent to each other in a first direction; When a predetermined change condition is satisfied, at least one of the orientation of the field of view center and the field of view angle of the first reflective sensor is changed in the first direction, and an overlapping area between the field of view of the first reflective sensor after the change and the field of view of the second reflective sensor in the first field of view pattern is set to a second field of view pattern that is larger than the first field of view pattern; A sensor system that performs sensing of the measurement object using the second field of view pattern based on the detection result by the first reflective sensor.
2. 2. The sensor system of claim 1, The predetermined change condition includes the controller detecting an abnormality in the second reflective sensor.
3. 2. The sensor system of claim 1, The controller widening the viewing angle of the first reflective sensor relative to the first viewing pattern to set the second viewing pattern; A sensor system, wherein the angular resolution of the first reflective sensor in the first field of view pattern is higher than the angular resolution of the first reflective sensor in the second field of view pattern.
4. 2. The sensor system of claim 1, further comprising a third reflective sensor located on the opposite side of the first reflective sensor from the second reflective sensor in the first direction; The controller changing the orientation of the field of view center of the first reflective sensor to set it to the second field of view pattern; A sensor system that changes at least one of the orientation of the field of view center and the field of view angle of the third reflective sensor, and increases the overlap area between the changed field of view of the third reflective sensor and the field of view of the first reflective sensor in the first field of view pattern compared to the first field of view pattern.
5. A mobile object comprising the sensor system according to any one of claims 1 to 4, The first reflective sensor and the second reflective sensor are disposed on the front side of the moving body.
6. A control method for a sensor system including a first reflective sensor and a second reflective sensor, the method comprising: sensing the measurement object based on a detection result by the first reflective sensor and a detection result by the second reflective sensor in a first field of view pattern in which a field of view of the first reflective sensor and a field of view of the second reflective sensor are adjacent to each other in a first direction; When a predetermined change condition is satisfied, at least one of the orientation of the field of view center and the field of view angle of the first reflective sensor is changed in the first direction, and an overlapping area between the field of view of the first reflective sensor after the change and the field of view of the second reflective sensor in the first field of view pattern is set to a second field of view pattern that is larger than the first field of view pattern; A method for controlling a sensor system, wherein sensing of the measurement object is performed based on the detection result by the first reflective sensor using the second field of view pattern.
7. A sensor system including a first reflective sensor and a second reflective sensor includes a controller, performing sensing of the measurement object based on the detection results by the first reflective sensor and the detection results by the second reflective sensor in a first field of view pattern in which the field of view of the first reflective sensor and the field of view of the second reflective sensor are adjacent to each other in a first direction; When a predetermined change condition is satisfied, at least one of the orientation of the field of view center and the field of view angle of the first reflective sensor is changed in the first direction, and an overlapping area between the field of view of the first reflective sensor after the change and the field of view of the second reflective sensor in the first field of view pattern is set to a second field of view pattern that is larger than the first field of view pattern; a control program for the sensor system that causes sensing of the measurement object to be performed using the second field of view pattern based on the detection result by the first reflective sensor;
8. A computer-readable recording medium having a computer program recorded thereon for controlling a sensor system including a first reflective sensor and a second reflective sensor, For the sensor system, performing sensing of the measurement object based on the detection results by the first reflective sensor and the detection results by the second reflective sensor in a first field of view pattern in which the field of view of the first reflective sensor and the field of view of the second reflective sensor are adjacent to each other in a first direction; When a predetermined change condition is satisfied, at least one of the orientation of the field of view center and the field of view angle of the first reflective sensor is changed in the first direction, and an overlapping area between the field of view of the first reflective sensor after the change and the field of view of the second reflective sensor in the first field of view pattern is set to a second field of view pattern that is larger than the first field of view pattern; A computer-readable recording medium having a computer program recorded thereon, the computer program causing sensing of the measurement object based on the detection result by the first reflective sensor using the second field of view pattern.
Citation Information
Patent Citations
Redundant Hardware Systems for Autonomous Vehicles
JP2022512092A