vehicle

Abstract

To suppress narrowing of an expression angle.SOLUTION: The vehicle includes a first sensor, a second sensor, and a controller. The first sensor detects the position of a first detection point representing a part of the surface of an object in a two-dimensional coordinate system. The second sensor detects the position of a second detection point representing a part of the surface of the object in the two-dimensional coordinate system. The controller derives the position of a virtual detection point in the two-dimensional coordinate system based on a virtual sensor on the basis of the result of detection by the first sensor and the result of detection by the second sensor. The controller moves the virtual sensor from a reference position so as to approach the object on the basis of the result of detection by the first sensor and the result of detection by the second sensor.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] This disclosure relates to a vehicle.

Background Art

[0002] The vehicle disclosed in Patent Document 1 includes a plurality of sensors and a control device. The control device obtains new information by combining the detection results of the plurality of sensors. Thereby, the control device recognizes the external situation.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] A vehicle may include a plurality of sensors that detect the position of a detection point in a two-dimensional coordinate system. When obtaining new information by combining the detection results of these sensors, the control device derives the position of a virtual detection point in a two-dimensional coordinate system with the virtual sensor as the origin from the detection results of the plurality of sensors. In this case, due to the difference between the position of the sensor and the position of the virtual sensor, the expression angle for expressing an object with the virtual sensor as the origin may be narrower than the expression angle for expressing the object with the sensor as the origin.

Means for Solving the Problems

[0005] A vehicle that solves the above problem includes a first sensor that detects the position in a two-dimensional coordinate system of a first detection point representing a part of the surface of an object, a second sensor that detects the position in a two-dimensional coordinate system of a second detection point representing a part of the surface of the object, and a control device. The control device derives the position of a virtual detection point in a two-dimensional coordinate system with the virtual sensor as the origin, based on the detection result of the first sensor and the detection result of the second sensor, and moves the virtual sensor from a reference position closer to the object, based on the detection result of the first sensor and the detection result of the second sensor.

[0006] The control device moves the virtual sensor's position to approach the object. If the virtual sensor's position is kept constant, depending on the relative positions of the object and the virtual sensor, the representation angle for the object, with the virtual sensor as the origin, may become narrower. By moving the virtual sensor's position to approach the object, this narrowing of the representation angle can be suppressed.

[0007] With respect to the above-mentioned vehicle, the control device may move the virtual sensor along a virtual line segment connecting the first sensor and the second sensor. With respect to the above vehicle, the control device may calculate a first average value, which is the average value of the distances to a plurality of first detection points detected by the first sensor in one cycle, and a second average value, which is the average value of the distances to a plurality of second detection points detected by the second sensor in one cycle, and move the virtual sensor so that the ratio of the distance from the first sensor to the virtual sensor and the distance from the second sensor to the virtual sensor matches the ratio of the first average value and the second average value. [Effects of the Invention]

[0008] According to the present invention, it is possible to suppress the narrowing of the display angle. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic diagram of the vehicle's configuration. [Figure 2] This figure shows the field of view and angular resolution of the sensors installed in the vehicle shown in Figure 1. [Figure 3] This diagram shows the location of the sensors installed in the vehicle shown in Figure 1. [Figure 4] This figure schematically shows the virtual sensor generated by the control device shown in Figure 1. [Figure 5] This is a flowchart showing the control performed by the control device in Figure 1. [Figure 6] Figure 5 is a flowchart illustrating the control process by which the control device calculates the position of the virtual generation point. [Figure 7] This figure shows the transition of the virtual sensor's position as the vehicle moves. [Figure 8] This is a diagram to explain the representation angle. [Modes for carrying out the invention]

[0010] One embodiment of the vehicle will be described. <Vehicle> As shown in Figure 1, the vehicle 10 comprises a vehicle body 11, a first sensor 12, a second sensor 13, and a control device 14. The vehicle 10 in this embodiment is configured to move autonomously. The vehicle 10 may move along a generated path. The vehicle 10 may track a predetermined target. The vehicle 10 is, for example, an industrial vehicle, a transport vehicle, or a passenger car. Industrial vehicles include forklifts and towing tractors.

[0011] In this embodiment, the first sensor 12 and the second sensor 13 are identical to each other. Sensors 12 and 13 can detect the two-dimensional position of an object. In this embodiment, LIDAR (Laser Imaging Detection and Ranging) is used as sensors 12 and 13. Sensors 12 and 13 are rangefinders that emit a laser into their surroundings and receive reflected light reflected from the detection point, which is the area where the laser hits. The laser is reflected from the surface of the object. The detection point represents a part of the object's surface.

[0012] As shown in Figure 2, sensors 12 and 13 emit lasers at an angle corresponding to the angular resolution θ2 within the field of view θ1. The field of view θ1 of sensors 12 and 13 is less than 360°. For example, the field of view θ1 of sensors 12 and 13 is 270°. The angular resolution θ2 is, for example, 30°. Sensors 12 and 13 are positioned to emit lasers while changing the irradiation angle in the horizontal direction. Sensors 12 and 13 emit lasers while changing the irradiation angle within the field of view θ1 centered on sensors 12 and 13. The range defined by the field of view θ1 and the reachable distance of the laser is the detectable range of sensors 12 and 13.

[0013] One cycle is defined as one scan of the field of view angle θ1 by sensors 12 and 13. The detection results of sensors 12 and 13 can be represented as a group of distance data. The group of distance data includes multiple distance data detected by sensors 12 and 13 during one cycle. With sensors 12 and 13 of this embodiment, 10 distance data can be obtained during one cycle, corresponding to the angular resolution θ2. The group of distance data is an array of 10 numbers, for example, {1.0, 1.5, 0, 1.2, 1.8, 1.9, 0, 0.8, 1.5, 1.0}. Each of the 10 numbers is distance data indicating the distance to the detection point. If reflected light cannot be received even when the laser is irradiated, the distance data will be 0. The order of the distance data included in the group of distance data represents the angle from the reference angle. The reference angle is predetermined. If the angular resolution θ2 is 30°, the first distance data is 0°, the second distance data is 30°, and the third distance data is 60°. Thus, the later the order of the distance data in the distance data set, the larger the angle from the reference angle. Since the distance data set is data that associates distance data with angles, it can be said to be a collection of data that represents the position of the detection point with sensors 12 and 13 as the origin in a two-dimensional polar coordinate system. Sensors 12 and 13 can be said to detect the position in a two-dimensional coordinate system of the detection point that represents a part of the surface of an object. The distance data set that is the detection result of the first sensor 12 is called the first distance data set. The distance data included in the first distance data set is called the first distance data. The distance data set that is the detection result of the second sensor 13 is called the second distance data set. The distance data included in the second distance data set is called the second distance data.

[0014] As shown in Figure 3, the first sensor 12 and the second sensor 13 are positioned apart from each other. The first sensor 12 is positioned in front of the vehicle 10 compared to the second sensor 13. The first sensor 12 is positioned so that its field of view θ1 is equal in the left-right direction of the vehicle 10. The field of view θ1 of the first sensor 12 extends 135° to the left and right of the vehicle 10. The blind spot of the first sensor 12 is in the rear direction of the vehicle 10. The second sensor 13 is positioned so that its field of view θ1 is equal in the left-right direction of the vehicle 10. The field of view θ1 of the second sensor 13 extends 135° to the left and right of the vehicle 10. The blind spot of the second sensor 13 is in the front direction of the vehicle 10. The first sensor 12 and the second sensor 13 are positioned so that their blind spots face each other. The detection point P1 by the first sensor 12 is referred to as the first detection point P1. The detection point P2 by the second sensor 13 is referred to as the second detection point P2.

[0015] As shown in Figure 1, the control device 14 comprises a processor 15 and a storage unit 16. The storage unit 16 includes RAM (Random Access Memory) and ROM (Read Only Memory). The storage unit 16 stores program code or instructions configured to cause the processor 15 to execute processing. The storage unit 16, i.e., the computer-readable medium, includes any available medium that can be accessed by a general-purpose or dedicated computer. The control device 14 may be composed of hardware circuits such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control device 14, which is a processing circuit, may include one or more processors that operate according to a computer program, one or more hardware circuits such as an ASIC or FPGA, or a combination thereof.

[0016] <Virtual Sensor> As shown in FIG. 4, the control device 14 can derive the position of the virtual detection point P3 in the two-dimensional polar coordinate system with the virtual sensor IS as the origin from the first distance data group and the second distance data group. The virtual sensor IS is a virtual sensor generated by synthesizing the first distance data group and the second distance data group.

[0017] The viewing angle θ3 of the virtual sensor IS is 360°. The angular resolution θ4 of the virtual sensor IS is 30°. The virtual sensor IS has a wider viewing angle θ3 than the sensors 12 and 13 and the same angular resolution θ4 as the sensors 12 and 13. When the virtual sensor IS is arranged at the virtual generation point IP, the control device 14 derives a virtual distance data group detected by the virtual sensor IS. Similar to the distance data group, the virtual distance data group is an array of a plurality of numerical values. The numerical values included in the virtual distance data group are virtual distance data indicating the distance to the virtual detection point P3. The order of the virtual distance data included in the virtual distance data group represents the angle from the reference angle.

[0018] When the virtual detection point P3, which is predicted to have its distance detected when the virtual sensor IS is arranged at the virtual generation point IP, overlaps with the detection points P1 and P2, the control device 14 uses, as the virtual distance data, the distance data to the detection points P1 and P2 that overlap with the virtual detection point P3. When the virtual detection point P3 does not overlap with the detection points P1 and P2, the control device 14 uses, as the virtual distance data, the distance data to the detection points P1 and P2 located within a predetermined range A1 from the virtual detection point P3. The predetermined range A1 is a range in which the detection points P1 and P2 can be regarded as the virtual detection point P3. The predetermined range A1 is, for example, a circular range centered on the virtual detection point P3. When there are no detection points P1 and P2 located within the predetermined range A1 from the virtual detection point P3, the virtual distance data is 0. As described above, distance data is used as the virtual distance data.

[0019] The control device 14 recognizes the position of an object using a set of virtual distance data. The control device 14 may also recognize the position of an object in a Cartesian coordinate system by converting the virtual distance data into coordinates in a Cartesian coordinate system. The control device 14 may also estimate its own position from the position of the recognized object. The self-position is the coordinate of the vehicle 10 in the map data. The control device 14 may perform control to avoid contact between the vehicle 10 and the object based on the position of the recognized object. For example, the control device 14 may perform control to avoid the object or control to slow down the vehicle 10. If the vehicle 10 has a person in it, it may also warn the person. Thus, the control that the control device 14 performs based on the position of the recognized object is arbitrary.

[0020] <Control performed by the control unit when generating a virtual sensor> The control performed by the control device 14 when generating the virtual sensor IS will now be described. This control is repeatedly executed at a predetermined control cycle while the vehicle 10 is starting up.

[0021] As shown in Figure 5, in step S1, the control device 14 acquires a first group of distance data from the first sensor 12. Next, in step S2, the control device 14 calculates a first average value D1, which is the average value of the first distance data. The first average value D1 is the average value of the distances to multiple first detection points P1 detected by the first sensor 12 in one cycle.

[0022] Next, in step S3, the control device 14 acquires a second group of distance data from the second sensor 13. Next, in step S4, the control device 14 calculates a second average value D2, which is the average value of the second distance data. The second average value D2 is the average value of the distances to multiple second detection points P2 detected by the second sensor 13 in one cycle.

[0023] Next, in step S5, the control device 14 calculates the position of the virtual generation point IP. The virtual generation point IP is the position of the virtual sensor IS. The virtual generation point IP is the origin of a two-dimensional polar coordinate system represented by a set of virtual distance data. In this embodiment, the virtual generation point IP is set within the range between the first sensor 12 and the second sensor 13.

[0024] As shown in Figure 6, the virtual generation point IP is set between the first sensor 12 and the second sensor 13. The control device 14 sets the virtual generation point IP on a virtual line segment L1 connecting the first sensor 12 and the second sensor 13. That is, the virtual generation point IP moves along a straight line between the origin of the polar coordinate system representing the position of the first detection point P1 and the origin of the polar coordinate system representing the position of the second detection point P2. In this embodiment, the virtual generation point IP moves in the longitudinal direction of the vehicle 10. The center position of the line segment L1, i.e., the center position between the first sensor 12 and the second sensor 13, is defined as the reference position PS.

[0025] The control device 14 sets a virtual generation point IP at a position that divides the line segment L1 into an average value ratio D1:average value ratio D2. That is, the ratio of the distance from the first sensor 12 to the virtual generation point IP and the distance from the second sensor 13 to the virtual generation point IP is equal to the ratio of the first average value ratio D1 to the second average value ratio D2.

[0026] If the first mean value D1 and the second mean value D2 are the same, the virtual generation point IP is set to the reference position PS. If the first mean value D1 is smaller than the second mean value D2, the distance from the virtual generation point IP to the first sensor 12 will be shorter than the distance from the virtual generation point IP to the second sensor 13. If the first mean value D1 is smaller than the second mean value D2, the distance from the first sensor 12 to the object will be shorter than the distance from the second sensor 13 to the object. Therefore, the virtual generation point IP will move between the first sensor 12 and the second sensor 13 to approach the object.

[0027] As shown in Figure 5, in step S6, the control device 14 sets the virtual generation point IP at the position calculated in step S5. Next, in step S7, the control device 14 derives a set of virtual distance data for the case where the virtual sensor IS is located at the virtual generation point IP set in step S6. As described above, the control device 14 derives the set of virtual distance data using the first set of distance data and the second set of distance data. Since the virtual generation point IP is the location of the virtual sensor IS, the virtual sensor IS will move to approach the object.

[0028] [Operation of this embodiment] As shown in Figure 7, we assume that a vehicle 10 passes between two walls 21 and 22. The vehicle 10 passes between the two walls 21 and 22 while the distance from the two sensors 12 and 13 to the two walls 21 and 22 remains constant. An obstacle 23 is located between the two walls 21 and 22. The obstacle 23 is provided along the wall 22. The two walls 21 and 22, and the obstacle 23 are examples of objects.

[0029] If the obstacle 23 does not enter the detection range of sensors 12 and 13, sensors 12 and 13 will only detect walls 21 and 22. In this case, the first average value D1 and the second average value D2 will be the same. The position of the virtual sensor IS is the reference position PS.

[0030] As the vehicle 10 moves, the obstacle 23 enters the detectable range of the first sensor 12. Since the distance from the first sensor 12 to the obstacle 23 is shorter than the distance from the first sensor 12 to the wall 22, the value of the first average value D1 becomes smaller. The position of the virtual sensor IS moves from the reference position PS toward the first sensor 12, approaching the obstacle 23.

[0031] If the distance from the first sensor 12 to the obstacle 23 is shorter than the distance from the second sensor 13 to the obstacle 23, the first average value D1 will be smaller than the second average value D2. In this case, the position of the virtual sensor IS will move closer to the obstacle 23 from the reference position PS, according to the ratio of the first average value D1 to the second average value D2. In this case, the distance from the first sensor 12 to the virtual sensor IS is shorter than the distance from the second sensor 13 to the virtual sensor IS.

[0032] If the distance from the second sensor 13 to the obstacle 23 is shorter than the distance from the first sensor 12 to the obstacle 23, the second average value D2 will be smaller than the first average value D1. In this case, the position of the virtual sensor IS will move closer to the obstacle 23 from the reference position PS, according to the ratio of the first average value D1 to the second average value D2. In this case, the distance from the second sensor 13 to the virtual sensor IS is shorter than the distance from the first sensor 12 to the virtual sensor IS.

[0033] As described above, the control device 14 moves the position of the virtual sensor IS from the reference position PS closer to the obstacle 23. In other words, the control device 14 moves the position of the virtual sensor IS from the reference position PS closer to the sensors 12 and 13 that are closer to the obstacle 23.

[0034] Furthermore, if multiple objects are present around vehicle 10, there may be objects that the virtual sensor IS moves away from as a result of the virtual sensor IS's movement. The object that affects the first average value D1 and the second average value D2 is the object that has the greatest impact on the control of vehicle 10. If multiple objects are present around vehicle 10, the virtual sensor IS will move closer to the object that has the greatest impact.

[0035] As shown in Figure 8, if the position of the virtual sensor IS is kept constant, the representation angle θ6 representing the object 24 with the virtual sensor IS as the origin may be narrower than the representation angle θ5 representing the object 24 with the first sensor 12 as the origin. The representation angle is the range occupied by the object 24 when viewed from the origin of the coordinate system. As can be seen from Figure 8, the representation angle θ6 with the virtual sensor IS as the origin is narrower than the representation angle θ5 with the first sensor 12 as the origin. A narrow representation angle may reduce the accuracy of object 24 recognition by the control device 14, which may lead to a decrease in self-position estimation accuracy. A narrow representation angle reduces the number of detection points included in the range of the representation angle, making it more difficult to recognize objects. In the example shown in Figure 8, the number of virtual detection points P3 included in the range of the representation angle θ6 is less than the number of first detection points P1 included in the representation angle θ5, so the accuracy of object recognition may decrease when the virtual sensor IS recognizes the object.

[0036] In contrast, in this embodiment, the position of the virtual sensor IS moves closer to the object from the reference position PS. As a result, the position of the virtual sensor IS approaches the first sensor 12. This suppresses the narrowing of the representation angle θ6 of the virtual sensor IS.

[0037] [Operation of this embodiment] (1) The control device 14 moves the position of the virtual sensor IS so that it is closer to the object. This suppresses the narrowing of the display angle.

[0038] (2) The control device 14 moves the position of the virtual sensor IS on a virtual line segment L1 connecting the first sensor 12 and the second sensor 13. When the virtual sensor IS is moved on the line segment L1, the virtual sensor IS moves closer to one of the two sensors 12 and 13. As a result, the detection points P1 and P2 are more likely to be included in the predetermined range A1, and the object represented by the detection points P1 and P2 is more likely to be represented by the virtual detection point P3. As a result, a decrease in the accuracy of object recognition can be suppressed.

[0039] (3) The control device 14 moves the virtual sensor IS so that the ratio of the distance from the first sensor 12 to the virtual sensor IS and the distance from the second sensor 13 to the virtual sensor IS matches the ratio of the first average value D1 to the second average value D2. The shorter the distance between sensors 12 and 13 and the object, the smaller the average value of the distance to detection points P1 and P2 becomes. By moving the virtual sensor IS according to the ratio of the first average value D1 to the second average value D2, the virtual sensor IS can be brought closer to the object.

[0040] [Example of changes] The embodiment can be implemented with the following modifications. The embodiment and the following modifications can be combined with each other to the extent that they do not contradict each other technically.

[0041] ○The control device 14 may move the virtual generation point IP in the left-right direction of the vehicle 10. In this case, the control device 14 calculates the position of the virtual generation point IP based on distance data to the right of the vehicle 10 and distance data to the left of the vehicle 10. For example, the control device 14 calculates the average distance to detection points P1 and P2 within the 135° range to the right of the vehicle 10 within the field of view θ1 of the sensors 12 and 13, and the average distance to detection points P1 and P2 within the 135° range to the left of the vehicle 10 within the field of view θ1 of the sensors 12 and 13. The average distance to detection points P1 and P2 within the 135° range to the right of the vehicle 10 within the field of view θ1 of the sensors 12 and 13 is taken as the right average value. The average distance to detection points P1 and P2 within the 135° range to the left of the vehicle 10 within the field of view θ1 of the sensors 12 and 13 is taken as the left average value. The control device 14 sets a virtual generation point IP to the right of the vehicle 10 relative to the line segment L1 if the right average value is smaller than the left average value. The control device 14 sets a virtual generation point IP to the left of the vehicle 10 relative to the line segment L1 if the left average value is smaller than the right average value. For example, the range extending to the left and right of the vehicle 10 with the line segment L1 as the center may be set as the range in which the virtual generation point IP can move in the left and right directions, and the position of the virtual generation point IP within this range may be set according to the ratio of the right average value to the left average value. In this case, the line segment L1 is the reference position. When the control device 14 moves the virtual generation point IP in the left and right directions of the vehicle 10, it may also move the virtual generation point IP in the front and rear directions of the vehicle 10, or it may not move the virtual generation point IP in the front and rear directions of the vehicle 10.

[0042] ○The control device 14 may convert the distance data into coordinates in a Cartesian coordinate system. Since polar coordinates and Cartesian coordinate systems are mutually convertible, distance data can be converted into coordinates in a Cartesian coordinate system. The Cartesian coordinate system is a coordinate system in which the front-rear direction of the vehicle 10 is the Y axis and the left-right direction of the vehicle 10 is the X axis. The Y coordinate is the distance of the vehicle 10 in the front-rear direction to detection points P1 and P2. The X coordinate is the distance of the vehicle 10 in the left-right direction to detection points P1 and P2. The control device 14 may use the average value of the distances in the Y axis direction to multiple first detection points P1 detected by the first sensor 12 in one cycle as the first average value D1. The control device 14 may use the average value of the distances in the Y axis direction to multiple second detection points P2 detected by the second sensor 13 in one cycle as the second average value D2. The control device 14 may then set the position of the virtual sensor IS from these average values.

[0043] ○The control device 14 may derive the position of the virtual detection point P3 in a two-dimensional Cartesian coordinate system with the virtual sensor IS as the origin from the first distance data set and the second distance data set. In this case, the control device 14 may convert the distance data into Cartesian coordinates and then derive the position of the virtual detection point P3 in a two-dimensional Cartesian coordinate system with the virtual sensor IS as the origin. That is, the two-dimensional coordinate system with the virtual sensor IS as the origin may be a polar coordinate system or a Cartesian coordinate system.

[0044] ○When the control device 14 calculates the average value of the distances to multiple detection points P1 and P2 detected by sensors 12 and 13 in one cycle, it may exclude distance data with a value of 0 when calculating the average value.

[0045] The virtual generation point IP may be set at a position offset from the line segment L1. For example, the virtual generation point IP may be set on a line segment that is parallel to the line segment L1 and at a predetermined distance from the line segment L1.

[0046] Sensors 12 and 13 only need to be capable of detecting the positions of detection points P1 and P2 in a two-dimensional coordinate system. For example, radar, stereo cameras, or ToF (Time of Flight) cameras can be used as sensors 12 and 13. The two-dimensional coordinate system of detection points P1 and P2 may be a polar coordinate system or a Cartesian coordinate system.

[0047] ○The first sensor 12 and the second sensor 13 may have different field of view angles θ1 and different angular resolutions θ2. The first sensor 12 and the second sensor 13 may be of different types. For example, a LIDAR may be used as the first sensor 12 and a stereo camera as the second sensor 13.

[0048] ○The angular resolution θ4 of the virtual sensor IS may be higher or lower than the angular resolution θ2 of sensors 12 and 13. Vehicle 10 may be operated by a person riding in vehicle 10. [Explanation of symbols]

[0049] IS...Virtual sensor, L1...Line segment, P1...First detection point, P2...Second detection point, P3...Virtual detection point, PS...Reference position, 10...Vehicle, 12...First sensor, 13...Second sensor, 14...Control device.

Claims

[Claim 1] A first sensor detects the position in a two-dimensional coordinate system of a first detection point that represents a part of the surface of an object, A second sensor detects the position in a two-dimensional coordinate system of a second detection point that represents a part of the surface of the object, A control device is provided, The control device is Based on the detection results of the first sensor and the detection results of the second sensor, the position of the virtual detection point in a two-dimensional coordinate system with the virtual sensor as the origin is derived. A vehicle that moves a virtual sensor along a virtual line segment connecting the first sensor and the second sensor so as to approach the object from a reference position, based on the detection result of the first sensor and the detection result of the second sensor, The control device is The first average value is calculated, which is the average value of the distances to multiple first detection points detected by the first sensor in one cycle. The second average value is calculated, which is the average value of the distances to multiple second detection points detected by the second sensor in one cycle. A vehicle that moves the virtual sensor such that the ratio of the distance from the first sensor to the virtual sensor to the distance from the second sensor to the virtual sensor matches the ratio of the first average value to the second average value.

Images