Obstacle detection device and obstacle detection method
The obstacle detection device improves parking efficiency by accurately distinguishing between relevant and irrelevant objects using ultrasonic sensors and internal/external determination, reducing unnecessary stops and shortening parking time.
Patent Information
- Application Number
- JP2021006345
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-01-19
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2041-01-19
AI Technical Summary
Existing obstacle detection systems inaccurately identify objects as potential obstacles, leading to unnecessary vehicle stops during parking, which prolongs the parking process.
An obstacle detection device that utilizes ultrasonic sensors to determine the range of detected objects and an internal/external determining unit to differentiate between objects within and outside the vehicle's travel path, improving accuracy and reducing false detections.
Enhances the accuracy of obstacle detection and reduces the time required for parking by minimizing false stops due to incorrect obstacle identification.
Smart Images

Figure 0007587992000001 
Figure 0007587992000002 
Figure 0007587992000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an obstacle detection device and an obstacle detection method. [Background technology]
[0002] 2. Description of the Related Art Conventionally, there is known a device that detects objects present around a vehicle and determines whether or not the detected object is an obstacle that may hinder the vehicle traveling along a parking path. For example, Patent Document 1 discloses an obstacle detection and notification device that includes a moving obstacle detection unit that detects moving obstacles within a monitoring area, a first calculation unit that calculates a predicted movement path of the moving obstacle, a second calculation unit that calculates a predicted movement path of the host vehicle, an exclusion unit that excludes moving obstacles that are unlikely to reach an alarm execution area from moving obstacles to be warned about based on the predicted movement path of the moving obstacle and the predicted movement path of the host vehicle, and an alarm unit that issues an alarm for moving obstacles to be warned about. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-180909 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, there were many detected objects, and there were cases where the object was judged to be in contact with or colliding with the vehicle due to erroneous detection, causing the vehicle to stop moving. When the vehicle stopped moving, the parking route was recalculated, which caused the problem of taking a long time to park.
[0005] An object of the present invention is to provide an obstacle detection device and an obstacle detection method that improve the accuracy of detecting obstacles that impede a traveling vehicle and reduce the time required for parking. [Means for solving the problem]
[0006] In order to achieve the above object, the obstacle detection device of the present invention includes an input interface connected to an external device, route information which is information on a parking route to a parking position where a vehicle is to be parked, and obstacle detection information which is information on obstacles existing around the vehicle. Show the extent of the structure Range information; Sensor data obtained by detecting objects around the vehicle using ultrasonic waves; and an acquisition unit that acquires the route information; a driving control unit that generates a drive signal to operate a driving drive unit that drives the vehicle according to the route information acquired by the acquisition unit, and outputs the generated drive signal to the driving drive unit; before Through the input interface Enter Forced The sensor data indicates The object is the Structure Located inside the range Ruka , the above Structure Located outside the range Ruka of, Based on the range information an inside / outside determination unit that determines Structure The parking system further includes an obstacle determination unit that determines whether an object determined to be outside the range will be an obstacle to the vehicle traveling along the parking path. Effect of the Invention
[0007] According to the present invention, the accuracy of detecting an obstacle that may be an impediment to a traveling vehicle can be improved, and the time required for parking can be shortened. [Brief description of the drawings]
[0008] [Figure 1] FIG. 2 is a block diagram showing a configuration of an in-vehicle device. [Diagram 2] FIG. 2 is a diagram showing a state in which the vehicle and its surroundings are viewed from above. [Diagram 3] FIG. 4 is a diagram showing the positions of detection points detected by a sonar unit. [Figure 4] FIG. 2 is a diagram showing an example of a surrounding area map. [Diagram 5] FIG. 4 is a diagram illustrating an example of an obstacle map. [Figure 6] FIG. 13 is a diagram showing an example of an obstacle map, illustrating decision points set on a parking path. [Figure 7] FIG. 13 is a diagram showing an example of an obstacle map, and is a diagram showing a host vehicle figure. [Figure 8] 4 is a flowchart showing an operation of the obstacle detection device. [Figure 9] 4 is a flowchart showing an operation of the obstacle detection device. [Figure 10] FIG. 13 is a block diagram showing a configuration of a modified example of an obstacle detection device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
[0010] 1 is a diagram showing a configuration of an in-vehicle device 3 mounted on a vehicle. In the following, the vehicle on which the in-vehicle device 3 is mounted is referred to as a host vehicle 1A. The in-vehicle device 3 includes a position detection unit 10, a sonar unit 30, a path generation device 50, an obstacle detection device 100, and a traveling drive device 150, all connected via a communication bus 5. The communication bus 5 is a bus for data communication conforming to standards such as Ethernet (registered trademark), CAN (Controller Area Network), and LIN (Local Interconnect Network).
[0011] The position detection unit 10 detects the position of the vehicle 1A. The position detection unit 10 includes a GNSS (Global Navigation Satellite System) receiver and a processor (both not shown). The GNSS receiver receives signals transmitted from satellites. The processor calculates the latitude and longitude, which are position information of the vehicle 1A, based on the signals received by the GNSS receiver, and the orientation of the vehicle 1A based on the difference in calculated position information. The position detection unit 10 outputs the calculated position information and orientation information of the vehicle 1A to the route generation device 50.
[0012] The sonar unit 30 is mounted at multiple locations, such as the front, rear, left side, and right side, of the vehicle 1A, and detects objects present around the vehicle 1A using ultrasonic waves. Specifically, the sonar unit 30 detects the distance to the object, information on the direction based on the vehicle 1A, etc. The sonar unit 30 outputs sensor data indicating the sensing result to the path generating device 50 and the obstacle detecting device 100.
[0013] In this embodiment, a case will be described in which the in-vehicle device 3 is equipped with a sonar, but the sensor that can be installed in the in-vehicle device 3 is not limited to a sonar. For example, the in-vehicle device 3 may be equipped with a radar or a LiDAR (Laser Imaging Detection and Ranging) that can measure the distance to an object using radio waves, light, etc. Also, the in-vehicle device 3 may be equipped with a camera.
[0014] The route generating device 50 is a computer device including an input / output interface (hereinafter, interface will be abbreviated as I / F) 60, a memory 70, and a processor 80. In addition to these devices, the route generating device 50 may be configured to include a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).
[0015] The input / output I / F 60 is connected to the communication bus 5, and performs data communication with external devices connected to the communication bus 5. The external devices include a position detection unit 10, a sonar unit 30, and an obstacle detection device 100.
[0016] The memory 70 is configured with a ROM (Read Only Memory), a RAM (Random Access Memory), or the like. The memory 70 may also be configured with a non-volatile semiconductor memory such as a flash memory. The memory 70 stores computer programs executed by the processor 80, data processed by the processor 80 when executing the computer programs, and data resulting from the processing. The memory 70 also stores sensor data output by the sonar unit 30. The processor 80 is composed of a CPU (Central Processing Unit), an MPU (Microprocessor Unit), and the like.
[0017] The path generation device 50 includes, as functional components, a position acquisition unit 81, a situation acquisition unit 82, a map generation unit 83, a parking position determination unit 84, a parking path generation unit 85, and a driving information generation unit 86. These functional components are functions realized by the processor 80 performing calculations in accordance with a computer program.
[0018] The position acquisition unit 81 receives position information and orientation information of the vehicle 1A calculated by the position detection unit 10. The position acquisition unit 81 corrects the position information and orientation information input from the position detection unit 10 using a well-known dead reckoning method. The position acquisition unit 81 outputs the corrected position information and orientation information to the map generation unit 83. The position acquisition unit 81 also outputs the corrected position information and orientation information to the obstacle detection device 100. Hereinafter, the position information and orientation information will be referred to as position and orientation information.
[0019] The situation acquisition unit 82 causes the sonar unit 30 to execute sensing, and acquires, as ambient information, sensor data that is the detection result of the sonar unit 30. The situation acquisition unit 82 temporarily stores the acquired sensor data in the memory .
[0020] The map generating unit 83 generates a surrounding map 200 (see FIG. 4) showing the situation around the vehicle 1A based on the position and direction information input from the position acquiring unit 81 and the sensor data acquired from the memory 70. The surrounding map 200 records the position of the vehicle 1A, the positions of objects around the vehicle 1A, the distances to the objects, the positions of parking spaces such as white lines painted on the road surface of the parking lot, and the like. The objects recorded in the surrounding map 200 include, for example, other vehicles and structures such as pillars and walls of the parking lot. Hereinafter, these objects are referred to as targets. Since the parking spaces are painted on the road surface with a predetermined thickness, intervals corresponding to the thickness of the white lines are detected as periodic features.
[0021] Furthermore, when recording the position and range of a detected object in the surrounding area map 200, the map generation unit 83 generates a range graphic indicating the range of the object, and records the generated range graphic in the surrounding area map 200. Here, the range graphic generated by the map generation unit 83 will be described with reference to Figures 2 to 4. Figure 2 is a diagram of the host vehicle 1A and its surroundings as viewed from above.
[0022] As shown in FIG. 2, there are three parking areas 201, 202, and 203 on the right side of the host vehicle 1A, and a wall 220 is installed on the left side of the host vehicle 1A. Another vehicle 1B is parked in the parking area 201, and another vehicle 1C is parked in the parking area 203. In FIG. 2, the position of the host vehicle 1A is indicated as position S0. Position S0 indicates the reference position of the host vehicle 1A. The reference position is a preset position of the host vehicle 1A, and may be, for example, the center position of the front or rear wheels in the vehicle width direction, the center of gravity of the host vehicle 1A, or the center position in the vehicle length direction and the vehicle width direction.
[0023] 3 is a diagram showing the positions of detection points T detected by the sensor data of the sonar unit 30 while the host vehicle 1A moves to the position S0 shown in FIG. 2. In the example shown in FIG. 3, T1, T2, T3, and T4 are detected as detection points T of the other vehicle 1B, and T11, T12, T13, and T14 are detected as detection points T of the other vehicle 1C. Also, a case is shown in which T21, T22, T23, T24, T25, and T26 are detected as detection points T of the wall 220. Note that FIG. 3 does not show all detection points T detected by the sensor data of the sonar unit 30, and in reality, the sonar unit 30 detects objects with more detailed accuracy.
[0024] FIG. 4 is a diagram showing an example of the surrounding area map 200 generated by the map generating unit 83. As shown in FIG. In the surrounding area map 200, a coordinate system is set with the position S0 of the host vehicle 1A as the origin and two orthogonal axes, an x-axis and a y-axis. For example, the x-axis is parallel to the vehicle length direction of the host vehicle 1A, and the y-axis is parallel to the vehicle width direction of the host vehicle 1A. The position S0 of the host vehicle 1A is a position indicated by the position and orientation information acquired by the position acquisition unit 81. In addition, in the surrounding area map 200, rectangular range figures 211, 213, and 225 generated by the map generation unit 83 based on the coordinates of the detection point T are recorded. Range figure 211 is a rectangular figure indicating the range of the target object, other vehicle 1B, range figure 213 is a rectangular figure indicating the range of the target object, other vehicle 1C, and range figure 225 is a rectangular figure indicating the range of the target object, wall 220.
[0025] As the range figures 211, 213 and 225 indicating the range of the object, figures corresponding to the detailed shapes of the other vehicle 1B, the other vehicle 1C and the wall 220 may be created. However, this increases the processing load of the route generation device 50 and makes it difficult to generate the figures. Success For this reason, the map generating unit 83 groups together sensor data that can be determined to be data that detects one target object, and generates range figures 211, 213, and 225 that indicate the range of the target object. The map generating unit 83 determines that data in which the interval between positions indicated by the sensor data is equal to or less than a preset distance is data of one target object.
[0026] The map generating unit 83 selects, for each object, detection points T that indicate the maximum and minimum values in the x-axis direction and the maximum and minimum values in the y-axis direction. For example, in the case of the other vehicle 1B, T1 is selected as the detection point T showing the maximum value in the x-axis direction, and T3 or T4 is selected as the detection point T showing the minimum value in the x-axis direction. Also, T4 is selected as the detection point T showing the maximum value in the y-axis direction, and T2 is selected as the detection point T showing the minimum value in the y-axis direction.
[0027] The map generating unit 83 generates rectangular range figures 211, 213, and 225 based on the coordinates of the selected detection point T. For example, the map generating unit 83 generates a figure consisting of a first side passing through detection point T1 indicating the maximum value in the x-axis direction and parallel to the y-axis, a second side passing through detection point T3 indicating the minimum value in the x-axis direction and parallel to the y-axis, a third side passing through detection point T4 indicating the maximum value in the y-axis direction and parallel to the x-axis, and a fourth side passing through detection point T2 indicating the minimum value in the y-axis direction and parallel to the x-axis, as the range figure 211 indicating the range of the other vehicle 1B. The range graphic 211 is a graphic having four vertices, namely, point A (xa, ya), point B (xb, yb), point C (xc, yc), and point D (xd, yd) shown in FIG. The range graphic 213 is a graphic having four vertices: point E (xe, ye), point F (xf, yf), point G (xg, yg), and point H (xh, yh). The range graphic 225 is a graphic having four vertices: point I (xi, yi), point J (xj, yj), point K (xk, yk), and point L (xl, yl).
[0028] When the vehicle 1A is located at the position S0 shown in FIG. 2 to FIG. 4, the positions of the surfaces of the other vehicles 1B and 1C opposite to the side facing the vehicle 1A are determined by the sonar unit 30 The sensor data from the range graphic 211 cannot measure the position of the surface of the wall 220 opposite to the surface facing the vehicle 1A. Similarly, when the vehicle 1A is located at the position S0, the position of the surface of the wall 220 opposite to the surface facing the vehicle 1A cannot be measured. However, the positions of the surfaces of the other vehicles 1B, 1C and the wall 220 opposite to the surface facing the vehicle 1A do not require high accuracy from the viewpoint of collision detection, so a preset value may be set. For example, the y coordinate value of the point B of the range graphic 211 may be set to a value obtained by adding or subtracting a preset value to the y coordinate value of the point A (xa, ya), and the y coordinate value of the point D of the range graphic 211 may be set to a value obtained by adding or subtracting a preset value to the y coordinate value of the point C (xc, yc).
[0029] The parking position determination unit 84 determines a parking frame in which the host vehicle 1A is to be parked, with reference to the surrounding area map 200 generated by the map generation unit 83. For example, the parking position determination unit 84 selects a parking frame in which no object is detected and the distance from the host vehicle 1A is equal to or less than a preset distance from among the parking frames recorded in the surrounding area map 200. The parking position determination unit 84 determines the parking position P by setting a position and an angle at which the host vehicle 1A is to be parked within the selected parking frame.
[0030] The parking path generating unit 85 generates a parking path R for parking the host vehicle 1A at the parking position P determined by the parking position determining unit 84. The parking path R is a path for moving the host vehicle 1A from the position S0 of the host vehicle 1A to the parking position P. A known means is used for the parking path generating process.
[0031] The driving information generating unit 86 receives information on the parking route R generated by the parking route generating unit 85. The driving information generating unit 86 generates driving information that causes the obstacle detection device 100 to control the traveling drive device 150 based on the input information on the parking route R. Furthermore, the driving information generating unit 86 refers to the surroundings map 200 generated in the memory 70 by the map generating unit 83, and acquires the coordinates of the four vertices of range figures 211, 213 and 225 indicating the position and range of the object. The driving information generation unit 86 outputs to the obstacle detection device 100 control information including route information which is information about the parking route R, range information which is information about the coordinates of the four vertices of the range figures 211, 213 and 225, and the generated driving information.
[0032] The obstacle detection device 100 is a computer device including an input / output I / F 110, a memory 120, and a processor 130. In addition to these devices, the obstacle detection device 100 may be configured to include a storage device such as an HDD or SSD.
[0033] The input / output I / F 110 is connected to the communication bus 5, and performs data communication with external devices connected to the communication bus 5. The external devices include the position detection unit 10, the sonar unit 30, the path generation device 50, and the traveling drive device 150.
[0034] The memory 120 is configured with a ROM (Read Only Memory), a RAM (Random Access Memory), or the like. The memory 120 may also be configured with a non-volatile semiconductor memory such as a flash memory. The memory 120 stores computer programs executed by the processor 130, data processed by the processor 130 when executing the computer programs, and data resulting from the processing. The memory 120 also stores sensor data output by the sonar unit 30 and control information input from the path generating device 50. The processor 80 is composed of a CPU, an MPU, and the like.
[0035] The obstacle detection device 100 includes, as functional components, an acquisition unit 131, a driving control unit 132, an inside / outside determination unit 133, and an obstacle determination unit 134. These functional components are functions realized by the processor 80 performing calculations in accordance with a computer program.
[0036] The acquisition unit 131 acquires the range information and sensor data included in the control information stored in the memory 120. The acquisition unit 131 outputs the acquired range information and sensor data to the inside / outside determination unit 133. In addition, the acquisition unit 131 outputs the driving information stored in the memory 120 to the driving control unit 132. Furthermore, the acquisition unit 131 acquires the route information stored in the memory 120. The acquisition unit 131 outputs the acquired route information to the obstacle determination unit .
[0037] When the driving information is input from the acquisition unit 131, the driving control unit 132 generates driving information for driving each unit of the traveling drive device 150 according to the input driving information. The driving control unit 132 outputs the generated driving information to the traveling drive device 150.
[0038] Here, the traveling drive device 150 will be described. The traveling drive device 150 includes a steering device 151 , a drive device 153 , a braking device 155 and a transmission device 157 . The steering device 151 is a device including an actuator for steering the steering wheels of the host vehicle 1A. The driving control unit 132 drives the actuator based on the driving information to steer the steering wheels. The driving device 153 is a device including an actuator that adjusts the driving force of the driving wheels of the host vehicle 1A. If the power source of the host vehicle 1A is an engine, this actuator corresponds to a throttle actuator, and if the power source is a motor, this actuator corresponds to the motor. The driving control unit 132 drives the actuator based on the driving information to adjust the driving force of the driving wheels of the host vehicle 1A.
[0039] The braking device 155 is a device that controls a brake system provided in the host vehicle 1A and includes an actuator that controls the braking force applied to the wheels of the host vehicle 1A. The driving control unit 132 drives the actuator based on the driving information to control the braking force applied to the wheels of the host vehicle 1A. The transmission 157 is a device that includes a transmission and an actuator. The driving control unit 132 drives an actuator based on the driving information to change the gear ratio of the transmission and switch between forward and reverse driving of the host vehicle 1A.
[0040] The inside / outside determination unit 133 receives range information from the acquisition unit 131. The inside / outside determination unit 133 loads in the memory 120 a range graphic indicating the position and range of the object indicated by the input range information, and generates an obstacle map 300. An example of the obstacle map 300 is shown in Figs. 5 to 7.
[0041] Furthermore, when the sensor data is input from the acquisition unit 131, the inside / outside determination unit 133 acquires information about the object contained in the input sensor data. That is, the inside / outside determination unit 133 acquires information about the distance to the object indicated by the sensor data input from the sonar unit 30 and the direction of the object relative to the vehicle 1A. Based on the acquired information about the distance to the object, the direction, etc., the inside / outside determination unit 133 determines whether the object is located inside or outside the range figures 211, 213, 225 shown on the obstacle map 300.
[0042] FIG. 5 is a diagram showing an example of the obstacle map 300 generated by the inside / outside determination unit 133. The obstacle map 300 also has a coordinate system set with the position S0 of the vehicle 1A as the origin and two orthogonal axes, an x-axis and a y-axis. Point U in Fig. 5 indicates the position of an object detected by sensor data. Let the coordinates of point U be (xu, yu).
[0043] First, inside / outside determination unit 133 selects one of the target range figures. Here, a case where range figure 211 is selected will be described. Inside / outside determination unit 133 selects two adjacent vertices from among the four vertices of range figure 211. Fig. 5 shows a state in which point A and point B are selected as the two adjacent vertices. Point A is located upstream when the vertices of range graphic 211 are selected clockwise, and point B is located downstream when the vertices of range graphic 211 are selected clockwise. Inside / outside determination unit 133 generates vector AB starting from point A located upstream and ending at point B located downstream, and vector AU starting from point A and ending at point U. The components of vector AB are (xb-xa, yb-ya), and the components of vector AU are (xu-xa, yu-ya).
[0044] Next, inside / outside determination section 133 calculates the cross product AB×AU of vector AB and vector AU. Vector AB x Vector AU = {(xb-xa) (yu-ya)} - {(xu-xa) (yb-xa)} At this time, the inside / outside determination unit 133 generates a cross product calculation formula so that a vector connecting two vertices of the range figure 211 (for example, vector AB) comes before a vector connecting one vertex of the range figure 211 and the coordinates of the object (for example, vector AU).
[0045] In addition to the cross product between vectors AB and vector AU, inside / outside determination unit 133 also calculates the cross products of the other two adjacent vertices of range graphic 211 with point U of the object. Specifically, inside / outside determination unit 133 calculates the cross product between vectors BD and vector BU (vector BD x vector BU), the cross product between vectors DC and vector DU (vector DC x vector DU), and the cross product between vectors CA and vector CU (vector CA x vector CU). If any one of the results of the cross product calculations contains a positive value, the inside / outside determination unit 133 determines that the point U of the object is located outside the range graphic 211. In addition, if all of the results of the cross product calculations are negative values, the inside / outside determination unit 133 determines that the point U is located inside the range graphic 211.
[0046] The inside / outside determination unit 133 determines whether the point U of the object is located inside or outside the range graphic 213, 225 for all other range graphic figures 213, 225 indicated by the range information. When the inside / outside determination unit 133 determines that the point U of the object is located outside all the range graphic figures 211, 213, and 225, it determines that the point U of the object is a target for obstacle determination. When the inside / outside determination unit 133 determines that the point U of the object is located inside any one of the range graphic figures 211, 213, and 225, it determines that the point U of the object is not a target for obstacle determination. For example, when the point U of the object is a point within the range graphic figure 211, the point U of the object is determined to be a point at which another vehicle 1B is detected. Since the path generating device 50 generates the parking path R taking into consideration the position of the other vehicle 1B, if the point U of the object is a point within the range graphic 211, it can be determined that the host vehicle 1A will not come into contact with or collide with the object even if the host vehicle 1A travels along the parking path R. Therefore, when the inside / outside determination unit 133 determines that the point U of the object is located inside any one of the range graphics 211, 213, and 225, it excludes the point U of this object from the object of obstacle determination. The inside / outside determination unit 133 outputs the coordinates of the point U of the object determined to be the object of obstacle determination to the obstacle determination unit 134.
[0047] 6 and 7 are diagrams showing the obstacle map 300. As shown in FIG. The obstacle determination unit 134 receives the coordinates of point U of an object that the inside / outside determination unit 133 has determined to be located outside all of the range figures 211, 213, and 225, as well as the route information and position / orientation information acquired by the acquisition unit 131. The obstacle determination unit 134 determines whether or not the point U of the object whose coordinates have been inputted becomes an obstacle to the host vehicle 1A traveling along the parking path R. The obstacle determination unit 134 determines, as an obstacle, an object that is determined to come into contact with or collide with the host vehicle 1A traveling along the parking path.
[0048] First, the obstacle determination unit 134 sets a plurality of judgment points W on the parking route R indicated by the route information. For example, the obstacle determination unit 134 sets judgment points W for each preset distance. Fig. 6 shows a state in which the parking route R has a route R1 and a route R2, and five judgment points W1, W2, W3, W4, and W5 are set on the route R1 and the route R2.
[0049] When the distance between the host vehicle 1A traveling along the parking path R and the judgment point W becomes equal to or shorter than a predetermined distance, the obstacle determination unit 134 calculates the direction of the host vehicle 1A when it moves to the judgment point W, and calculates the range occupied by the host vehicle 1A when the host vehicle 1A is located at the judgment point W. The obstacle determination unit 134 develops a host vehicle figure 310 indicating the calculated range of the host vehicle 1A on the obstacle map 300. FIG. 7 shows the host vehicle figure 310 when the host vehicle 1A is located at the judgment point W3. The obstacle determination unit 134 calculates the distance between the coordinates of the point U of the object input from the inside / outside determination unit 133 and the host vehicle figure 310, and determines whether or not the host vehicle 1A will come into contact with or collide with the object. If the distance between the host vehicle diagram 310 and the coordinates of the object point U is equal to or less than a preset distance, the obstacle determination unit 134 determines that the object is an obstacle. When the obstacle determination unit 134 determines that the object is an obstacle, it instructs the driving control unit 132 to stop the host vehicle 1A from traveling.
[0050] When the driving control unit 132 receives the coordinates of the object determined to be an obstacle from the obstacle determination unit 134, it stops the traveling of the host vehicle 1A. The driving control unit 132 notifies the route generation device 50 that the traveling of the host vehicle 1A has been stopped, and causes the route generation device 50 to generate again a parking route that can avoid contact or collision with the obstacle.
[0051] 8 and 9 are flowcharts showing the operation of the obstacle detection device 100. The operation of the obstacle detection device 100 will be described with reference to the flow charts shown in FIGS. First, the obstacle detection device 100 determines whether or not control information has been acquired from the path generation device 50 (step S1). The path generation device 50 generates path information, range information, and driving information, and outputs the generated information to the obstacle detection device 100 as control information. The obstacle detection device 100 temporarily stores the input control information in the memory 120. The obstacle detection device 100 determines that the control information has been acquired by reading the control information from the memory 120. Step S1 corresponds to an acquisition step.
[0052] When the obstacle detection device 100 acquires the control information (step S1 / YES), it generates an obstacle map 300 in the memory 120 based on the range information included in the control information (step S2). The obstacle detection device 100 records a range figure indicating the position and range indicated by the range information in the obstacle map 300, and generates the obstacle map 300.
[0053] Next, the obstacle detection device 100 generates a drive signal to operate each part of the traveling drive device 150 according to the driving information included in the control information. The driving control unit 132 outputs the generated drive signal to the traveling drive device 150 to start traveling of the host vehicle 1A (step S3). As a result, the host vehicle 1A starts traveling to the parking position P according to the parking route generated by the route generation device 50. Step S3 corresponds to an output step.
[0054] Next, the obstacle detection device 100 acquires sensor data indicating the detection result of the sonar unit 30 from the memory 120. (Step S4) The obstacle detection device 100 determines whether or not the acquired sensor data includes information about an object (step S5). Here, the obstacle detection device 100 acquires information about the distance to the object and the direction of the object relative to the host vehicle 1A. If the obstacle detection device 100 cannot acquire information about the object from the sensor data (step S5 / NO), it acquires position and direction information from the position acquisition unit 81 and determines whether or not the vehicle has arrived at the parking position P based on the acquired position and direction information (step S12).
[0055] If the vehicle has arrived at the parking position P (step S12 / YES), the obstacle detection device 100 ends this processing flow. If the vehicle has not arrived at the parking position P (step S12 / NO), the obstacle detection device 100 acquires sensor data again (step S4) and determines whether or not an object has been detected.
[0056] Furthermore, when the obstacle detection device 100 detects an object in the determination of step S5 (step S5 / YES), it performs inside / outside determination processing to determine whether the position of the detected object is inside or outside the range figure (step S6). Details of the inside / outside determination processing will be described with reference to the flowchart of Fig. 9. Step S6 corresponds to an inside / outside determination step.
[0057] If there is no object determined to be located outside the range figure as a result of the inside / outside determination process (step S7 / NO), the obstacle detection device 100 returns to the process of step S4 and acquires sensor data. If there is an object determined to be located outside the range figure (step S7 / YES), the obstacle detection device 100 performs an obstacle determination process to determine whether or not the detected object is an obstacle that may come into contact with or collide with the vehicle 1A traveling along the parking path (step S9). Step S9 is disability This corresponds to the harmful object determination step.
[0058] The obstacle detection device 100 sets a plurality of judgment points W on the parking path, and calculates the orientation of the host vehicle 1A at the set judgment points W based on the position and orientation information input from the position acquisition unit 81. The obstacle detection device 100 generates a host vehicle figure that indicates the range of the host vehicle 1A when the host vehicle 1A is located at the judgment point W, based on the calculated orientation of the host vehicle 1A at the judgment point W. The obstacle detection device 100 judges whether the distance between the generated host vehicle figure and the detected object is equal to or less than a preset distance. (Step S10)If the distance between the host vehicle figure and the object is equal to or less than the preset distance (step S10 / YES), the obstacle detection device 100 stops driving the driving device 153 and drives the braking device 155 to stop the host vehicle 1A from traveling (step S11). If the distance between the host vehicle figure and the object is not equal to or less than the preset distance (step S10 / NO), the obstacle detection device 100 proceeds to the judgment of step S12.
[0059] Next, the inside / outside determination process in step S6 will be described in detail with reference to the flowchart shown in FIG. First, the obstacle detection device 100 selects one of the range figures (step S61). Next, the obstacle detection device 100 selects two adjacent vertices from among the vertices of the selected range figure in a clockwise direction (step S62). Here, the two selected vertices are A and B, and the point of the object is point U. It is also assumed that point A is located upstream and point B is located downstream when selecting two adjacent vertices of the range figure in a clockwise direction. Next, the obstacle detection device 100 generates the coordinates of the object, a vector AB connecting the two selected vertices, and a vector AU connecting the upstream vertex A and the point U of the object, and calculates the cross product AB×AU of the generated vectors (step S63). Next, the obstacle detection device 100 determines whether or not there is any combination of the two adjacent vertices of the range figure selected in step S61 that has not been selected (step S64).
[0060] If there is a combination of two adjacent vertices that has not been selected (step S64 / YES), the obstacle detection device 100 returns to step S62 and selects two adjacent vertices. If there is no combination of two adjacent vertices that has not been selected (step S64 / NO), the obstacle detection device 100 determines whether or not the cross product values calculated for each combination of two adjacent vertices are all negative values (step S65). If the cross product values are not all negative values, that is, if the cross product values include a positive value (step S65 / NO), the obstacle detection device 100 determines that the position of the object is outside the range figure (step S67). If the cross product values are all negative values (step S65 / YES), the obstacle detection device 100 determines that the position of the object is inside the range figure (step S66).
[0061] Next, the obstacle detection device 100 judges whether or not all range figures have been selected as targets (step S68). If the obstacle detection device 100 has not selected all range figures as targets (step S68 / NO), the obstacle detection device 100 returns to step S61 and selects one of the unselected range figures (step S61). If the obstacle detection device 100 has selected all range figures as targets (step S68 / YES), the obstacle detection device 100 judges whether or not there is a range figure that is determined to have an object located inside (step S69).
[0062] If there is no range figure that the object is determined to be located inside (step S69 / NO), the obstacle detection device 100 determines that the object is located outside all range figures (step S70). The obstacle detection device 100 determines that this object is a target for obstacle determination, and outputs the coordinates of the object. Furthermore, if there is a range figure within which the obstacle detection device 100 has determined that the object is located (step S69 / YES), the obstacle detection device 100 determines that the object is located within the range figure, and determines whether there are other objects that have not been processed (step S71). If there are other objects that have not been processed (step S71 / YES), the obstacle detection device 100 returns to the processing of step S61. If there are no other objects that have not been processed (step S71 / NO), the obstacle detection device 100 proceeds to the processing of step S7.
[0063] As described above, the obstacle detection device 100 of this embodiment includes the input / output I / F 110, the acquisition unit 131, the driving control unit 132, the inside / outside determination unit 133, and the obstacle determination unit .
[0064] The acquisition unit 131 acquires route information, which is information about a parking route R to a parking position P where the host vehicle 1A is to be parked, and range information, which indicates the positions and ranges of objects existing around the host vehicle 1A. The driving control unit 132 generates a drive signal for operating the traveling drive device 150 that drives the host vehicle 1A in accordance with the route information acquired by the acquisition unit 131, and outputs the generated drive signal to the traveling drive device 150. When surrounding information indicating the situation around the vehicle 1A is input from the route generating device 50 via the input / output I / F 110, the inside / outside determination unit 133 determines whether an object included in the input surrounding information is located inside or outside the range indicated by the acquired range information. In other words, the inside / outside determination unit 133 determines whether an object indicated by the sensor data input from the sonar unit 30 is located inside or outside the range indicated by the range information. The obstacle determination unit 134 determines whether or not an object that is determined by the inside / outside determination unit 133 to be located outside the range will be an obstacle to the host vehicle 1A traveling along the parking route R. Therefore, the obstacle detection device 100 performs obstacle determination for objects located outside the range indicated by the range information, thereby shortening the time required to detect an obstacle that poses an obstacle to the host vehicle 1A and improving the detection accuracy of an obstacle that poses an obstacle to the host vehicle 1A.
[0065] Furthermore, the obstacle detection device 100 does not determine whether an object that is determined by the inside / outside determination unit 133 to be located inside the range will be an obstacle to the host vehicle 1A traveling along the parking path R. Therefore, the obstacle detection device 100 can reduce the time required to detect an obstacle that may be an obstacle to the host vehicle 1A.
[0066] The inside / outside determination unit 133 calculates the cross product of a vector connecting the coordinates of two adjacent vertices of the range indicated by the range information and a vector connecting one of the two vertices and the coordinates of the object, and determines whether the object is located inside or outside the range indicated by the range information based on the result of the cross product. Therefore, it is necessary to determine whether the obstacle is located within the range indicated by the range information or outside the range. accuracy can be improved.
[0067] The obstacle determining unit 134 sets a plurality of determination points W on the parking path R, and generates a host vehicle figure 310 indicating the area occupied by the host vehicle 1A when the host vehicle 1A is positioned at each of the determination points W. The obstacle determination unit 134 determines that an object whose distance from the host vehicle figure 310 is less than a preset distance is an obstacle, and when an object determined to be an obstacle is detected, it instructs the driving control unit 132 to stop the host vehicle 1A. Therefore, when an obstacle that may be an obstacle to the host vehicle 1A traveling along the parking path is detected, the host vehicle 1A can be stopped from traveling.
[0068] The above-described embodiment is merely an example of one aspect of the present invention, and any modifications and applications are possible without departing from the spirit and scope of the present invention. For example, the path generating device 50 and the obstacle detection device 100 may be configured by separate computer devices as shown in FIG. 1, or may be configured by one computer device as shown in FIG. 10. FIG. 10 shows a configuration in which the obstacle detection device 500 includes a position acquisition unit 531, a situation acquisition unit 532, an acquisition unit 540, a driving information generation unit 533, a driving control unit 534, an inside / outside determination unit 535, and an obstacle determination unit 536. The acquisition unit 540 includes a map generation unit 541, a parking position determination unit 542, and a parking path generation unit 543. That is, the obstacle detection device 500 shown in FIG. 10 generates path information, which is information on a parking path to the parking position P, and range information indicating the position and range of an object present around the vehicle 1A.
[0069] 2 to 7 show a case where the parking mode of the vehicle 1A is parallel parking, but the parking mode of the vehicle 1A may be parallel parking or diagonal parking. Parallel parking is a parking mode in which the vehicle 1A is parked so that the vehicle 1A and another vehicle are arranged along the vehicle length direction of the vehicle 1A. Diagonal parking is a parking mode in which the vehicle is parked in a parking space that is diagonally arranged with respect to the passage in front of or behind the parking space.
[0070] In addition, Figures 2 to 7 show cases where the shape of the range figures 211, 213, and 225 indicating the range of the object is rectangular, but the shape of the range figures 211, 213, and 225 does not have to be rectangular and may be, for example, a polygon such as a triangle or a pentagon.
[0071] In addition, since the inside / outside determination unit 133 selected two adjacent vertices of the range figure in a clockwise direction, if the cross product value contains at least one positive value, it determines that point U of the object is located outside the range figure, and if the results of the cross product calculations are all negative values, it determines that point U is located inside the range figure. Alternatively, two adjacent vertices of the range figure may be selected counterclockwise. In this case, if any of the cross product values is negative, the point U of the object is determined to be located outside the range figure, and if all the cross product calculation results are positive, the point U of the object is determined to be located inside the range figure.
[0072] 1 is a schematic diagram showing components classified according to main processing contents in order to facilitate understanding of the present invention, and the components can be further classified into more components according to the processing contents. Also, one component can be classified to perform more processes.
[0073] Furthermore, when the obstacle detection method of the present invention is realized using a computer, the program executed by the computer can be configured in the form of a recording medium or a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specific examples of the recording medium include portable or fixed recording media such as a flexible disk, HDD, CD-ROM (Compact Disk Read Only Memory), DVD, Blu-ray (registered trademark) Disc, magneto-optical disk, flash memory, and card-type recording medium. The recording medium may also be a non-volatile storage device such as a ROM or HDD provided in the path generating device 50.
[0074] 8 and 9 are divided according to the main processing contents in order to facilitate understanding of the processing of the obstacle detection device 100, and the present invention is not limited by the manner in which the processing units are divided or the names of the processing units. The processing of the obstacle detection device 100 may be divided into more processing units according to the processing contents. Furthermore, the processing of the obstacle detection device 100 may be divided so that one processing unit includes more processes. [Explanation of symbols]
[0075] 1A Car 1B Other vehicles 1C Other vehicles 3 Onboard equipment 5. Communication Bus 10 Position detection unit 30 Sonar Unit 50 Route Generation Device 60 Input / Output Interface 70 Memory 80 processors 81 Position acquisition part 82 Status Acquisition Unit 83 Map Generation Unit 84 Parking position determination unit 85 Parking route generation unit 86 Driving Information Generation Unit 100 Obstacle detection device 110 Input / Output Interface 120 Memory 130 processors 131 Acquisition Department 132 Operation control unit 133 Domestic and foreign judgment section 134 Obstacle detection unit 150 Travel drive unit 151 Steering Gear 153 Drive unit 155 Braking device 157 Gearbox 200 Surrounding Area Map 201, 202, 203 Parking Area 220 Wall 300 Obstacle Map 310 Vehicle design
Claims
1. an input interface connected to an external device; an acquisition unit that acquires route information, which is information on a parking route to a parking position where the vehicle is to be parked, range information indicating the range of structures existing around the vehicle, and sensor data obtained by detecting objects existing around the vehicle using ultrasonic waves; a driving control unit that generates a drive signal to operate a driving drive unit that drives the vehicle in accordance with the route information acquired by the acquisition unit, and outputs the generated drive signal to the driving drive unit; an inside / outside determination unit that determines, based on the range information, whether an object indicated by the sensor data input via the input interface is located inside the range of the structure acquired by the acquisition unit, or outside the range of the structure; an obstacle determination unit that determines whether an object determined to be located outside the range of the structure by the inside / outside determination unit will be an obstacle to the vehicle traveling along the parking path; An obstacle detection device comprising:
2. 2. The obstacle detection device according to claim 1, wherein the obstacle determination unit does not determine whether an object determined to be located inside the range of the structure will be an obstacle to the vehicle traveling along the parking path.
3. 3. The obstacle detection device according to claim 1, wherein the inside / outside determination unit calculates a cross product of a vector connecting the coordinates of two adjacent vertices of the range of the structure indicated by the range information and a vector connecting one of the two vertices and the coordinates of the object, and determines whether the object is located inside or outside the range of the structure indicated by the range information based on a result of the cross product.
4. The obstacle determination unit is A plurality of judgment points are set on the parking route indicated by the route information; Calculating a vehicle range that is a range that the vehicle occupies when the vehicle is located at each of the decision points; An object whose distance from the subject vehicle range is equal to or less than a preset distance is determined to be an obstacle; 4. The obstacle detection device according to claim 1, further comprising: an instruction to the driving control unit to stop the vehicle from traveling when an object determined to be an obstacle is detected.
5. The acquisition unit is a route generating unit that generates the route information based on the sensor data and position information indicating a position of the vehicle; 5. The obstacle detection device according to claim 1, further comprising: a map generation unit that generates range information indicating positions and ranges of objects present around the vehicle based on the sensor data.
6. an acquisition step of acquiring route information, which is information on a parking route to a parking position where the vehicle is to be parked, range information indicating the range of structures existing around the vehicle, and sensor data obtained by detecting objects existing around the vehicle using ultrasonic waves; an output step of generating a drive signal for operating a driving unit that drives the vehicle in accordance with the route information acquired in the acquisition step, and outputting the generated drive signal to the driving unit; an inside / outside determination step of determining, based on the range information, whether an object indicated by the sensor data input via an input interface connected to an external device is located inside the range of the structure acquired in the acquisition step or outside the range of the structure; an obstacle determination step of determining whether or not an object determined to be located outside the range of the structure in the inside / outside determination step will be an obstacle to the vehicle traveling along the parking path; 11. An obstacle detection method comprising the steps of:
Citation Information
Patent Citations
Moving object detection apparatus
JP2008158640A
Obstacle detection notification device, method, and program
JP2018180909A
Parking assistance device and parking assistance method
WO2020070822A1
