Parking assistance method and parking assistance device
The parking assistance method ensures safe and controlled parking by activating assistance only when the vehicle is close to the parking space and meets specific conditions, addressing inadvertent activation issues in existing systems.
Patent Information
- Application Number
- CN202180100739.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-07-30
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2041-07-30
AI Technical Summary
Existing parking assistance systems inadvertently activate parking assistance when a vehicle approaches a parking space, leading to potential misuse by drivers.
Implementing a parking assistance method that determines if the vehicle is within a specified distance of the parking position and satisfies certain conditions, such as a time elapsed since starting from the parking position, before activating parking assistance to prevent inadvertent activation.
Balances the convenience of automatic parking assistance with preventing inadvertent activation, ensuring safe and controlled parking operations.
Smart Images

Figure CN117677553B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a parking assistance method and a parking assistance device. Background Art
[0002] The following Patent Document 1 describes a parking assistance device that automatically activates parking assistance when it is determined that the host vehicle is approaching a parking space.
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: International Publication No. 2017 / 072941 Summary of the invention
[0006] Technical problem to be solved by the invention
[0007] However, immediately after starting from a parking space, when parking assistance is automatically started because the host vehicle is approaching the parking space, the driver may inadvertently perform parking assistance.
[0008] An object of the present invention is to achieve a balance between the convenience of automatically starting parking assistance when a host vehicle approaches a parking space and preventing the driver from inadvertently starting parking assistance immediately after starting from the parking space.
[0009] Technical solutions for solving technical problems
[0010] In a parking assistance method of one embodiment of the present invention, it is determined whether the distance between the current position of the vehicle, i.e., the own position, and the target parking position is less than a first prescribed distance, and it is determined whether any one of the conditions, i.e., the parking assistance permission condition, is satisfied, i.e., the condition that a prescribed time has passed since the vehicle started from the target parking position, or the condition that the distance between the own position and the target parking position has exceeded a second prescribed distance less than the first prescribed distance after the vehicle started from the target parking position. When the distance between the own position and the target parking position is less than the first prescribed distance and the parking assistance permission condition is satisfied, parking assistance control of the vehicle based on the target driving trajectory is implemented. When the distance between the own position and the target parking position is less than the first prescribed distance but the parking assistance permission condition is not satisfied even if the distance between the own position and the target parking position is less than the first prescribed distance, the parking assistance control is suppressed.
[0011] Effects of the Invention
[0012] According to the present invention, it is possible to achieve both the convenience of automatically starting parking assistance when the host vehicle approaches a parking space and preventing the driver from inadvertently starting parking assistance after starting from the parking space.
[0013] The objects and advantages of the present invention are specifically embodied by the elements and combinations thereof indicated in the scope of the claims. Both the above general description and the following detailed description are merely examples and explanations, and should be understood not to limit the present invention as indicated in the scope of the claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 FIG. 1 is a diagram showing an example of a schematic configuration of a parking assist device according to an embodiment.
[0015] Figure 2 (a) is an explanatory diagram of an example of a process of storing object mark learning positions. Figure 2 (b) is an explanatory diagram of an example of processing when performing parking assistance.
[0016] Figure 3 It is an explanatory diagram of an example of a driving assistance method according to an embodiment.
[0017] Figure 4 yes Figure 1 A block diagram of an example of the functional structure of a controller.
[0018] Figure 5 This is a flowchart of an example of a process for storing object learning positions.
[0019] Figure 6 This is a flowchart of an example of processing when parking assistance is performed. DETAILED DESCRIPTION
[0020] (constitute)
[0021] Reference Figure 1. The vehicle 1 has a parking assistance device 10 that assists in parking the vehicle 1 toward a target parking position. In the parking assistance performed by the parking assistance device 10, a target driving trajectory of the vehicle 1 from the current position to the target parking position is calculated. Then, the vehicle 1 is assisted in traveling along the target driving trajectory. The parking assistance performed by the parking assistance device 10 includes various methods of assisting the vehicle 1 in traveling along the target driving trajectory. For example, the parking of the vehicle 1 can be assisted by controlling the automatic driving of the vehicle 1 in such a manner that the vehicle 1 travels along the target driving trajectory of the vehicle 1 to the target parking position. It should be noted that the so-called automatic driving of the vehicle 1 in such a manner that the vehicle 1 travels along the target driving trajectory of the vehicle 1 to the target parking position refers to controlling all or part of the steering angle, driving force, and braking force of the vehicle, automatically implementing all or part of the driving along the target driving trajectory of the vehicle 1, and assisting the parking operation of the occupant. Furthermore, parking of the host vehicle 1 may be assisted by displaying the target travel trajectory and the current position of the host vehicle 1 on a display device that can be visually recognized by the occupant of the host vehicle 1 .
[0022] The parking assist device 10 includes a positioning device 11, a human-machine interface 12, a shift switch 13, an external sensor 14, a vehicle sensor 15, a controller 16, a parking brake 17, a steering actuator 18a, an accelerator actuator 18b, and a brake actuator 18c. In the accompanying drawings, the human-machine interface is denoted as "HMI" and the shift switch is denoted as "shift SW".
[0023] The positioning device 11 measures the current position of the vehicle 1. The positioning device 11 may include, for example, a global navigation positioning system (GNSS) receiver. The GNSS receiver is, for example, a global positioning system (GPS) receiver, which receives radio waves from a plurality of navigation satellites and measures the current position of the vehicle 1.
[0024] The human-machine interface 12 is an interface device for receiving and sending information between the parking assistance device 10 and the occupant. The human-machine interface 12 includes a display device (such as a display interface of a navigation system) that can be visually recognized by the occupant of the vehicle 1, and a speaker or buzzer for outputting warning sounds, notification sounds, and audio information.
[0025] The human-machine interface 12 includes an operating element for receiving an operation input from the occupant to the parking assist device 10. The operating element may be a mechanical interface device such as a key, switch, lever, knob, or keyboard, or may be a key, switch, lever, knob, or keyboard displayed on a touch panel.
[0026] The shift switch 13 is a switch used by the driver or the parking assist device 10 to switch the shift position of the host vehicle 1 .
[0027] The external sensor 14 detects objects within a specified distance range from the vehicle 1 (for example, the detection area of the external sensor 14). The external sensor 14 detects the surrounding environment of the vehicle 1, such as the relative position of the objects existing around the vehicle 1 and the vehicle 1, the distance between the vehicle 1 and the objects, and the direction in which the objects exist. The external sensor 14 may, for example, include a camera that photographs the surrounding environment of the vehicle 1. The camera may, for example, be a surround monitoring camera that photographs the road surface around the vehicle 1 and generates a photographed image that is converted into a bird's-eye view (surround monitoring image). The external sensor 14 may also include a distance measuring device such as a laser rangefinder (LRF) or a radar or a LiDAR (Light Detection and Ranging) laser radar.
[0028] The vehicle sensor 15 detects various information (vehicle information) obtained from the host vehicle 1. The vehicle sensor 15 includes, for example, a vehicle speed sensor for detecting the travel speed (vehicle speed) of the host vehicle 1, a wheel speed sensor for detecting the rotation speed of each tire of the host vehicle 1, a three-axis acceleration sensor (G sensor) for detecting acceleration (including deceleration) in three axial directions of the host vehicle 1, a steering angle sensor for detecting a steering angle (including a steering angle of a steering wheel or a steering wheel), a gyro sensor for detecting an angular velocity generated by the host vehicle 1, and a yaw rate sensor for detecting a yaw rate.
[0029] The controller 16 is an electronic control unit (ECU) that performs parking assist control of the vehicle 1. The controller 16 includes a processor 20 and peripheral components such as a storage device 21. The processor 20 may be, for example, a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The storage device 21 may include a semiconductor storage device, a magnetic storage device, an optical storage device, and the like.
[0030] The functions of the controller 16 described below are realized, for example, by the processor 20 executing a computer program stored in the storage device 21. It should be noted that the controller 16 may be formed by dedicated hardware for executing each information processing described below.
[0031] The steering actuator 18a controls the steering direction and steering amount of the steering mechanism according to the control signal from the controller 16. The accelerator actuator 18b controls the accelerator opening of the engine or the drive motor, that is, the drive device according to the control signal from the controller 16. The brake actuator 18c activates the brake device according to the control signal from the controller 16.
[0032] Next, an example of parking assist control performed by the parking assist device 10 according to the embodiment will be described.
[0033] Reference Figure 2 (a) When the driver utilizes parking assistance by the parking assistance device 10 , the driver stores the position of an object that is located near the target parking position 30 , which is the target position for parking the host vehicle 1 , in the storage device 21 .
[0034] Object landmarks are landmarks used to specify the current position of the vehicle 1. They can be road markings (road signs, road dividing lines, and road markings) drawn on the road surface around the vehicle 1, or obstacles such as road boundaries, curbs, guardrails, and telephone poles.
[0035] When the object position is stored in the storage device 21, for example, the driver operates the "parking position learning switch" prepared as the operating element of the human-machine interface 12. Then, the driver manually drives the vehicle 1 to park at the target parking position 30. The external sensor 14 detects the position of the object existing in the detection area within a predetermined distance range from the external sensor 14, that is, the object position.
[0036] For example, the parking assistance device 10 can detect the image of the portion representing the object such as the road surface marking or the road boundary as the feature point from the captured image captured by the external sensor 14, i.e., the camera, and use the position of the feature point as the object position. The parking assistance device 10 also detects the feature quantity of the detected feature point. In addition, for example, the feature points and feature quantities (such as the depth or attributes of the feature points) of the point cloud information obtained by the external sensor 14, i.e., the laser rangefinder or radar, LiDAR, can also be detected. In this specification, an example of detecting feature points from a captured image is described.
[0037] exist Figure 2 In (a), the circular icons represent the feature points (i.e., the positions of the object marks) detected in the shooting area of the camera.
[0038] While the driver is manually parking the vehicle 1 at the target parking position 30, the parking assist device 10 stores the object mark position detected by the external sensor 14 (e.g., feature points and feature quantities detected from an image captured by a camera) in the storage device 21. Hereinafter, the object mark position stored in the storage device 21 is sometimes referred to as an "object mark learning position".
[0039] In addition, the parking assistance device 10 stores the relative positional relationship between the object learning position and the target parking position 30 .
[0040] For example, the driver may operate the human-machine interface 12 to input information that the current position of the host vehicle 1 is the target parking position 30 into the parking assistance device 10. The parking assistance device 10 may also obtain the relative position relationship between the object learning position and the target parking position 30 based on the object position detected by the external sensor 14 when the host vehicle 1 is located at the target parking position 30.
[0041] In addition, for example, the image captured by the external sensor 14, i.e., the camera, may be displayed on the display device of the human-machine interface 12, and the driver may designate the position of the target parking position 30 on the captured image. The parking assistance device 10 may also determine the relative positional relationship between the object learning position and the target parking position 30 based on the designated position of the target parking position 30 and the position of the object reflected in the captured image.
[0042] When the relative positional relationship between the object learning position and the target parking position 30 is stored in the storage device 21, for example, each object learning position and the position of the target parking position 30 may be stored as coordinates on a coordinate system (hereinafter referred to as a "map coordinate system") with a fixed point as a reference point. The above relative positional relationship can be obtained based on the difference between the coordinates of the object learning position and the target parking position 30 in the common map coordinate system.
[0043] When the coordinates on the map coordinate system are stored as the object learning position, the current position on the map coordinate system measured by the positioning device 11 when the host vehicle 1 is located at the target parking position 30 may be stored as the target parking position 30 .
[0044] In addition, instead of the map coordinate system, the relative positions of the target parking position 30 with respect to the learned positions of the respective object markers may be stored.
[0045] When the object learning position and the position of the target parking position 30 are stored in the storage device 21 , parking assistance by the parking assistance device 10 can be utilized.
[0046] Reference Figure 2 (b) The parking assist device 10 determines whether the distance between the host vehicle 1 and the target parking position 30 is equal to or smaller than a first predetermined distance.
[0047] The parking assist device 10 also determines whether the driver has performed a shift operation for switching between forward and reverse movement of the host vehicle 1 . Figure 2(b) shows an example of the vehicle turning back at the turning position 31. It should be noted that "turning back" includes switching from forward to reverse and switching from reverse to forward. The parking assist device 10 can determine that a shift operation for turning back has been performed when the shift position is switched from the forward gear (hereinafter referred to as "D gear") to the reverse gear (hereinafter referred to as "R gear"), or from the R gear to the D gear.
[0048] The parking assist device 10 also determines whether the driver has operated a “parking assist start switch” provided as an operating element of the human-machine interface 12 .
[0049] The parking assist device 10 automatically performs parking assistance when the distance between the vehicle 1 and the target parking position 30 is less than the first prescribed distance and the shift operation for turning back is performed. It should be noted that the first prescribed distance is a predetermined arbitrary distance, which is a distance appropriately set in design. In addition, the parking assist device 10 performs driving assistance for the vehicle 1 when the distance between the vehicle 1 and the target parking position 30 is less than the first prescribed distance and the parking assist start switch is operated. It should be noted that in this embodiment, an example of performing driving assistance for the vehicle 1 is described when the distance between the vehicle 1 and the target parking position 30 is less than the first prescribed distance and the shift operation for turning back or the parking assist start switch operation is performed, but the conditions for performing driving assistance are not limited to this. For example, the driving assistance of the vehicle 1 can also be performed when the distance between the vehicle 1 and the target parking position 30 is less than the first prescribed distance and the hazard warning light is on, or when the distance between the vehicle 1 and the target parking position 30 is less than the first prescribed distance and the vehicle is parked. That is, when predetermined conditions are satisfied, including the distance between the host vehicle 1 and the target parking position 30 being equal to or smaller than the first predetermined distance, driving assistance for the host vehicle 1 may be performed.
[0050] At this time, the external sensor 14 detects the position of the object existing in the detection area of the external sensor 14, that is, the object position. The triangle icon represents the object position detected by the external sensor 14 when the parking assist is implemented. It should be noted that the detection of the object position by the external sensor 14 can also be performed regardless of the shift operation or the operation of the parking assist start switch, and the detection time of the object position by the external sensor 14 is not limited.
[0051] The parking assistance device 10 compares the positions of the objects (triangular icons) detected by the external sensor 14 with the learned positions of the objects ( Figure 2 (a)) are matched so that the positions of the object marks detected for the same object mark correspond to each other.
[0052] The parking assistance device 10 calculates the relative position relationship between the current position of the vehicle 1 and the target parking position 30 based on the relative position relationship between the positions of each object mark (triangular icon) detected by the external sensor 14 and the vehicle 1, and the relative position relationship between the object mark learning position (circular icon) corresponding to the above-mentioned object mark position (triangular icon) and the target parking position 30.
[0053] For example, the parking assistance device 10 may also calculate the position of the target parking position 30 on a coordinate system (hereinafter referred to as the "vehicle coordinate system") based on the current position of the host vehicle 1. For example, when the object marker learning position (circular icon) in the map coordinate system and the coordinates of the target parking position 30 are stored in the storage device 21, the target parking position 30 on the map coordinate system may be converted to the target parking position 30 on the vehicle coordinate system based on the object marker position (triangular icon) in the vehicle coordinate system detected when the parking assistance is implemented and the object marker learning position (circular icon) in the map coordinate system.
[0054] Alternatively, the current position of the vehicle 1 in the map coordinate system can be determined based on the position of the object in the vehicle coordinate system (triangular icon) detected when parking assistance is implemented and the learned position of the object in the map coordinate system (circular icon), and the relative position relationship between the current position of the vehicle 1 and the target parking position 30 can be calculated based on the difference between the coordinates of the vehicle 1 in the map coordinate system and the coordinates of the target parking position 30.
[0055] The parking assist device 10 calculates a target travel trajectory from the current position of the host vehicle 1 to the target parking position 30 via the turnaround position 31 based on the relative positional relationship between the current position of the host vehicle 1 and the target parking position 30 .
[0056] At this time, for example, when the position of the host vehicle 1 is the turnaround position 31 when the parking assist is activated, a trajectory 32 from the turnaround position 31 to the target parking position 30 is calculated as the target travel trajectory.
[0057] In addition, for example, when the position of the vehicle 1 is at position 33 near the target parking position 30 when the parking assist is started by operating the parking assist start switch, a trajectory 34 from position 33 to the turning position 31 and a trajectory 32 from the turning position 31 to the target parking position 30 are calculated as target driving trajectories.
[0058] That is, the “target driving trajectory to the target parking position via the turning position” includes: a target driving trajectory 32 starting from the turning position 31 to the target parking position 30, and two target driving trajectories 34 and 32 traveling from position 33 to the turning position 31 and turning back to the target parking position 30 at the turning position 31.
[0059] Then, the parking assistance device 10 implements parking assistance control of the host vehicle 1 based on the calculated target driving trajectory. As the parking assistance control of the host vehicle 1, the host vehicle 1 can be controlled to travel along the calculated target driving trajectory (automatic driving) or the target driving trajectory can be displayed on the display device of the human-machine interface 12.
[0060] In this way, when parking assistance is automatically implemented when the distance between the vehicle 1 and the target parking position 30 is less than the first specified distance, when starting from the target parking position 30, the parking assistance may be activated inadvertently by the driver because the distance between the vehicle 1 and the target parking position 30 just after starting is less than the first specified distance.
[0061] Therefore, if Figure 3 As shown, when the parking assist device 10 detects that the vehicle 1 has started from the target parking position 30, the parking assist control is suppressed before the vehicle 1 exceeds a range 35 of a second prescribed distance, which is a predetermined prescribed distance below the first prescribed distance from the target parking position 30, or before a predetermined prescribed time has passed after starting. It should be noted that the second prescribed distance is an arbitrary distance predetermined in the same way as the first prescribed distance, and is a distance appropriately set in design. In addition, the predetermined prescribed time is also an arbitrary time, and is a time appropriately set in design. It should be noted that the predetermined prescribed time is preferably a time set in consideration of the time from when the vehicle 1 starts from the target parking position 30 to when it travels the second prescribed distance.
[0062] This makes it possible to achieve both the convenience of automatically starting parking assistance when the host vehicle approaches a parking space and preventing the driver from inadvertently starting parking assistance after starting from the parking space.
[0063] Next, the functional structure of the controller 16 will be described in further detail. Figure 4 The controller 16 is used as a human-machine interface control unit (hereinafter referred to as “HMI control unit”) 40, a parking assist control unit 41, an image conversion unit 42, a self-position calculation unit 43, a feature point detection unit 44, a map generation unit 45, a matching (engagement) unit 47, a target trajectory generation unit 48, a steering control unit 49, and a vehicle speed control unit 50.
[0064] When the parking position learning switch of the human-machine interface 12 is operated by the driver, the HMI control unit 40 outputs a map generation command to the map generation unit 45 for storing the learned position of the object in the storage device 21 .
[0065] The HMI control unit 40 determines whether the driver has performed a shift operation for turning back, and outputs the determination result to the parking assist control unit 41. When the parking assist start switch of the human machine interface 12 is detected to be operated by the driver, the detection result is output to the parking assist control unit 41.
[0066] The parking assist control unit 41 determines whether the distance between the host vehicle 1 and the target parking position 30 is less than the first predetermined distance. For example, the parking assist control unit 41 may determine whether the distance between the host vehicle 1 and the target parking position 30 is less than the first predetermined distance based on the current position of the host vehicle 1 measured by the positioning device 11.
[0067] In addition, for example, feature quantities of object marks near the target parking position 30 may be pre-stored, and whether the distance between the host vehicle 1 and the target parking position 30 is less than the first specified distance may be determined based on whether the external sensor 14 detects an object mark having similar feature quantities. In addition, the detection range of the external sensor 14 may be set to a range of the first specified distance from the host vehicle, and when a feature quantity similar to that of an object mark near the target parking position 30 is detected, it is determined that the distance between the host vehicle 1 and the target parking position 30 is less than the first specified distance.
[0068] When the distance between the host vehicle 1 and the target parking position 30 is equal to or smaller than the first predetermined distance and a shift operation for turning back is detected, the parking assist control unit 41 determines whether a predetermined parking assist permission condition is satisfied.
[0069] The parking assistance permission condition may be, for example, a condition that a predetermined time or longer has passed since the host vehicle 1 started from the target parking position 30. Alternatively or in addition thereto, the parking assistance permission condition may be a condition that a distance between the current position of the host vehicle 1 and the target parking position 30 has exceeded a second predetermined distance that is less than the first predetermined distance since the host vehicle 1 started from the target parking position 30.
[0070] When the parking assist permission condition is satisfied, the parking assist control unit 41 starts the parking assist control.
[0071] In addition, when the distance between the host vehicle 1 and the target parking position 30 is less than the first predetermined distance and the HMI control unit 40 detects the operation of the parking assist start switch, the parking assist control unit 41 starts the parking assist control. It should be noted that in this embodiment, an example is shown in which the parking assist control unit 41 starts the parking assist control when the HMI control unit 40 detects the operation of the parking assist start switch, but it is not limited to this. For example, in the same way as the case of detecting the shift operation, when the operation of the parking assist start switch is detected, it is determined whether the prescribed parking assist permission condition is met, and when the parking assist permission condition is met, the parking assist control unit 41 starts the parking assist control.
[0072] Alternatively, the parking assist control unit 41 may detect only one of the shift operation and the operation of the parking assist start switch, and activate the parking assist control when the parking assist permission condition is satisfied.
[0073] The parking assist control unit 41 outputs a parking position calculation command for calculating the position of the target parking position 30 in the vehicle coordinate system to the matching unit 47 .
[0074] Furthermore, a travel trajectory calculation instruction for calculating a target travel trajectory from the current position of the host vehicle 1 to the target parking position 30 and a target vehicle speed curve for the host vehicle 1 to travel along the target travel trajectory is output to the target travel trajectory generation unit 48 based on the calculated target parking position 30 .
[0075] The target trajectory generating unit 48 calculates the target driving trajectory and the target vehicle speed curve from the current position of the host vehicle 1 to the target parking position 30, and outputs them to the parking assist control unit 41. The target driving trajectory from the current position of the host vehicle 1 to the target parking position 30 can be calculated by applying a well-known method adopted in a generally known automatic parking device, but as an example, it can be calculated by connecting the route from the current position of the host vehicle 1 to the target parking position 30 via the turning position 31 using a clothoid curve. In addition, as an example, the target vehicle speed curve can be calculated as follows, that is, based on a predetermined set speed, after accelerating from the current position of the host vehicle 1 to the set speed, decelerating before the turning position 31 and stopping at the turning position 31, then accelerating from the turning position 31 to the set speed, decelerating before the target parking position 30 and stopping at the target parking position 30. Alternatively, based on the curvature of the calculated target driving trajectory, the set speed when calculating the speed curve can be set so that the greater the curvature, the lower the speed.
[0076] The parking assist control unit 41 outputs the target driving trajectory calculated by the target trajectory generation unit 48 and the information of the current position of the host vehicle 1 to the HMI control unit 40. Figure 2 When the track 32 and 34 in (b) include a return, the information of the return position 31 is output to the HMI control unit 40 .
[0077] The HMI control unit 40 displays the target driving trajectory, the current position of the host vehicle 1 , and the position of the turnaround position on the display device of the human-machine interface 12 .
[0078] The parking assist control unit 41 outputs a steering control command to the steering control unit 49 for steering the host vehicle 1 along the calculated target travel trajectory. The parking assist control unit 41 outputs a vehicle speed control command to the vehicle speed control unit 50 for controlling the vehicle speed according to the calculated target vehicle speed curve.
[0079] On the other hand, when the parking assist permission condition is not satisfied, the parking assist control unit 41 suppresses the parking assist control. For example, the parking assist control unit 41 prohibits the parking assist control. For example, the parking assist control unit 41 may also stop the output of the parking position calculation command, the driving trajectory calculation command, the steering control command, and the vehicle speed control command. Thus, the parking assist that controls the vehicle 1 to travel to the target parking position along the target driving trajectory is prohibited.
[0080] Alternatively, the driving assistance for displaying the target driving trajectory and the current position of the host vehicle 1 on the display device may be prohibited.
[0081] In addition, the parking assist control unit 41 may also suppress the parking assist control by limiting the speed of the host vehicle 1 controlled by the speed control unit 50 to be lower than the calculated target speed curve. For example, the parking assist control unit 41 may also output a speed control instruction to the speed control unit 50 that makes the speed of the host vehicle 1 lower than the target speed curve. Alternatively, the maximum speed of the calculated target speed curve may be limited to a speed lower than a prescribed set speed, and a speed control instruction based on the target speed curve with the limited maximum speed may be output to the speed control unit 50. That is, in the case where the parking assist permission condition is not satisfied, it is sufficient to reduce the moving speed (vehicle speed) of the host vehicle 1 when traveling to the target parking position, compared to the case where the parking assist permission condition is satisfied.
[0082] The image conversion unit 42 converts the captured image of the camera of the external sensor 14 into Figure 2 (a) and Figure 2 (b) is a bird's-eye view image (surrounding monitoring image) viewed from a virtual viewpoint directly above the host vehicle 1. Hereinafter, the bird's-eye view image converted by the image conversion unit 42 may be referred to as a "surrounding image". Figure 2 (a) is a surrounding image when the object learning position is stored in the storage device 21. Figure 2 (b) is a surrounding image when the parking assist control is implemented.
[0083] The image conversion unit 42 generates surrounding images at predetermined intervals. For example, the image conversion unit 42 may generate surrounding images every time the vehicle 1 travels a predetermined distance (e.g., 50 cm). In addition, for example, the surrounding images may be generated every time the vehicle 1 travels for a predetermined time (e.g., one second). In this way, each surrounding image acquired when the vehicle 1 is located at a different position or each surrounding image acquired at different times is sometimes recorded as a "frame".
[0084] The own position calculation unit 43 calculates the current position of the own vehicle 1 on the map coordinate system using dead reckoning based on vehicle information output from the vehicle sensor 15 .
[0085] The feature point detection unit 44 performs predetermined preprocessing such as denoising, adjusting brightness, and enhancing edges on the surrounding image output from the image conversion unit 42. The feature point detection unit 44 detects feature points and feature quantities from the surrounding image after the preprocessing. For example, the feature point detection unit 44 can detect feature points and feature quantities using a FAST detector or a FREAK descriptor.
[0086] use Figure 2 The circular icons in (a) represent feature points detected when the object mark learning position is stored in the storage device 21. Figure 2 The triangular icons in (b) represent characteristic points detected when the parking assist control is executed.
[0087] Furthermore, the feature point detection unit 44 extracts common feature points in two different frames. By extracting the common feature points, feature points for detecting three-dimensional objects, raindrops, the shadow of the vehicle, and moving objects can be removed.
[0088] The feature point detection unit 44 synchronizes the feature points extracted as common feature points with the current position of the host vehicle 1 received from the own position calculation unit 43 when acquiring the surrounding image, and outputs the synchronized feature points to the map generation unit 45 and the matching unit 47 .
[0089] Reference Figure 4 When the object learning position is stored in the storage device 21 , the driver operates the parking position learning switch and parks the host vehicle 1 at the target parking position by manual driving. At this time, the map generation unit 45 receives a map generation instruction from the HMI control unit 40 .
[0090] When the map generating unit 45 receives the map generating instruction, it stores the feature point information including the feature point outputted from the feature point detecting unit 44 , the current position of the vehicle 1 synchronized therewith, and the feature amount of the feature point in the storage device 21 as the object learning position, and generates the map data 46 .
[0091] The position of the feature point in the map coordinate system may be calculated based on the current position of the host vehicle 1 synchronized with the feature point, and stored as the feature point information.
[0092] Furthermore, when the driver operates the human-machine interface 12 and inputs information that the current position of the host vehicle 1 is the target parking position 30 into the parking assist device 10, the map generating unit 45 receives the current position of the host vehicle 1 on the map coordinate system from the positioning device 11 or the own position calculating unit 43, and stores it in the map data 46 as the target parking position 30. That is, the relative positional relationship between the target parking position 30 and the plurality of feature points is stored as the map data.
[0093] Thereafter, when the parking assist control unit 41 starts the parking assist control, the matching unit 47 receives the parking position calculation command from the parking assist control unit 41 .
[0094] When the matching unit 47 receives the parking position calculation instruction, it converts the feature point information ( Figure 2 (a) and feature point information ( Figure 2 (b) to match the feature point information detected for the same object marker.
[0095] At this time, the matching unit 47 can remove the feature points that do not conform to the two-dimensional affine transformation from the corresponding feature points as outliers. The detection of outliers can be performed using, for example, the RANSAC (Random Sample Consensus) algorithm. In addition, feature points whose feature quantities such as depth or attributes are inconsistent can also be removed from the corresponding feature points.
[0096] The matching unit 47 calculates the relative position relationship between the current position of the vehicle 1 and the target parking position 30 based on the relative position relationship between the feature point (triangular icon) when the parking assistance is implemented and the vehicle 1, and the relative position relationship between the feature point (circular icon) of the map data 46 corresponding to the above-mentioned feature point (triangular icon) and the target parking position 30.
[0097] For example, the feature points detected during parking assistance are recorded as (x i ,y i ), will be combined with the feature point (x i ,y i ) and the feature points stored as object learning positions in the map data 46 are recorded as (x mi ,y mi)(i=1~N).
[0098] The matching unit 47 calculates the affine transformation matrix M using the following equation based on the least squares method: affine .
[0099] [Number 1]
[0100]
[0101] in
[0102]
[0103]
[0104] We can also use the weighted least squares method to calculate the column vector (a1, a2, a3, a4) as shown below: T .
[0105] [Number 2]
[0106] W=diag(w1 … w N )
[0107]
[0108] The matching unit 47 calculates the position (target x) of the target parking position 30 on the map coordinate system stored in the map data 46 using the following equation: m , targety m ) is converted to the position (targetx, targety) in the vehicle coordinate system.
[0109] [Number 3]
[0110]
[0111] When the target trajectory generating unit 48 receives a driving trajectory calculation instruction from the parking assist control unit 41, it calculates a target driving trajectory from the current position of the vehicle 1 (i.e., the coordinate origin) on the vehicle coordinate system to the target parking position 30 (targetx, targety), as well as a target vehicle speed curve of the vehicle 1 traveling along the target driving trajectory.
[0112] When receiving the steering control command from the parking assist control unit 41 , the steering control unit 49 controls the steering actuator 18 a so that the host vehicle 1 travels along the target travel trajectory.
[0113] When the vehicle speed control unit 50 receives the vehicle speed control command from the parking assist control unit 41 , it controls the accelerator actuator 18 b and the brake actuator 18 c so that the vehicle speed of the host vehicle 1 changes according to the target vehicle speed curve.
[0114] Thus, the host vehicle 1 is controlled so as to travel along the target travel trajectory.
[0115] The parking assist control unit 41 determines whether the host vehicle 1 has reached the target parking position 30 and the parking assist control has been completed. When the parking assist control is completed, the parking assist control unit 41 operates the parking brake 17 and switches the shift position to the parking position (hereinafter referred to as "P" position).
[0116] (action)
[0117] Figure 5 2 is a flowchart of an example of a process of storing the object mark learning position. When the object mark learning position is stored in the storage device 21, the driver operates the parking position learning switch and parks the host vehicle 1 at the target parking position by manual driving.
[0118] In step S1 , the image conversion unit 42 acquires a surrounding image by converting an image captured by the camera of the external sensor 14 into a bird's-eye view image viewed from a virtual viewpoint directly above the host vehicle 1 .
[0119] In step S2 , the feature point detection unit 44 performs predetermined pre-processing such as denoising, brightness adjustment, and edge enhancement on the surrounding image output from the image conversion unit 42 .
[0120] In step S3 , the feature point detection unit 44 detects feature points from the pre-processed surrounding image.
[0121] In step S4 , the feature point detection unit 44 extracts common feature points in two different frames.
[0122] In step S5 , the map generating unit 45 stores the feature points extracted in step S4 in the storage device 21 .
[0123] Figure 6 This is a flowchart of an example of processing when parking assistance is performed.
[0124] In step S10 , the image conversion unit 42 acquires a surrounding image.
[0125] In step S11 , the feature point detection unit 44 performs predetermined preprocessing on the surrounding image output from the image conversion unit 42 .
[0126] In step S12, feature points are detected from the pre-processed surrounding image.
[0127] In step S13 , the feature point detection unit 44 extracts common feature points in two different frames.
[0128] In step S14, the parking assist control unit 41 determines whether the distance between the host vehicle 1 and the target parking position 30 is less than the first prescribed distance. If the distance between the host vehicle 1 and the target parking position 30 is less than the first prescribed distance (step S14: Y), the process proceeds to step S15. If the distance between the host vehicle 1 and the target parking position 30 is not less than the first prescribed distance (step S14: N), the process returns to step S10.
[0129] In step S15, the parking assist control unit 41 determines whether a shift operation for turning back is detected. If a shift operation for turning back is detected (step S15: Y), the process proceeds to step S16. If a shift operation for turning back is not detected (step S15: N), the process proceeds to step S24.
[0130] In step S16, the parking assist control unit 41 determines whether the parking assist permission condition is satisfied. If the parking assist permission condition is satisfied (step S16: Y), the process proceeds to step S17. If the parking assist permission condition is not satisfied (step S16: N), the process proceeds to step S23.
[0131] In step S17 , the matching unit 47 reads the feature points stored as the object marker learning positions in the map data 46 .
[0132] In step S18 , the matching unit 47 matches the feature points extracted in step S13 with the feature points read in step S17 .
[0133] In step S19 , the matching unit 47 calculates the target parking position 30 based on the matched feature points.
[0134] In step S20 , the target trajectory generation unit 48 calculates a target travel trajectory from the current position of the host vehicle 1 to the target parking position 30 , and a target vehicle speed curve for the host vehicle 1 to travel along the target travel trajectory.
[0135] In step S21, the steering control unit 49 controls the steering actuator 18a so that the host vehicle 1 travels along the target travel trajectory. The vehicle speed control unit 50 controls the accelerator actuator 18b and the brake actuator 18c so that the vehicle speed of the host vehicle 1 changes according to the target vehicle speed curve.
[0136] In step S22, the parking assist control unit 41 determines whether the parking assist control is completed. If the parking assist control is completed, the parking assist control unit 41 operates the parking brake 17 and switches the shift position to the P position. Thereafter, the process ends.
[0137] On the other hand, when the parking assist permission condition is not satisfied in step S16 (step S16: N), the parking assist control unit 41 suppresses the parking assist control in step S23, and then the process ends.
[0138] In addition, when the shift operation for turning back is not detected in step S15 (step S15: N), in step S24, the parking assist control unit 41 determines whether the parking assist start switch is operated by the driver. When the parking assist start switch is operated (step S24: Y), the process proceeds to step S17 to execute the parking assist control. When the parking assist start switch is not operated (step S24: N), the process returns to step S10.
[0139] (Effects of Embodiments)
[0140] (1) The controller 16 detects the current position of the vehicle 1, i.e., its own position, calculates a target driving trajectory from its own position to the target parking position, determines whether the distance between its own position and the target parking position is less than a first specified distance, and determines whether any one of the following conditions, i.e., a parking assistance permission condition, is satisfied: a condition that a specified time has passed since the vehicle 1 started from the target parking position, or a condition that the distance between its own position and the target parking position has exceeded a second specified distance less than the first specified distance since the vehicle 1 started from the target parking position; if it is determined that the distance between its own position and the target parking position is less than the first specified distance and the parking assistance permission condition is satisfied, parking assistance control of the vehicle 1 based on the target driving trajectory is implemented; if the distance between its own position and the target parking position is less than the first specified distance but the parking assistance permission condition is not satisfied, parking assistance control is suppressed.
[0141] This makes it possible to achieve both the convenience of automatically starting parking assistance when the host vehicle approaches a parking space and the prevention of the driver's inadvertent parking assistance immediately after starting from the parking space.
[0142] (2) The position of the shift lever is added to the conditions for implementing the parking assist control, so that the parking assist control can be implemented even when it is determined that the distance between the vehicle's own position and the target parking position is less than the first predetermined distance and the parking assist permission condition is satisfied, and the position of the shift lever is in the reverse gear. In this way, the parking assist control can be prevented more appropriately from being inadvertently performed by the driver.
[0143] (3) The controller 16 may also perform parking assist control by controlling the vehicle 1 to travel along the target driving trajectory. The speed of the vehicle 1 traveling along the target driving trajectory may be reduced when the parking assist permission condition is not satisfied compared to when the parking assist permission condition is satisfied, thereby suppressing the parking assist control. Thus, the driver can stop continuing the unintentional parking assist control at a stage where the moving distance of the vehicle based on the parking assist control is short, for example, by operating the brakes when the unintentional parking assist control has been activated. Alternatively, the parking assist control may be prohibited when the parking assist permission condition is not satisfied. Thus, the driver's unintentional parking assist control can be suppressed.
[0144] (4) The controller 16 may also perform parking assist control by displaying the target driving trajectory and the position of the host vehicle 1 on a display device that can be seen by the occupants. It may also prohibit the display of the target driving trajectory and the position of the host vehicle 1 on the display device when the parking assist permission condition is not satisfied. In this way, it is possible to suppress the parking assist control that is inadvertently performed by the driver.
[0145] All examples and conditional terms described herein are intended for educational purposes to help readers understand the present invention and the concepts proposed by the inventors for the development of technology. It should be understood that the above examples and conditions described in detail, as well as the structures of examples in this specification related to the advantages and disadvantages of the present invention, are not intended to be limiting. Although the embodiments of the present invention are described in detail, it should be understood that various changes, substitutions and modifications can be added therein without departing from the spirit and scope of the present invention.
[0146] Description of Reference Numerals
[0147] 40 human-machine interface control unit; 41 parking assist control unit; 42 image conversion unit; 43 own position calculation unit; 44 feature point detection unit; 45 map generation unit; 46 map data; 47 matching unit; 48 target trajectory generation unit; 49 steering control unit; 50 vehicle speed control unit.
Claims
1. A parking assistance method, characterized in that: Detect the current position of the vehicle, i.e. its own position, Calculating a target driving trajectory from the vehicle's own position to a target parking position, determining whether the distance between the own position and the target parking position is less than a first predetermined distance, When the host vehicle starts from the target parking position, determining whether the distance between the host position and the target parking position after the host vehicle starts from the target parking position satisfies a condition that the distance exceeds a second predetermined distance less than the first predetermined distance, i.e., a parking assistance permission condition; When it is determined that the distance between the own position and the target parking position is less than a first predetermined distance, the parking assist permission condition is satisfied, and a shift operation for turning back is detected, parking assist control of the own vehicle based on the target driving trajectory is performed, Even if it is determined that the distance between the own position and the target parking position is equal to or smaller than the first predetermined distance and a shift operation for turning back is detected, if the parking assist permission condition is not satisfied, the parking assist control is suppressed.
2. The parking assistance method according to claim 1, characterized in that: The parking assist control controls the host vehicle so as to travel along the target travel trajectory.
3. The parking assistance method according to claim 2, characterized in that: The parking assist control is suppressed by reducing the speed of the host vehicle traveling along the target traveling trajectory when the parking assist permission condition is not satisfied, compared to when the parking assist permission condition is satisfied.
4. The parking assistance method according to claim 2, characterized in that: When the parking assist permission condition is not satisfied, the parking assist control is prohibited.
5. The parking assistance method according to claim 1, characterized in that: The parking assist control displays the target driving trajectory and the position of the host vehicle on a display device that can be visually recognized by an occupant.
6. The parking assistance method according to claim 5, characterized in that: When the parking assist permission condition is not satisfied, displaying the target driving trajectory and the position of the host vehicle on the display device is prohibited.
7. A parking assist device, characterized in that: have: A sensor or positioning device, which is used to detect the current position of the vehicle, i.e., its own position; A controller for calculating a target driving trajectory from the own position to the target parking position, determining whether the distance between the own position and the target parking position is less than a first prescribed distance, and when the own vehicle starts from the target parking position, determining whether the distance between the own position and the target parking position after the own vehicle starts from the target parking position satisfies a condition of a second prescribed distance that is greater than or equal to the first prescribed distance, i.e., a parking assistance permission condition, and implementing parking assistance control of the own vehicle based on the target driving trajectory when it is determined that the distance between the own position and the target parking position is less than the first prescribed distance, the parking assistance permission condition is satisfied, and a shift operation for turning back is detected, and even if it is determined that the distance between the own position and the target parking position is less than the first prescribed distance, and a shift operation for turning back is detected, the parking assistance control is suppressed when the parking assistance permission condition is not satisfied.
