Parking assistance device and parking assistance method

The parking assistance device generates multiple parking routes to help drivers avoid obstacles, ensuring safe parking by visually displaying alternative paths to bypass detected or undetected hazards.

JP7593779B2Active Publication Date: 2024-12-03FSVAP JAPAN CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2020181127
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-10-29
Publication Date
2024-12-03
Estimated Expiration
2040-10-29

AI Technical Summary

Technical Problem

Existing parking support devices face challenges in accurately detecting obstacles during route generation, leading to potential collisions when vehicles are maneuvered into parking positions.

Method used

A parking assistance device that includes a situation acquisition unit to gather vehicle surroundings, a parking position determination unit, a route generation unit to create multiple parking routes, and a display control to show these routes side by side, allowing the driver to select and avoid obstacles.

Benefits of technology

Enables safe parking by allowing drivers to visually assess and select routes that avoid obstacles, even with low detection accuracy, reducing the risk of collisions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593779000001
    Figure 0007593779000001
  • Figure 0007593779000002
    Figure 0007593779000002
  • Figure 0007593779000003
    Figure 0007593779000003
Patent Text Reader

Abstract

To provide a parking support device and a parking support method which enable a vehicle to safely travel to a parking position while avoiding a collision with an obstacle.SOLUTION: A parking support device comprises: a parking position determination section 134 which determines a parking position Pf enabling an own vehicle 1A to park on the basis of a surrounding state of the own vehicle 1A; a route generation section 135 which generates a first parking route r1 enabling the own vehicle 1A to move from a present position P0 to the parking position Pf and a second parking route r2 different from the first parking route r1; a display control section 136 which causes a display section 60 to display an image showing the first parking route and the second parking route r2 generated with the route generation section 135; a control information generation section 137 which generates control information when either the first parking route r1 or the second parking route r2 is selected, causing the own vehicle 1A to travel along the selected parking route; and a communication control section 138 which transmits the generated control information to a vehicle control unit 80.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a parking assistance device and a parking assistance method. [Background technology]

[0002] There is known a parking assistance device that assists in parking a vehicle. For example, Patent Document 1 discloses a parking assistance device that includes a surrounding image providing unit that receives an image captured by an on-board camera capturing the vehicle's traveling direction and displays an image of the surroundings of the vehicle on a monitor device in the vehicle, a parking target setting unit that sets a parking target for the vehicle, a path calculation unit that calculates multiple candidates for a guide path and a reverse start position for reversing the vehicle to the parking target after moving the vehicle forward to the reverse start position based on the parking target, and a graphic control unit that generates markers indicating at least multiple candidates for the reverse start position and superimposes them on the surrounding image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-66709 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, when acquiring the surrounding conditions of the vehicle and generating a parking path for moving the vehicle to a parking position based on the acquired surrounding conditions, if the detection accuracy of the surrounding conditions is low, it may not be possible to detect obstacles on the generated parking path. An object of the present invention is to provide a parking assistance device and a parking assistance method that enable a vehicle to safely travel to a parking position while avoiding collision with an obstacle. [Means for solving the problem]

[0005] In order to achieve the above object, the parking assistance device of the present invention includes a situation acquisition unit that acquires a surrounding situation of a vehicle, a parking position determination unit that determines a parking position at which to park the vehicle based on the surrounding situation of the vehicle acquired by the situation acquisition unit, a route generation unit that generates a first parking path that is a moving path for moving the vehicle from the position of the vehicle to the parking position and a second parking path that is the moving path and is a different route from the first parking path, a display control unit that displays an image showing the first parking path and an image showing the second parking path generated by the route generation unit on a display screen, and a control information generation unit that generates control information for driving the vehicle according to the selected parking path when either the first parking path or the second parking path is selected. a communication control unit that transmits the control information generated by the control information generation unit to a vehicle control unit that controls driving of the vehicle; The display control unit displays an image showing the first parking path generated by the path generation unit and an image showing the second parking path side by side on the display screen. It is characterized by: Effect of the Invention

[0006] According to the present invention, a vehicle can be safely driven to a parking position while avoiding collision with an obstacle. [Brief description of the drawings]

[0007] [Figure 1] FIG. 2 is a block diagram showing a configuration of an in-vehicle device. [Diagram 2] FIG. 2 is a diagram showing a first parking path generated in the case of perpendicular parking. [Diagram 3] FIG. 11 is a diagram showing a second parking path generated in the case of perpendicular parking. [Figure 4] 11 is a diagram showing an example of a display on a display panel when a first parking path and a second parking path are generated. FIG. [Diagram 5] 13 is a diagram showing an example of a display on the display panel when a first parking path is generated. FIG. [Figure 6] FIG. 2 is a diagram showing a first parking path and a second parking path generated in the case of parallel parking. [Figure 7] FIG. 4 is a diagram showing a display example of a display panel. [Figure 8]FIG. 2 is a diagram showing a first parking path and a second parking path generated in the case of parallel parking. [Figure 9] FIG. 4 is a diagram showing a display example of a display panel. [Figure 10] 4 is a flowchart showing the operation of the parking assistance device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0009] 1 is a diagram showing a configuration of an on-vehicle device 3 mounted on a vehicle. In the following, the vehicle on which the on-vehicle device 3 is mounted is referred to as a host vehicle 1A, and a vehicle other than the host vehicle 1A is referred to as a different vehicle 1B. The in-vehicle device 3 includes a position detection unit 10, a sensor section 20, a wireless communication section 50, a display section 60, an operation section 70, a vehicle control unit 80, a steering device 81, a drive device 83, a braking device 85, a transmission 87, and a parking assistance device 100.

[0010] The position detection unit 10 detects the current position of the vehicle 1A. The position detection unit 10 includes a GNSS receiver that receives a GNSS (Global Navigation Satellite System) signal, and a processor that calculates the latitude and longitude, which are the current position of the vehicle 1A, based on the GNSS signal received by the GNSS receiver. The GNSS receiver and the processor are not shown. The position detection unit 10 outputs the calculated latitude and longitude indicating the current position of the vehicle 1A to the parking assistance device 100 as position information.

[0011] The sensor section 20 includes a plurality of sensors. The sensor section 20 of the present embodiment includes an imaging section 30 having a plurality of cameras and a sonar unit 40 as sensors. In this embodiment, the sensor unit 20 is described as having a camera and a sonar, but the sensor of the sensor unit 20 is not limited to a camera and a sonar. For example, the sensor unit 20 may be equipped with a radar or LiDAR (Laser Imaging Detection and Ranging) capable of measuring the distance to an obstacle using radio waves, light, or the like. The sensor unit 20 outputs the captured image of the imaging unit 30 and the sensor data of the sonar unit 40 to the parking assistance device 100 as detection information.

[0012] The photographing unit 30 includes a front camera 31 that photographs the front of the vehicle 1A, a rear camera 32 that photographs the rear of the vehicle 1A, a left side camera 33 that photographs the left side of the vehicle 1A, and a right side camera 34 that photographs the right side of the vehicle 1A. Each of these cameras includes an image sensor such as a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS), and a data processing circuit that generates an image based on the light receiving state of the image sensor. The photographing unit 30 has an angle of view adjusted so that the four cameras can photograph a 360° range centered on the vehicle 1A. The front camera 31, the rear camera 32, the left side camera 33, and the right side camera 34 photograph their respective photographing ranges at a predetermined frame rate to generate photographed images. The front camera 31, the rear camera 32, the left side camera 33, and the right side camera 34 output the generated photographed images to the parking assistance device 100.

[0013] The sonar unit 40 is mounted at multiple locations on the vehicle 1A, such as the front, rear, left side, and right side, and uses ultrasonic waves to detect obstacles present around the vehicle 1A. Specifically, the sonar unit 40 detects the location of the obstacle and the distance to the obstacle.

[0014] The wireless communication unit 50 performs wireless communication according to a wireless communication standard such as Wi-Fi (registered trademark) under the control of the parking assistance device 100.

[0015] The display unit 60 includes a touch panel 65. The touch panel 65 includes a display panel 61 and a touch sensor 63. The display panel 61 is an example of a display screen. For example, a liquid crystal display or an organic EL display is used for the display panel 61. For the touch sensor 63, a sensor of a generally known type such as a resistive film type or a capacitive type is used. The touch sensor 63 detects a touch operation performed on the display panel 61, and generates a position signal indicating the operation position of the detected touch operation. The touch sensor 63 outputs operation information including the generated position signal to the parking assistance device 100.

[0016] The operation unit 70 functions as a reception unit that receives operations by the driver. For example, the operation unit 70 includes buttons, switches, and the like, and outputs an operation signal corresponding to the operation button or switch operated by the driver to the parking assistance device 100.

[0017] The vehicle control unit 80 is, for example, a computer device such as an ECU (Electronic Control Unit), and is a unit that controls the steering device 81, the drive device 83, the braking device 85, and the transmission device 87 mounted on the host vehicle 1A. The vehicle control unit 80 is connected to the steering device 81, the drive device 83, the braking device 85, the transmission device 87, and the parking assistance device 100 via a bus 90 that complies with standards such as Ethernet (registered trademark), CAN (Controller Area Network), and LIN (Local Interconnect Network). The vehicle control unit 80 controls the steering device 81, the drive device 83, the braking device 85, and the transmission device 87 in accordance with control information input from the parking assistance device 100.

[0018] The steering device 81 is a device including an actuator that steers the steering wheels of the host vehicle 1A. The drive device 83 is a device including an actuator that adjusts the drive force of the drive wheels of the host vehicle 1A. If the power source of the host vehicle 1A is an engine, this actuator corresponds to a throttle actuator, and if the power source is a motor, this actuator corresponds to the motor. The braking device 85 is a device that controls a brake system provided in the host vehicle 1A based on information from the parking assistance device 100, and includes an actuator that controls the braking force applied to the wheels of the host vehicle 1A. The transmission 87 is a device including a transmission and an actuator. The transmission 87 drives the actuator to control the shift position of the transmission, and switches the gear ratio of the transmission and the forward and reverse motion of the host vehicle 1A.

[0019] The parking assistance device 100 is a computer device including a processor 130 such as a CPU (Central Processing Unit) or an MPU (Microprocessor Unit) and a memory 110 such as a ROM (Read Only Memory) or a RAM (Random Access Memory). In addition to these devices, the parking assistance device 100 also includes a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), an interface circuit for connecting sensors and peripheral devices, and an in-vehicle network communication circuit for communicating with other in-vehicle devices via an in-vehicle network. The parking assistance device 100 realizes various functional configurations by having the processor execute computer programs stored in the memory 110 or the storage device.

[0020] The memory 110 stores computer programs executed by the processor 130, data processed when the processor 130 executes the computer programs, and data resulting from the processing. The memory 110 also stores images captured by the imaging section 30 and sensor data output from the sonar unit 40.

[0021] The parking assistance device 100 includes, as functional components, a position acquisition unit 131, a situation acquisition unit 132, a surrounding map generation unit 133, a parking position determination unit 134, a route generation unit 135, a display control unit 136, a control information generation unit 137, and a communication control unit 138. The functions indicated by these functional components are realized by the processor 130 executing a computer program and performing calculations.

[0022] The position acquisition unit 131 receives latitude and longitude indicating the current position of the vehicle 1A calculated by the position detection unit 10. The position acquisition unit 131 corrects the latitude and longitude input from the position detection unit 10 using a well-known dead reckoning method to calculate the current position of the vehicle 1A. The position acquisition unit 131 outputs the calculated current position of the vehicle 1A to the surrounding map generation unit 133.

[0023] The situation acquisition section 132 causes the photographing section 30 to perform photographing, and acquires the photographed image generated by the photographing section 30. The situation acquisition section 132 causes the memory 110 to temporarily store the acquired photographed image. Furthermore, the situation acquisition unit 132 causes the sonar unit 40 to execute sensing, and acquires sensor data that is the detection result of the sonar unit 40. The situation acquisition unit 132 causes the memory 110 to temporarily store the acquired sensor data.

[0024] The surrounding map generating unit 133 generates a surrounding map showing the surrounding conditions of the host vehicle 1A based on the current position of the host vehicle 1A input from the position acquiring unit 131 and the captured images and sensor data stored in the memory 110. The surrounding map records obstacles present around the host vehicle 1A and the distances to the obstacles, parking areas, parking spaces such as white lines painted on the road surface of the parking lot, driving routes along which the host vehicle 1A is driven, and the like. Obstacles include, for example, other vehicles 1B, structures such as pillars in the parking lot, shopping carts, and the like. Since the parking spaces are painted on the road surface with a predetermined thickness, intervals corresponding to the thickness of the white lines are detected as periodic features.

[0025] The parking position determination unit 134 determines a parking frame in which the vehicle 1A is to be parked, with reference to the surrounding map generated by the surrounding map generation unit 133. For example, the parking position determination unit 134 selects a parking frame in which no obstacle is detected and the distance from the current position is equal to or less than a preset distance from the parking frame recorded in the surrounding map. The parking position determination unit 134 sets a position and an angle at which the vehicle 1A is to be parked in the selected parking frame, and determines a parking position Pf (see FIG. 2, FIG. 3, FIG. 6, and FIG. 8).

[0026] The route generating unit 135 generates a plurality of parking routes for parking the vehicle 1A according to the parking position Pf determined by the parking position determining unit 134. The parking route is a moving route for moving the vehicle 1A from the current position to the parking area. A known means is used for the parking route generating process. The route generating unit 135 of this embodiment generates two parking routes, a first parking route r1 and a second parking route r2 that is different from the first parking route r1.

[0027] FIG. 2 is a diagram showing an example of a first parking route r1, and FIG. 3 is a diagram showing an example of a second parking route r2. When the parking position Pf determined by the parking position determination unit 134 is on the right or left side of the vehicle 1A and the parking mode of the parking position Pf is parallel parking, the path generation unit 135 generates a first parking path r1 shown in Fig. 2 and generates a second parking path r2 shown in Fig. 3. Parallel parking is a parking mode in which the vehicle 1A is parked so that the vehicle 1A and another vehicle 1B parked in another parking area are lined up along the vehicle width direction of the vehicle 1A.

[0028] The first parking route r1 is a route having a first route r1a and a second route r1b. The first route r1a is a route from the current position P0 of the vehicle 1A to the change point P1, and the second route r1b is a route from the change point P1 to the parking position Pf. The change point P1 is a point where the traveling direction of the vehicle 1A is changed, and in the case of the first parking route r1, it is a point where the traveling direction is changed from forward to reverse.

[0029] The first route r1a of the first parking route r1 is a route that the vehicle 1A moves straight without turning. The second route r1b of the first parking route r1 is a route that the vehicle 1A moves backward while turning after reaching the change point P1, and moves the vehicle 1A to the parking position Pf.

[0030] The second parking route r2 is a route having a first route r2a and a second route r2b. The first route r2a is a route from the current position P0 of the vehicle 1A to the change point P2, and the second route r2b is a route from the change point P2 to the parking position Pf. The change point P2 is also a point where the traveling direction of the vehicle 1A is changed, that is, the point where the traveling direction is changed from forward to reverse.

[0031] The first route r2a of the second parking route r2 is a route for moving the host vehicle 1A forward while turning. The second route r2b of the second parking route r2 is a route for moving the host vehicle 1A backward while turning after the host vehicle 1A reaches the change point P2, and for moving the host vehicle 1A to the parking position Pf. The first parking route r1 and the second parking route r2 are different in the locations of the change points (P1, P2), and the first route (r1a, r2a) and the second route (r1b, r2b) are different routes.

[0032] The route generating unit 135 first determines whether the change points P1 and P2 can be set. For example, the route generating unit 135 sets points (called candidate points) that are candidates for the change points P1 and P2 with reference to a surrounding map. If an obstacle exists on the route from the set candidate point to the parking position Pf, the route generating unit 135 determines that the candidate point cannot be set as the change point P1 or P2. In addition, if the vehicle 1A cannot move from the parking position Pf to the candidate point due to restrictions such as the turning radius of the vehicle 1A, the route generating unit 135 determines that the candidate point cannot be set as the change point P1 or P2.

[0033] Next, the route generating unit 135 determines whether the vehicle 1A can move from the candidate point to the current position P0. If an obstacle exists between the current position P0 and the candidate point, the route generating unit 135 determines that the candidate point cannot be set as the change point P1 or P2. In addition, if the vehicle 1A cannot move from the set candidate point to the current position P0 due to restrictions such as the turning radius of the vehicle 1A, the route generating unit 135 determines that this point cannot be set as the change point P1, P2.

[0034] The route generating unit 135 attempts to generate the first parking route r1 and the second parking route r2 multiple times while changing the positions of the candidate points. If the route generating unit 135 cannot detect a candidate point from which the first parking route r1 can be generated even after changing the candidate points a predetermined number of times, the route generating unit 135 determines that the first parking route r1 cannot be generated. Similarly, if the route generating unit 135 cannot detect a candidate point from which the second parking route r2 can be generated even after changing the candidate points a predetermined number of times, the route generating unit 135 determines that the second parking route r2 cannot be generated. If the route generating unit 135 cannot generate the first parking route r1 and the second parking route r2, the route generating unit 135 causes the parking position determining unit 134 to change the parking position Pf.

[0035] In addition, when the route generating unit 135 detects a candidate point that can be set as the change point P1 or P2, it generates a parking route with the candidate point as the change point P1 or P2. In addition, when at least one of the first parking route r1 and the second parking route r2 can be generated, the route generating unit 135 generates the first parking route r1 or the second parking route r2 that can be generated without changing the parking position Pf.

[0036] The display control unit 136 causes the touch panel 65 to display the parking route generated by the route generation unit 135. First, the display control unit 136 reads out a captured image from the memory 110 and processes the captured image to generate an overhead image. The overhead image is an image of the host vehicle 1A, and shows the host vehicle 1A as a whole and the surroundings of the host vehicle 1A as seen from above. The display control unit 136 generates the overhead image by a generally known method. After generating the overhead image, the display control unit 136 generates a superimposed image by superimposing an image showing the parking path generated by the path generation unit 135 on the generated overhead image. The display control unit 136 causes the generated superimposed image to be displayed on the touch panel 65.

[0037] The control information generator 137 generates control information for driving the host vehicle 1A along the first parking route r1 or the second parking route r2 selected by operating the operation unit 70 or by touching the touch panel 65. This control information is information for driving the host vehicle 1A along the exit route, and includes information for controlling steering, driving, braking, and gear shifting.

[0038] The communication control unit 138 is a functional unit that controls mutual data communication with the vehicle control unit 80 connected to the bus 90. The communication control unit 138 transmits the control information generated by the control information generation unit 137 to the vehicle control unit 80.

[0039] 4 and 5 are diagrams showing examples of images displayed on the touch panel 65. FIG. When the first parking route r1 and the second parking route r2 are generated by the route generating unit 135, the display control unit 136 displays an image showing the first parking route r1 and an image showing the second parking route r2 side by side on the touch panel 65. In FIG. 4, the image showing the first parking route r1 is displayed on the left screen (hereinafter referred to as the left screen 67) of the touch panel 65, and the image showing the second parking route r2 is displayed on the left screen (hereinafter referred to as the left screen 67) of the touch panel 65. right Side screen (hereinafter, right An example of the display on screen 69 is shown below.

[0040] The image showing the first parking path r1 includes an image 7A showing the first path r1a, an image 7B showing the second path r1b, and a parking space 9 showing the parking position Pf. As an image showing the first parking path r1, an image showing the current position P0 of the vehicle 1A and an image showing the change point P1 may be displayed. FIG. 4 shows a case where the current position P0 and the change point P1 are displayed by images of black circles. Furthermore, as an image showing the first parking path r1, an icon 5 showing the direction and position of the vehicle 1A when the vehicle 1A reaches the change point P1 may be displayed.

[0041] The image showing the second parking route r2 also shows the image 7 showing the first route r2a. C and image 7 showing the second pathway r2b Dand a parking space 9 indicating the parking position Pf. As an image showing the second parking route r2, an image showing the current position P0 of the vehicle 1A and an image showing the change point P2 may be displayed. FIG. 4 shows a case where the current position P0 and the change point P2 are displayed as images of black circles. Furthermore, as an image showing the second parking route r2, an icon 5 showing the orientation and position of the vehicle 1A when it arrives at the change point P2 may be displayed.

[0042] In addition, when either the first parking route r1 or the second parking route r2 is generated by the route generating unit 135, the display control unit 136 displays an image showing the generated first parking route r1 or the second parking route r2. FIG. 5 shows an example in which an image showing the first parking route r1 is displayed on the left screen 67, and the right screen 69 is displayed blank. Note that, when only either the first parking route r1 or the second parking route r2 is generated, the image showing the generated first parking route r1 or the second parking route r2 may be displayed on the full screen of the touch panel 65.

[0043] 6 is a diagram showing parking routes generated by the route generating unit 135 when the parking mode is oblique parking. In particular, (A) shows the first parking route r3, and (B) shows the second parking route r4. Oblique parking is a parking mode in which the vehicle 1A is parked so that the overall length of the vehicle is oblique to the road that the parking area faces. When the parking style is oblique parking, if two parking paths can be generated, the path generation unit 135 generates two parking paths, a first parking path r3 and a second parking path r4.

[0044] The first parking route r3 is a route that has a first route r3a, a change point P3, and a second route r3b. The first route r3a is a route on which the host vehicle 1A travels straight without making any turns. The change point P3 is a point where the traveling direction of the host vehicle 1A changes from forward to reverse. The second route r3b is a route for moving the host vehicle 1A backward while turning, to the parking position Pf.

[0045] The second parking route r4 is a route that has a first route r4a, a change point P4, and a second route r4b. The first route r4a is a route in which the host vehicle moves forward while turning. The change point P4 is a point where the traveling direction of the host vehicle 1A changes from forward to reverse. The second route r4b is a route for moving the host vehicle 1A backward without turning and moving the host vehicle 1A to the parking position Pf.

[0046] FIG. 7 is a diagram showing a display image displayed on the touch panel 65 when the route generating unit 135 generates two routes, a first parking route r3 and a second parking route r4. For example, an image showing a first parking route r3 is displayed on a left screen 67 of the touch panel 65, and an image showing a second parking route r4 is displayed on a right screen 69. The image showing the first parking path r3 includes an image 7E showing the first path r3a, an image 7F showing the second path r3b, the current position P0 of the host vehicle 1A, the change point P3, and the parking space 9. The image showing the second parking path r4 includes an image 7G showing the first path r4a, an image 7H showing the second path r4b, the current position P0 of the host vehicle 1A, the change point P4, and the parking space 9.

[0047] 8 is a diagram showing parking routes generated by the route generating unit 135 when the parking mode is parallel parking. In particular, (A) shows the first parking route r5, and (B) shows the second parking route r6. Parallel parking is a parking mode in which the host vehicle 1A is parked so that the host vehicle 1A and another vehicle 1B parked in the parking area are lined up in the front-to-rear direction of the host vehicle 1A. When the parking style is parallel parking, if two parking paths can be generated, the path generation unit 135 generates two parking paths, a first parking path r5 and a second parking path r6.

[0048] The first parking route r5 is a route that has a first route r5a, a change point P5, and a second route r5b. The first route r5a is a route along which the host vehicle 1A moves backward while turning. The change point P5 is a point where the turning direction of the vehicle 1A is changed. For example, when the vehicle 1A is turned left rearward on the first route r5a, the turning direction is changed to right rearward at the change point P5. Also, when the vehicle 1A is turned right rearward on the first route r5a, the turning direction is changed to left rearward at the change point P5. The second route r5b is a route for moving the host vehicle 1A backward while turning to the parking position Pf.

[0049] The second parking route r6 is a route that includes a first route r6a, a change point P6, and a second route r6b. The first route r6a is a route along which the host vehicle 1A moves forward while turning. The change point P6 is a point where the traveling direction of the host vehicle 1A changes from forward to reverse. The second route r6b is a route for moving the host vehicle 1A backward while turning, to the parking position Pf.

[0050] FIG. 9 is a diagram showing a display image displayed on the touch panel 65 when the route generating unit 135 generates two routes, a first parking route r5 and a second parking route r6. For example, an image showing a first parking route r5 is displayed on a left screen 67 of the touch panel 65, and an image showing a second parking route r6 is displayed on a right screen 69. In the image showing the first parking path r5, an image 7I showing the first path r5a, an image 7J showing the second path r5b, the current position P0 of the host vehicle 1A, the change point P5, and the parking space 9 are displayed. In the image showing the second parking path r6, an image 7K showing the first path r6a, an image 7L showing the second path r6b, the current position P0 of the host vehicle 1A, the change point P6, and the parking space 9 are displayed.

[0051] FIG. 10 is a flowchart showing the operation of the parking assistance device 100. The operation of the parking assistance device 100 will be described with reference to Fig. 10. In this flowchart, the case where the parking mode is the perpendicular parking shown in Figs. First, the parking assistance device 100 determines whether or not a start operation for starting automatic parking has been received (step S1). For example, the parking assistance device 100 determines that a start operation has been received when a button for starting automatic parking displayed on the touch panel 65 is touched. The parking assistance device 100 may also determine that a start operation has been received when a button or switch provided on the operation unit 70 is operated. If the parking assistance device 100 has not received a start operation (step S1 / NO), the parking assistance device 100 waits to start the next process until a start operation is received.

[0052] When the parking assistance device 100 receives a start operation (step S1 / YES), the parking assistance device 100 acquires surrounding information of the vehicle 1A from the sensor unit 20 (step S2). Step S2 corresponds to an acquisition step of the present invention. Based on the acquired surrounding information, the parking assistance device 100 detects a parking area in which the vehicle 1A can be parked (step S3).

[0053] The parking assistance device 100 determines the detected parking area as a parking position Pf for parking the vehicle 1A (step S4), and generates a first parking route r1 and a second parking route r2 from the current position of the vehicle 1A to the set parking position Pf (step S5). Step S4 corresponds to a determination step. Step S5 corresponds to a generation step.

[0054] For example, the parking assistance device 100 sets candidate points for the change points P1 and P2 with reference to a surrounding map. The parking assistance device 100 judges whether or not it is possible to move the vehicle 1A from the parking position Pf to the set candidate point. If there is an obstacle between the parking position Pf and the candidate point, or if the vehicle 1A cannot be moved from the parking position Pf to the candidate point, the parking assistance device 100 changes the candidate point and judges again whether or not it is possible to move the vehicle 1A from the parking position Pf to the changed candidate point. Furthermore, when the vehicle 1A can be moved from the parking position Pf to the set candidate point, the parking assistance device 100 determines whether the vehicle 1A can be moved from the parking position Pf to the current position P0. When an obstacle exists between the candidate point and the current position P0 or when the vehicle 1A cannot be moved from the candidate point to the current position P0, the parking assistance device 100 changes the candidate point again and detects a candidate point to which the vehicle 1A can be moved to the parking position Pf.

[0055] When the parking assistance device 100 cannot detect a candidate point that can be the change point P1, it determines that it cannot generate the first parking route r1. When the parking assistance device 100 can detect a candidate point that can be the change point P1, it generates the first parking route r1 with the candidate point as the change point P1. In addition, if the parking assistance device 100 cannot detect a candidate point that can be the change point P2, it determines that the second parking route r2 cannot be generated. In addition, if the parking assistance device 100 can detect a candidate point that can be the change point P2, it generates the second parking route r2 with the candidate point as the change point P2.

[0056] Next, the parking assistance device 100 judges whether the first parking route r1 and the second parking route r2 have been generated (step S6). If the parking assistance device 100 has not been able to generate the first parking route r1 and the second parking route r2 (step S6 / NO), the parking assistance device 100 judges whether the first parking route r1 or the second parking route r2 has been generated, and judges whether one parking route has been generated (step S7). If the parking assistance device 100 has generated one parking route (step S7 / NO), the parking assistance device 100 returns to the process of step S3 and detects the parking area again.

[0057] When one parking route is generated (step S7 / YES), the parking assistance device 100 displays the generated first parking route r1 or second parking route r2 on the touch panel 65 (step S8).

[0058] Next, the parking assistance device 100 judges whether or not a confirmation operation, which is a selection to park the vehicle 1A at the parking position Pf according to the parking route displayed on the touch panel 65, has been received (step S9). If the confirmation operation has not been received (step S9 / NO), the parking assistance device 100 repeats the judgment of step S9. Also, if the confirmation operation has not been received (step S9 / NO), the parking assistance device 100 may return to the judgment of step S3 and redetect the parking position Pf.

[0059] When the parking assistance device 100 receives the confirmation operation (step S9 / YES), the parking assistance device 100 generates control information for driving the vehicle 1A along the parking route generated in step S7 (step S10). The parking assistance device 100 transmits the generated control information to the vehicle control unit 80 (step S11).

[0060] Furthermore, when the parking assistance device 100 determines in step S5 that the first parking route r1 and the second parking route r2 have been generated (step S5 / YES), the parking assistance device 100 displays the generated first parking route r1 and second parking route r2 on the touch panel 65 (step S12). Step S12 corresponds to a display step.

[0061] Next, the parking assistance device 100 judges whether or not an operation to select either the first parking route r1 or the second parking route r2 displayed on the touch panel 65 has been received (step S13). When the parking assistance device 100 has not received an operation to select either the first parking route r1 or the second parking route r2 (step S13 / NO), the parking assistance device 100 waits until the selection operation is received (step S13). When the parking assistance device 100 receives an operation to select either the first parking route r1 or the second parking route r2 (step S13 / YES), the parking assistance device 100 generates control information for driving the host vehicle 1A according to the selected parking route (step S14). Step S14 corresponds to a generating step. The parking assistance device 100 transmits the generated control information to the vehicle control unit 80 (step S15). Step S15 corresponds to a transmitting step.

[0062] As described above, the parking assistance device 100 of this embodiment generates two routes, the first parking route (r1, r3, r5) and the second parking route (r2, r4, r6), based on the surrounding information detected by the sensor unit 20, and displays the generated parking routes on the touch panel 65. Then, the parking assistance device 100 generates control information for driving the host vehicle 1A according to the parking route selected by the driver, and transmits the generated control information to the vehicle control unit 80 that controls the driving of the host vehicle 1A. Therefore, the driver can check whether there are any obstacles on the first parking path (r1, r3, r5) and the second parking path (r2, r4, r6) by visually checking or by looking at the image displayed on the touch panel 65, or by actually visually checking the surroundings of the vehicle 1A, and by selecting a parking path that does not have any obstacles, the possibility of the vehicle 1A coming into contact with or colliding with an obstacle can be reduced even if the detection accuracy of the sensor unit 20 is low and the sensor unit 20 is unable to detect an obstacle. This allows the vehicle 1A to safely travel to a parking position while avoiding collision with an obstacle.

[0063] The route generation unit 135 sets the change points (P1, P2), (P3, P4), and (P5, P6) that change the direction of travel of the vehicle 1A at different points in the first parking route (r1, r3, r5) and the second parking route (r2, r4, r6), and generates the first parking route (r1, r3, r5) and the second parking route (r2, r4, r6), respectively. Therefore, a first parking route (r1, r3, r5) and a second parking route (r2, r4, r6) with different routes can be generated, and if there is an obstacle on either the first parking route (r1, r3, r5) or the second parking route (r2, r4, r6), the other route can be selected to park the vehicle 1A at the parking position Pf while avoiding the obstacle.

[0064] When the parking mode to the parking position Pf is parallel parking or diagonal parking and the parking position Pf is on the right or left side of the vehicle 1A, the route generation unit 135 generates a route as a first parking route (r1, r3) that drives the vehicle 1A straight to the change point (P1, P3) and then turns while backing up to the parking position Pf. In addition, the route generating unit 135 generates a route for moving the host vehicle 1A forward while turning to the change point (P2, P4), and then moving the host vehicle 1A back to the parking position Pf as the second parking route (r2, r4). Therefore, when the parking mode to the parking position Pf is parallel parking or oblique parking, a first parking route (r1, r3) and a second parking route (r2, r4) with different routes can be generated. Therefore, when there is an obstacle on either the first parking route (r1, r3) or the second parking route (r2, r4), the vehicle 1A can be parked at the parking position Pf while avoiding the obstacle by selecting the other route.

[0065] When the parking mode to the parking position Pf is parallel parking and the parking position Pf is located to the right rear or left rear of the vehicle 1A, the route generation unit 135 generates a route as a first parking route r5 that reverses the vehicle 1A to the change point P5 while making a right turn or a left turn, and then reverses the vehicle 1A from the change point P5 to the parking position Pf while making a left turn or a right turn. In addition, the route generating unit 135 generates, as the second parking route r6, a route for moving the host vehicle 1A forward to the change point P6 while turning, and then moving the host vehicle 1A backward from the change point P6 while turning to the parking position Pf. Therefore, when the parking mode to the parking position Pf is parallel parking, a first parking route r5 and a second parking route r6, which are different routes, can be generated. Therefore, when an obstacle is found on either the first parking route r5 or the second parking route r6, the vehicle 1A can be parked at the parking position Pf while avoiding the obstacle by selecting the other route.

[0066] The above-described embodiment is merely an example of one aspect of the present invention, and any modifications and applications are possible without departing from the spirit and scope of the present invention. For example, the block diagram showing the configuration of the parking assistance device 100 shown in Fig. 1 is a schematic diagram showing components classified according to main processing contents in order to facilitate understanding of the present invention, and the components can be further classified into more components according to the processing contents. Also, one component can be classified to perform more processes.

[0067] In addition, in FIG. 1, the parking assistance device 100 may be configured to include at least one of the position detection unit 10 and the sensor section 20 as an integrated unit.

[0068] In addition, when the parking assistance method of the present invention is realized using a computer, the program executed by the computer can be configured in the form of a recording medium or a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specifically, portable or fixed recording media such as a flexible disk, a hard disk drive (HDD), a compact disk read only memory (CD-ROM), a DVD, a Blu-ray (registered trademark) disc, a magneto-optical disk, a flash memory, and a card-type recording medium can be used. The recording medium can also be a non-volatile storage device such as a ROM or HDD provided in the parking assistance device 100.

[0069] 10 is divided according to the main processing contents in order to facilitate understanding of the processing of the parking assistance device 100, and the present invention is not limited by the manner in which the processing units are divided or the names of the processing units. The processing of the parking assistance device 100 may be divided into more processing units according to the processing contents. Furthermore, the processing of the parking assistance device 100 may be divided so that one processing unit includes more processes. [Explanation of symbols]

[0070] 1A Car 1B Other vehicles 3 Onboard equipment 5 Icons Images showing 7A, 7C, and 7E 1st parking route Images showing 7B, 7D, and 7F 2nd parking route 9 Parking Space 10 Position detection unit 20 Sensor section 30 Photography Department 31 Front Camera 32 Rear camera 33 Left side camera 34 Right side camera 40 Sonar Unit 50 Wireless Communication Division 61 Display Panel 63 Touch Sensor 65 Touch Panel 67 Left screen 69 Right screen 70 Operation section 80 Vehicle Control Unit 81 Steering Gear 83 Drive unit 85 Braking device 87 Gearbox 100 Parking assistance device 110 Memory 130 processors 131 Position acquisition part 132 Status Acquisition Unit 133 Surrounding Area Map Generation Unit 134 Parking position determination unit 135 Route Generation Unit 137 Control information output section P0 Current position P1~P6 Change points Pf Parking Position r1, r3, r5 1st parking route r2, r4, r6 2nd parking route r1a, r2a, r3a, r4a, r5a, t6a 1st route r1b, r2b, r3b, r4b, r5b, t6b Alternative pathway

Claims

1. A situation acquisition unit that acquires a surrounding situation of the vehicle; a parking position determination unit that determines a parking position for parking the vehicle based on the surrounding situation of the vehicle acquired by the situation acquisition unit; a route generating unit that generates a first parking route, which is a route for moving the vehicle from the position of the vehicle to the parking position, and a second parking route, which is the route and is different from the first parking route; A display control unit that displays an image indicating the first parking path and an image indicating the second parking path generated by the path generation unit on a display screen; a control information generating unit that generates control information for driving the vehicle along the selected parking route when one of the first parking route and the second parking route is selected; a communication control unit that transmits the control information generated by the control information generation unit to a vehicle control unit that controls driving of the vehicle; Equipped with A parking assistance device characterized in that the display control unit displays an image showing the first parking route generated by the route generation unit and an image showing the second parking route side by side on the display screen.

2. 2. The parking assistance device according to claim 1, wherein the route generation unit determines whether or not a change point that is included in the first parking route and the second parking route and that is a point at which the vehicle's traveling direction is changed can be set based on the surrounding conditions of the vehicle, and sets the change point that is determined to be set based on the surrounding conditions of the vehicle to a different point in the first parking route and the second parking route, thereby generating the first parking route and the second parking route, respectively.

3. The parking assistance device of claim 2, characterized in that the route generation unit determines that the candidate point cannot be set as the change point if an obstacle exists on the route from a candidate point that is a candidate for the change point based on the surrounding conditions of the vehicle to the parking position, or if an obstacle exists between the current position of the vehicle and the candidate point based on the surrounding conditions of the vehicle.

4. The parking assistance device of claim 1, characterized in that the display control unit displays an image showing the first parking route including the first parking route and the parking position, and an image showing the second parking route including the second parking route and the parking position, side by side on the display screen.

5. The parking assistance device of claim 1, characterized in that when the route generation unit generates either the first parking route or the second parking route, the display control unit displays an image showing the generated first parking route or an image showing the generated second parking route full-screen on the display screen.

6. When the parking mode to the parking position is parallel parking or oblique parking, and the parking position is on the right side or left side of the vehicle, generating, as the first parking path, a path in which the vehicle is driven straight to the change point and then reversed to the parking position while turning the vehicle; 3. The parking assistance device according to claim 2, wherein the second parking path is generated by moving the vehicle forward while turning to the change point, and then moving the vehicle backward to the parking position.

7. When the parking mode to the parking position is parallel parking and the parking position is located to the right rear or left rear of the vehicle, A route for backing up the vehicle to the change point while turning right or left, and backing up the vehicle from the change point to a parking position while turning left or right is generated as the first parking route; 3. The parking assistance device according to claim 2, wherein the second parking path is generated by moving the vehicle forward to the change point while turning, and then moving the vehicle backward from the change point to the parking position while turning.

8. An acquisition step of acquiring a surrounding situation of the vehicle; A determination step of determining a parking position for parking the vehicle based on the acquired surrounding conditions of the vehicle; a generating step of generating a first parking path which is a movement path for moving the vehicle from the position of the vehicle to the parking position, and a second parking path which is the movement path and is different from the first parking path; A display step of displaying the generated image showing the first parking path and the generated image showing the second parking path on a display screen; a generating step of generating control information for driving the vehicle according to the selected parking route when either the first parking route or the second parking route is selected; a transmission step of transmitting the control information generated in the generation step to a vehicle control unit that controls driving of the vehicle; having The parking assistance method is characterized in that the display step includes displaying an image showing the first parking path generated in the generation step and an image showing the second parking path side by side on the display screen.

Citation Information

Patent Citations

  • Parking assistance device

    JP2008284969A

  • Parking assist system

    JP2012066709A

  • Automatic parking device

    JP2019043429A

  • Parking support device

    JP2019127112A

  • Parking assistance system

    US20180345955A1