Parking assistance device

By combining LiDAR sensors and cameras, the system can detect parking areas around the vehicle in real time and provide options to change the parking target location during the parking process. This solves the problems of inaccurate detection of long-distance parking areas and difficulty in selecting target locations in existing technologies, thereby improving the intelligence and user experience of parking assistance.

CN123104523APending Publication Date: 2026-11-17AISIN CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202610639452.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2025-05-16
Filing Date
2026-05-11
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing parking assistance devices are not accurate enough in detecting parking areas far from the vehicle, making it difficult for users to select a suitable parking target location and preventing them from changing the parking target location during the parking process.

Method used

It uses LiDAR sensors combined with cameras and ultrasonic sensors to detect the parking area around the vehicle in real time and provides the opportunity to change the target parking location during parking assistance. It guides users to choose a suitable parking location through an LCD display and voice.

Benefits of technology

It improves the detection accuracy of long-distance parking areas, allowing users to flexibly choose a more suitable parking target location during the parking process, thus enhancing the intelligence of parking assistance and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123104523A_ABST
    Figure CN123104523A_ABST
Patent Text Reader

Abstract

This invention provides a parking assistance device that, during the execution of parking assistance, when a new candidate parking location different from the original parking location exists, proposes to change the parking target location to the new candidate parking location. The device uses detection sensors on the vehicle to detect candidate parking target locations. After setting the detected candidate parking target location as the vehicle's parking target location, parking assistance for parking the vehicle at the target location is executed. If, during the execution of parking assistance, the detection sensors detect a new candidate parking target location different from the set candidate parking target location, a proposal to change the parking target location to the new candidate parking target location is made.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to a parking assistance device for assisting in parking a vehicle. Background Technology

[0002] Currently, a parking assistance device is known to assist a vehicle in parking. In this device, a target parking location is preset, and parking assistance is provided, for example, by automatically moving the vehicle to the preset target location or by guiding the vehicle towards the target location. Furthermore, in setting the target parking location, as disclosed in Japanese Patent Application Publication No. 2016-16681, it is possible to detect available parking areas around the vehicle using detection sensors such as cameras equipped with the vehicle, and then set the detected available parking areas as the target parking location.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2016-16681 (paragraphs 0022-0028)

[0006] In Patent Document 1, sensors such as cameras mounted on the vehicle are used to detect available parking areas around the vehicle. However, due to the different types of sensors, available parking areas located far from the vehicle can also be detected. Alternatively, information on available parking areas can be obtained, for example, from a parking lot management server without using sensors mounted on the vehicle; even in this case, available parking areas located far from the vehicle can still be detected. Moreover, in particular, the following problems arise when detecting available parking areas located far from the vehicle and setting the detected available parking areas as parking target locations.

[0007] First, it's difficult to accurately detect the status of parking areas located far away using sensors. Therefore, sometimes the parking area set as the target parking location is not actually suitable for parking the vehicle. Second, it's difficult for users to grasp the status of parking areas located far away. Therefore, when there are multiple parking areas, it's difficult for users to select a suitable target parking location before activating parking assistance.

[0008] However, despite the aforementioned problems, existing parking assistance devices generally do not offer users the opportunity to change their parking target location once a parking target location is set and parking assistance begins, even if it is later determined that the parking target location is not suitable for parking or a more suitable parking target location is found as a backup. Summary of the Invention

[0009] The present invention was proposed to solve the above-mentioned problems, and its purpose is to provide a parking assistance device that, in the execution of parking assistance, when there is a new candidate parking target location different from the parking target location, can propose to change the parking target location to the new candidate parking target location.

[0010] In order to achieve the above objectives, the parking assistance device according to the present invention, in the execution of parking assistance for a vehicle parking at a parking target location, when there is a candidate for a new parking target location different from the parking target location, proposes to change the parking target location to the candidate for the new parking target location.

[0011] The phrase "in the execution of vehicle parking assistance, there is a new candidate parking target location" includes situations where the device has already detected a new candidate parking target location before parking assistance begins, and situations where the device detects a new candidate parking target location for the first time after parking assistance begins.

[0012] In addition, "parking assistance" can be an assistance for vehicle control used to move the vehicle to a target parking position, or it can be an assistance for guiding the vehicle to a target parking position.

[0013] Additionally, "execution of parking assistance" could be the period from setting the target parking location to completing the parking, or the period from when vehicle control or guidance for parking actually begins. Alternatively, it could be the time until it becomes possible to change to another target parking location. Or, it could be the time until the current target parking location can be reliably sensed by sensors (i.e., until it can be determined that parking is possible at the target location).

[0014] According to the parking assistance device of the present invention having the above-described structure, after parking assistance is initiated, if it is known that there is a more suitable alternative parking target location, the user can be provided with the opportunity to change the parking target location to a new alternative parking target location. Attached Figure Description

[0015] Figure 1 This is a general structural diagram of the vehicle involved in this embodiment.

[0016] Figure 2 This is a diagram illustrating the LiDAR sensor equipped in the vehicle.

[0017] Figure 3 This is a block diagram illustrating the structure of the parking assistance device according to this embodiment.

[0018] Figure 4This is a flowchart of the parking assistance processing procedure involved in this embodiment.

[0019] Figure 5 This diagram illustrates the method of converting a captured image into an aerial view.

[0020] Figure 6 This is a diagram illustrating the method for generating an overhead image.

[0021] Figure 7 This is a graph representing the range that LiDAR sensors cannot detect.

[0022] Figure 8 This is a diagram showing an example of a target parking frame image displayed on a liquid crystal display.

[0023] Figure 9 This is a diagram illustrating how parking trajectories are calculated.

[0024] Figure 10 It is a diagram illustrating the initial target position and other candidate targets.

[0025] Figure 11 This diagram illustrates situations where other target candidates are identified as having higher evaluation scores than the initial target position.

[0026] Figure 12 This is an example diagram showing a proposal screen displayed on an LCD monitor.

[0027] Explanation of reference numerals in the attached figures

[0028] 1…Parking assistance device, 2…Vehicle, 3…Operating unit, 4…LCD display, 6…Front camera (detection sensor), 7…Rear camera (detection sensor), 8A, 8B…Side camera (detection sensor), 9A~9L…Ultrasonic sensor (detection sensor), 10…LiDAR sensor (detection sensor), 11…Driver assistance ECU, 31…CPU, 34…Flash memory, 65~67…Parking area (parking target location), 69…Obstacles. Detailed Implementation

[0029] Hereinafter, a specific embodiment of the parking assistance device according to the present invention will be described in detail with reference to the accompanying drawings. First, the vehicle 2 equipped with the parking assistance device 1 according to this embodiment will be described. Figure 1 This is a general structural diagram of the vehicle 2 involved in this embodiment.

[0030] Vehicle 2 can be, for example, an automobile powered by an internal combustion engine (engine, etc.) (internal combustion engine vehicle), an automobile powered by an electric motor (motor, etc.) (electric vehicle, fuel cell vehicle, etc.), or an automobile powered by both (hybrid vehicle). Furthermore, there are no specific limitations on the vehicle type; it can be a regular car, or a large commercial truck, bus, construction machinery, etc. Additionally, while the following description refers to a four-wheeled vehicle, it can also be a two-wheeled or three-wheeled vehicle.

[0031] However, vehicle 2 is an assisted driving vehicle that, in addition to being able to perform manual driving based on user driving operations, can also perform autonomous driving without relying on user driving operations.

[0032] Furthermore, autonomous driving assistance can be implemented only in specific situations such as parking or exiting a parking space, or it can be implemented on all road sections, or only while the vehicle is traveling on a specific road section (e.g., a highway with gates at the boundary (regardless of whether there are people or it is toll-free)). In this embodiment, assisted driving based on autonomous driving assistance is performed at least on the driving from the time the vehicle stops until it reaches the parking space (i.e., parking assistance).

[0033] Furthermore, in the vehicle control of the automated driving assistance system in this embodiment, for example, the vehicle's current position, the lane lines the vehicle is traveling in, and the positions of surrounding obstacles are detected at any time, and vehicle control such as steering wheel, drive source, and brakes is automatically performed to make the vehicle travel along the generated driving trajectory at a speed determined according to the same generated speed plan. In particular, in the case of parking assistance, as described later, a candidate parking location specified by the user from the candidates displayed on the in-vehicle display is set as the parking target location for this time. Then, vehicle control is automatically performed: the parking trajectory to the set parking target location is calculated, and the vehicle is driven into the parking target location along the calculated parking trajectory to complete the parking. However, only the steering operation can be performed automatically, and the drive source and brakes can be controlled manually. Alternatively, only the parking operation instruction can be given, and the parking operation can be performed manually by the user. Furthermore, when performing the above-mentioned parking assistance, the scenery around the vehicle (which can be a real scene or CG (computer-generated image)) is displayed on the in-vehicle display, along with the parking target location and obstacles (such as parked vehicles) present in its vicinity.

[0034] In addition, such as Figure 1As shown, vehicle 2 includes an operation unit 3 that receives operations from occupants, an LCD display 4 that displays bird's-eye view or overhead view of the vehicle's surroundings and other driver assistance-related information to the occupants, a speaker 5 that outputs voice guidance regarding driver assistance, a front camera 6 for capturing images of the vehicle's surroundings, a rear camera 7, side cameras 8A and 8B, ultrasonic sensors 9A-9L for detecting obstacles around the vehicle, a LiDAR (Light Detection and Ranging) sensor 10 that detects objects in a more distant area in the direction of travel, and a driver assistance ECU (Electronic Control Unit) 11 that performs various calculations based on the input information. Furthermore, the aforementioned driver assistance ECU 11 is included as a parking assistance device 1.

[0035] The following describes the various components of vehicle 2. First, the operation unit 3 is disposed, for example, on the front surface of the steering wheel (also called the steering wheel), and includes operation buttons that are operated when autonomous driving assistance is initiated. By operating the operation unit 3, the user can switch between manual driving, where driving is based on the user's driving operations, and assisted driving, where the vehicle drives automatically without the user's driving operations. In particular, in this embodiment, the operation unit 3 also includes a touch panel disposed on the front surface of the liquid crystal display 4. By operating the touch panel, the user can specify and change the parking target location during parking assistance, as described later. In addition, the operation unit 3 may also include a microphone and a voice recognition device.

[0036] The LCD display 4 is a type of display device installed on the dashboard of the vehicle 2. During the execution of automated driving assistance, it displays a bird's-eye view or panoramic view of the vehicle's surroundings, generated by viewpoint conversion and compositing of images captured by the front camera 6, rear camera 7, and side cameras 8A and 8B. However, it may also display a virtual image of the vehicle's surroundings recreated using CG instead of a real-world image. Furthermore, when parking assistance is initiated, a candidate parking frame image representing the target parking location may be overlaid on the aforementioned vehicle surroundings image. Moreover, during parking assistance, if a new candidate parking location different from the currently set parking target location exists, under certain conditions, a proposal screen suggesting changing the parking target location to the new candidate parking target location may also be displayed. Additionally, the LCD display 4 can also function as a display for a navigation device.

[0037] Additionally, speaker 5 is mounted on the dashboard of vehicle 2, outputting guidance voice, warning sounds, etc., related to driver assistance. Furthermore, in parking assistance, if a new candidate parking location exists that differs from the currently set parking target location, a voice prompt proposing to change the parking target location to the new candidate location can be output under specified conditions. Speaker 5 can also function as a speaker for the navigation device.

[0038] In addition, the front camera 6 is, for example, a camera with a solid-state imaging element such as a CCD, and is positioned above the front bumper of the vehicle 2 or on the back of the interior rearview mirror, for example, with the optical axis direction facing forward of the vehicle's direction of travel.

[0039] The rear camera 7 is also a camera device that uses a solid-state imaging element such as a CCD. For example, it is installed near the center of the license plate at the rear of the vehicle 2, with the optical axis facing the rear of the vehicle.

[0040] Furthermore, the side cameras 8A and 8B are also cameras that use solid-state imaging elements such as CCDs, for example, mounted on the left and right side mirrors of vehicle 2, with the optical axis facing the side of the vehicle.

[0041] Furthermore, the driver assistance ECU 11 performs viewpoint conversion and synthesis processing on the images captured by the aforementioned front camera 6, rear camera 7, and side cameras 8A and 8B (hereinafter collectively referred to as cameras) to generate a top-down or bird's-eye view image of the vehicle's surroundings. Additionally, during the execution of autonomous driving assistance, image recognition processing is performed on the captured images to detect lane markings, parking lines, and obstacles (other vehicles, pedestrians, bicycles, walls, guardrails, and other structures) around the vehicle, and autonomous driving assistance is executed based on the detection results.

[0042] On the other hand, ultrasonic sensors 9A to 9L are respectively arranged at predetermined intervals at the front, rear, and sides of the vehicle, emitting ultrasonic waves as detection waves around the vehicle 2, and receiving reflected waves from objects present around the vehicle, thereby sensing the objects reflecting the detection waves. Specifically, the ultrasonic sensor is a ranging sensor capable of detecting the distance (range value) of the object reflecting the detection wave by measuring the time from transmission to reception. Furthermore, the ultrasonic sensors 9A to 9L are configured to generate an output signal (containing the distance to the detected object) corresponding to the reception result of the received wave and send it to the control unit. Furthermore, objects detected by the ultrasonic sensors 9A to 9L can include, for example, people, bicycles, other vehicles, walls, and other obstacles that the vehicle 2 needs to avoid while driving. They are particularly useful for detecting objects present near the vehicle 2. Millimeter-wave sensors or laser sensors can also be used as ranging sensors instead of ultrasonic sensors.

[0043] Furthermore, the placement and orientation of each ultrasonic sensor 9A-9L can be appropriately set. However, in this embodiment, to define the detection range of the object as the entire area in front of, behind, and to the left and right sides of the vehicle 2 in its direction of travel, for example, ultrasonic sensors 9A-9D are placed on the front surface of the vehicle 2, facing the direction of travel, with the direction of transmitting detection waves in front of the vehicle. Ultrasonic sensors 9E and 9F are placed on the left side of the vehicle 2, facing to the left, with the direction of transmitting detection waves to the left side of the vehicle. Ultrasonic sensors 9G and 9H are placed on the right side of the vehicle, facing to the right, with the direction of transmitting detection waves to the right side of the vehicle. Ultrasonic sensors 9I-9L are placed on the rear surface of the vehicle 2, facing the opposite direction of travel, with the direction of transmitting detection waves to the rear of the vehicle. The height of each ultrasonic sensor 9A-9L above the ground surface is the same.

[0044] Furthermore, in this embodiment, the ultrasonic sensors 9A-9L, particularly the ultrasonic sensors 9A-9D on the front surface of vehicle 2 and the ultrasonic sensors 9I-9L on the rear surface of vehicle 2, are positioned between adjacent sensors so that they can receive reflected waves as indirect waves. Therefore, by receiving both direct and indirect waves, not only can the distance to the object be detected, but the specific position of the object (relative to the vehicle) can also be determined using triangulation. The lateral ultrasonic sensors 9E-9H are separated from each other. Therefore, although they cannot receive indirect waves, by using triangulation of the distance measured at the previous position, the distance measured at the current position, and the distance moved between them, the specific position of the object (relative to the vehicle) can also be determined.

[0045] On the other hand, the LiDAR sensor 10, for example, is disposed on the back side of an interior rearview mirror, irradiates a laser beam in front of the vehicle 2, and detects an object based on information about the laser beam reflected by the object. Specifically, the LiDAR sensor is a sensing device capable of detecting the distance (range value) from the object reflecting the laser beam by measuring the time from irradiation to light reception. More specifically, the LiDAR sensor 10 includes, for example, a light source for irradiating the laser beam, a photodiode for receiving the reflected laser beam, and a control circuit for measuring the time from irradiation to light reception. Furthermore, the LiDAR sensor 10 is configured to generate an output signal corresponding to the sensing result and can be output to the control unit of the parking assistance device 1.

[0046] In particular, in this embodiment, a 3D LiDAR capable of three-dimensional sensing is used as the LiDAR sensor 10. Multiple lasers are superimposed in the vertical direction and rotated in the horizontal direction to perform sensing (scanning), thereby obtaining three-dimensional information. For example, Figure 2 As shown, 3D LiDAR can more accurately measure the position and shape of objects around a vehicle by collecting distance information as a set of points (point cloud data). Specifically, by visualizing the reflection points of reflected laser light using a three-dimensional point cloud, it is possible to identify more information such as the position, shape, size, and speed of objects with high precision. The objects detected by the LiDAR sensor 10 are the same as those detected by the ultrasonic sensors 9A to 9L, such as people, bicycles, other vehicles, walls, and other obstacles that the vehicle 2 needs to avoid while driving. However, compared with ultrasonic sensors and millimeter-wave sensors, the LiDAR sensor 10 can sense over a longer distance, such as a range of tens of meters away from the vehicle.

[0047] Furthermore, in this embodiment, when providing parking assistance, the parking assistance device 1 uses the LiDAR sensor 10 to detect candidate parking areas located far from the vehicle's position that serve as the parking target location. However, the detection of parking areas is not necessarily performed solely by the LiDAR sensor 10; it is preferable to also use, for example, image recognition using a camera. Additionally, the area near the vehicle can also be detected using the aforementioned ultrasonic sensors 9A-9L.

[0048] Furthermore, in the example above, a 3D LiDAR capable of three-dimensional sensing was used as the LiDAR sensor 10, but a 2D LiDAR could also be used. Additionally, any sensor capable of sensing a wide range can be used, even sensors other than LiDAR sensors.

[0049] Furthermore, the placement position and orientation of the LiDAR sensor 10 can be appropriately set. However, in this embodiment, in order to include the area in front of the vehicle 2 in the direction of travel as the detection range for the object, the LiDAR sensor 10 is, for example, placed on the front surface of the vehicle 2 with the laser irradiation direction in front of the vehicle's direction of travel and facing the direction of travel. However, in addition to the front surface of the vehicle 2, the LiDAR sensor 10 can also be placed on the side or rear surface, in which case it can sense the sides and rear of the vehicle 2.

[0050] On the other hand, the driver assistance ECU 11 is an electronic control unit that performs various processes related to autonomous driving assistance. The driver assistance ECU 11 is connected via an in-vehicle network such as CAN (Controller Area Network) to the aforementioned operating unit 3, LCD display 4, speaker 5, front camera 6, rear camera 7, side cameras 8A and 8B, ultrasonic sensors 9A-9L, and LiDAR sensor 10. Furthermore, the driver assistance ECU 11 is also connected to various sensors installed in the vehicle 2, such as GPS, vehicle speed sensor, acceleration sensor, gyroscope sensor, steering sensor, and gear position sensor, as well as navigation devices that are in-vehicle equipment. The detailed structure of the driver assistance ECU 11 will be described later.

[0051] In addition, vehicle 2 Figure 1 In addition to the constituent elements shown, there may be other constituent elements that are the basic constituent elements of vehicle 2. However, only the constituent elements related to the control of autonomous driving assistance (especially parking assistance) and the control related to the constituent elements will be described.

[0052] The following is a detailed description of the parking assistance device 1, particularly the driver assistance ECU 11, which is provided in the aforementioned vehicle 2. Figure 3 This is a block diagram showing the structure of the parking assistance device 1 according to this embodiment.

[0053] like Figure 3 As shown, the driver assistance ECU (electronic control unit) 11 is an electronic control unit that performs overall control of the parking assistance device 1. It includes a CPU 31, which serves as a computing and control unit; RAM 32, which is used as working memory when the CPU 31 performs various calculations and processes and stores the sensing results of the LiDAR sensor 10, driving trajectory data when calculating the driving trajectory, etc.; and a control program and the parking assistance processing program described later (see reference). Figure 4 The ECU 11 includes internal storage devices such as ROM 33 and flash memory 34 storing programs read from ROM 33. Furthermore, the ECU 11 performs various functions as processing algorithms. These include: detecting parking areas in the direction of vehicle travel and in a passageway facing the vehicle using a LiDAR sensor 10 that sets the vehicle's direction of travel as its detection range; providing parking assistance after setting the detected parking area as the target parking location; and proposing a change to the new target parking location if a new candidate parking location exists during the execution of parking assistance for a vehicle parking at the set target location.

[0054] In addition, the driver assistance ECU 11 is connected to various sensors 36 used to detect the vehicle's current position and behavior, such as GPS, vehicle speed sensor, acceleration sensor, gyroscope sensor, steering sensor, and gear position sensor, as well as various drive units 37 of the vehicle, such as steering wheel, brakes, accelerator, and transmission. Based on the detection results of these sensors 36, the current position and behavior of the vehicle are detected, and autonomous driving assistance for the vehicle 2 is implemented by controlling each drive unit 37. As a specific example of autonomous driving assistance, in parking assistance, the vehicle's current position and the positions of surrounding obstacles are constantly detected, and vehicle control, such as steering wheel, drive source, and brakes, is performed to drive along a generated parking trajectory. Specifically, in parking assistance-based driving, if the ultrasonic sensors 9A-9L and LiDAR sensor 10 detect obstacles within a specified distance from the vehicle, deceleration control is performed to stop the vehicle, or obstacle avoidance control is performed. However, it is also possible to automatically perform steering operations while the control of the drive source and brakes is based on manual operation. Alternatively, it is also possible to only provide parking operation instructions and allow the user to perform the parking operation manually.

[0055] Additionally, ROM33 contains vehicle information DB35, which stores various information related to vehicle 2. For example, it stores the location (height above the ground, left and right position) of the cameras, ultrasonic sensors 9A-9L, and LiDAR sensor 10 installed on vehicle 2, the detection axes (optical axis and viewing angle of the cameras), overall length, vehicle width, wheelbase, and minimum turning radius. This information can be pre-input by occupants or personnel from the vehicle manufacturer.

[0056] Next, based on Figure 4 This section describes the parking assistance processing procedure executed by the driver assistance ECU 11 in the parking assistance device 1 with the above-described structure. Figure 4 This is a flowchart of the parking assistance processing procedure according to this embodiment. The parking assistance processing procedure is executed after the ACC power supply (accessory power supply) of vehicle 2 is turned on and the start conditions for starting parking assistance are met; it is a procedure for parking assistance, particularly when the vehicle is parking, as a type of automated driving assistance. The following... Figure 4 The program shown in the flowchart is stored in the RAM32 and ROM33 of the parking assistance device 1 and is executed by the CPU31.

[0057] Furthermore, the conditions for starting parking assistance can be: when the user selects to start parking assistance by operating the operation unit 3; when the vehicle is detected entering the parking lot; when the set destination is determined to have been reached; or when the vehicle is detected approaching the parking lot.

[0058] First, in step (hereinafter referred to as S) 1, CPU 31 generates an overhead view of the vehicle's surroundings from a vertical perspective, based on real-time images captured by the front camera 6, the rear camera 7, and the side cameras 8A and 8B. The method for generating the overhead view is described below. Figure 5 As shown, real-time images captured by each camera are projected onto a horizontal plane corresponding to the height of the ground surface, i.e., a virtual projection plane. The images projected onto the virtual projection plane are then converted into images viewed from a virtual viewpoint, thereby generating a bird's-eye view from each camera. This virtual viewpoint is a virtual viewpoint viewed vertically from above vehicle 2. Furthermore, the coordinates of the captured image coordinate system, set along a plane perpendicular to the optical axis of the camera, are first converted to coordinates of a ground coordinate system set along the ground surface, and then converted to coordinates of the bird's-eye view coordinate system, thus performing a transformation to the image viewed from the virtual viewpoint (viewpoint transformation). The transformation formulas used for each coordinate transformation are known and therefore omitted from explanation. Based on this, as... Figure 6As shown, an overhead image 41, which is a viewpoint-shifted image of the front camera 6, an overhead image 42, which is a viewpoint-shifted image of the rear camera 7, an overhead image 43, which is a viewpoint-shifted image of the side camera 8A, and an overhead image 44, which is a viewpoint-shifted image of the side camera 8B, are synthesized (stitched together). Then, an illustration image 45, which schematically represents the vehicle, is inserted between each overhead image 41 to 44 to generate an overhead image 46.

[0059] Then, in S2, the CPU 31 displays the overhead view 46 generated in S1 as a vehicle perimeter image representing the vehicle's surroundings on the liquid crystal display 4. However, instead of displaying a real-world image, a virtual image of the vehicle's surroundings recreated using CG can be displayed as the vehicle perimeter image.

[0060] Furthermore, in the following description, an example of displaying an overhead view 46, which is a vertical downward view of the vehicle's surroundings, will be given. However, instead of the overhead view, a bird's-eye view, which is a downward angle view of the vehicle's surroundings, may also be displayed. Alternatively, the screen may be divided into two parts, displaying the overhead view and the bird's-eye view separately. Additionally, in the bird's-eye view, the viewpoint may be set, for example, inside the vehicle. In this case, an image showing the vehicle's surroundings as seen from inside the vehicle can be displayed as the vehicle's surroundings image. Alternatively, the real-time images captured by any one of the front camera 6, the rear camera 7, and the side cameras 8A and 8B may be displayed without processing. Furthermore, even when the bird's-eye view and the camera images are displayed directly instead of the overhead view 46, these images can be overlaid with the target parking frame image described later.

[0061] In addition, the generation and display of the overhead view 46 of S1 and S2 will be repeated until the parking assistance ends, and the LCD 4 will continuously display the real-time overhead view 46 showing the surroundings of the vehicle.

[0062] Then, in S3, the CPU 31 acquires the sensing results from the LiDAR sensor 10. As described above, the vehicle 2 is equipped with a LiDAR sensor 10 capable of three-dimensional sensing, which is used to detect the situation ahead in the direction of travel. Figure 2 As shown, point cloud data is acquired to determine the reflection point of the reflected laser in three-dimensional space. Alternatively, a 2D LiDAR can be used, in which case point cloud data to determine the reflection point in two-dimensional space is acquired. Furthermore, compared to ultrasonic sensors and millimeter-wave sensors, the LiDAR sensor 10 can sense a wider range; in step S3, sensing results are acquired for a range of tens of meters in front of the vehicle's direction of travel, i.e., the area where the vehicle is not traveling, as the target.

[0063] Furthermore, in S3, in addition to the sensing results of the LiDAR sensor 10, image recognition results and detection results of ultrasonic sensors 9A-9L can also be acquired from the images captured by the front camera 6, the rear camera 7, and the side cameras 8A and 8B. Then, the CPU 31 can use the sensing results of the LiDAR sensor 10, the image recognition results from these cameras, and the detection results of the ultrasonic sensors 9A-9L to perform the candidate detection of the parking target position described later.

[0064] Next, in S4, CPU31 determines whether there is a parking area available for the vehicle to park in the vehicle's direction of travel. Specifically, if there is a spacious space available for parking and there are no other vehicles or obstacles in that space (however, this may not be the case that there are no obstacles, but rather that they are not within the sensing range), that space is identified as a parking area available for the vehicle to park, and it is determined whether more than one such parking area can be identified. Furthermore, if there are multiple parking areas available for parking, then the corresponding multiple parking areas are identified. The parking areas identified in S4 become candidates for parking target locations in subsequent parking assistance for vehicle 2.

[0065] Furthermore, if LiDAR sensor 10 is used, then as Figure 2 As shown, by visualizing the reflection points of the reflected laser using a three-dimensional point cloud, the position, shape, and size of objects located in front of the vehicle's direction of travel can be identified with high precision. Furthermore, the CPU 31 determines whether a parking area exists in the vehicle's direction of travel based on these identification results. In particular, the LiDAR sensor 10 can sense a range of tens of meters in front of the vehicle's direction of travel; therefore, it can identify parking areas not only near the vehicle but also at locations some distance away, such as in a passageway facing the vehicle. However, while the LiDAR sensor 10 can sense distant locations, its sensing range is limited by the range from the vehicle's position to the laser beam's reach. Therefore, for example, ... Figure 7 As shown, in the presence of large obstacles 48 such as other vehicles, the area obscured by these obstacles cannot be sensed. Therefore, other obstacles (such as small vehicles, two-wheeled vehicles, colored traffic cones, etc.) may exist within this area. Consequently, at the determination time point S4, the parking area determined to be suitable for parking may actually be a parking area where parking is impossible or difficult.

[0066] Furthermore, the determination in S4 is not necessarily performed solely by the LiDAR sensor 10; it can also be achieved through image recognition using, for example, a camera. Additionally, ultrasonic sensors 9A-9L can be used to determine the vicinity of the vehicle.

[0067] Then, if it is determined that there is at least one parking area in the direction of the vehicle's travel where the vehicle can park (S4: Yes), proceed to S5. Conversely, if it is determined that there is no parking area in the direction of the vehicle's travel where the vehicle can park (S4: No), return to S3 and continue sensing by LiDAR sensor 10 and other sensors until a parking area where the vehicle can park is detected.

[0068] In S5, CPU 31 overlays a target parking frame image onto the parking areas within the overhead view 46 displayed in S2, which were identified in S4 as suitable parking areas for vehicles. If a plurality of parking areas are identified, the target parking frame image is overlaid onto each of the plurality of parking areas.

[0069] Here, Figure 8 This is a diagram illustrating an example of an overhead image 46 displayed on the liquid crystal display 4. (See diagram for example.) Figure 8 As shown, target parking frame images 50 are displayed for the locations of parking areas available for vehicle parking included in the overhead view image 46. The target parking frame images 50 have a rectangular shape corresponding to the size of the vehicle 2, and are essentially fixed in shape regardless of the size of the parking area. Furthermore, when the target parking frame images 50 are displayed in the overhead view image 46, the orientation of the target parking frame images 50 is as follows: for parallel parking areas, it is the direction intersecting with the aisle 51; for longitudinal parking areas, it is the direction parallel to the aisle 51. Whether the parking area to which the target parking frame images 50 are configured is a parallel parking area or a longitudinal parking area can be determined by the above-sight image S4. Then, the user can visually confirm the overhead view image 46 displayed on the liquid crystal display 4, thereby identifying potential parking areas where the vehicle can park, i.e., candidate parking locations.

[0070] Furthermore, the LCD display 4, serving as the operation unit 3, has a touch panel, allowing the user to arbitrarily specify a desired parking location within the target parking frame image 50 included in the overhead view image 46 displayed on the LCD display 4. In S6, the CPU 31 determines whether the operation of specifying the aforementioned parking target location has been performed.

[0071] Then, if it is determined that an operation to specify a parking target location has been performed (S6: Yes), proceed to S7. Conversely, if it is determined that an operation to specify a parking target location has not been performed (S6: No), return to S3. Then, if a new parking area where a vehicle can park is detected, a new target parking frame image 50 is displayed overlaid in that parking area. In addition, in addition to the target parking frame image 50, obstacles existing in the surrounding area (such as parked vehicles) are also displayed in the overhead view 46, so warning images for these obstacles can also be displayed.

[0072] In S7, CPU31 sets the parking area corresponding to the target parking frame image 50 specified by the user as the target parking position, i.e., the parking target position, in subsequent parking assistance. The parking target position set in S7, i.e., the initially set parking target position in parking assistance, is referred to below as the "initial target position".

[0073] Then, in S8, CPU 31 begins vehicle control for parking at the initial target position set in S7. First, CPU 31 calculates the driving trajectory, or parking trajectory, for parking the vehicle from its current position to the initial target position. For example, to illustrate the calculation of the parking trajectory in the case of parallel parking, firstly, as... Figure 9 As shown, the CPU 31 sets the reversing start position 62 for the vehicle to stop at the initial target position 61 specified by the user (i.e., the position of the vehicle when reversing to park). The reversing start position 62 is determined relative to the initial target position 61 by taking into account the vehicle's length, width, minimum turning radius, etc.

[0074] Then, CPU 31 calculates the turning trajectory 63 from the reversing start position 62 to the initial target position 61. Specifically, the turning trajectory is the path through which the vehicle can reach the initial target position 61 without contacting surrounding obstacles and turns at the most suitable steering angle derived from the vehicle's turning characteristics. For example, the driving trajectory with the minimum turning radius is calculated as the turning trajectory 63. Furthermore, the turning trajectory 63 can be an arc, a spiral curve, or may partially include a straight line. Next, CPU 31 calculates the preparation trajectory 64 from the vehicle's current position to the reversing start position 62. Furthermore, as... Figure 9 As shown, the preparation trajectory 64 is sometimes a straight line, and sometimes it includes arcs and spiral curves depending on the relationship between the vehicle's current position and the starting position 62 of reversing. In addition, the CPU 31 also calculates the trajectory for forward and reverse switching when it needs to correct the vehicle's orientation.

[0075] Then, CPU31 initiates parking assistance based on the calculated parking trajectory. Specifically, it continuously monitors the vehicle's current position and the positions of surrounding obstacles, automatically controlling the steering wheel, drive system, brakes, etc., to ensure the vehicle travels along the generated parking trajectory at a specified speed. Additionally, it automatically switches gears when forward or reverse shifting is required to enter the parking area. This parking assistance continues until the vehicle is successfully parked at the target location.

[0076] However, during the movement of the vehicle following the parking trajectory, only steering can be performed automatically, while the drive source and brakes can be controlled manually. Alternatively, the vehicle can be moved manually without automatic driving. In this case, as a parking assistance, the parking trajectory is displayed on the LCD screen 4, or the timing of turning the steering wheel is guided by voice.

[0077] Then, in S9, after starting parking assistance in S8, the CPU31 acquires the sensing results of the LiDAR sensor 10 in parallel with the parking assistance. In addition to the sensing results of the LiDAR sensor 10, it also acquires the image recognition results of the images captured by the front camera 6, the rear camera 7, and the side cameras 8A and 8B, as well as the detection results of the ultrasonic sensors 9A to 9L.

[0078] Here, the sensing results from various sensors acquired in S9 include, in addition to the detection results for the initial target position set as the parking target position at the current time point, the detection results for other target candidates (hereinafter referred to as "other target candidates") if a new parking target position different from the initial target position exists within the detection range. For example, Figure 10 As shown, when there are parking areas 65-67 in front of the vehicle 2 in the direction of travel, and parking area 66 is set as the initial target position, the sensing results obtained in the parking assistance include not only parking area 66, but also the detection results of parking areas 65 and 67.

[0079] Then, in S10, CPU31 determines whether there are at least one other target candidates as parking target positions in addition to the initial target position.

[0080] Here, other target candidates can include parking areas that have been detected before parking assistance begins, or parking areas that are newly detected after parking assistance begins. Therefore, in S9, new parking areas that are available for vehicle parking, other than the already detected parking areas, are detected.

[0081] Then, if it is determined that there are other target candidates as parking target locations besides the initial target location (S10: Yes), proceed to S11. Conversely, if it is determined that there are no other target candidates as parking target locations besides the initial target location (S10: No), proceed to S16.

[0082] Then, in S11, the CPU31 detects the condition of the initial target position and the condition of other target candidates based on the sensing results of various sensors acquired in S9. That is, in parking assistance, the processing of detecting the condition of the initial target position set as the parking target position by sensors and the processing of detecting the condition of new parking target position candidates different from the initial target position are performed in parallel. In addition, more specifically, the "condition" includes the detailed shape of the initial target position and the parking area as other target candidates, whether there are obstacles in the parking area, whether there are other vehicles parked adjacent to the parking area, their models, and the usage restrictions of the parking area (e.g., parking space for disabled persons), etc. In addition, the models of other vehicles and the usage restrictions of the parking area can be detected using image recognition results, especially from cameras. And, based on these detected conditions of the initial target position and the conditions of other target candidates, an evaluation score for the initial target position and other target candidates is calculated. Here, the evaluation score is a value that represents the suitability as a parking target position; basically, the higher the evaluation score, the more suitable it is as a parking target position.

[0083] For example, the evaluation score of S11 is calculated based on the following criteria (A) to (F).

[0084] (A) Determine whether there are obstacles (e.g., small vehicles, two-wheeled vehicles, colored traffic cones, etc.) in the parking area that serves as the initial target location. Similarly, determine whether there are obstacles in the parking areas that serve as other target candidates. Then, for the initial target location or other target candidate that is determined to have obstacles, since parking is not possible, the evaluation score will be low (e.g., 0 points).

[0085] (B) Calculate the spaciousness of the parking area as the initial target location and the spaciousness of the parking areas as other candidate locations. A more spacious parking area is easier to park in, therefore, a higher evaluation score will be awarded. Furthermore, spaciousness can be measured by the length of the parking space entrance.

[0086] (C) After calculating the parking trajectory to the parking area that serves as the initial target location, the time required to complete parking is calculated. Similarly, after calculating the parking trajectory to other potential parking areas, the time required to complete parking is calculated. Furthermore, the shorter the time required to complete parking, the faster the parking can be completed, and therefore, a higher evaluation score is calculated.

[0087] (D) In ​​particular, when the parking lot providing parking assistance is an attached parking lot of the facility, the distance from the parking area serving as the initial target location to the facility entrance is calculated. Similarly, the distance from the parking area serving as another target candidate to the facility entrance is calculated. Furthermore, the shorter the distance to the facility entrance, the greater the convenience for the user after parking, and therefore, a higher evaluation score is calculated.

[0088] (E) Determine whether there are other vehicles parked adjacent to the parking area designated as the initial target location, and the types of other vehicles involved. Similarly, determine whether there are other vehicles parked adjacent to parking areas designated as alternative targets, and the types of other vehicles involved. Furthermore, for initial target locations or alternative targets where no adjacent vehicles are determined, parking is easier, and therefore, a higher evaluation score is calculated. Conversely, for initial target locations or alternative targets where adjacent vehicles are determined, a lower evaluation score is calculated, especially when the types of other vehicles are classified as specific high-end vehicle types, parking is more difficult, and therefore, a lower evaluation score is calculated.

[0089] (F) Determine whether the parking area used as the initial target location and other candidate parking areas have usage restrictions (e.g., for disabled persons). Furthermore, parking in parking areas with usage restrictions should be avoided; therefore, a lower evaluation score will be assigned.

[0090] However, the calculation basis for the evaluation score of S11 is not limited to (A) to (F) mentioned above, and can also be calculated based on other basis.

[0091] Then, in S12, CPU31 compares the evaluation score calculated for the initial target position in S11 with the evaluation scores calculated for the other target candidates. If there are multiple other target candidates, a comparison is made for each of them. Then, it is determined whether there are other target candidates with a higher evaluation score than the initial target position; that is, whether there are other target candidates that are more suitable as parking target positions than the initial target position.

[0092] Then, if it is determined that there are other target candidates with a higher evaluation score than the initial target location, that is, if there are other target candidates that are more suitable as parking target locations than the initial target location (S12: Yes), proceed to S13. Conversely, if it is determined that there are no other target candidates with a higher evaluation score than the initial target location, that is, if there are no other target candidates that are more suitable as parking target locations than the initial target location (S12: No), proceed to S16.

[0093] Here, in S12, the situation where it is determined that there are other target candidates with higher evaluation scores than the initial target position can be listed as, for example... Figure 11 The situation is as shown. Specifically, as... Figure 11 As shown, this situation occurs when parking areas 65-67 exist ahead of vehicle 2 in its direction of travel. At the start time of parking assistance, the obstacle 69 within parking area 66 cannot be detected by vehicle 2, and parking area 66 is used as the target parking location for parking assistance. That is, parking area 66 is the initial target location, while parking areas 65 and 67 are other candidate targets. In this case, vehicle 2, which initiates parking assistance, detects obstacle 69 when approaching parking area 66. As a result, based on the criteria in (A) above, the evaluation score for parking area 66 is calculated to be lower, while the evaluation scores for parking areas 65 and 67 are calculated to be higher than those for parking area 66, and the determination in S12 is "yes".

[0094] Then, in S13, CPU31 proposes to change the parking target location to another target candidate whose evaluation score is higher than the initial target location (resetting the parking target location). Furthermore, if there are multiple other target candidates whose evaluation scores are higher than the initial target location, the target candidate with the highest evaluation score is generally chosen as the proposal target. However, it is also possible to choose all other target candidates whose evaluation scores are higher than the initial target location as the proposal target, or to choose a predetermined number of other target candidates whose evaluation scores are ranked from highest to lowest.

[0095] Here, the content of the proposal made in S13 differs depending on whether parking assistance can continue at the currently set parking target location. Furthermore, for example... Figure 11 As shown, the situation where it is difficult to continue parking assistance to the currently set parking target location refers to situations such as the presence of obstacles within the parking area of ​​the currently set parking target location.

[0096] 1. A situation where it is difficult to continue parking assistance to the currently set parking target location.

[0097] As alternatives, the proposal includes a first option to change the parking target location to another alternative and a second option to discontinue parking assistance.

[0098] 2. The system is capable of continuing parking assistance to the currently set parking target location.

[0099] As alternatives, the proposal includes a first option of continuing parking assistance without changing the parking target location to another target, and a second option of changing the parking target location to another target.

[0100] Furthermore, the proposal made in S13 can be made while the parking assistance is temporarily interrupted and the vehicle is stopped, or conversely, while parking assistance continues. Regarding the case where the proposal is made while parking assistance continues, a third option, "interrupt parking assistance," can be proposed as a candidate option in addition to the first and second options mentioned above, to allow the user sufficient time to choose between these two options. Furthermore, if the user selects the third option (interrupt), the vehicle can be stopped and parking assistance temporarily interrupted after the selection, and then the first and second options can be proposed again as candidates. Moreover, if an option other than stopping parking assistance is subsequently selected, the interrupted parking assistance will be restarted after the selection. As a result, the user has ample time to choose whether to change the parking target location to another candidate location or to stop parking assistance while the parking assistance is temporarily interrupted.

[0101] Furthermore, the proposal in S13 can be made by displaying the image on the LCD 4 or by speaking through the speaker 5. When making a proposal using the LCD 4, the target parking position (initial target position) set at the time of the proposal and the other candidate positions determined in S12 to have a higher evaluation score than the initial target position are displayed in a user-readable manner on the overhead view 46. Preferably, the parking trajectory up to parking at the target parking position set at the time of the proposal and the parking trajectory up to parking at the other candidate positions determined in S12 to have a higher evaluation score than the initial target position are displayed in a comparable manner.

[0102] For example, Figure 12 This is a diagram of screen 70, which shows a proposal to change the target parking location to parking area 65 when parking area 66 is set as the target parking location. Figure 12 As shown, in the proposal screen 70, the box 71 identifying the parking area 66 set as the parking target location at the time of the proposal, the parking trajectory 72 leading to parking in the parking area 66, the box 73 identifying the parking area 65 as another target candidate, and the parking trajectory 74 leading to parking in the parking area 65 are respectively overlaid on the overhead view 46. Additionally, icons for "No (first option)" and "Yes (second option)" that become the user's selection are also displayed. After visually confirming the boxes 71, 73 and the parking trajectories 72, 74, the user selects the "No" icon if continuing parking assistance to the parking area 66, and selects the "Yes" icon if changing the parking target location to the parking area 65. Although the illustration is omitted, an icon for selecting to stop parking assistance can also be added.

[0103] In S14, CPU31 determines whether the user agrees to the proposal in S13. Furthermore, user agreement to the proposal in S13 means that the user agrees to abandon the currently set parking target location and set another target candidate determined in S12 to have a higher evaluation score than the initial target location as the new parking target location (i.e., change the parking target location). On the other hand, user disagreement to the proposal in S13 means choosing to maintain the currently set parking target location (i.e., not change the parking target location). The determination of user agreement in S14 can be based on, for example, touch panel operation, or by recognizing the user's voice. Additionally, regarding the proposal in S13, if the user chooses to discontinue parking assistance, the parking assistance processing procedure ends at that point.

[0104] Then, if it is determined that the user agrees to the proposal in S13 (S14: Yes), proceed to S15. Conversely, if it is determined that the user does not agree to the proposal in S13 (S14: No), proceed to S16.

[0105] In S15, CPU31 re-sets other candidate parking locations that the user has agreed to be re-set as parking target locations. That is, the parking target location of the currently assisted parking is changed midway through the assisted parking process.

[0106] In S16, CPU 31 continues to provide parking assistance for parking at the currently set parking target position. Therefore, if the parking target position is re-set (changed) in S15, parking assistance for parking at the re-set parking target position is then provided. If the parking target position is re-set, CPU 31 recalculates the parking trajectory for parking the vehicle from its current position to the re-set parking target position, and automatically controls the vehicle, including the steering wheel, drive source, and brakes, to make the vehicle travel along the calculated parking trajectory at a specified speed. Additionally, when switching between forward and reverse gears to enter the parking area, the shift position can be automatically changed. The above parking assistance continues until parking at the target position is completed.

[0107] Then, in S17, CPU31 determines whether parking assistance has been completed. Specifically, parking assistance is considered complete when the vehicle's movement to the currently set parking target location is completed.

[0108] Then, if the parking assistance is determined to be complete (S17: Yes), the parking assistance process ends. Conversely, if the parking assistance is determined not to be complete (S17: No), proceed to S9.

[0109] Furthermore, after changing the parking target location from the initial target location to other target candidates, the parking target location can be further changed. That is, after the first change of the parking target location (S15), if a candidate parking target location that is more suitable than the first changed parking target location is detected (S12: Yes), a proposal to change the parking target location a second time can be made (S13). Similarly, a third and fourth proposal to change the parking target location can also be made. However, the proposal to change the parking target location in S13 is made until the time when it is possible to change to another parking target location. For example, if the determination condition of S12 is met after the reverse for entering the parking area has already begun, it is preferable not to make the proposal to change the parking target location in S13. Alternatively, the proposal to change the parking target location in S13 can be made until the time when the sensor or the like can reliably sense the parking target location (i.e., until it can be determined that parking is possible at the parking target location).

[0110] As described above, according to the parking assistance device 1 and the computer program (parking assistance method) executed by the parking assistance device 1 according to this embodiment, in the execution of parking assistance for a vehicle 2 used to park at a parking target location, if there is a new parking target location candidate that is different from the currently set parking target location, a proposal to change the parking target location to the new parking target location candidate is made (S13). Therefore, after parking assistance is started, if it is known that there is a more suitable parking target location candidate, the user can be provided with the opportunity to change the parking target location to the new parking target location candidate.

[0111] Furthermore, by using the LiDAR sensor 10 which sets the direction of travel of vehicle 2 as the detection range, it is possible to detect parking areas located in the direction of travel of vehicle 2 and in the passageway facing the vehicle 2 (S3). After setting the detected parking area as the parking target position (S7), parking assistance for parking the vehicle at the parking target position is executed (S8). Therefore, in particular, when a parking area located far from the vehicle is detected and the detected parking area is set as the parking target position, when parking assistance is started, it is possible to determine that the parking area is not actually suitable for parking, and provide the user with an opportunity to change the parking target position to a new parking target position.

[0112] Furthermore, in the proposal in S13, as alternatives, at least a first option to change the parking target location to a new parking target location and a second option to stop parking assistance are proposed. Therefore, for example, in a situation where it is difficult to continue parking assistance to the currently set parking target location, the user can choose to change the parking target location to continue parking assistance or stop parking assistance according to their wishes.

[0113] Furthermore, in the proposal in S13, as alternative options, at least a first option is proposed to continue parking assistance without changing the parking target location to a new parking target location, and a second option is proposed to change the parking target location to a new parking target location. Therefore, for example, when parking assistance to the currently set parking target location can continue, the user can choose whether to continue parking assistance without changing the parking target location or to continue parking assistance with changing the parking target location, according to the user's wishes.

[0114] Furthermore, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be made without departing from the spirit of the present invention.

[0115] For example, in this embodiment, the vehicle surroundings image displayed on the LCD 4 during parking assistance is a top-down image generated from images captured by the front camera 6, rear camera 7, and side cameras 8A and 8B. However, the vehicle surroundings image displayed on the LCD 4 may not be a top-down image but a bird's-eye view looking diagonally downwards. Furthermore, the images captured by the cameras may not be processed before displaying. Alternatively, a virtual image recreating the vehicle's surroundings using CG may be displayed instead of a real-world image.

[0116] Furthermore, in this embodiment, the proposal to change the parking target location in S13 is described as a first option and a second option, but the content of the proposal is not limited to the options mentioned above. For example, other target candidates may be displayed on the LCD 4 to indicate that the parking target location can be changed. Moreover, the user can select other target candidates on the LCD 4 through screen touch, voice input, or other means, which is considered as the user's consent to the setting (S14: Yes).

[0117] In this embodiment, parking areas available for vehicle parking are detected using sensors (camera, ultrasonic sensors 9A-9L, LiDAR sensor 10) and set as parking target locations (S7, S15). However, parking target locations can also be set based on information obtained from sources other than the vehicle's sensors. For example, parking space availability information can be obtained from a parking lot management server, and parking target locations can be set based on this availability information. Similarly, new parking target locations can be detected based on this availability information during parking assistance.

[0118] in addition, Figure 4The execution order of the steps in the parking assistance procedure shown is an example, and its execution order can be changed appropriately. Additionally, some steps in the parking assistance procedure can be omitted. For example, the decision-making process in S12 can be omitted. In this case, if no other suitable parking target location is available as a candidate, a proposal to change the parking target location is made even if other candidates exist.

[0119] Furthermore, in this embodiment, although the parking assistance process is executed by the driver assistance ECU 11 of the parking assistance device 1 ( Figure 4 The processing can be performed by the control unit of the LCD display 4, the vehicle control ECU, the control unit of the navigation device, or other in-vehicle equipment.

[0120] [Postscript]

[0121] In the above embodiments, the following inventions are also disclosed. In the following description, for reference, the names, representations, and reference numerals used in the corresponding structures in the embodiments are indicated in parentheses. However, the constituent elements of each invention are not limited to these reference numerals.

[0122] (Invention A)

[0123] According to the parking assistance device (1) of technical solution 1, the detection sensors (6, 7, 8A, 8B, 9A~9L, 10) of the vehicle are used to detect the candidate parking target position for the vehicle (2) to park. After setting the detected candidate parking target position as the parking target position of the vehicle, parking assistance for the vehicle to park at the parking target position is executed. During the execution of the parking assistance of the vehicle, the proposal is made if the detection sensor detects a new candidate parking target position that is different from the parking target position.

[0124] Therefore, once parking assistance is activated, if the vehicle's sensors detect a more suitable alternative parking location, the user can be given the opportunity to change their parking target location to the alternative parking target location.

[0125] (Invention B)

[0126] According to the parking assistance device (1) of invention A, in the execution of parking assistance of the vehicle (2), the processing of detecting the status of the candidate parking location set as the parking target location by means of the detection sensors (6, 7, 8A, 8B, 9A~9L, 10) and the processing of detecting the status of the candidate parking target location that is different from the candidate parking target location set as the parking target location are performed in parallel.

[0127] Therefore, during the execution of parking assistance, the status of the currently set parking target location is detected. On the other hand, if there are other alternative parking areas that can serve as parking target locations, the status of those other parking areas can also be detected.

[0128] (Invention C)

[0129] According to the parking assistance device (1) of technical solution 1, in the execution of parking assistance of the vehicle (2), if there is a new parking target location candidate that is different from the parking target location, the parking target location is compared with the new parking target location candidate, and if the new parking target location candidate is more suitable as the parking target location, the proposal to change the parking target location to the new parking target location candidate is made.

[0130] Therefore, after parking assistance is activated, if it is possible to identify a more suitable alternative parking location, the system can provide the user with the opportunity to change their parking target location to the alternative parking target location.

[0131] (Invention D)

[0132] According to the parking assistance device (1) of invention C, the comparison between the parking target location and the candidate new parking target location takes into account at least one of the following: whether there are obstacles (69) in the parking area of ​​the parking target location, the spaciousness of the parking area of ​​the parking target location, the time to parking completion, the location of the parking area of ​​the parking target location, the condition of other vehicles parked adjacent to the parking area of ​​the parking target location, and the usage restrictions of the parking area of ​​the parking target location.

[0133] Therefore, after parking assistance is activated, if it is confirmed that there are other alternative parking locations, it can accurately determine which of the other alternative parking locations is more suitable.

[0134] (Invention E)

[0135] According to the parking assistance device (1) of technical solution 1, when the proposal is made, the parking trajectory (72) up to the parking target position set at the time of the proposal and the parking trajectory (74) up to the candidate parking target position can be displayed in a comparative manner.

[0136] Therefore, after parking assistance is activated, if it is confirmed that there are other alternative parking locations, the user can easily determine which of the currently set parking location and other alternative parking locations is more suitable.

[0137] (Invention F)

[0138] According to the parking assistance device (1) of technical solution 3 or technical solution 4, when the proposal is made while the parking assistance of the vehicle is continuing, the third option of interrupting parking assistance is proposed as a candidate.

[0139] Therefore, when changing the parking target location to a new one while parking assistance is in progress, the user can temporarily interrupt the parking assistance as needed. Furthermore, the user has ample time to select both the first and second options while parking assistance is temporarily interrupted.

Claims

1. A parking assistance device, wherein, In the execution of parking assistance for vehicles parking at a target parking location, if there is a candidate for a new parking target location that is different from the target parking location, a proposal is made to change the target parking location to the candidate for the new parking target location.

2. The parking assistance device according to claim 1, wherein, Using a detection sensor whose detection range is set to the vehicle's direction of travel, a parking area located in the direction of the vehicle's travel and in the passageway facing the vehicle ahead is detected. After setting the detected parking area as the target parking location, parking assistance is performed for the vehicle to park at the target parking location.

3. The parking assistance device according to claim 1 or 2, wherein, The proposal includes at least a first option and a second option as alternatives. The first option is to change the parking target location to the new parking target location, and the second option is to suspend the parking assistance.

4. The parking assistance device according to claim 1 or 2, wherein, The proposal includes at least a first option and a second option as alternatives. The first option is to continue providing parking assistance without changing the parking target location to the new parking target location. The second option is to change the parking target location to the new parking target location.

Citation Information

Patent Citations

  • Parking frame recognition device

    JP2016016681A