Vehicle periphery monitoring device and vehicle periphery monitoring method
By setting detection point positions in the vehicle, and storing and estimating obstacle positions using the detection results of multiple peripheral monitoring sensors, the problem of identification and avoiding obstacles in the dead-end area monitoring system is solved, and the detection accuracy is improved and security.
Patent Information
- Application Number
- CN202080070388.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-10-11
- Filing Date
- 2020-08-24
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-08-24
AI Technical Summary
When the existing vehicle peripheral monitoring system uses multiple peripheral monitoring sensors, there are blind spots between the detection ranges, resulting in the inability to identify and avoid obstacles at the start, affecting the accuracy and safety of obstacle position detection.
By setting a detection point position determination unit, a position update unit, a storage processing unit and a position estimation unit in the vehicle, the obstacle position is determined by using the detection results of a plurality of peripheral monitoring sensors, and the locations are stored when the vehicle is parked, and the position is estimated and Avoid obstacles in undetectable dead corner areas.
The accuracy of obstacle position detection of peripheral monitoring sensors is improved, and the ability to identify and avoid obstacles in dead corner areas is enhanced, ensuring safety when starting the vehicle.
Smart Images

Figure CN114555420B_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application is based on patent application No. 2019-188086 filed in Japan on October 11, 2019, and the contents of the basic application are cited in their entirety by reference. Technical Field
[0003] The present disclosure relates to a vehicle periphery monitoring device and a vehicle periphery monitoring method. Background Art
[0004] The following technology is known: when starting a parked vehicle, an autonomous sensor that monitors the surroundings of the vehicle, that is, a surrounding monitoring sensor, is used to confirm the presence or absence of an obstacle. Patent document 1 discloses the following technology: when it is detected that the driver has performed an operation for starting the vehicle, the vehicle surrounding situation recognition unit detects the surroundings of the vehicle, sets an area that the driver should pay attention to, and detects moving objects within the area.
[0005] Patent document 1: Japanese Patent No. 6231345.
[0006] Even when multiple cameras, sonars and other surrounding monitoring sensors are used to monitor the surroundings of the vehicle, since each surrounding monitoring sensor has a detection range, even in the surroundings of the vehicle, a blind spot may sometimes occur between the detection ranges of each surrounding monitoring sensor. In addition, in order to improve the detection accuracy of the position of the obstacle, whether it is a camera or a distance measuring sensor such as a sonar, it is necessary to narrow the detection range to improve the resolution. Therefore, the more you want to improve the detection accuracy of the position of the obstacle, the more likely it is to produce this blind spot. In the case of such a blind spot, even if multiple surrounding monitoring sensors are used, it is impossible to identify the obstacle that exists in the blind spot between the detection ranges of the surrounding monitoring sensors when the vehicle starts, and it is difficult to avoid approaching the obstacle. Summary of the invention
[0007] One object of the present disclosure is to provide a vehicle surrounding monitoring device and a vehicle surrounding monitoring method, which can improve the detection accuracy of the position of obstacles using the surrounding monitoring sensors even when a plurality of surrounding monitoring sensors are used to monitor the surroundings of the vehicle, and make it easier to avoid approaching obstacles in blind spots between the detection ranges of the surrounding monitoring sensors in the horizontal direction when starting a parked vehicle.
[0008] The above-mentioned object is achieved by the combination of features described in the independent claims, and the subordinate claims specify more advantageous specific examples disclosed. The reference numerals in parentheses in the claims indicate the correspondence with the specific units described in the embodiments described later as one mode, and do not limit the technical scope of the present disclosure.
[0009] In order to achieve the above-mentioned purpose, the vehicle surrounding monitoring device disclosed in the present invention is used in a vehicle equipped with multiple surrounding monitoring sensors with blind spots between their detection ranges in the horizontal direction, and comprises: a detection point position determination unit, which determines the position of the detection point of the obstacle relative to the vehicle based on the detection results of the surrounding monitoring sensors; a position updating unit, which updates the position of the position group of the detection points determined in sequence by the detection point position determination unit according to the change of the position of the vehicle; a storage processing unit, which stores the position group of the detection points updated by the position updating unit in a memory that is not deleted when the vehicle is parked when the vehicle is parked; and a position estimation unit, which uses the position group of the detection points stored in the memory by the storage processing unit when the vehicle starts after stopping to estimate the position of the detection point that exists in the blind spot and cannot be detected by any of the multiple surrounding monitoring sensors when starting.
[0010] In order to achieve the above-mentioned purpose, the vehicle perimeter monitoring method disclosed in the present invention is used in a vehicle equipped with multiple perimeter monitoring sensors having blind spots between their detection ranges in the horizontal direction, and the position of the obstacle detection point relative to the vehicle is determined based on the detection results of the perimeter monitoring sensors. For the position group of the detection points determined in sequence, the position is updated based on the change in the position of the vehicle, and when the vehicle stops, the updated position group of the detection points is stored in a memory that is not deleted when the vehicle is parked. When the vehicle starts after stopping, the position group of the detection points stored in the memory is used to infer the position of the detection point that exists in the blind spot and cannot be detected by any of the multiple perimeter monitoring sensors when starting.
[0011] According to this, the position of the obstacle detection point relative to the vehicle is determined based on the detection results of multiple surrounding monitoring sensors in which there is a blind spot between the detection ranges of each other in the horizontal direction, and the position of the detection point position group determined in sequence is updated according to the change of the position of the vehicle. Therefore, even if the detection point exists in the blind spot when the vehicle is parked, as long as it is a detection point that can be detected in the past, the position of the vehicle relative to the parking time can be expressed by the updated position. Therefore, even if it is desired to narrow the detection range of the surrounding monitoring sensor to improve the detection accuracy of the obstacle position, the position of the vehicle relative to the parking time can be expressed by the updated position. In addition, when the vehicle is parked, the updated position group of the obstacle detection point is stored in the memory that is not deleted when the vehicle is parked, so the updated position group can be stored until the start after the vehicle is parked. Therefore, when the vehicle starts after the vehicle is parked, by using the position group of the obstacle detection point stored in the memory, the position of the obstacle detection point that exists in the blind spot between the detection ranges of each other in the horizontal direction, which cannot be detected by any of the multiple surrounding monitoring sensors at the time of starting, can be estimated. If the position of the detection point of the obstacle existing in the blind spot which cannot be determined at the time of starting can be estimated, it is easy to avoid approaching the obstacle. As a result, even when a plurality of surrounding monitoring sensors are used to monitor the surroundings of the vehicle, the detection accuracy of the position of the obstacle using the surrounding monitoring sensors can be improved, and it is easier to avoid approaching the obstacle existing in the blind spot between the detection ranges of the surrounding monitoring sensors in the horizontal direction when starting a parked vehicle. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 1 is a diagram showing an example of a schematic configuration of the vehicle system 1 and the periphery monitoring ECU 10 .
[0013] Figure 2 This is a diagram for explaining an example of a method of installing the surrounding monitoring sensor 20 on the vehicle.
[0014] Figure 3 This is a diagram for explaining an example of determining whether a position group of detection points of the same obstacle can be detected by the first sonar 21 and the second sonar 22 .
[0015] Figure 4 This is a diagram for explaining an example of a method of estimating the position of a detection point in a blind spot area between the detection ranges of the first sonar 21 and the second sonar 22 at the time of starting.
[0016] Figure 5 This is a diagram for explaining an example of a method of estimating the position of a detection point in a blind spot area between the detection ranges of the first sonar 21 and the second sonar 22 at the time of starting.
[0017] Figure 6 This is a diagram for explaining an example of a method of estimating the position of a detection point in a blind spot area between the detection ranges of the first sonar 21 and the second sonar 22 at the time of starting.
[0018] Figure 7 This is a diagram for explaining an example of a method of estimating the position of a detection point in a blind spot area between the detection ranges of the first sonar 21 and the second sonar 22 at the time of starting.
[0019] Figure 8 This is a diagram for explaining an example of a method of estimating the position of a detection point in a blind spot area between the detection ranges of the first sonar 21 and the second sonar 22 at the time of starting.
[0020] Fig. 9 1 is a flowchart showing an example of the flow of surrounding area monitoring related processing in the surrounding area monitoring ECU 10 .
[0021] Fig.10 This is a diagram for explaining the effects of the structure according to the first embodiment.
[0022] Fig.11 1 is a diagram showing an example of a schematic configuration of the vehicle system 1 a and the periphery monitoring ECU 10 a . DETAILED DESCRIPTION
[0023] A plurality of embodiments disclosed are described with reference to the accompanying drawings. In addition, for the convenience of description, between the plurality of embodiments, parts having the same functions as parts shown in the drawings used in the previous description are marked with the same reference numerals, and their descriptions are sometimes omitted. For parts marked with the same reference numerals, the descriptions in other embodiments can be referred to.
[0024] <Schematic structure of vehicle system 1>
[0025] Hereinafter, Embodiment 1 of the present disclosure will be described with reference to the drawings. Figure 1 The vehicle system 1 shown is used in a vehicle. Figure 1 As shown, the vehicle system 1 includes a periphery monitoring ECU 10, a periphery monitoring sensor 20, a vehicle state sensor 30, and an alarm device 40. The vehicle using the vehicle system 1 is not necessarily limited to an automobile, but the following description takes the case of using the vehicle as an example.
[0026] The surrounding monitoring sensor 20 is an autonomous sensor that monitors the surroundings of the vehicle. The surrounding monitoring sensor 20 is used to detect objects (i.e., obstacles) around the vehicle. Examples of the surrounding monitoring sensor 20 include a surrounding monitoring camera that captures a predetermined range around the vehicle, and a ranging sensor such as a millimeter wave radar, sonar, or LIDAR that transmits a probe wave within a predetermined range around the vehicle. The ranging sensor is a sensor that detects the presence of an obstacle and the distance to the obstacle by transmitting a probe wave and receiving a reflected wave of the probe wave reflected by an obstacle within the reach of the probe wave.
[0027] In the ranging sensor, the reception information of the reflected wave of the probe wave becomes the sensing detection result. The surrounding monitoring camera can detect the presence of obstacles using image recognition processing on the captured image. In the surrounding monitoring camera, the captured image becomes the sensing detection result. In addition, the surrounding monitoring camera can detect the distance of the obstacle relative to the vehicle based on the captured image (hereinafter referred to as the obstacle distance). As an example, the obstacle distance can be detected by calculating the longitudinal pixel position of the part where the obstacle is recognized in the captured image. As a surrounding monitoring sensor 20, for example, it can also be configured to use a combination of multiple surrounding monitoring sensors 20 in a manner that uses the entire surroundings of the vehicle as the detection range. As an example, a surrounding monitoring camera and a ranging sensor can also be used in combination.
[0028] There are a plurality of perimeter monitoring sensors 20 , and there is a blind spot between the detection ranges of each other in the horizontal direction. Hereinafter, a case where a plurality of sonars are used as the perimeter monitoring sensors 20 will be described as an example.
[0029] Use it here Figure 2 An example of a method of installing the surrounding monitoring sensor 20 on the vehicle will be described. Figure 2 In the description, a case where two sensors, the first sonar 21 and the second sonar 22, are used as the surrounding monitoring sensor 20 is taken as an example. Figure 2 The HV indicates this vehicle. Figure 2 The SAF represents the detection range of the first sonar 21 . Figure 2 The SAR of represents the detection range of the second sonar 22. The same applies to the following figures.
[0030] The first sonar 21 is mounted on the right side of the front of the vehicle. The first sonar 21 is used to detect obstacles on the right side of the front of the vehicle. The second sonar 22 is mounted on the right side of the rear of the vehicle. The second sonar 22 is used to detect obstacles on the right side of the rear of the vehicle.
[0031] Here, an example is shown in which the first sonar 21 and the second sonar 22 are arranged on the right side of the vehicle, but it is not necessarily limited to this. The first sonar 21 and the second sonar 22 may also be configured to be arranged on the left side, left and right sides, etc. of the vehicle. The first sonar 21 and the second sonar 22 may also be configured to be arranged in front of the vehicle in order to detect obstacles in front of the vehicle. The first sonar 21 and the second sonar 22 may also be configured to be arranged behind the vehicle in order to detect obstacles behind the vehicle. In addition, the number of arrangements is not limited to two as long as it is multiple. In the following, for convenience, the following description is continued by taking the case where the first sonar 21 and the second sonar 22 are arranged in front and behind on the right side of the vehicle as an example.
[0032] For example, the first sonar 21 is arranged on the right side of the front bumper of the vehicle. The second sonar 22 is arranged on the right side of the rear bumper. The first sonar 21 and the second sonar 22 are arranged on the bumper because the installation place of the sonar needs to be a material that easily converges vibration. The first sonar 21 and the second sonar 22 are set, for example, so that the center line of directivity is parallel to the axle direction of the vehicle HV. In the example of this embodiment, the detection range SAF of the first sonar 21 and the detection range SAR of the second sonar 22 are arranged front and back on the right side of the vehicle along the front and rear direction of the vehicle HV. The center line of the directivity of the first sonar 21 and the second sonar 22 can also be arranged at an inclination of about 40° from the axle direction of the vehicle HV. In addition, in order to improve the detection accuracy of the position of the obstacle, as long as it has a width that can well transmit and receive the detection wave during use within the assumed vehicle speed range, the directivity of the first sonar 21 and the second sonar 22 is preferably narrower.
[0033] The vehicle state sensor 30 is a sensor group for detecting various states such as the driving state and operation state of the vehicle. As the vehicle state sensor 30, there are a vehicle speed sensor, a steering sensor, an acceleration sensor, a yaw rate sensor, a moving position sensor, a parking brake switch, etc. The vehicle speed sensor detects the speed of the vehicle. The steering sensor detects the steering angle of the vehicle. The acceleration sensor detects accelerations such as the front and rear acceleration and the lateral acceleration of the vehicle. The acceleration sensor can also detect deceleration as acceleration in the negative direction. The yaw rate sensor detects the angular velocity of the vehicle. The moving position sensor detects the moving position of the vehicle. The parking brake switch outputs a signal corresponding to the opening and closing of the parking brake of the vehicle.
[0034] The alarm device 40 warns the driver of the vehicle. Examples of the alarm device 40 include a display device and a buzzer. When a display device is used as the alarm device, the device may be configured to warn the driver through a display. The display device, for example, displays an image, an icon, a text, etc. on a display to warn the driver. As a display device, for example, a CID (Center Information Display) may be used. The CID is disposed, for example, in the center instrument cluster of the vehicle. In addition, as a display device, other displays such as a display of a navigation device and a HUD (Head-Up Display) may be used. When a buzzer is used as the alarm device, the device may be configured to warn the driver by ringing a bell.
[0035] In addition, it is also possible to use a device other than a display device and a buzzer as an alarm device to warn the driver. For example, it is also possible to warn the driver by sound output from a sound output device. In addition, it is also possible to warn the driver by vibration of a vibrator provided at a part of the vehicle that the driver touches, such as a steering wheel or a seat back. In addition, it is also possible to warn the driver by light emission of a light emitting element such as an LED.
[0036] The surrounding monitoring ECU 10 is provided with, for example, a processor, a memory, an I / O, and a bus connecting these, and executes processing related to monitoring obstacles around the vehicle (hereinafter, surrounding monitoring related processing) by executing a control program stored in the memory. The memory mentioned here is a non-transitory tangible storage medium (non-transitory tangible storage medium) that non-temporarily stores programs and data that can be read by a computer. In addition, the non-transitory tangible storage medium is implemented by a semiconductor memory or a magnetic disk, etc. The surrounding monitoring ECU 10 is equivalent to a vehicle surrounding monitoring device. In addition, the details of the surrounding monitoring ECU 10 are described below.
[0037] <Schematic Configuration of Peripheral Monitoring ECU 10 >
[0038] Next, use Figure 1 , the brief structure of the surrounding monitoring ECU 10 is described. Figure 1As shown in FIG. 1 , the surrounding monitoring ECU 10 includes an obstacle detection unit 11, a change amount determination unit 12, a detection result management unit 13, a memory 14, a position estimation unit 15, a travel path determination unit 16, an avoidance determination unit 17, and an alarm processing unit 18 as functional modules. In addition, part or all of the functions performed by the surrounding monitoring ECU 10 may be configured in hardware by one or more ICs, etc. In addition, part or all of the functional modules of the surrounding monitoring ECU 10 may also be implemented by a combination of software execution based on a processor and hardware components.
[0039] The obstacle detection unit 11 detects obstacles around the vehicle using the sensing detection results of the surrounding monitoring sensor 20. The obstacle detection unit 11 detects the existence of obstacles around the vehicle and their positions relative to the vehicle. As for the position relative to the vehicle, it is sufficient to detect the distance from the surrounding monitoring sensor 20 to the obstacle that can be determined using the sensing detection results of the surrounding monitoring sensor 20, the direction of the obstacle that can be determined based on the detection direction of the surrounding monitoring sensor 20 relative to the vehicle, and the installation position of the surrounding monitoring sensor 20 relative to the reference point of the vehicle. The reference point of the vehicle can adopt a structure determined appropriately. As an example, the position in the center of the vehicle width direction that becomes the rear wheel axle can be used as the reference point. In addition, points with equal distances from the front end to the rear end of the vehicle on the center line of the vehicle at equal distances from both sides of the vehicle can be used as reference points. The position of the obstacle relative to the vehicle can be constructed to be expressed as coordinates in an XY coordinate system with the reference point of the vehicle as the origin. The XY coordinate system takes the X-axis and the Y-axis in a horizontal plane parallel to the road surface.
[0040] In addition, the information such as the detection direction of the surrounding monitoring sensor 20 relative to the vehicle, the installation position of the surrounding monitoring sensor 20 relative to the reference point of the vehicle (hereinafter referred to as the sensor position), etc. may be configured to use information pre-stored in the non-volatile memory of the surrounding monitoring ECU 10. In addition, regarding the direction of the obstacle, when the surrounding monitoring sensor 20 is a distance measuring sensor, it may be configured to have two elements for receiving reflected waves, thereby detecting the direction of the obstacle based on the difference in time when the reflected waves for the same detection wave are received by each element.
[0041] The position of the obstacle detected by the obstacle detection unit 11 relative to the vehicle is set as the position of the obstacle detection point. When the surrounding monitoring sensor 20 is a distance measuring sensor, the detection point corresponds to the reflection point where the obstacle reflects the probe wave. When the surrounding monitoring sensor 20 is a surrounding monitoring camera, the detection point corresponds to, for example, a feature point of the obstacle recognized by the image. The obstacle detection unit 11 sequentially detects the positions of the obstacle detection points.
[0042] In the present embodiment, the obstacle detection unit 11 includes a first position determination unit 101 and a second position determination unit 102 as sub-functional modules. The obstacle detection unit 11, the first position determination unit 101, and the second position determination unit 102 are equivalent to the detection point position determination unit. The first position determination unit 101 determines the position of the obstacle detected within the detection range of the first sonar 21 relative to the vehicle using the sensor detection result of the first sonar 21. The second position determination unit 102 determines the position of the obstacle detected within the detection range of the second sonar 22 relative to the vehicle using the sensor detection result of the second sonar 22. The first position determination unit 101 and the second position determination unit 102 determine the position of the detection point (hereinafter, simply referred to as the detection point) of the obstacle as described above as the position of the obstacle relative to the vehicle. The position of the detection point determined in the first position determination unit 101 and the position of the detection point determined in the second position determination unit 102 are both expressed as coordinates on the same XY coordinate system.
[0043] In addition, for example, a series of processes (i.e., sensing detection) of receiving the sensing waves after the first sonar 21 and the second sonar 22 send sensing waves are periodically performed at a predetermined period in a state where a control signal instructing the implementation of sensing detection is input from the surrounding monitoring ECU 10. The obstacle detection unit 11 can be configured to detect one detection point relative to one sensing detection of one sonar. In addition, in the case of using a surrounding monitoring sensor 20 such as a camera other than sonar, it can also be configured to detect multiple detection points relative to one sensing detection. The condition for implementing sensing detection can also be set to, for example, less than a specified speed. The specified speed mentioned here is a value that can be set arbitrarily, for example, it can be set to a low speed such as 40 km / h.
[0044] The change amount determination unit 12 determines the change amount of the vehicle position during a predetermined period based on the driving state of the vehicle detected sequentially by the vehicle state sensor 30. The vehicle position can be set as a reference point of the vehicle. For example, the change amount determination unit 12 only needs to determine the change amount of the vehicle position in each cycle of the sensing detection of the surrounding monitoring sensor 20 that is periodically performed to detect the position of the detection point of the obstacle. As an example, the change amount determination unit 12 determines the change amount of the vehicle position based on the vehicle speed detected sequentially by the vehicle speed sensor and the steering angle of the vehicle detected sequentially by the steering angle sensor.
[0045] The detection result management unit 13 manages information about at least one detection point detected by the obstacle detection unit 11 as detection point management data. The detection point management data is data that represents the relative position of the detection point relative to the current position of the vehicle in an XY coordinate system with the reference point of the vehicle as the origin. The detection point management data is updated sequentially as the position of the vehicle changes or the detection points are added. For example, the detection result management unit 13 can exclude detection points that are more than a certain distance away from the vehicle from the detection point management data. The detection result management unit 13 includes a position update unit 131, a storage processing unit 132, and a distinction processing unit 133 as sub-functional modules.
[0046] The position updating unit 131 updates the position of the detection point group determined in sequence by the first position determining unit 101 and the second position determining unit 102 according to the change in the position of the vehicle. As an example, the position updating unit 131 may update the position of the detection point in the XY coordinate system by applying a position change corresponding to the change amount of the vehicle position determined by the change amount determining unit 12 to the position of the detection point. Thus, even if the detection point deviates from the detection range of the surrounding monitoring sensor 20, the relative position of each detection point with respect to the position of the vehicle can continue to be determined in sequence.
[0047] The storage processing unit 132 stores the detection point management data in the memory 14. The memory 14 can be implemented by a rewritable storage medium. The memory 14 includes a volatile memory 141 and a non-volatile memory 142. The storage processing unit 132 can be configured to store the detection point management data in the volatile memory 141 when the vehicle is traveling until it stops. The detection result management unit 13 can determine that the vehicle has stopped based on, for example, the detection of the moving position as the parking position by the moving position sensor in the vehicle state sensor 30. In addition, the detection result management unit 13 can also determine based on the signal of the parking brake switch in the vehicle state sensor 30 becoming turned on. In addition, the detection point management data stored in the volatile memory 141 is deleted when the power supply to the volatile memory 141 is disconnected when the switch (hereinafter referred to as the power switch) for starting the internal combustion engine or the electric generator of the vehicle is turned off.
[0048] When the first position determination unit 101 and the second position determination unit 102 determine that the detection point stored in the volatile memory 141 is a new detection point with a different position, the storage processing unit 132 stores the position of the detection point in the volatile memory 141. In addition, the storage processing unit 132 rewrites the position of the detection point stored in the volatile memory 141 to the updated position for the detection point whose position is updated by the update of the position of the detection point in the position update unit 131. In addition, when the updated position of the detection point detected by one of the first sonar 21 and the second sonar 22 coincides with the position of the detection point detected by the other sonar, they can be managed as the same detection point. The coincidence mentioned here may be a rough coincidence of values including a degree of error.
[0049] The above-mentioned control program, vehicle body shape information, detection range information, etc. can be configured to be pre-stored in the non-volatile memory 142. The vehicle body shape information is information related to the vehicle body shape of the vehicle. As the vehicle body shape information, for example, information on the vehicle height, vehicle width, and vehicle length of the vehicle is listed. In addition, the vehicle body shape information also includes the position of each part of the vehicle body relative to the reference point of the vehicle, each wheel, and sensor position. The detection range information is information on the detection range of the surrounding monitoring sensor 20. For example, the detection range information can be information indicating the detection range of the first sonar 21 and the second sonar 22 in the XY coordinate system. The detection range can be expressed as a range extending from the sensor position of each sonar in the XY coordinate system.
[0050] When the vehicle stops, the storage processing unit 132 stores the position group of the detection points updated by the position updating unit 131 in the nonvolatile memory 142. That is, when the vehicle stops, the storage processing unit 132 stores the detection point management data stored in the volatile memory 141 at that time in the nonvolatile memory 142. In addition, the detection point management data stored in the nonvolatile memory 142 is not deleted even when the power switch of the vehicle is turned off.
[0051] When a plurality of detection points are regarded as detection results for the same obstacle, the distinction processing unit 133 associates them with each other and performs distinction processing to manage them as a cluster (hereinafter, group). For example, when the distance between the detection points is smaller than the distance for distinguishing whether the detection points are the same obstacle, the detection points may be regarded as the same obstacle. In addition, in the point group in which the plurality of detection points are arranged in the order of time series, the detection points belonging to the part that can be approximated by a function such as an ellipse or a parabola may be regarded as the detection points for the same obstacle.
[0052] The classification processing unit 133 may be configured to perform classification processing on the detection points stored in the volatile memory 141, or may be configured to perform classification processing on the detection points stored in the non-volatile memory 142. In the case of a configuration in which the classification processing is performed on the detection points stored in the volatile memory 141, the storage processing unit 132 may store the information on the above-mentioned group in the non-volatile memory 142 when the vehicle is parked. On the other hand, in the case of a configuration in which the classification processing is performed on the detection points stored in the non-volatile memory 142, the classification processing unit 133 may perform classification processing on the detection points stored in the non-volatile memory 142 when the vehicle starts after being parked.
[0053] In the case of adopting a configuration in which the detection points stored in the volatile memory 141 are subjected to a differentiated processing, the information on the above-mentioned group is also stored in the non-volatile memory 142, which accordingly causes a problem such as an increase in the load of writing. In addition, if the writing time when the vehicle is parked increases due to the increase in the load of writing, the problem of increased power consumption when the vehicle is parked occurs. Therefore, it is preferable to adopt a configuration in which the detection points stored in the non-volatile memory 142 are subjected to a differentiated processing.
[0054] When the detection result management unit 13 can determine the contour shape of the detected obstacle based on the point group of the grouped detection points, the area forming the contour shape can also be regarded as the area where an obstacle exists. In addition, the area inside the determined contour shape as viewed from the vehicle can also be regarded as the area where the obstacle exists. The contour shape of the obstacle can be represented by a linear approximation curve calculated as a whole for multiple detection points for the same obstacle. In addition, the contour shape of the obstacle can also be a shape formed by connecting multiple detection points for the same obstacle in a time series order.
[0055] When the vehicle starts after parking, the position estimation unit 15 estimates the position of the detection point that cannot be detected by either the first sonar 21 or the second sonar 22 at the start of the vehicle (hereinafter referred to as the blind spot between the detection ranges) by using the position group of the detection points stored in the nonvolatile memory 142 by the storage processing unit 132. For example, the position estimation unit 15 can determine the start of the vehicle by detecting that the power switch is turned on. In addition, the position estimation unit 15 can determine the start of the vehicle by detecting that the moving position sensor in the vehicle state sensor 30 has detected that the moving position has become the forward position or the reverse position. In addition, the position estimation unit 15 can also determine the start of the vehicle by the signal of the parking brake switch in the vehicle state sensor 30 being turned off.
[0056] The position estimation unit 15 determines whether the position group of the detection points classified as the same group by the classification processing unit 133 and stored in the non-volatile memory 142 by the storage processing unit 132 can be detected by the plurality of surrounding monitoring sensors 20 at the start. In the example of the present embodiment, it is determined whether the detection can be performed by the first sonar 21 and the second sonar 22. The detection point can be detected by the first sonar 21, or in other words, the position of the detection point can be determined by the first position determination unit 101. The detection point can be detected by the second sonar 22, or in other words, the position of the detection point can be determined by the second position determination unit 102. The position group of the detection points classified as the same group by the classification processing unit 133 and stored in the non-volatile memory 142 by the storage processing unit 132 is a position group of the detection points of the same obstacle. For example, the position estimation unit 15 compares the position group of the detection points stored in the non-volatile memory 142 by the storage processing unit 132 with the detection range indicated by the detection range information pre-stored in the non-volatile memory 142, and determines whether a part of the position group is included in the detection range and can be detected.
[0057] Use it here Figure 3 An example of determining whether a position group of detection points of the same obstacle can be detected by the first sonar 21 and the second sonar 22 is shown. Figure 3 The white circles represent the detection points stored in the nonvolatile memory 142 by the storage processing unit 132. Figure 3 As shown in A, when the position group of the detection points stored in the nonvolatile memory 142 by the storage processing unit 132 is included in both the detection range SAF of the first sonar 21 and the detection range SAR of the second sonar 22, it is determined that the detection is possible by both sonars. Figure 3 As shown in FIG. 1B , when the position group of the detection points stored in the nonvolatile memory 142 by the storage processing unit 132 is included in only one of the detection range SAF of the first sonar 21 and the detection range SAR of the second sonar 22, it is determined that detection is possible only by one sonar. Figure 3 As shown in C, when the position group of detection points stored in the nonvolatile memory 142 by the storage processing unit 132 is not included in either the detection range SAF of the first sonar 21 or the detection range SAR of the second sonar 22, it is determined that neither sonar can detect.
[0058] When the position group of detection points determined to be the same obstacle can be detected by two sonars (refer to Figure 4 D. Figure 5The position estimation unit 15 is as follows. The position estimation unit 15 causes the first sonar 21 and the second sonar 22 to perform sensing detection multiple times, for example. Furthermore, when a detection point is detected by actual sensing detection at the same detection distance as the detection point determined to be detectable by each sonar (refer to Figure 4 E, black circle), the position of the detection point in the blind spot area between the detection ranges that cannot be detected by both sonars is estimated based on the position of the detection point stored in the non-volatile memory 142 (refer to Figure 4 F, white circle). Here, the circle without blank space is represented as a black circle. The same applies to the following. In addition, for example, for multiple sensing detections, when a detection point is detected more than a certain number of times at the same detection distance as the detection point determined to be detectable by sonar, it can be set as the detected detection point. The same applies to the following. In addition, the same mentioned here is roughly the same, including the degree of error. The same applies to the following.
[0059] In other words, when a detection point determined to be the same as a detection point included in a position group of detection points of the same obstacle is detected by either of the two sonars at the start, the position estimation unit 15 estimates the position stored in the non-volatile memory 142 as the position of the detection point for the detection point that could not be detected by either of the two sonars at the start.
[0060] exist Figure 4 In the example of , the position estimating unit 15 may read the estimated position of the detection point from the nonvolatile memory 142 and write it as the position of the detection point into the volatile memory 141. In addition, the position of the detection point that can be actually detected by the first sonar 21 and the second sonar 22 may be written into the volatile memory 141 through the storage processing unit 132.
[0061] On the other hand, when the detection point is detected by only the second sonar 22 in actual sensing at the same distance as the detection point determined to be detectable by each sonar (see Figure 5 H, black circle), the position of the detection point in the blind spot area between the detection ranges is not estimated based on the position of the detection point stored in the non-volatile memory 142 (refer to Figure 5 I).
[0062] In other words, when a detection point determined to be the same as a detection point included in a position group of detection points of the same obstacle is detected using only one of the first sonar 21 and the second sonar 22 at the start, the position estimating unit 15 does not estimate the position stored in the non-volatile memory 142 as the position of the detection point for the detection point that cannot be detected using either of the two sonars at the start.
[0063] exist Figure 5 In the example of , the position of the detection point in the blind spot portion stored in the nonvolatile memory 142 is not written to the volatile memory 141 , and the position of the detection point actually detected by the second sonar 22 is written to the volatile memory 141 through the storage processing unit 132 .
[0064] According to the above configuration, when the position group of detection points determined to be the same obstacle can be detected by two sonars, unless the detection point determined to be the same as the detection point included in the position group is detected by either of the two sonars at the start, the position of the detection point in the area of the blind spot between the detection ranges is not estimated based on the position of the detection point stored in the non-volatile memory 142. When the position group of detection points of the same obstacle is detected by either of the two sonars at the start, the position of the detection point in the area of the blind spot between the detection ranges estimated to be the position of the detection point stored in the non-volatile memory 142 has a higher reliability. Therefore, only when it is estimated to be highly reliable, the position of the detection point in the area of the blind spot between the detection ranges is estimated based on the position of the detection point stored in the non-volatile memory 142, so that the estimation accuracy of the position of the detection point can be improved.
[0065] The position estimation unit 15 can restore only the position of the detection point detected by the sonar at the same detection distance as the detection point determined to be detectable by each sonar, for example, at the stage where the detection point is detected by only one sonar in actual sensing detection. That is, the storage processing unit 132 first writes only the position of the detection point detected by the sonar into the volatile memory 141. The stage where the detection point is detected by only one sonar refers to the following situation: there is a difference in the timing of the end of multiple sensing detections by the first sonar 21 and the second sonar 22, and it is clear whether the detection point is detected by only one sonar.
[0066] Next, the position estimating unit 15 can restore the position of the detection point detected by the sonar and the position of the detection point in the blind spot area between the detection ranges when another sonar delay detects the detection point at the same detection distance as the detection point determined to be detectable by the sonar. That is, the storage processing unit 132 writes the position of the detection point detected by the sonar into the volatile memory 141, and the storage processing unit 132 writes the position of the detection point in the blind spot area between the detection ranges stored in the non-volatile memory 142 into the volatile memory 141.
[0067] Furthermore, when the position estimating unit 15 determines that the detection point identical to the detection point included in the position group of the same obstacle has not been detected by either the first sonar 21 or the second sonar 22 at the start, the position estimating unit 15 does not estimate the position stored in the nonvolatile memory 142 as the position of the detection point that could not be detected by either of the two sonars at the start. In this case, the position of the detection point that can actually be detected by the first sonar 21 and the second sonar 22 may be written into the volatile memory 141 by the storage processing unit 132.
[0068] When the position group of detection points determined to be the same obstacle can be detected by only one of the first sonar 21 and the second sonar 22 (see Figure 6 J. Figure 7 The position estimation unit 15 is as follows. Here, the case where it is determined that the detection point can be detected only by the second sonar 22 is described as an example. The position estimation unit 15 causes the second sonar 22 to perform sensing detection for example multiple times. Furthermore, when the detection point is detected in the actual sensing detection at the same detection distance as the detection point determined to be detectable by the second sonar 22 (refer to Figure 6 K, black circle), the position of the detection point in the blind spot area between the detection ranges that cannot be detected by both sonars is estimated based on the position of the detection point stored in the non-volatile memory 142 (refer to Figure 6 L, white circle).
[0069] In other words, when a detection point determined to be the same as a detection point included in a position group of detection points of the same obstacle is detected using the second sonar 22 at the start, the position estimating unit 15 estimates the position stored in the non-volatile memory 142 as the position of the detection point for a detection point that cannot be detected using either of the two sonars at the start.
[0070] exist Figure 6 In the case of the example, the position estimation unit 15 may read the estimated position of the detection point from the nonvolatile memory 142 and write it as the position of the detection point into the volatile memory 141. In addition, the position of the detection point actually detected by the second sonar 22 may be written into the volatile memory 141 through the storage processing unit 132.
[0071] On the other hand, when the detection point is not detected by the second sonar 22 in the actual sensing detection at the same detection distance as the detection point determined to be detectable by the second sonar 22 (see Figure 7 The positions of the detection points in the blind spot area between the detection ranges are not estimated based on the positions of the detection points stored in the nonvolatile memory 142 (refer to Figure 5 I). Figure 7 In FIG. 1 , the position of the detection point determined to be detectable by the second sonar 22 is shown (refer to Figure 7 N × mark) different positions (refer to Figure 7 In addition, when the detection point itself is not detected by the second sonar 22, the position of the detection point in the blind spot area between the detection ranges is not estimated based on the position of the detection point stored in the non-volatile memory 142.
[0072] In other words, when the position estimating unit 15 determines that a detection point identical to a detection point included in a position group of detection points of the same obstacle has not been detected by the second sonar 22 at the time of starting, the position estimating unit 15 does not estimate the position stored in the non-volatile memory 142 as the position of the detection point that could not be detected by either of the two sonars at the time of starting.
[0073] exist Figure 7 In the example of FIG. 1 , the position of the detection point in the blind spot portion stored in the nonvolatile memory 142 is not written into the volatile memory 141 , and the position of the detection point actually detected by the second sonar 22 can be written into the volatile memory 141 through the storage processing unit 132 .
[0074] When the position group of detection points determined to be the same obstacle cannot be detected by either of the two sonars (see Figure 8 The position estimation unit 15 is as follows. The position estimation unit 15 does not cause the first sonar 21 and the second sonar 22 to perform multiple sensing detections (see Figure 8 Q), the position of the detection point in the blind spot area between the detection ranges that cannot be detected by both sonars is estimated based on the position of the detection point stored in the non-volatile memory 142 (refer to Figure 8 R, white circle).
[0075] In other words, the position estimation unit 15 estimates the position stored in the non-volatile memory 142 as the position of the detection point for the same obstacle position group, based on the fact that the detection point included in the position group is not included in the detection range of any of the two sonars at the time of starting. For the detection point that cannot be detected using either of the two sonars at the time of starting.
[0076] In addition, the position estimating unit 15 is preferably configured so that, even if the position group of detection points determined to be the same obstacle cannot be detected by any of the two sonars at the start, when the distance of these detection points to the vehicle is greater than a predetermined distance, the position stored in the non-volatile memory 142 is not estimated as the position of these detection points. This is because, for detection points with a lower urgency for approach avoidance and farther away, the accuracy of not estimating an erroneous position can also be emphasized. The predetermined distance mentioned here is a distance for distinguishing the high and low urgency for approach avoidance, and can be set to 50 cm, for example.
[0077] On the other hand, the position estimating unit 15 may be configured to estimate the positions stored in the non-volatile memory 142 as the positions of the detection points when the position group of the detection points determined to be the same obstacle cannot be detected by any of the two sonars at the start, when the distance of these detection points relative to the vehicle is less than a predetermined distance. This is because, for detection points that are closer and have a higher degree of urgency for approach avoidance, safety is preferred over accuracy. In addition, the distance relative to the vehicle may be the distance between the outer surface of the vehicle and the points of the detection points that are closest to each other. The position of the outer surface relative to the reference point of the vehicle may be determined, for example, based on the body shape information of the vehicle stored in the non-volatile memory 142.
[0078] The travel path determination unit 16 determines the travel path of the vehicle. The travel path of the vehicle may be a predicted trajectory of a reference point of the vehicle determined based on the steering angle of the vehicle detected by the steering angle sensor in the vehicle state sensor 30 and the vehicle speed of the vehicle detected by the vehicle speed sensor. Alternatively, the travel path of the vehicle may be a direction relative to the reference point of the vehicle indicated by the steering angle of the vehicle detected by the steering angle sensor in the vehicle state sensor 30.
[0079] The avoidance determination unit 17 determines in sequence whether it is necessary to avoid obstacles (hereinafter referred to as target obstacles) whose detection points are managed by the detection result management unit 13, based on the travel path of the vehicle determined by the travel path determination unit 16. As an example, when the passing area of the vehicle inferred based on the travel path of the vehicle determined by the travel path determination unit 16 contains the position of the detection point stored in the volatile memory 141, it can be determined that it is necessary to avoid the target obstacle. The passing area is an area determined along the travel path of the vehicle and is inferred to be required for the passage of the vehicle. On the other hand, when the position of the detection point stored in the volatile memory 141 is not included in the passing area, it can be determined that it is not necessary to avoid the target obstacle. The avoidance determination unit 17 can infer the passing area of the vehicle based on the travel path of the vehicle and the information on the vehicle width of the vehicle in the above-mentioned vehicle body shape information. In addition, the width of the passing area can also be set to a width that allows a margin for the vehicle width of the vehicle.
[0080] The avoidance determination unit 17 preferably determines whether to avoid an obstacle based on conditions such as TTC (Time To Collision) and obstacle distance in addition to the vehicle's travel path. This is because it is difficult to mistakenly determine that an obstacle with a low probability of approaching needs to be avoided. The TTC for the obstacle can be calculated based on the obstacle distance and the vehicle speed detected by the vehicle speed sensor in the vehicle state sensor 30.
[0081] The obstacle distance may be the distance between the outer surface of the vehicle and the closest points among the obstacle detection points. In addition, the obstacle distance may be the distance between the reference point of the vehicle and the closest points among the obstacle detection points. In addition, it may be the distance between the installation position of the surrounding monitoring sensor 20 of the vehicle and the closest points among the obstacle detection points.
[0082] The avoidance determination unit 17 may determine that the obstacle needs to be avoided when the position of the detection point stored in the volatile memory 141 is included in the passing area of the host vehicle and the TTC with respect to the obstacle is less than the threshold value for TTC. On the other hand, when any of the conditions are not satisfied, it may be determined that the obstacle does not need to be avoided. The threshold value for TTC mentioned here is a value for distinguishing whether it is a time when the obstacle can be avoided with a margin, and can be set arbitrarily.
[0083] The avoidance determination unit 17 may determine that it is necessary to avoid the obstacle when the position of the detection point stored in the volatile memory 141 is included in the passing area of the host vehicle and the obstacle distance is less than the avoidance distance. On the other hand, when any of the conditions are not satisfied, it may be determined that it is not necessary to avoid the obstacle. The avoidance distance mentioned here is a value for distinguishing whether it is a distance that can avoid the obstacle with a margin, and can be set arbitrarily. The avoidance distance may be configured to be longer as the speed of the host vehicle increases, for example.
[0084] The alarm processing unit 18 causes the alarm device 40 to issue an alarm when the avoidance determination unit 17 determines that the obstacle needs to be avoided. The alarm processing unit 18 does not cause the alarm device 40 to issue an alarm when the avoidance determination unit 17 determines that the obstacle needs not to be avoided.
[0085] <Processing Related to Surrounding Area Monitoring in Surrounding Area Monitoring ECU 10 >
[0086] Here, use Fig. 9The flowchart of FIG. 1 is used to describe an example of the flow of the surrounding monitoring related processing in the surrounding monitoring ECU 10. The steps included in the surrounding monitoring related processing executed by the computer are equivalent to executing the vehicle surrounding monitoring method. Fig. 9 The flowchart may be configured to start when the vehicle starts after stopping and the power switch of the vehicle is turned on. Fig. 9 In the example of FIG. 1 , after the surrounding monitoring related processing is started, sensing detection is performed in the first sonar 21 and the second sonar 22 in sequence, for example.
[0087] In step S1, if the position group of the detection points has already been stored in the nonvolatile memory 142 (Yes in S1), the process proceeds to step S2. The position group of the detection points already stored in the nonvolatile memory 142 is the position group of the detection points updated by the position updating unit 131 when the vehicle was parked last time, which is stored by the storage processing unit 132. On the other hand, if the position group of the detection points has not been stored in the nonvolatile memory 142 (No in S1), the process proceeds to step S11.
[0088] In step S2, the classification processing unit 133 performs classification processing for grouping the detection points of the same obstacle with respect to the detection points stored in the nonvolatile memory 142. In step S3, the position estimation unit 15 determines whether the position group of the detection points classified as the same group in S2 can be detected by both the first sonar 21 and the second sonar 22. If it is determined that it can be detected by both sonars (Yes in S3), the process proceeds to step S4. On the other hand, if it is not determined that it can be detected by both sonars (No in S3), the process proceeds to step S7.
[0089] In step S4, the position estimation unit 15 causes the first sonar 21 and the second sonar 22 to perform sensing detection multiple times. And, when the detection point is detected by the two sonars at the same detection distance as the detection point determined to be detectable by each sonar in S3 through actual sensing detection (Yes in S4), the process moves to step S5. On the other hand, when the detection point is not detected by the two sonars at the same detection distance as the detection point determined to be detectable by each sonar in S3 (No in S4), the process moves to step S13. In addition, when the detection point is not detected by the two sonars, and only one sonar detects the detection point at the same detection distance as the detection point determined to be detectable, the first position determination unit 101 or the second position determination unit 102 determines the position of the detection point. And, the storage processing unit 132 stores the determined position of the detection point in the volatile memory 141.
[0090] In step S5, for the detection points detected in S4, the first position determination unit 101 determines the position of the detection point detected by the first sonar 21. Also, for the detection point detected by the second sonar 22, the second position determination unit 102 determines the position of the detection point. Then, the storage processing unit 132 stores the determined positions of the detection points in the volatile memory 141, and the process proceeds to step S6.
[0091] In step S6, the position estimating unit 15 estimates the position of the detection point in the blind spot area between the detection ranges that cannot be detected by both sonars based on the positions of the detection points stored in the nonvolatile memory 142. Then, the estimated position of the detection point is read from the nonvolatile memory 142 and written into the volatile memory 141 as the position of the detection point, and the process moves to step S13. That is, the position of the detection point in the blind spot area between the detection ranges is restored based on the storage in the nonvolatile memory 142, and the process moves to step S13.
[0092] In step S7, when it is determined that the position group of the detection points classified as the same group in S2 can be detected by only one of the first sonar 21 and the second sonar 22 (Yes in S7), the process proceeds to step S8. On the other hand, when it is determined that it cannot be detected by either the first sonar 21 or the second sonar 22 (No in S7), the process proceeds to step S10.
[0093] In step S8, the position estimation unit 15 causes the first sonar 21 and the second sonar 22 to perform sensing detection multiple times. And, when the detection point is detected by the target sonar at the same detection distance as the detection point determined to be detectable by only one of the first sonar 21 and the second sonar 22 (hereinafter referred to as the target sonar) through actual sensing detection (Yes in S8), the process moves to step S9. On the other hand, when the detection point is not detected by the target sonar at the same detection distance as the detection point determined to be detectable by the target sonar (No in S8), the process moves to step S13. In addition, when the detection point is detected at a detection distance different from the detection point determined to be detectable among the cases where the detection point is not detected by the target sonar, the first position determination unit 101 or the second position determination unit 102 determines the position of the detection point. And, the storage processing unit 132 stores the determined position of the detection point in the volatile memory 141.
[0094] In step S9, for the detection points detected in S8, the first position determination unit 101 determines the position of the detection point detected by the first sonar 21. Also, for the detection point detected by the second sonar 22, the second position determination unit 102 determines the position of the detection point. Then, the storage processing unit 132 stores the determined positions of the detection points in the volatile memory 141, and moves to S6.
[0095] In step S10, the position estimation unit 15 determines the distance of the detection point located in the blind spot between the detection ranges from the vehicle in the position group of the detection points stored in the nonvolatile memory 142. If the distance is less than the predetermined distance (Yes in S10), the process proceeds to S6. On the other hand, if the distance is greater than the predetermined distance (No in S10), the process proceeds to step S13.
[0096] In step S11, the first sonar 21 and the second sonar 22 are made to perform sensing detection multiple times. And, when the detection point is detected by at least one of the sonars through actual sensing detection (Yes in S11), the process moves to step S12. On the other hand, when the detection point is not detected by any of the sonars (No in S11), the process moves to step S15.
[0097] In step S12, for the detection points detected in S11, the first position determination unit 101 determines the position of the detection point detected by the first sonar 21. Also, for the detection point detected by the second sonar 22, the second position determination unit 102 determines the position of the detection point. Then, the storage processing unit 132 stores the determined positions of the detection points in the volatile memory 141, and the process proceeds to S13.
[0098] In step S13, if the change amount determination unit 12 determines the change amount of the vehicle position (Yes in S13), the process proceeds to step S14. On the other hand, if the change amount determination unit 12 does not determine the change amount of the vehicle position (No in S13), the process proceeds to step S15.
[0099] In step S14 , the position updating unit 131 updates the positions of the detection points in the XY coordinate system by changing the positions of the detection point position group stored as the detection point management data in the volatile memory 141 by the amount of change determined in step S13 .
[0100] In step S15, if the detection result management unit 13 has determined the parking of the vehicle (Yes in S15), the process proceeds to step S16. On the other hand, if the detection result management unit 13 has not determined the parking of the vehicle (No in S15), the process returns to S13 and repeats the process.
[0101] In step S16, the storage processing unit 132 stores the detection point management data stored in the volatile memory 141 in the non-volatile memory 142, and ends the surrounding monitoring related processing. In addition, the detection point management data stored in the non-volatile memory 142 can be configured to be deleted by overwriting when new detection point management data is stored when the vehicle stops next time.
[0102] <Summary of Implementation 1>
[0103] According to the configuration of the first embodiment, even if an obstacle is in the blind spot area between the detection ranges and is not detected by the first sonar 21 and the second sonar 22 at the start, it can be estimated by the position estimating unit 15. Therefore, even if an obstacle is in the blind spot area between the detection ranges, the avoidance determining unit 17 can determine whether it is necessary to avoid it using the position of the detection point estimated by the position estimating unit 15. Therefore, even if an obstacle is in the blind spot area between the detection ranges, the alarm device 40 can sound an alarm when it is necessary to avoid it. As a result, even if a plurality of surrounding monitoring sensors 20 are used to monitor the surroundings of the vehicle, the detection accuracy of the position of the obstacle using the surrounding monitoring sensors 20 can be improved, and it is easier to avoid approaching an obstacle existing in the blind spot area between the detection ranges of the surrounding monitoring sensors 20 in the horizontal direction when starting a parked vehicle.
[0104] Here, use Fig.10 , the effect of the structure of implementation mode 1 is explained. Fig.10 S represents an example of the prior art, and T represents an example of implementation mode 1. Fig.10 Ob represents an obstacle. Fig.10 The black circle indicates the detection point of the obstacle Ob detected by the surrounding monitoring sensor 20 when the host vehicle HV starts. Fig.10 The white circles indicate detection points whose positions are estimated by the position estimating unit 15 of the first embodiment when the host vehicle HV starts.
[0105] In the prior art, the positions of the detection points detected by the surrounding monitoring sensor 20 until the vehicle HV stops are only stored in the volatile memory 141, and are therefore temporarily deleted when the vehicle HV stops. Therefore, when the vehicle HV starts, only the positions of the detection points that can be actually detected by the surrounding monitoring sensor 20 can be recognized. Therefore, it is difficult to assist the vehicle HV to avoid approaching obstacles that exist in the blind spot between the detection ranges of the surrounding monitoring sensor 20 in the horizontal direction (see Fig.10 of S).
[0106] On the other hand, according to the configuration of the first embodiment, even obstacles in the blind spot between the detection ranges can be estimated by the position estimating unit 15. Therefore, it is easier to assist the host vehicle HV to avoid approaching obstacles in the blind spot between the detection ranges (see Fig.10 of T).
[0107] In addition, in Embodiment 1, a configuration is shown in which the detection point management data is stored in the volatile memory 141 except when the vehicle is parked, but the present invention is not necessarily limited to this. For example, the detection point management data may be stored in the nonvolatile memory 142 except when the vehicle is parked. However, it is preferable to store the detection point management data in the volatile memory 141 except when the vehicle is parked. This is because, in the case where an obstacle for which detection points are stored when the vehicle is parked moves during parking, it is easy to verify whether the detection points stored when the vehicle is parked can be used when starting the vehicle and then restore the detection points.
[0108] In the first embodiment, the volatile memory 141 and the nonvolatile memory 142 for storing the checkpoint management data are provided in the surrounding monitoring ECU 10, but the present invention is not necessarily limited to this. For example, when a system for communicating with a server installed outside the vehicle is mounted, the checkpoint management data may be stored in the memory of the server. In this case, the vehicle communicates with the server at the same time as the vehicle is started, and the information of the vehicle is acquired.
[0109] In addition, the configuration is not limited to storing the detection point management data in the nonvolatile memory 142 when the vehicle is parked. For example, as long as the memory is not deleted when the vehicle is parked, the detection point management data may be stored in a volatile memory when the vehicle is parked. As an example of a volatile memory that is not deleted when the vehicle is parked, there is a volatile memory provided in a device having a stable power supply.
[0110] (Implementation Method 2)
[0111] The structure of the embodiment 1 is not limited thereto, and the structure of the following embodiment 2 may also be used. Fig.11 Implementation method 2 is described. Fig.11 The illustrated vehicle system 1 a is similar to the vehicle system 1 of the first embodiment, except that it includes a surrounding monitoring ECU 10 a instead of the surrounding monitoring ECU 10 .
[0112] The surrounding monitoring ECU 10a is the same as the surrounding monitoring ECU 10 of the first embodiment except that a position estimating unit 15a is provided instead of the position estimating unit 15. The position estimating unit 15a is the same as the position estimating unit 15 of the first embodiment except that a part of the processing is different. The processing in the position estimating unit 15a that is different from the processing in the position estimating unit 15 is described below. In the second embodiment, for the sake of convenience, the case where two sensors, the first sonar 21 and the second sonar 22, are used as the surrounding monitoring sensor 20 is described as an example.
[0113] When the position group of detection points determined to be the same obstacle can be detected by two sonars, the position estimation unit 15a is as follows. The position estimation unit 15 causes the first sonar 21 and the second sonar 22 to perform sensing detection for example a plurality of times. Then, at a stage where the detection point is detected by only one sonar through actual sensing detection at the same detection distance as the detection point determined to be detectable by each sonar, the position of the detection point in the blind spot area between the detection ranges that cannot be detected by both sonars is estimated based on the position of the detection point stored in the non-volatile memory 142. The same here may be substantially the same including the degree of error.
[0114] In other words, when a detection point determined to be the same as a detection point included in a position group of detection points of the same obstacle is detected using either the first sonar 21 or the second sonar 22 at the time of starting, the position estimating unit 15a estimates the position stored in the non-volatile memory 142 as the position of the detection point for a detection point that could not be detected using either of the two sonars at the time of starting.
[0115] According to the above configuration, the position estimating unit 15 can also estimate obstacles in the blind spot area between the detection ranges that are not detected by the first sonar 21 and the second sonar 22 when starting. Therefore, even when a plurality of surrounding monitoring sensors 20 are used to monitor the surroundings of the vehicle, the detection accuracy of the positions of obstacles using the surrounding monitoring sensors 20 can be improved, and it is easier to avoid approaching obstacles existing in the blind spot between the detection ranges of the surrounding monitoring sensors 20 in the horizontal direction when starting a parked vehicle.
[0116] On the other hand, when the position estimation unit 15a determines that the position group of detection points of the same obstacle can be detected by two sonars, and when the detection point is not detected by any sonar through actual sensing at the same distance as the detection point determined to be detectable by each sonar, the position estimation unit 15a does not estimate the position of the detection point in the blind spot area between the detection ranges based on the position of the detection point stored in the non-volatile memory 142.
[0117] In other words, when a detection point determined to be the same as a detection point included in a position group of detection points of the same obstacle has not been detected by any of the multiple peripheral monitoring sensors at the time of starting, the position estimating unit 15a does not estimate the position stored in the non-volatile memory 142 as the position of the detection point that could not be detected by either the first sonar 21 or the second sonar 22 at the time of starting.
[0118] (Implementation method 3)
[0119] In the above-mentioned embodiment, a configuration is shown in which the avoidance of approaching an obstacle is assisted by an alarm, but the present invention is not necessarily limited to this. For example, the avoidance of approaching an obstacle may be assisted by automatically controlling the steering of the vehicle or increasing the steering torque.
[0120] (Implementation 4)
[0121] In addition, the present invention is not limited to the configuration of the above-described embodiment, and the function of the periphery monitoring ECUs 10 and 10 a may be shared among a plurality of control devices.
[0122] In addition, the present disclosure is not limited to the above-mentioned embodiments, and various changes can be made within the scope indicated by the claims. The embodiments obtained by appropriately combining the technical solutions respectively disclosed in different embodiments are also included in the technical scope of the present disclosure. In addition, the control unit and the method thereof described in the present disclosure may also be implemented by a special-purpose computer, which constitutes a processor programmed to execute one or more functions concretized by a computer program. Alternatively, the device and the method thereof described in the present disclosure may also be implemented by a special-purpose hardware logic circuit. Alternatively, the device and the method thereof described in the present disclosure may also be implemented by one or more special-purpose computers, which are composed of a combination of a processor that executes a computer program and one or more hardware logic circuits. In addition, the computer program may also be stored as an instruction executed by a computer in a computer-readable non-transient tangible recording medium.
Claims
1. A vehicle periphery monitoring device, used in a vehicle equipped with a plurality of periphery monitoring sensors having blind spots between their detection ranges in the horizontal direction, wherein: have: a detection point position determination unit, which determines the position of the detection point of the obstacle relative to the vehicle according to the detection result of the surrounding monitoring sensor; a position updating unit, for updating the position group of the detection points sequentially determined by the detection point position determining unit according to a change in the position of the vehicle; a storage processing unit, which stores the position group of the detection points updated by the position updating unit in a memory which is not deleted while the vehicle is parked, when the vehicle is parked; a position estimating unit that estimates the position of the detection point that cannot be detected by any of the plurality of perimeter monitoring sensors at the time of starting the vehicle after the vehicle stops, using the position group of the detection points stored in the memory by the storage processing unit; as well as a classification processing unit that classifies the position groups of the detection points into groups, the group being a cluster of the detection points estimated to be related to the same obstacle, When the position group of the detection points classified as the same group by the classification processing unit and stored in the memory by the storage processing unit is included in the detection range of the plurality of periphery monitoring sensors at the time of starting, When the detection point determined to be the same as the detection point included in the position group is detected by any of the plurality of surrounding monitoring sensors at the time of starting, the position estimating unit estimates the position stored in the memory by the storage processing unit as the position of the detection point for the detection point that could not be detected by any of the surrounding monitoring sensors at the time of starting, and on the other hand, In a case where the detection point determined to be the same as the detection point included in the position group is detected using only one of the multiple peripheral monitoring sensors at the time of starting, the position estimation unit does not estimate the position stored in the memory by the storage processing unit as the position of the detection point for the detection point that cannot be detected using any of the peripheral monitoring sensors at the time of starting.
2. A vehicle periphery monitoring device, used in a vehicle equipped with a plurality of periphery monitoring sensors having blind spots between their detection ranges in the horizontal direction, wherein: have: a detection point position determination unit, which determines the position of the detection point of the obstacle relative to the vehicle according to the detection result of the surrounding monitoring sensor; a position updating unit, for updating the position group of the detection points sequentially determined by the detection point position determining unit according to a change in the position of the vehicle; a storage processing unit, which stores the position group of the detection points updated by the position updating unit in a memory which is not deleted while the vehicle is parked, when the vehicle is parked; a position estimating unit that estimates the position of the detection point that cannot be detected by any of the plurality of perimeter monitoring sensors at the time of starting the vehicle after the vehicle stops, using the position group of the detection points stored in the memory by the storage processing unit; as well as a classification processing unit that classifies the position groups of the detection points into groups of clusters of the detection points estimated to be related to the same obstacle, When the position group of the detection points classified as the same group by the classification processing unit and stored in the memory by the storage processing unit is included in the detection range of only one of the plurality of surrounding monitoring sensors at the start, When the detection point determined to be the same as the detection point included in the position group is detected by the surrounding monitoring sensor at the time of starting, the position estimating unit estimates the position stored in the memory by the storage processing unit as the position of the detection point for the detection point that cannot be detected by any of the plurality of surrounding monitoring sensors at the time of starting, and on the other hand, In a case where the detection point determined to be the same as the detection point included in the position group cannot be detected using the surrounding monitoring sensor at the time of starting, the position estimation unit does not estimate the position stored in the memory by the storage processing unit as the position of the detection point for the detection point that cannot be detected using any of the multiple surrounding monitoring sensors at the time of starting.
3. A vehicle periphery monitoring device, used in a vehicle equipped with a plurality of periphery monitoring sensors having blind spots between their detection ranges in the horizontal direction, wherein: have: a detection point position determination unit, which determines the position of the detection point of the obstacle relative to the vehicle according to the detection result of the surrounding monitoring sensor; a position updating unit, for updating the position group of the detection points sequentially determined by the detection point position determining unit according to a change in the position of the vehicle; a storage processing unit, which stores the position group of the detection points updated by the position updating unit in a memory which is not deleted while the vehicle is parked, when the vehicle is parked; a position estimating unit that estimates the position of the detection point that cannot be detected by any of the plurality of perimeter monitoring sensors at the time of starting the vehicle after the vehicle stops, using the position group of the detection points stored in the memory by the storage processing unit; as well as a classification processing unit that classifies the position groups of the detection points into groups of clusters of the detection points estimated to be related to the same obstacle, When the position group of the detection points classified as the same group by the classification processing unit and stored in the memory by the storage processing unit is included in the detection range of the plurality of periphery monitoring sensors at the time of starting, When the detection point determined to be the same as the detection point included in the position group is detected by one of the plurality of surrounding monitoring sensors at the time of starting, the position estimating unit estimates the position stored in the memory by the storage processing unit as the position of the detection point for the detection point that cannot be detected by any of the surrounding monitoring sensors at the time of starting, and on the other hand, In a case where the detection point determined to be the same as the detection point included in the position group is not detected by any of the multiple peripheral monitoring sensors at the time of starting, the position estimation unit does not estimate the position stored in the memory by the storage processing unit as the position of the detection point for the detection point that cannot be detected by any of the peripheral monitoring sensors at the time of starting.
4. A vehicle periphery monitoring device, used in a vehicle equipped with a plurality of periphery monitoring sensors having blind spots between their detection ranges in the horizontal direction, wherein: have: a detection point position determination unit, which determines the position of the detection point of the obstacle relative to the vehicle according to the detection result of the surrounding monitoring sensor; a position updating unit, for updating the position group of the detection points sequentially determined by the detection point position determining unit according to a change in the position of the vehicle; a storage processing unit, which stores the position group of the detection points updated by the position updating unit in a memory which is not deleted while the vehicle is parked, when the vehicle is parked; as well as a position estimating unit that estimates the position of the detection point that cannot be detected by any of the plurality of surrounding monitoring sensors at the time of starting the vehicle after the vehicle stops, using the position group of the detection points stored in the memory by the storage processing unit, The position estimating unit estimates the position group of the detection points stored in the memory by the storage processing unit as the position of the detection points existing in the blind spot that cannot be detected by any of the plurality of periphery monitoring sensors at the time of starting, based on the fact that the position group of the detection points stored in the memory by the storage processing unit is not included in any of the detection ranges of the plurality of periphery monitoring sensors at the time of starting, In a case where the position group of the detection points stored in the memory by the storage processing unit is not included in any of the detection ranges of the plurality of periphery monitoring sensors at the time of starting, and when the distance to the vehicle at the time of starting is less than a predetermined distance, the position estimating unit estimates the position group of the detection points stored in the memory by the storage processing unit as the positions of the detection points existing in the blind spot which cannot be detected by any of the periphery monitoring sensors at the time of starting, and on the other hand, In a case where the position group of the detection points stored in the memory by the storage processing unit is not included in any of the detection ranges of the plurality of surrounding monitoring sensors at the time of starting, and where the distance relative to the vehicle at the time of starting is greater than a prescribed distance, the position estimation unit does not estimate the position group of the detection points stored in the memory by the storage processing unit as the position of the detection points existing in the blind spot that cannot be detected by any of these surrounding monitoring sensors at the time of starting.
5. A vehicle perimeter monitoring method, used on a vehicle equipped with a plurality of perimeter monitoring sensors having blind spots between their detection ranges in the horizontal direction, wherein: determining the position of the obstacle detection point relative to the vehicle according to the detection result of the perimeter monitoring sensor, For the position groups of the detection points determined in sequence, the positions are updated according to the changes in the position of the vehicle, When the vehicle is parked, the updated position group of the detection points is stored in a memory that is not deleted during the parking of the vehicle. When the vehicle starts to move after stopping, the position group of the detection points stored in the memory is used to estimate the position of the detection point existing in the blind spot which cannot be detected by any of the plurality of surrounding monitoring sensors when starting to move, The position groups of the detection points are divided into groups, the group being a cluster of the detection points presumed to be related to the same obstacle, When the position group of the detection points classified as the same group and stored in the memory is included in the detection range of the plurality of periphery monitoring sensors at the time of starting, When the detection point determined to be the same as the detection point included in the position group is detected by any of the plurality of periphery monitoring sensors at the time of starting, for the detection point that cannot be detected by any of the periphery monitoring sensors at the time of starting, the position stored in the memory is estimated as the position of the detection point, and on the other hand, In a case where the detection point determined to be the same as the detection point included in the position group is detected using only one of the multiple surrounding monitoring sensors at the time of starting, for the detection point that cannot be detected using any of the surrounding monitoring sensors at the time of starting, the position stored in the memory is not estimated as the position of the detection point.
6. A vehicle perimeter monitoring method, used on a vehicle equipped with a plurality of perimeter monitoring sensors having blind spots between their detection ranges in the horizontal direction, wherein: determining the position of the obstacle detection point relative to the vehicle according to the detection result of the surrounding monitoring sensor, For the position groups of the detection points determined in sequence, the positions are updated according to the changes in the position of the vehicle, When the vehicle is parked, the updated position group of the detection points is stored in a memory that is not deleted during the parking of the vehicle. When the vehicle starts to move after stopping, the position group of the detection points stored in the memory is used to estimate the position of the detection point existing in the blind spot which cannot be detected by any of the plurality of surrounding monitoring sensors when starting to move, The position groups of the detection points are divided into groups of clusters of the detection points presumed to be related to the same obstacle, When the position group of the detection points classified as the same group and stored in the memory is included in the detection range of only one of the plurality of surrounding monitoring sensors at the time of starting, When the detection point determined to be the same as the detection point included in the position group is detected by the surrounding monitoring sensor at the time of starting, for the detection point that cannot be detected by any of the plurality of surrounding monitoring sensors at the time of starting, the position stored in the memory is estimated as the position of the detection point, and on the other hand, In a case where the detection point determined to be the same as the detection point included in the position group cannot be detected using the surrounding monitoring sensor at the time of starting, for the detection point that cannot be detected using any of the multiple surrounding monitoring sensors at the time of starting, the position stored in the memory is not estimated as the position of the detection point.
7. A vehicle perimeter monitoring method, used on a vehicle equipped with a plurality of perimeter monitoring sensors having blind spots between their detection ranges in the horizontal direction, wherein: determining the position of the obstacle detection point relative to the vehicle according to the detection result of the perimeter monitoring sensor, For the position groups of the detection points determined in sequence, the positions are updated according to the changes in the position of the vehicle, When the vehicle is parked, the updated position group of the detection points is stored in a memory that is not deleted during the parking of the vehicle. When the vehicle starts to move after stopping, the position group of the detection points stored in the memory is used to estimate the position of the detection point existing in the blind spot which cannot be detected by any of the plurality of surrounding monitoring sensors when starting to move, The position groups of the detection points are divided into groups of clusters of the detection points presumed to be related to the same obstacle, When the position group of the detection points stored in the memory classified as the same group is included in the detection range of the plurality of periphery monitoring sensors at the time of starting, When the detection point determined to be the same as the detection point included in the position group is detected by one of the plurality of periphery monitoring sensors at the time of starting, the position stored in the memory is estimated as the position of the detection point for the detection point that cannot be detected by any of the periphery monitoring sensors at the time of starting, and on the other hand, In a case where the detection point determined to be the same as the detection point included in the position group is not detected by any of the multiple surrounding monitoring sensors at the time of starting, the position stored in the memory is not estimated as the position of the detection point for the detection point that cannot be detected by any of the surrounding monitoring sensors at the time of starting.
8. A vehicle periphery monitoring method, used on a vehicle equipped with a plurality of periphery monitoring sensors having blind spots between their detection ranges in the horizontal direction, wherein: determining the position of the obstacle detection point relative to the vehicle according to the detection result of the perimeter monitoring sensor, For the position groups of the detection points determined in sequence, the positions are updated according to the changes in the position of the vehicle, When the vehicle is parked, the updated position group of the detection points is stored in a memory that is not deleted during the parking of the vehicle. When the vehicle starts to move after stopping, the position group of the detection points stored in the memory is used to estimate the position of the detection point existing in the blind spot which cannot be detected by any of the plurality of surrounding monitoring sensors when starting to move, Based on the fact that the position group of the detection points stored in the memory is not included in any of the detection ranges of the plurality of perimeter monitoring sensors at the time of starting, the position group of the detection points stored in the memory is estimated to be positions of the detection points existing in the blind spot that cannot be detected by any of the plurality of perimeter monitoring sensors at the time of starting, When the position group of the detection points stored in the memory is not included in any of the detection ranges of the plurality of periphery monitoring sensors at the time of starting, and when the distance to the vehicle at the time of starting is less than a predetermined distance, the position group of the detection points stored in the memory is estimated to be the positions of the detection points existing in the blind spot that cannot be detected by any of the periphery monitoring sensors at the time of starting, and on the other hand, In a case where the position group of the detection points stored in the memory is not included in any of the detection ranges of the plurality of periphery monitoring sensors at the time of starting, and when the distance relative to the vehicle at the time of starting is greater than a prescribed distance, the position group of the detection points stored in the memory is not estimated as the position of the detection points existing in the blind spot that cannot be detected by any of the periphery monitoring sensors at the time of starting.
