Speed ​​limit recognition method and speed limit recognition device

Abstract

This speed limit recognition method involves acquiring, from a camera, a captured image representative of the environment ahead of an ego vehicle. The foregoing also involves recognizing a speed limit sign from the captured image, and determining whether a plurality of speed limit signs have been recognized from the captured image. If a plurality of speed limit signs are determined to have been recognized, then it is determined whether the plurality of speed limit signs include speed limit signs indicating the same speed limit present to the front-right and front-left of the ego vehicle. If the plurality of speed limit sign are determined to include speed limit signs including the same speed limit present to the front-right and front-left of the ego vehicle, then the speed limit indicated by the speed limit signs present to the front-right and front-left of the ego vehicle is recognized as being the speed limit for the ego vehicle.

Description

[Technical field]

[0001] The present invention relates to a speed limit recognition method and a speed limit recognition device. [Background technology]

[0002] The following Patent Document 1 describes a vehicle control device that selects one of a speed limit recognized based on an image acquired by an image acquisition means, a speed limit recognized based on map information, or a speed limit recognized based on communication with the outside, and performs driving control based on the selected speed limit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-014239 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when multiple speed limit signs are recognized from an image captured by a camera, the vehicle control device described in Patent Document 1 cannot select which speed limit sign's speed should be recognized as the speed limit. An object of the present invention is to improve the accuracy of recognizing a speed limit when multiple speed limit signs are recognized from an image captured by a camera. [Means for solving the problem]

[0005] In one embodiment of the speed limit recognition method of the present invention, a controller is caused to execute the following processes: acquiring an image representing the environment in front of the host vehicle from a camera; recognizing speed limit signs from the image; determining whether or not multiple speed limit signs have been recognized from the image; if it is determined that multiple speed limit signs have been recognized, determining whether or not the multiple speed limit signs include speed limit signs that are located on the right front and left front of the host vehicle and indicate the same speed limit; and if it is determined that the multiple speed limit signs include speed limit signs that are located on the right front and left front of the host vehicle and indicate the same speed limit, recognizing the speed limit indicated by the speed limit signs located on the right front and left front of the host vehicle as the speed limit of the host vehicle. Effect of the Invention

[0006] According to the present invention, it is possible to improve the recognition accuracy of the speed limit when a plurality of speed limit signs are recognized from an image captured by a camera. The objects and advantages of the invention will be realized and attained by means of the elements and combinations recited in the appended claims. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed. [Brief description of the drawings]

[0007] [Figure 1] 1 is a diagram showing an example of a schematic configuration of a vehicle equipped with a driving assistance device according to an embodiment; [Diagram 2] FIG. 2 is a diagram showing a part of the input device of FIG. [Diagram 3] FIG. 2 is an explanatory diagram of a first example of a situation in which a plurality of speed limit signs are recognized simultaneously; [Figure 4] FIG. 11 is an explanatory diagram of a second example of a situation in which a plurality of speed limit signs are recognized simultaneously. [Diagram 5] 4 is a flowchart of an example of a speed limit recognition method according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] (composition) 1 is a diagram showing an example of a schematic configuration of a vehicle equipped with a driving support device according to an embodiment. The driving support device 10 equipped in the vehicle 1 includes a sensor 11, a positioning device 12, a map database (map DB) 13, an in-vehicle device 14, a navigation system 15, a display device 16, a voice output device 17, an input device 18, a vehicle behavior control device 19, and a controller 20. These devices are connected to each other by, for example, a CAN (Controller Area Network) or other in-vehicle LAN in order to transmit and receive information to and from each other.

[0009] The sensor 11 detects the traveling state of the vehicle 1. For example, the sensor 11 includes cameras such as a front camera that captures an image in front of the vehicle 1, a rear camera that captures an image behind the vehicle 1, and a side camera that captures an image on the left and right sides of the vehicle 1. The sensor 11 also includes radars such as a front radar that detects an obstacle in front of the vehicle 1, a rear radar that detects an obstacle behind the vehicle 1, and a side radar that detects an obstacle on the left and right sides of the vehicle 1. The sensor 11 also includes a vehicle speed sensor that detects the speed of the vehicle 1, a touch sensor (capacitive sensor) that detects the holding of the steering wheel by an occupant (e.g., the driver), and an in-vehicle camera that captures an image of the occupant.

[0010] The positioning device 12 includes a GPS unit, a gyro sensor, a vehicle speed sensor, etc. The positioning device 12 detects radio waves transmitted from a plurality of satellite communications by the GPS unit, and periodically acquires position information of the vehicle 1. The positioning device 12 also detects the current position of the vehicle 1 based on the acquired position information of the vehicle 1, angle change information acquired from the gyro sensor, and vehicle speed acquired from the vehicle speed sensor.

[0011] The map database 13 is a memory that stores three-dimensional high-precision map information including position information of various facilities and specific points, and is accessible from the controller 20. The three-dimensional high-precision map information is three-dimensional map information based on road shapes detected when an actual road is traveled using a data acquisition vehicle. The three-dimensional high-precision map information is map information in which detailed and highly accurate position information such as curved roads and the magnitude of the curve (e.g., curvature or curvature radius), road junctions, branching points, toll gates, and positions where the number of lanes decreases is associated as three-dimensional information in addition to the map information. The 3D high precision map information also includes speed limit information indicating the speed limit of a road. The speed limit information may be information associated with a road or a lane and specifying the speed limit of the associated road or lane, or information on the installation position of a speed limit sign and the speed limit.

[0012] The in-vehicle devices 14 are various devices mounted on the vehicle 1 and are operated by the driver of the vehicle. Examples of such in-vehicle devices include a steering wheel, an accelerator pedal, a brake pedal, a turn signal, wipers, lights, a horn, and other specific switches. The navigation system 15 acquires current position information of the vehicle 1 from the positioning device 12, and displays the position of the vehicle 1 on a display or the like by superimposing the position of the vehicle 1 on map information for navigation. The navigation system 15 also has a navigation function that, when a destination is set, sets a route to the destination and guides the occupant along the set route. This navigation function displays the route on a map on the display and informs the occupant of the route by voice or the like. The route set by the navigation system 15 is also used by a route driving assistance function provided in the controller 20. The route driving assistance function is a function that causes the vehicle 1 to autonomously drive to the destination based on the set route.

[0013] The display device 16 includes various displays, such as a display provided in the navigation system 15, a display built into a rearview mirror, a display built into a meter section, a head-up display projected on the windshield, etc. The display device 16 notifies the occupant of various pieces of presented information under the control of the controller 20. The audio output device 17 is a device that outputs auditory information such as a speaker provided in the navigation system 15, a speaker of an audio device, a buzzer, etc. Under the control of the controller 20, the audio output device 17 notifies the occupant of various pieces of presentation information.

[0014] The input device 18 is, for example, a button switch that allows the occupant to manually input information, a touch panel arranged on a display screen, or a microphone that allows the occupant to input information by voice. By operating the input device 18, the occupant can input setting information for the presentation information presented by the display device 16 and the audio output device 17. 2 is a diagram showing a part of the input device 18 of this embodiment. The input device 18 may be, for example, a group of button switches arranged on the spokes of a steering wheel. The input device 18 is used when setting the on / off of an autonomous driving control function provided in the controller 20. The input device 18 includes a main switch 181, a resume / accelerate switch 182, a set / coast switch 183, a cancel switch 184, a vehicle distance adjustment switch 185, and a lane change assist switch 186.

[0015] The main switch 181 is a switch for turning on / off the autonomous driving control function of the controller 20. The resume / accelerate switch 182 is a switch for setting the autonomous driving control function to resume at the set speed before the autonomous driving control function was turned off after it was turned off, or for increasing the set speed. The set / coast switch 183 is a switch for starting the autonomous driving control function. To start the autonomous driving control function, the set / coast switch 183 is pressed after the autonomous driving control function is turned on by the main switch 181. The set / coast switch 183 is also a switch for lowering the set speed. The cancel switch 184 is a switch for canceling the autonomous driving control function. The vehicle distance adjustment switch 185 is a switch for setting the vehicle distance from the preceding vehicle. The lane change assistance switch 186 is a switch for instructing (agreeing to) start lane change when the controller 20 has confirmed with the occupant that the lane change should be started. 2, a turn signal lever of a turn signal or other switches of the in-vehicle device 14 can be used as the input device 18. For example, when the controller 20 suggests whether or not to automatically change lanes, if the occupant operates the turn signal lever, the vehicle will change lanes in the direction in which the turn signal lever was operated, rather than the suggested lane change.

[0016] The vehicle behavior control device 19 controls the vehicle behavior of the vehicle 1. For example, when the vehicle 1 travels at a constant speed at a set speed due to the autonomous driving control function, the vehicle behavior control device 19 controls the operation of the drive mechanism and the brake operation to realize the acceleration / deceleration and traveling speed so that the vehicle 1 reaches the set speed. In addition, the vehicle behavior control device 19 also controls the operation of the drive mechanism and the brake in the same manner when the vehicle 1 travels following a preceding vehicle due to the autonomous driving control function. Note that the operation control of the drive mechanism includes the operation of the internal combustion engine in an engine vehicle and the operation of the driving motor in an electric vehicle system. In addition, in a hybrid vehicle, it includes the torque distribution between the internal combustion engine and the driving motor. In addition, when the vehicle behavior control device 19 uses the autonomous driving control function to execute lane keeping control, lane change assistance function, overtaking assistance function, or route driving assistance function described below, it performs steering control of the vehicle 1 by controlling the operation of the steering actuator in addition to controlling the operation of the drive mechanism and brakes.

[0017] The controller 20 is one or more electronic control units (ECUs) for controlling the running of the vehicle 1, and includes a processor 21 and peripheral components such as a storage device 22. The processor 21 may be, for example, a central processing unit (CPU) or a micro-processing unit (MPU). The storage device 22 may include a semiconductor storage device, a magnetic storage device, an optical storage device, etc. The storage device 22 may include memories such as a register, a cache memory, a ROM (Read Only Memory) used as a main storage device, and a RAM (Random Access Memory). The functions of the controller 20 described below are realized, for example, by the processor 21 executing a computer program stored in the storage device 22. The controller 20 may be formed of dedicated hardware for executing each information processing described below. For example, the controller 20 may include a functional logic circuit set in a general-purpose semiconductor integrated circuit. For example, the controller 20 may include a programmable logic device (PLD) such as a field programmable gate array (FPGA).

[0018] The controller 20 realizes a driving information acquisition function for acquiring information about the driving state of the vehicle 1, and an autonomous driving control function for autonomously controlling the driving speed and / or steering of the vehicle 1. The driving information acquisition function of the controller 20 is a function for acquiring driving information about the driving state of the vehicle 1. For example, the controller 20 may acquire image information of the outside of the vehicle captured by the front camera, rear camera, and side camera of the sensor 11 as the driving information. The controller 20 also acquires detection results by the front radar, rear radar, and side radar as the driving information. Furthermore, the controller 20 also acquires vehicle speed information of the vehicle 1 detected by the vehicle speed sensor of the sensor 11 and image information of the face of the occupant captured by the in-vehicle camera as the driving information.

[0019] Furthermore, the controller 20 acquires current position information of the vehicle 1 from the positioning device 12 as the travel information. The controller 20 also acquires a set destination and a route to the destination from the navigation system 15 as the travel information. The controller 20 also acquires position information such as curved roads and the magnitude of the curve (e.g., curvature or curvature radius), merging points, branching points, toll gates, and positions where the number of lanes is reduced as the travel information from the map database 13 as the travel information. In addition, the controller 20 acquires operation information of the in-vehicle device 14 by the occupant from the in-vehicle device 14 as the travel information.

[0020] The autonomous driving control function of the controller 20 is a function that autonomously controls the driving of the vehicle 1 without relying on the operation of the occupant. The autonomous driving control function of the controller 20 includes an autonomous speed control function that autonomously controls the driving speed of the vehicle 1, and an autonomous steering control function that autonomously controls the steering of the vehicle 1. The autonomous speed control function and the autonomous steering control function of this embodiment will be described below. Note that in the present invention, it is sufficient for the autonomous driving control function to include only the autonomous speed control function, and the autonomous driving control function does not necessarily have to include the autonomous steering control function.

[0021] Autonomous speed control function The autonomous speed control function is a function that, when a preceding vehicle is detected, follows the preceding vehicle while performing vehicle distance control to maintain a distance according to the vehicle speed, with the upper limit set to the speed limit of the road on which vehicle 1 is traveling or the vehicle speed set by the occupant. On the other hand, when no preceding vehicle is detected, the autonomous speed control function performs constant speed driving at the speed limit of the road on which the vehicle 1 is traveling or at a speed set by the occupant. The former is also called inter-vehicle control, and the latter is also called constant speed control. The controller 20 may include a function of recognizing the speed limit of the road on which the vehicle is traveling from road signs using the sensor 11, or recognizing the speed limit from map information in the map database 13, and automatically setting the speed limit as the set vehicle speed. The method of recognizing the speed limit will be described later.

[0022] The constant speed control is executed when the forward radar of the sensor 11 or the like detects that there is no preceding vehicle ahead in the own lane. In the constant speed control, the vehicle behavior control device 19 controls the operation of the drive mechanisms such as the engine and brakes while feeding back the vehicle speed data from the vehicle speed sensor so as to maintain the set traveling speed. The vehicle distance control is executed when the forward radar of the sensor 11 detects the presence of a preceding vehicle ahead in the own lane. In the vehicle distance control, the vehicle behavior control device 19 controls the operation of the drive mechanisms such as the engine and brakes while feeding back the vehicle distance data detected by the forward radar so as to maintain the set vehicle distance with the set travel speed as the upper limit.

[0023] Autonomous steering control function The autonomous steering control function is a function that executes steering control of the vehicle 1 by controlling the operation of the steering actuator. The autonomous steering control function includes, for example, a lane keeping function, a lane change assist function, an overtaking assist function, and a route driving assist function. The lane keeping function is a function that assists the occupant in steering the vehicle by controlling the steering actuator so that the vehicle stays in the center of the lane, for example.

[0024] When the set / coast switch 183 is pressed after the autonomous driving control function is turned on by the main switch 181, the controller 20 judges whether or not a predetermined autonomous driving control start condition is satisfied. If it is judged that the autonomous driving control start condition is satisfied, the controller 20 executes the lane keeping function of the autonomous steering control function. Alternatively, when an autonomous driving control start condition is satisfied after the autonomous driving control function is turned on by the main switch 181, the controller 20 waits for the set / coast switch 183 to be pressed. When the set / coast switch 183 is pressed, the controller 20 starts the autonomous driving control and executes the lane keeping function of the autonomous steering control function.

[0025] Lane change assistance function The lane change assist function turns on the turn signal when the driver operates the turn signal lever, and when a predetermined lane change start condition is met, starts a lane change operation, which is a series of processes for changing lanes on a vehicle. The lane change assist function determines whether or not the predetermined lane change start condition is met based on various driving information acquired by the driving information acquisition function. The lane change assist function starts a lane change operation when the lane change start conditions are met. In the lane change operation, the vehicle 1 is moved laterally to the adjacent lane, and when the movement to the adjacent lane is completed, the turn signal is turned off and the lane keeping function in the adjacent lane is started.

[0026] Overtaking Assistance Function The overtaking support function presents overtaking information to the occupant via the display device 16 when there is a preceding vehicle slower than the vehicle 1 ahead in the own lane and when a predetermined overtaking suggestion condition is satisfied. Here, the overtaking information is information for suggesting to the occupant to overtake the preceding vehicle. When the occupant accepts the overtaking information presented by operating the lane change support switch 186 of the input device 18 and a preset overtaking start condition is satisfied, the overtaking support function turns on the turn signal and starts the above-mentioned lane change operation. Based on various driving information acquired by the driving information acquisition function, the overtaking support function judges whether the overtaking suggestion condition and the overtaking start condition are satisfied.

[0027] Route driving support function The route driving assistance function presents route driving information on the display device 16 and suggests a lane change to the driving direction change point when a branch point, junction point, exit, toll gate, or other driving direction change point exists on the set route, the distance to the driving direction change point is within a predetermined distance, and predetermined route driving suggestion conditions are satisfied. In addition, the route driving assistance function starts a lane change operation when the lane change suggestion is accepted by operating the lane change assistance switch 186 and predetermined route driving start conditions are satisfied. The route driving assistance function determines whether or not the route driving suggestion conditions and the route driving start conditions are met based on various driving information acquired by the driving information acquisition function.

[0028] How to recognize the speed limit As described above, the controller 20 recognizes the speed limit of the road on which the vehicle is traveling from road signs using the sensor 11, or recognizes the speed limit from map information in the map database 13, and uses the recognized speed limit as the set vehicle speed for the autonomous speed control function. The controller 20 also displays the recognized speed limit on the display device 16. For example, the speed limit may be displayed on a display incorporated in the meter section or a head-up display projected on the windshield.

[0029] When recognizing the speed limit, the controller 20 acquires an image showing the environment ahead of the vehicle 1 from the front camera of the sensor 11, which is a camera that captures the environment ahead of the vehicle 1. The controller 20 recognizes the speed limit sign from the acquired image and estimates the distance from the vehicle 1 to the speed limit sign. The distance from the vehicle 1 to the speed limit sign can be estimated, for example, by detecting the coordinates of the grounding position of the support structure of the speed limit sign from the image.

[0030] The controller 20 excludes from the recognition result of the speed limit sign any speed limit sign that is located far from the vehicle 1. For example, the controller 20 excludes from the recognition result any speed limit sign that is located farther from the vehicle 1 than a threshold distance. Then, the controller 20 judges whether or not a speed limit sign is recognized from the captured image after excluding the speed limit sign located far from the vehicle 1. That is, it judges whether or not a speed limit sign other than the speed limit sign located far from the vehicle 1 is recognized from the captured image. If a speed limit sign is recognized from the captured image, the speed limit indicated by the speed limit sign recognized from the captured image is recognized as the speed limit of the road on which the vehicle 1 is traveling. If a speed limit sign is not recognized from the captured image, the speed limit of the road on which the vehicle 1 is traveling is recognized based on the speed limit information included in the three-dimensional high-precision map information. For example, the speed limit stored in the three-dimensional high-precision map information in association with the road on which the vehicle 1 is traveling may be recognized as the speed limit of the road on which the vehicle 1 is traveling.

[0031] There are cases where multiple speed limit signs are recognized simultaneously from a captured image. Fig. 3 is an explanatory diagram of a first example of a situation where multiple speed limit signs are recognized simultaneously. 3 illustrates a situation in which a plurality of roads, including a first road R1 and a second road R2, are parallel to one another, and a vehicle 1 is traveling on the first road R1. For example, the first road R1 is a freeway in the United States, and the second road R2 is an expressway. Speed ​​limit signs 31 and 32 on the first road R1 indicate a relatively low speed limit (55 miles per hour in the example of FIG. 3), and speed limit signs 33 and 34 on the second road R2 indicate a relatively high speed limit (65 miles per hour in the example of FIG. 3).

[0032] In such a case, the speed limit signs 31 and 32 on the first road R1 and the speed limit signs 33 and 34 on the second road R2 may be recognized simultaneously from the captured image. That is, the multiple speed limit signs recognized simultaneously from the captured image may indicate multiple different speed limits (55 miles per hour and 65 miles per hour in the example of FIG. 3). When multiple speed limit signs are recognized simultaneously from a captured image in this manner, there is a risk that a sign that is not a speed limit sign for the road on which vehicle 1 is traveling may be mistakenly recognized as a speed limit sign for the road on which vehicle 1 is traveling.

[0033] In the example of Figure 3, there is a risk that the 65 mph speed limit indicated by speed limit signs 33 and 34 on the second road R2, which is not the road on which vehicle 1 is traveling, will be mistakenly recognized as the speed limit for the road on which vehicle 1 is traveling. Therefore, the controller 20 determines whether or not multiple speed limit signs have been recognized from the captured image, and if it is determined that multiple speed limit signs have been recognized, it determines whether or not the recognized multiple speed limit signs include speed limit signs indicating the same speed limit that are located to the right and left front of the vehicle 1.

[0034] In the example of Fig. 3, the controller 20 determines that a plurality of speed limit signs 31-34 have been recognized from the captured image. The controller 20 then determines that the plurality of speed limit signs 31-34 include speed limit signs 31 and 32 that are located on the right front and left front of the vehicle 1, respectively, and indicate the same speed limit (55 miles per hour in the example of Fig. 3). The speed limit signs 31 and 32 do not necessarily have to be located on the left and right road edges of the first road R1. The speed limit signs 31 and 32 may be detected, for example, at coordinates to the right and left of the lateral center of the captured image.

[0035] When it is determined that the multiple speed limit signs include speed limit signs indicating the same speed limit located respectively to the right front and left front of the vehicle 1, the controller 20 recognizes the speed limit indicated by the speed limit signs located respectively to the right front and left front of the vehicle 1 as the speed limit of the road on which the vehicle 1 is traveling. In the example of FIG. 3, the speed limit of 55 miles per hour indicated by speed limit signs 31 and 32 is recognized as the speed limit for road No. 1 R1. This makes it possible to prevent the vehicle 1 from mistakenly recognizing the speed limit indicated by the speed limit sign of an adjacent road as the speed limit of the road on which the vehicle 1 is traveling, in a section where multiple roads are adjacent to each other.

[0036] FIG. 4 is a diagram illustrating a second example of a situation in which multiple speed limit signs are recognized simultaneously. In the example of Fig. 4, multiple speed limit signs 35 and 36 are installed close to each other to form a group of speed limit signs. When multiple speed limit signs are installed close to each other in this manner, the multiple speed limit signs may include, for example, a speed limit sign indicating the speed limit for a specific type of vehicle and a speed limit sign indicating the speed limit for other types of vehicles. Also, they may include a speed limit sign indicating a maximum speed and a speed limit sign indicating a minimum speed. In the example of Fig. 4, a speed limit sign 36 indicating the speed limit for trucks (40 miles per hour in the example of Fig. 4) and a speed limit sign 35 indicating the speed limit for vehicles other than trucks (55 miles per hour in the example of Fig. 4) are installed close to each other.

[0037] In such a case, a plurality of speed limit signs 35 and 36 each indicating a plurality of different speeds may be recognized simultaneously from the captured image. In this case, there is a risk that the speed indicated by the speed limit sign 36, which indicates the speed limit for a specific type of vehicle different from the vehicle 1, is recognized as the speed limit for the vehicle 1. Alternatively, there is a risk that the speed indicated by the speed limit sign indicating the minimum speed is recognized as the maximum speed limit for the vehicle 1.

[0038] Therefore, the controller 20 determines that multiple speed limit signs have been recognized from the captured image, and if the recognized multiple speed limit signs do not include speed limit signs indicating the same speed limit that are located to the right and left front of the vehicle 1, it determines whether the recognized multiple speed limit signs include a group of speed limit signs that are close to each other. If the controller 20 determines that the recognized multiple speed limit signs include a group of speed limit signs that are close to each other, it recognizes the highest speed among the speeds indicated by the group of speed limit signs that are close to each other as the speed limit of the road on which the vehicle 1 is traveling. In the example of Figure 4, of the speed indicated by speed limit sign 35 (55 miles per hour) and the speed indicated by speed limit sign 36 (40 miles per hour), the highest speed of 55 miles per hour is recognized as the speed limit of the road on which vehicle 1 is traveling. This makes it possible to avoid mistaking the speed limit of a specific type of vehicle different from vehicle 1 for the speed limit of vehicle 1 when multiple speed limit signs are installed close to each other. It also makes it possible to avoid mistaking the speed indicated by a speed limit sign indicating the minimum speed for the maximum speed of vehicle 1.

[0039] The controller 20 may determine whether the speed limit signs are a group of speed limit signs close to each other depending on whether the speed limit signs are within a predetermined distance range. The predetermined distance may be set appropriately according to the rules and standards for installing road signs. For example, the predetermined distance may be 3 m. For example, the controller 20 may sequentially select multiple recognized speed limit signs, and using the selected speed limit sign as a reference, extract all speed limit signs that are within a specified distance in the left-right, front-back, and up-down directions from the reference speed limit sign as a group of speed limit signs that are close to each other.

[0040] If the recognized multiple speed limit signs do not include speed limit signs indicating the same speed limit that are located on the right front and left front of the vehicle 1, and do not include a group of speed limit signs that are close to each other, the controller 20 recognizes the speed limit indicated by the speed limit sign located in a predetermined direction, either the right front or the left front of the vehicle 1, as the speed limit of the road on which the vehicle 1 is traveling. For example, the speed limit indicated by the speed limit sign located on the right front is recognized as the speed limit of the road on which the vehicle 1 is traveling. When there are multiple speed limit signs in a given direction, the speed limit indicated by the closest speed limit sign is recognized as the speed limit for the road on which the vehicle 1 is traveling. Alternatively, the controller 20 may recognize the speed limit indicated by the closest speed limit sign among a plurality of speed limit signs as the speed limit of the road on which the vehicle 1 is traveling. In the above description, the controller 20 determines whether the recognized multiple speed limit signs include speed limit signs that are located on the right front and the left front of the vehicle 1 and indicate the same speed limit, and if the recognized multiple speed limit signs do not include speed limit signs that are located on the right front and the left front of the vehicle 1 and indicate the same speed limit, determines whether the recognized multiple speed limit signs include a group of speed limit signs that are close to each other, but the present invention does not limit the determination order. For example, if the recognized multiple speed limit signs do not include a group of speed limit signs that are close to each other, the controller 20 may determine whether the recognized multiple speed limit signs include speed limit signs that are located on the right front and the left front of the vehicle 1 and indicate the same speed limit, or may recognize the speed limit by comprehensively determining whether the recognized multiple speed limit signs include speed limit signs that are located on the right front and the left front of the vehicle 1 and whether the recognized multiple speed limit signs include a group of speed limit signs that are close to each other.

[0041] (operation) FIG. 5 is a flowchart of an example of a speed limit recognition method according to the embodiment. In step S1, the controller 20 obtains a captured image showing the environment in front of the vehicle 1 from the front camera of the sensor 11. In step S2, the controller 20 recognizes a speed limit sign from the acquired captured image. In step S3, the controller 20 excludes speed limit signs that are located far away from the vehicle 1 from the speed limit sign recognition result.

[0042] In step S4, the controller 20 determines whether or not a speed limit sign is recognized from the captured image. That is, it determines whether or not a speed limit sign other than a speed limit sign located far from the vehicle 1 is recognized from the captured image. If a speed limit sign is recognized from the captured image (step S4: Y), the process proceeds to step S6. If a speed limit sign is not recognized from the captured image (step S4: N), the process proceeds to step S5. In step S5, the controller 20 recognizes the speed limit of the road on which the vehicle 1 is traveling based on the speed limit information included in the three-dimensional high-precision map information, and then the process ends.

[0043] In step S6, the controller 20 determines whether or not multiple speed limit signs have been recognized. If multiple speed limit signs have been recognized (step S6: Y), the process proceeds to step S8. If only a single speed limit sign has been recognized (step S6: N), the process proceeds to step S7. In step S7, the controller 20 recognizes the speed limit indicated by the recognized single speed limit sign as the speed limit of the road on which the vehicle 1 is traveling. Then, the process ends.

[0044] In step S8, the controller 20 determines whether the recognized multiple speed limit signs include speed limit signs indicating the same speed limit that are located on the right front and the left front of the vehicle 1. If the recognized multiple speed limit signs do not include these speed limit signs (step S8: N), the process proceeds to step S10. If the recognized multiple speed limit signs include these speed limit signs (step S8: Y), the process proceeds to step S9. In step S9, the controller 20 recognizes the speed limit indicated by the speed limit signs present on the right and left front of the vehicle 1 as the speed limit of the road on which the vehicle 1 is traveling. Then, the process ends.

[0045] In step S10, the controller 20 determines whether the recognized multiple speed limit signs include a group of speed limit signs that are close to each other. If the recognized multiple speed limit signs do not include a group of speed limit signs that are close to each other (step S10: N), the process proceeds to step S12. If the recognized multiple speed limit signs include a group of speed limit signs that are close to each other (step S10: Y), the process proceeds to step S11. In step S11, the controller 20 recognizes the highest speed among the speeds indicated by a group of speed limit signs that are close to each other as the speed limit of the road on which the vehicle 1 is traveling, and then the process ends. In step S12, the controller 20 recognizes the speed limit indicated by a speed limit sign in a predetermined direction, either the right front or the left front of the vehicle 1, as the speed limit of the road on which the vehicle 1 is traveling. Then, the process ends.

[0046] (Effects of the embodiment) (1) The controller 20 acquires an image showing the environment ahead of the vehicle 1 from the camera, recognizes speed limit signs from the image, determines whether or not multiple speed limit signs have been recognized from the image, and if it is determined that multiple speed limit signs have been recognized, determines whether or not the recognized multiple speed limit signs include speed limit signs that are located to the right front and left front of the vehicle 1 and indicate the same speed limit. death If it is determined that the multiple recognized speed limit signs include speed limit signs indicating the same speed limit that are located on the right front and left front of vehicle 1, the speed limit indicated by the speed limit signs located on the right front and left front of vehicle 1 is recognized as the speed limit of the road on which vehicle 1 is traveling. This makes it possible to prevent the vehicle 1 from mistakenly recognizing the speed limit indicated by the speed limit sign of an adjacent road as the speed limit of the road on which the vehicle 1 is traveling, in a section where multiple roads are adjacent to each other.

[0047] (2) If the controller 20 determines that the recognized multiple speed limit signs do not include speed limit signs indicating the same speed limit that are located to the right and left front of the vehicle 1, it may determine whether the recognized multiple speed limit signs include a group of speed limit signs that are close to each other, and if it determines that the recognized multiple speed limit signs include a group of speed limit signs that are close to each other, it may recognize the highest speed among the speeds indicated by the group of speed limit signs as the speed limit of the road on which the vehicle 1 is traveling. This makes it possible to avoid mistaking the speed limit of a specific type of vehicle different from vehicle 1 for the speed limit of vehicle 1 when multiple speed limit signs are installed close to each other. It also makes it possible to avoid mistaking the speed indicated by a speed limit sign indicating the minimum speed for the maximum speed of vehicle 1.

[0048] (3) The controller 20 may select one of the recognized multiple speed limit signs as a reference, determine whether or not the other speed limit signs of the recognized multiple speed limit signs are present within a predetermined distance range from the reference speed limit sign, and if it determines that the other speed limit signs are present within a predetermined distance range from the reference speed limit sign, extract the reference speed limit sign and the other speed limit sign as speed limit signs included in a group of speed limit signs that are close to each other. This makes it possible to determine whether the recognized multiple speed limit signs include a group of speed limit signs that are close to each other.

[0049] All examples and conditional terms described herein are intended for educational purposes to help the reader understand the present invention and the concepts provided by the inventor for the advancement of technology, and should be interpreted without being limited to the above specifically described examples and conditions, and the configuration of the examples in this specification with respect to showing the advantages and disadvantages of the present invention. Although the embodiments of the present invention have been described in detail, it should be understood that various changes, substitutions and modifications can be made thereto without departing from the spirit and scope of the present invention. [Explanation of symbols]

[0050] 1 ... vehicle, 10 ... driving assistance device, 11 ... sensor, 12 ... positioning device, 13 ... map database, 14 ... in-vehicle equipment, 15 ... navigation system, 16 ... display device, 17 ... audio output device, 18 ... input device, 19 ... vehicle behavior control device, 20 ... controller, 21 ... processor, 22 ... storage device

Claims

1. A process of acquiring an image representing an environment in front of the host vehicle from a camera; A process of recognizing a speed limit sign from the captured image acquired by the camera; A process of determining whether or not a plurality of speed limit signs are recognized from the captured image acquired from the camera; a process of determining whether the multiple speed limit signs include speed limit signs indicating the same speed limit detected at coordinates to the right of the lateral center of the image acquired from the camera and at coordinates to the left of the lateral center of the image acquired from the camera when it is determined that the multiple speed limit signs have been recognized; a process of recognizing the speed limit indicated by the speed limit signs respectively located on the right front and the left front of the vehicle as the speed limit of the road on which the vehicle is traveling, when it is determined that the multiple speed limit signs include speed limit signs respectively located on the right front and the left front of the vehicle and indicating the same speed limit; a process of determining whether the plurality of speed limit signs includes a group of speed limit signs located close to each other when it is determined that the plurality of speed limit signs does not include speed limit signs that are located on the right front and the left front of the vehicle and indicate the same speed limit; when it is determined that the plurality of speed limit signs includes a group of speed limit signs that are close to each other, the controller recognizes the highest speed among the speeds indicated by the group of speed limit signs as the speed limit of the road on which the host vehicle is traveling; A speed limit recognition method, wherein the host vehicle is a vehicle other than a specific type to which a relatively low speed limit is applied among a plurality of types of vehicles having different speed limits.

2. A process of selecting a speed limit sign from the plurality of speed limit signs; determining whether any other speed limit sign of the plurality of speed limit signs is present within a predetermined distance from any one of the speed limit signs; a process of extracting the one speed limit sign and the other speed limit sign as speed limit signs included in the group of speed limit signs that are close to each other when it is determined that the other speed limit sign is present within a predetermined distance range from the one speed limit sign; 2. The method for recognizing a speed limit according to claim 1, wherein the controller executes the following steps.

3. A camera that captures an image of the environment in front of the vehicle; A process for recognizing a speed limit sign from a captured image acquired from the camera, a process for determining whether or not a plurality of speed limit signs have been recognized from the captured image acquired from the camera, a process for determining whether or not the plurality of speed limit signs include speed limit signs that indicate the same speed limit detected at coordinates to the right of the lateral center of the captured image acquired from the camera and at coordinates to the left of the lateral center of the captured image acquired from the camera when it is determined that the plurality of speed limit signs include speed limit signs that indicate the same speed limit that are located respectively to the right and left front of the vehicle, and a process for detecting the speed limit signs that indicate the same speed limit detected at coordinates to the right of the lateral center of the captured image acquired from the camera and at coordinates to the left of the lateral center of the captured image when it is determined that the plurality of speed limit signs include speed limit signs that indicate the same speed limit that are located respectively to the right and left front of the vehicle. a controller that executes a process of recognizing the speed limit indicated by the speed limit signs respectively located ahead and to the left and right front of the host vehicle as the speed limit of the road on which the host vehicle is traveling; a process of determining whether the multiple speed limit signs include a group of speed limit signs that are close to each other when it is determined that the multiple speed limit signs do not include speed limit signs respectively located to the right and left front of the host vehicle that indicate the same speed limit; and a process of recognizing the highest speed among the speeds indicated by the group of speed limit signs as the speed limit of the road on which the host vehicle is traveling when it is determined that the multiple speed limit signs include a group of speed limit signs that are close to each other, A speed limit recognition device, wherein the host vehicle is a vehicle other than a specific type of vehicle to which a relatively low speed limit is applied among a plurality of types of vehicles having different speed limits.

4. 3. The speed limit recognition method according to claim 1, further comprising: causing the controller to execute a process of determining whether the plurality of speed limit signs include speed limit signs indicating the same speed limit that are located on a road edge to the right of the vehicle and on the right side of the road on which the vehicle is traveling, and on a road edge to the left of the vehicle and on the left side of the road on which the vehicle is traveling.

5. 4. The speed limit recognition device according to claim 3, wherein the controller executes a process to determine whether the plurality of speed limit signs include speed limit signs indicating the same speed limit that are located on a road edge to the right of the vehicle and on the right side of the road on which the vehicle is traveling, and on a road edge to the left of the vehicle and on the left side of the road on which the vehicle is traveling.

6. 5. The speed limit recognition method according to claim 1, 2 or 4, characterized in that, when the multiple speed limit signs do not include a group of speed limit signs that are close to each other, the method causes the controller to execute a process of recognizing the speed limit indicated by the speed limit sign closest to the vehicle among multiple speed limit signs located in a predetermined direction, which is either a predetermined direction to the right front or left front of the vehicle, as the speed limit of the road on which the vehicle is traveling.

7. 6. The speed limit recognition device according to claim 3 or 5, characterized in that, when the multiple speed limit signs do not include a group of speed limit signs that are close to each other, the controller executes a process of recognizing the speed limit indicated by the speed limit sign closest to the host vehicle among multiple speed limit signs located in a predetermined direction, which is either a predetermined direction to the right front or left front of the host vehicle, as the speed limit of the road on which the host vehicle is traveling.

Images