Speed limit recognition method and speed limit recognition device
By using a controller to determine the location and type of speed limit signs in the camera image, the recognition error under multiple speed limit signs is resolved, and the accuracy of speed limit recognition is improved.
Patent Information
- Application Number
- CN202180098544.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-05-28
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2041-05-28
AI Technical Summary
Existing technology cannot select the correct speed limit sign for identification when multiple speed limit signs are identified in the images captured by the camera.
The controller determines whether there are multiple speed limit signs in the image captured by the camera, and determines whether these signs represent the same speed limit on the right front and left front of the vehicle, and then selects the correct speed limit sign for recognition.
It improves recognition accuracy in situations with multiple speed limit signs and avoids misrecognition of speed limit signs on adjacent roads or for different types of vehicles.
Smart Images

Figure CN117396386B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a speed limit recognition method and a speed limit recognition device. Background Technology
[0002] Patent Document 1 describes a vehicle control device that selects any one of the following speed limits: a speed limit identified based on an image acquired by an image acquisition unit, a speed limit identified based on map information, and a speed limit identified based on communication with an external source, and performs driving control based on the selected speed limit.
[0003] Existing technical documents
[0004] Patent documents
[0005] Patent Document 1: Japanese Patent Application Publication No. 2021-014239 Summary of the Invention
[0006] The technical problem that the invention aims to solve
[0007] However, the vehicle control device described in Patent Document 1 cannot select which speed limit sign indicates as the speed limit when multiple speed limit signs are identified from the captured images obtained by the camera.
[0008] The purpose of this invention is to improve the accuracy of speed limit recognition when multiple speed limit signs are identified from images captured by a camera.
[0009] Technical solutions for solving technical problems
[0010] In one aspect of the speed limit recognition method of the present invention, the controller performs the following processes: acquiring a captured image of the environment in front of the vehicle from a camera; recognizing speed limit signs from the captured image; determining whether multiple speed limit signs are recognized from the captured image; if multiple speed limit signs are recognized, determining whether the multiple speed limit signs include speed limit signs representing the same speed limit that are respectively located at the front right and front left of the vehicle; if multiple speed limit signs are determined to include speed limit signs representing the same speed limit that are respectively located at the front right and front left of the vehicle, recognizing the speed limit represented by the speed limit signs located at the front right and front left of the vehicle as the speed limit of the vehicle.
[0011] The effects of the invention
[0012] According to the present invention, the accuracy of speed limit recognition can be improved when multiple speed limit signs are identified from images captured by a camera.
[0013] The objects and advantages of this invention are embodied and realized by means of the main components and combinations thereof shown in the claims. It should be understood that both the general description and the following detailed description are merely illustrative and explanatory, and are not intended to limit the invention to the scope of the claims. Attached Figure Description
[0014] Figure 1 This is a diagram illustrating an example of the configuration of a vehicle equipped with a driving assistance device according to an embodiment.
[0015] Figure 2 It means Figure 1 A diagram of a portion of the input device.
[0016] Figure 3 This is an illustration of the first example of a situation where multiple speed limit signs are recognized simultaneously.
[0017] Figure 4 This is a second illustration of a situation where multiple speed limit signs are recognized simultaneously.
[0018] Figure 5 This is a flowchart of an example of a speed limit recognition method implemented. Detailed Implementation
[0019] (constitute)
[0020] Figure 1 This diagram illustrates an example of the configuration of a vehicle equipped with a driver assistance device according to an embodiment. The driver assistance device 10 mounted on vehicle 1 includes: a sensor 11, a positioning device 12, a map database (DB) 13, an in-vehicle device 14, a navigation system 15, a display device 16, a voice output device 17, an input device 18, a vehicle behavior control device 19, and a controller 20. These devices are connected, for example, via CAN (Controller Area Network) or other in-vehicle LANs to receive and transmit information to each other.
[0021] Sensor 11 detects the driving status of vehicle 1. For example, sensor 11 includes cameras such as a front camera that captures images of the front of vehicle 1, a rear camera that captures images of the rear of vehicle 1, and side cameras that capture images of the left and right sides of vehicle 1. In addition, sensor 11 includes radar such as a front radar that detects obstacles in front of vehicle 1, a rear radar that detects obstacles behind vehicle 1, and side radar that detects obstacles present on the left and right sides of vehicle 1. Furthermore, sensor 11 includes a vehicle speed sensor that detects the vehicle speed, a touch sensor (capacitive sensor) that detects the occupant's (e.g., driver's) holding of the steering wheel, and an in-vehicle camera that captures images of the occupant.
[0022] The positioning device 12 includes a GPS unit, a gyroscope sensor, and a vehicle speed sensor. The positioning device 12 detects radio waves transmitted via multiple satellite communications using the GPS unit and periodically acquires the location information of the vehicle 1. Furthermore, the positioning device 12 detects the current position of the vehicle 1 based on the acquired location information, the angle change information obtained from the gyroscope sensor, and the vehicle speed obtained from the vehicle speed sensor.
[0023] Map database 13 is a storage device that stores high-precision 3D map information, including location information of various facilities or designated locations, and is accessible to controller 20. The high-precision 3D map information is based on the road shape detected by a data acquisition vehicle while it is driving on actual roads. Both the high-precision 3D map information and the map information are map information that incorporates detailed and high-precision location information such as curves and their curvature (e.g., curvature or radius of curvature), merging points, branching points, toll booths, and lane reduction locations as 3D information.
[0024] In addition, the 3D high-precision map information includes speed limit information indicating road speed limits. This speed limit information can be, for example, information specifying the speed limit for a particular road or lane, or information about the location of speed limit signs and the corresponding speed limit.
[0025] The vehicle-mounted equipment 14 refers to various devices installed on the vehicle 1 that operate through the operation of the occupants. Examples of such vehicle-mounted equipment include a steering wheel, accelerator pedal, brake pedal, turn indicators, windshield wipers, headlights, horn, and other designated switches.
[0026] The navigation system 15 obtains the current location information of the vehicle 1 from the positioning device 12, overlays the location of the vehicle 1 onto a navigation map, and displays it on a display or similar device. Furthermore, the navigation system 15 also has a navigation function that, given a set destination, sets a route to that destination and guides the occupants along the set route. This navigation function displays the route on a map on the display and informs the occupants of the route via voice or other means. The route set by the navigation system 15 can also be utilized in the route driving assistance function of the controller 20. The route driving assistance function enables the vehicle 1 to automatically drive to its destination based on a pre-set route.
[0027] Display devices 16 include, for example, the display of the navigation system 15, the display mounted on the rearview mirror, the display mounted on the instrument panel, and a head-up display projected onto the windshield, among other types of displays. Display devices 16, under the control of controller 20, provide various prompts and information to the occupants.
[0028] The voice output device 17 is a device in the navigation system 15 that outputs auditory information, such as a speaker, an audio device speaker, and a buzzer. Under the control of the controller 20, the voice output device 17 provides various prompts to the occupants.
[0029] The input device 18 may be a push-button switch that can be manually operated by the occupant, a touch panel configured on the display interface, or a microphone that can be used for voice input by the occupant. By operating the input device 18, the occupant can input setting information corresponding to the prompts provided by the display device 16 or the voice output device 17.
[0030] Figure 2 This diagram shows a portion of the input device 18 according to this embodiment. The input device 18 may be, for example, a set of push-button switches arranged on the spokes of a steering wheel. The input device 18 is used to activate / deactivate the automatic driving control function provided by the setting controller 20. The input device 18 includes: a main switch 181, a resume / accelerate switch 182, a set / coast switch 183, a cancel switch 184, a distance adjustment switch 185, and a lane change assist switch 186.
[0031] The main switch 181 is used to activate / deactivate the automatic driving control function of the controller 20. The resume / accelerate switch 182 is used to restart the automatic driving control function at the set speed before deactivation, or to increase the set speed, after the automatic driving control function has been deactivated. The set / coast switch 183 is used to activate the automatic driving control function. To activate the automatic driving control function, after activating it via the main switch 181, press the set / coast switch 183. Additionally, the set / coast switch 183 is used to decrease the set speed. The cancel switch 184 is used to deactivate the automatic driving control function. The distance adjustment switch 185 is used to set the distance to the vehicle in front. The lane change assist switch 186 is used to instruct (agre) to initiate a lane change when the controller 20 confirms lane change with the occupants.
[0032] It should be noted that, in addition to Figure 2 In addition to the button switch group shown, the direction indicator stalk of the direction indicator or other switches of the vehicle equipment 14 can also be used as input devices 18. For example, if the controller 20 proposes whether to automatically change lanes, when the occupant operates the direction indicator stalk, a lane change is performed in the direction the direction indicator stalk was operated, instead of the proposed lane change.
[0033] The vehicle behavior control device 19 controls the vehicle behavior of vehicle 1. For example, when vehicle 1 is traveling at a set speed using the automatic driving control function, the vehicle behavior control device 19 controls the operation of the drive mechanism used to achieve acceleration / deceleration and travel speed, as well as the operation of the brakes, to maintain vehicle 1 at the set speed. Similarly, when vehicle 1 is following a vehicle in front using the automatic driving control function, the vehicle behavior control device 19 also controls the operation of the drive mechanism and the brakes. It should be noted that the control of the drive mechanism's operation includes the operation of the internal combustion engine in engine vehicles, and the operation of the drive motor in electric vehicles. Furthermore, in hybrid vehicles, it includes the torque distribution between the internal combustion engine and the drive motor.
[0034] In addition, when the vehicle behavior control device 19 performs lane keeping control, lane change assist, overtaking assist or route driving assist functions as described later through the automatic driving control function, in addition to controlling the action of the drive mechanism and brakes, it also performs steering control of the vehicle 1 by controlling the action of the steering actuator.
[0035] The controller 20 is one or more electronic control units (ECUs) used to control the movement of the vehicle 1, including a processor 21 and peripheral components such as a storage device 22. The processor 21 can be, for example, a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The storage device 22 can be a semiconductor storage device, a magnetic storage device, an optical storage device, etc. The storage device 22 may include registers, cache memory, and memory such as ROM (Read Only Memory) and RAM (Random Access Memory) used as main storage.
[0036] The functions of the controller 20 described below are implemented, for example, by the processor 21 executing a computer program stored in the storage device 22.
[0037] It should be noted that the controller 20 may also be formed by dedicated hardware for performing the various information processing described below. For example, the controller 20 may have functional logic circuits configured in general-purpose semiconductor integrated circuits. For example, the controller 20 may also have a programmable logic device (PLD) such as a field-programmable gate array (FPGA).
[0038] The controller 20 performs a driving information acquisition function to obtain information related to the driving state of the vehicle 1, and an automatic driving control function to automatically control the driving speed and / or steering of the vehicle 1. The driving information acquisition function of the controller 20 is to acquire driving information related to the driving state of the vehicle 1. For example, the controller 20 can acquire image information of the vehicle's exterior captured by the front, rear, and side cameras of the sensor 11 as driving information. Additionally, the controller 20 acquires the detection results based on the front, rear, and side radars as driving information. Furthermore, the controller 20 acquires vehicle speed information detected by the vehicle speed sensor of the sensor 11, or acquires image information of the occupants' faces captured by the in-vehicle camera as driving information.
[0039] In addition, the controller 20 obtains the current location information of the vehicle 1 from the positioning device 12 as driving information. Furthermore, the controller 20 obtains the set destination and the route to the destination from the navigation system 15 as driving information. Additionally, as driving information, the controller 20 obtains location information from the map database 13, such as curves and their curvature (e.g., curvature or radius of curvature), merging points, branching points, toll booths, and lane reduction locations. Moreover, the controller 20 obtains occupant operation information on the on-board device 14 as driving information.
[0040] The automatic driving control function of the controller 20 is a function that automatically controls the movement of the vehicle 1 without relying on occupant operation. The automatic driving control function of the controller 20 includes: an automatic speed control function that automatically controls the speed of the vehicle 1, and an automatic steering control function that automatically controls the steering of the vehicle 1. The automatic speed control function and the automatic steering control function of this embodiment will be described below. It should be noted that in this invention, the automatic driving control function only needs to include the automatic speed control function; the automatic driving control function does not necessarily need to include the automatic steering control function.
[0041] Automatic speed control function
[0042] The automatic speed control function is a function that detects the vehicle in front and uses the speed limit of the road in which the vehicle 1 is traveling, or the speed set by the occupants, as the upper limit to ensure the vehicle distance is maintained in a way that corresponds to the vehicle speed, and follows the vehicle in front.
[0043] On the other hand, when no vehicle is detected ahead, the automatic speed control function maintains a constant speed based on the speed limit of the road on which vehicle 1 is traveling, or the speed set by the occupants. The former is also known as distance control, and the latter is also known as speed control.
[0044] The controller 20 may also include the function of identifying the speed limit of the road in motion from road signs using the sensor 11, or identifying the speed limit from map information in the map database 13, and automatically setting the speed limit to the set speed. The method for identifying the speed limit will be described later.
[0045] When the forward radar or other sensors of sensor 11 detect that there is no vehicle ahead in the lane, cruise control is executed. In cruise control, in order to maintain the set driving speed, the vehicle speed data detected by the vehicle speed sensor is fed back, and the vehicle behavior control device 19 controls the operation of the drive mechanism such as the engine or brakes.
[0046] When a vehicle is detected ahead in the lane using sensors such as the forward radar of sensor 11, distance control is performed. In distance control, a set driving speed is used as the upper limit. In order to maintain the set distance, the vehicle behavior control device 19 controls the operation of the drive mechanism such as the engine or brakes while feeding back the distance data detected by the forward radar.
[0047] Automatic steering control function
[0048] The automatic steering control function is to control the steering actuator to perform steering control of vehicle 1.
[0049] Automatic steering control functions include lane keeping assist, lane change assist, overtaking assist, and route assist.
[0050] Lane keeping assist functions, such as controlling the steering actuator to keep the vehicle near the center of the lane, assist the occupant's steering wheel operation.
[0051] After activating the automatic driving control function using the main switch 181, when the set / coast switch 183 is pressed, the controller 20 determines whether the prescribed automatic driving control start conditions are met. If the automatic driving control start conditions are met, the controller 20 executes the lane keeping function of the automatic steering control function.
[0052] Alternatively, after activating the automatic driving control function using the main switch 181, when the automatic driving control start condition is met, the controller 20 waits for the setting / coasting switch 183 to be pressed. When the setting / coasting switch 183 is pressed, the controller 20 starts automatic driving control and executes the lane keeping function of the automatic steering control function.
[0053] Lane change assist function
[0054] The lane change assist function illuminates the turn indicator when the occupant operates the turn signal stalk, and initiates an automatic lane change operation once the prescribed lane change initiation conditions are met. The lane change assist function determines whether the prescribed lane change initiation conditions are met based on various driving information obtained through the driving information acquisition function.
[0055] The lane change assist function initiates a lane change operation once the lane change start conditions are met. During the lane change operation, vehicle 1 moves laterally into the adjacent lane. Once the movement into the adjacent lane is complete, the turn indicator lights turn off, and the lane keeping function in the adjacent lane begins.
[0056] Overtaking Assist Function
[0057] When there is a vehicle slower than vehicle 1 ahead in the current lane and the prescribed overtaking proposal conditions are met, the overtaking assist function uses display device 16 to prompt overtaking information to the occupants. Here, overtaking information refers to information used to propose overtaking the vehicle ahead to the occupants. The overtaking assist function illuminates the direction indicator and initiates the lane change operation when the occupants agree to the overtaking information by operating the lane change assist switch 186 on input device 18, and the preset overtaking initiation conditions are met. The overtaking assist function determines whether the overtaking proposal conditions and overtaking initiation conditions are met based on various driving information obtained through the driving information acquisition function.
[0058] Route Driving Assist Function
[0059] When the route driving assistance function encounters a branching or merging point, exit, or toll station on the pre-set route, and the distance to the direction change point is within a specified distance, and the specified route driving suggestion conditions are met, the display device 16 will display route driving information and suggest a lane change to the direction change point. Additionally, the route driving assistance function will initiate a lane change operation if the lane change suggestion is approved by the lane change assistance switch 186 and the specified route driving start conditions are met.
[0060] The route driving assistance function determines whether the route driving suggestion conditions and route driving start conditions are met based on various driving information obtained through the driving information acquisition function.
[0061] Methods for identifying speed limits
[0062] As described above, the controller 20 uses the sensor 11 to identify the speed limit of the road being traveled on from road signs or from map information in the map database 13, and applies the identified speed limit to the set speed of the automatic speed control function. Furthermore, the controller 20 displays the identified speed limit on the display device 16. For example, it displays it on a display mounted on the instrument panel or on a head-up display projected onto the windshield.
[0063] When recognizing a speed limit, the controller 20 acquires an image of the environment in front of the vehicle 1 from the front camera of the sensor 11, which captures images of the environment in front of the vehicle 1. The controller 20 identifies the speed limit sign from the acquired image and estimates the distance between the vehicle 1 and the speed limit sign. For example, the distance between the vehicle 1 and the speed limit sign can be estimated by detecting the coordinates of the grounding position of the supporting structure of the speed limit sign from the captured image.
[0064] The controller 20 removes speed limit signs located at a distance from vehicle 1 from the speed limit sign recognition results. For example, it removes speed limit signs located at a distance from vehicle 1 that is greater than a threshold distance from the recognition results.
[0065] Then, after removing speed limit signs located at a distance from vehicle 1, controller 20 determines whether a speed limit sign can be identified from the captured image. That is, it determines whether any speed limit signs other than those located at a distance from vehicle 1 can be identified from the captured image. If a speed limit sign is identified from the captured image, the speed limit indicated by the identified sign is recognized as the speed limit of the road on which vehicle 1 is traveling. Alternatively, if no speed limit sign is identified from the captured image, the speed limit of the road on which vehicle 1 is traveling is identified based on speed limit information contained in the 3D high-precision map information. For example, a stored speed limit associated with the road on which vehicle 1 is traveling in the 3D high-precision map information can be identified as the speed limit of the road on which vehicle 1 is traveling.
[0066] Multiple speed limit signs may be identified simultaneously from the captured image. Figure 3 This is an illustration of the first example of simultaneously recognizing multiple speed limit signs.
[0067] Figure 3 This illustration depicts a scenario where multiple roads, including a first road R1 and a second road R2, are arranged side-by-side, with vehicle 1 traveling on the first road R1. For example, the first road R1 is a freeway in the United States, and the second road R2 is an expressway. Speed limit signs 31 and 32 on the first road R1 indicate a lower speed limit (within...). Figure 3 In the example, the speed limit is 55 mph. Speed limit signs 33 and 34 on the second road R2 indicate higher speed limits (in...). Figure 3 In the example, the speed is 65 miles per hour.
[0068] In this situation, it is possible to simultaneously identify speed limit signs 31 and 32 for the first road R1, and speed limit signs 33 and 34 for the second road R2, from the captured image. That is, multiple speed limit signs simultaneously identified from the captured image may represent multiple different speed limits (in... Figure 3 Examples include speeds of 55 mph and 65 mph.
[0069] In the case where multiple speed limit signs are identified simultaneously from the captured image, there is a possibility that a speed limit sign on a road that is not being traveled by vehicle 1 may be mistakenly identified as a speed limit sign on the road that vehicle 1 is traveling on.
[0070] exist Figure 3 In the example, there is a possibility that the speed limit indicated by signs 33 and 34 on the second road R2, which is not the road on which vehicle 1 travels, is 65 miles per hour, which is the speed limit on the road on which vehicle 1 travels.
[0071] Therefore, the controller 20 determines whether multiple speed limit signs are identified from the captured image. If multiple speed limit signs are identified, the controller 20 determines whether the identified multiple speed limit signs include speed limit signs that represent the same speed limit and are located at the front right and front left of the vehicle 1, respectively.
[0072] exist Figure 3 In the example, controller 20 determines that multiple speed limit signs 31-34 are identified from the captured image. Then, controller 20 determines that the multiple speed limit signs 31-34 include those indicating the same speed limit located on the right front and left front of vehicle 1, respectively. Figure 3 Examples include speed limit signs 31 and 32 (55 mph).
[0073] It should be noted that speed limit signs 31 and 32 do not necessarily have to be located on the left and right sides of the first road R1. Speed limit signs 31 and 32 can be detected, for example, as long as they are detected at coordinates that are closer to the right and closer to the left than the horizontal center of the captured image, respectively.
[0074] If it is determined that multiple speed limit signs include speed limit signs indicating the same speed limit that are located on the right front and left front of vehicle 1, the controller 20 will identify the speed limit indicated by the speed limit signs located on the right front and left front of vehicle 1 as the speed limit of the road on which vehicle 1 is traveling.
[0075] exist Figure 3 In the example, the speed limit indicated by speed limit signs 31 and 32, i.e., 55 miles per hour, is identified as the speed limit of Road R1.
[0076] Therefore, it is possible to suppress the misidentification of the speed limit indicated by the speed limit sign of an adjacent road as the speed limit of the road on which vehicle 1 is traveling in a section where multiple roads are set up side by side.
[0077] Figure 4 This is a second illustration of a situation where multiple speed limit signs are recognized simultaneously.
[0078] exist Figure 4 In the example, multiple speed limit signs 35 and 36 are positioned close to each other, forming a set of speed limit signs. When multiple speed limit signs are positioned close to each other, these multiple speed limit signs may include, for example, signs indicating speed limits for specific types of vehicles, and signs indicating speed limits for other types of vehicles. Additionally, they may include speed limit signs indicating the maximum speed and speed limits indicating the minimum speed. Figure 4 In the example, it represents the speed limit for the truck (in Figure 4 In the example, speed limit sign 36 (for speeds of 40 mph) and speed limit sign 35 (for speeds other than trucks) are different. Figure 4 In the example, the two vehicles are approaching each other at a speed of 55 miles per hour.
[0079] In the above situation, it is possible to simultaneously identify multiple speed limit signs 35 and 36, representing multiple different speeds, from the captured image.
[0080] In this case, there is a possibility that the speed indicated by the speed limit sign 36, which represents a speed limit for a specific type of vehicle different from vehicle 1, might be identified as the speed limit for vehicle 1. Additionally, there is a possibility that the speed indicated by the speed limit sign representing the minimum speed might be identified as the speed limit for the maximum speed of vehicle 1.
[0081] Therefore, when the controller 20 determines that multiple speed limit signs are identified from the captured image, and the identified multiple speed limit signs do not include speed limit signs indicating the same speed limit that are located at the front right and front left of the vehicle 1 respectively, it determines whether the identified multiple speed limit signs include a group of speed limit signs that are close to each other.
[0082] If the controller determines that the identified multiple speed limit signs include a group of speed limit signs that are close to each other, the controller 20 identifies the highest speed among the speeds represented by the group of speed limit signs that are close to each other as the speed limit of the road on which the vehicle 1 is traveling.
[0083] exist Figure 4 In the example, the higher of the speeds indicated by speed limit sign 35 (55 mph) and speed limit sign 36 (40 mph), 55 mph, is identified as the speed limit of the road on which vehicle 1 is traveling.
[0084] Therefore, when multiple speed limit signs are placed close to each other, it is possible to avoid misidentifying the speed limit of a specific type of vehicle that is different from vehicle 1 as the speed limit of vehicle 1. In addition, it is possible to avoid misidentifying the speed indicated by a speed limit sign that indicates the minimum speed as the maximum speed limit of vehicle 1.
[0085] The controller 20 can determine whether speed limit signs are close together based on whether they are within a specified distance range. The specified distance can be appropriately set according to the rules or benchmarks for setting road signs. For example, the specified distance can be 3 meters.
[0086] For example, the controller 20 can sequentially select multiple identified speed limit signs, use the selected speed limit signs as a reference, and extract all speed limit signs within a specified distance of the speed limit signs with distances in the left-right, front-back, and up-down directions as a group of speed limit signs that are close to each other.
[0087] If the identified speed limit signs do not include speed limit signs indicating the same speed limit located on the right front and left front of vehicle 1, nor do they include a group of speed limit signs that are close to each other, the controller 20 identifies the speed limit indicated by the speed limit sign located in either the right front or left front of vehicle 1 in a predetermined direction (i.e., a specified direction) as the speed limit of the road on which vehicle 1 is traveling. For example, the speed limit indicated by the speed limit sign located on the right front is identified as the speed limit of the road on which vehicle 1 is traveling.
[0088] In the case of multiple speed limit signs located in the specified direction, the speed limit indicated by the nearest speed limit sign is identified as the speed limit of the road on which vehicle 1 is traveling.
[0089] Alternatively, the controller 20 may identify the speed limit indicated by the nearest speed limit sign among multiple speed limit signs as the speed limit of the road on which the vehicle 1 is traveling.
[0090] It should be noted that, in the above description, the controller 20 determines whether speed limit signs indicating the same speed limit are present on the right front and left front of the vehicle 1, respectively. If speed limit signs indicating the same speed limit are not present on the right front and left front of the vehicle 1, the controller determines whether the identified multiple speed limit signs include a group of closely spaced speed limit signs. However, the present invention does not limit the order of determination. For example, if the identified multiple speed limit signs do not include a group of closely spaced speed limit signs, the controller can determine whether speed limit signs indicating the same speed limit are present on the right front and left front of the vehicle 1, respectively. Alternatively, the controller can comprehensively determine whether speed limit signs indicating the same speed limit are present on the right front and left front of the vehicle 1, respectively, and whether the identified multiple speed limit signs include a group of closely spaced speed limit signs, to identify the speed limit.
[0091] (action)
[0092] Figure 5 This is a flowchart of an example of a speed limit recognition method implemented.
[0093] In step S1, the controller 20 acquires a captured image of the environment in front of the vehicle 1 from the front camera of the sensor 11.
[0094] In step S2, the controller 20 identifies the speed limit sign from the acquired captured image.
[0095] In step S3, the controller 20 removes speed limit signs located at a distance from the vehicle 1 from the speed limit sign recognition results.
[0096] In step S4, the controller 20 determines whether a speed limit sign is identified from the captured image. That is, it determines whether a speed limit sign other than the one located at a distance from the vehicle 1 is identified from the captured image. If a speed limit sign is identified from the captured image (step S4: Y), the process proceeds to step S6. If a speed limit sign is not identified from the captured image (step S4: N), the process proceeds to step S5.
[0097] In step S5, the controller 20 identifies the speed limit of the road on which vehicle 1 is traveling based on the speed limit information contained in the three-dimensional high-precision map information. Afterward, the process ends.
[0098] In step S6, the controller 20 determines whether multiple speed limit signs are identified. If multiple speed limit signs are identified (step S6: Y), the process proceeds to step S8. If only a single speed limit sign is identified (step S6: N), the process proceeds to step S7.
[0099] In step S7, the controller 20 identifies the speed limit indicated by the single speed limit sign as the speed limit of the road on which vehicle 1 is traveling. The process then ends.
[0100] In step S8, the controller 20 determines whether the identified multiple speed limit signs include speed limit signs indicating the same speed limit that are located on the right front and left front of the vehicle 1, respectively. If the identified multiple speed limit signs do not include the aforementioned speed limit signs (step S8: N), the process proceeds to step S10. If the identified multiple speed limit signs include the aforementioned speed limit signs (step S8: Y), the process proceeds to step S9.
[0101] In step S9, the controller 20 identifies the speed limits indicated by the speed limit signs located to the right and left front of the vehicle 1 as the speed limits of the road on which the vehicle 1 is traveling. The process then ends.
[0102] In step S10, the controller 20 determines whether the identified multiple speed limit signs include a group of speed limit signs that are close to each other. If the identified multiple speed limit signs do not include a group of speed limit signs that are close to each other (step S10: N), the process proceeds to step S12. If the identified multiple speed limit signs include a group of speed limit signs that are close to each other (step S10: Y), the process proceeds to step S11.
[0103] In step S11, the controller 20 identifies the highest speed among a set of closely spaced speed limit signs as the speed limit for the road on which vehicle 1 travels. The process then ends.
[0104] In step S12, the controller 20 identifies the speed limit indicated by the speed limit sign located in either the pre-determined right front or left front direction of the vehicle 1 as the speed limit of the road on which the vehicle 1 is traveling. Afterward, the process ends.
[0105] (Effects of the implementation method)
[0106] (1) The controller 20 acquires a captured image of the environment in front of the vehicle 1 from the camera, identifies speed limit signs from the captured image, determines whether multiple speed limit signs are identified from the captured image, and if multiple speed limit signs are identified, determines whether the identified multiple speed limit signs include speed limit signs that represent the same speed limit on the right front and left front of the vehicle 1 respectively. If the identified multiple speed limit signs include speed limit signs that represent the same speed limit on the right front and left front of the vehicle 1 respectively, the speed limit represented by the speed limit signs that represent the same speed limit on the right front and left front of the vehicle 1 is identified as the speed limit of the road on which the vehicle 1 is traveling.
[0107] Therefore, it is possible to suppress the misidentification of the speed limit indicated by the speed limit sign of an adjacent road as the speed limit of the road on which vehicle 1 is traveling in a section where multiple roads are set up side by side.
[0108] (2) If the controller 20 determines that the identified multiple speed limit signs do not include speed limit signs that represent the same speed limit on the right front and left front of the vehicle 1, it determines whether the identified multiple speed limit signs include a group of speed limit signs that are close to each other. If the controller determines that the identified multiple speed limit signs include a group of speed limit signs that are close to each other, it identifies the highest speed among the speeds represented by the group of speed limit signs as the speed limit of the road on which the vehicle 1 travels.
[0109] Therefore, when multiple speed limit signs are set close together, it is possible to avoid misidentifying a speed limit for a specific type of vehicle that is different from vehicle 1 as the speed limit for vehicle 1. In addition, it is possible to avoid misidentifying the speed indicated by a speed limit sign that indicates the minimum speed as the maximum speed limit for vehicle 1.
[0110] (3) The controller 20 can select any one of the identified multiple speed limit signs as a reference, determine whether other speed limit signs of the identified multiple speed limit signs exist within a specified distance range from any one of the speed limit signs used as the reference, and if it is determined that other speed limit signs exist within a specified distance range from any one of the speed limit signs used as the reference, the controller 20 will extract any one of the speed limit signs used as the reference and other speed limit signs as speed limit signs included in a group of speed limit signs that are close to each other.
[0111] Therefore, it can be determined whether the identified speed limit signs include a group of speed limit signs that are close to each other.
[0112] All examples and conditional terms described herein are for educational purposes to aid the reader's understanding of the invention and the concepts proposed by the inventors for the development of the technology, and should not be construed as limiting to the specific examples, conditions, and configurations described above, or the examples in this specification relating to the advantages and disadvantages of the invention. It should be understood that while embodiments of the invention have been described in detail, various changes, substitutions, and modifications can be made thereto without departing from the spirit and scope of the invention.
[0113] Explanation of reference numerals in the attached figures
[0114] 1. Vehicle; 10. Driving assistance device; 11. Sensor; 12. Positioning device; 13. Map database; 14. In-vehicle equipment; 15. Navigation system; 16. Display device; 17. Voice output device; 18. Input device; 19. Vehicle behavior control device; 20. Controller; 21. Processor; 22. Storage device.
Claims
1. A speed limit recognition method, characterized in that, Cause the controller to perform the following processing: Processing of images captured by a camera to represent the environment in front of the vehicle; Processing of identifying speed limit signs from the captured images; Processing to determine whether multiple speed limit signs are identified from the captured image; If it is determined that the plurality of speed limit signs are identified, the process of determining whether the plurality of speed limit signs include speed limit signs that are detected at coordinates that are closer to the right than the horizontal center of the captured image obtained from the camera and at coordinates that are closer to the left than the horizontal center of the captured image obtained from the camera, respectively, indicating the same speed limit. If it is determined that the multiple speed limit signs include speed limit signs that represent the same speed limit and are respectively located at the front right and front left of the vehicle, the speed limit represented by the speed limit signs located at the front right and front left of the vehicle is identified as the speed limit of the road on which the vehicle is traveling. In the case where it is determined that the multiple speed limit signs do not include speed limit signs indicating the same speed limit that are respectively located on the right front and left front of the vehicle, the process of determining whether the multiple speed limit signs include a group of speed limit signs that are close to each other is as follows: If it is determined that the multiple speed limit signs include a group of speed limit signs that are close to each other, the highest speed among the speeds represented by the group of speed limit signs is identified as the speed limit of the road on which the vehicle is traveling. The vehicle in question is a vehicle other than the specific type that is subject to the lower speed limit among several types of vehicles with different speed limits.
2. The speed limit recognition method as described in claim 1, characterized in that, The controller is instructed to perform the following processing: Processing of selecting any one of the multiple speed limit signs; The process of determining whether other speed limit signs exist within a specified distance from any of the multiple speed limit signs; If it is determined that the other speed limit signs exist within a specified distance from any of the speed limit signs, then the speed limit sign and the other speed limit signs are extracted and treated as speed limit signs included in the group of speed limit signs that are close to each other.
3. The speed limit recognition method as described in claim 1 or 2, characterized in that, The controller performs a process to determine whether the plurality of speed limit signs include speed limit signs that represent the same speed limit and are located at the right front of the vehicle and the right end of the road on which the vehicle is traveling, and at the left front of the vehicle and the left end of the road on which the vehicle is traveling.
4. The speed limit recognition method as described in claim 1 or 2, characterized in that, The controller performs a process that, if it determines that the plurality of speed limit signs do not include a group of speed limit signs that are close to each other, identifies the speed limit indicated by the speed limit sign that is closest to the vehicle among the plurality of speed limit signs located in either the right front or left front of the vehicle, i.e., a predetermined direction, as the speed limit of the road on which the vehicle is traveling.
5. A speed limit recognition device, characterized in that, have: A camera that captures images of the environment in front of the vehicle; The controller performs the following operations: processing to identify speed limit signs from images captured by the camera; determining whether multiple speed limit signs are identified from the captured images; if multiple speed limit signs are identified, determining whether the multiple speed limit signs include speed limit signs indicating the same speed limit detected at coordinates closer to the right than the horizontal center of the captured image and closer to the left than the horizontal center of the captured image; and if the multiple speed limit signs include speed limit signs indicating the same speed limit located at the right front and left front of the vehicle, respectively. If the vehicle is identified, the speed limit indicated by the speed limit signs located to the right front and left front of the vehicle is identified as the speed limit of the road on which the vehicle is traveling. If the vehicle is identified as having multiple speed limit signs, the speed limit signs are identified as having multiple speed limit signs located to the right front and left front of the vehicle, and the speed limit signs are identified as having multiple speed limit signs that are close to each other. If the vehicle is identified as having multiple speed limit signs that are close to each other, the speed limit signs are identified as having multiple speed limit signs, and the speed limit signs are identified as having multiple speed limit signs, and the speed limit signs are identified as having multiple speed limit signs, and the speed limit signs are identified as having multiple speed limit signs. The vehicle in question is a vehicle other than the specific type that is subject to the lower speed limit among several types of vehicles with different speed limits.
6. The speed limit recognition device as described in claim 5, characterized in that, The controller performs a process to determine whether the plurality of speed limit signs include speed limit signs that represent the same speed limit and are located at the right front of the vehicle and the right end of the road on which the vehicle is traveling, and at the left front of the vehicle and the left end of the road on which the vehicle is traveling.
7. The speed limit recognition device as described in claim 5 or 6, characterized in that, The controller performs the following process: if it determines that the plurality of speed limit signs do not include a group of speed limit signs that are close to each other, it identifies the speed limit indicated by the speed limit sign that is closest to the vehicle among the plurality of speed limit signs located in either the right front or left front of the vehicle, i.e., a predetermined direction, as the speed limit of the road on which the vehicle is traveling.
Citation Information
Patent Citations
Vehicle control device
JP2021014239A
Traffic signs recognition apparatus and method of outputing speed limit using the same
CN105046999A
System and method for providing a speed warning and speed control
WO2017132645A1
