Driving assistance devices

Abstract

A driving assistance device (200) comprises a signal recognition unit (210) which is mounted in a host vehicle M and which uses detection results of sensors (100) that detect a position of the host vehicle or a state around the host vehicle to recognize a lighting state of a forward traffic light, being a traffic light existing in a traveling direction of the host vehicle, and a driving control unit (240) that executes driving assistance of the host vehicle in accordance with the lighting state of the forward traffic light, wherein the driving control unit (240) suspends or limits the driving assistance if a plurality of forward traffic lights are recognized, and among the recognized forward traffic lights the lighting states of at least two forward traffic lights differ from each other and the content of the driving assistance cannot be determined.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is based on Japanese Application No. 2022-171357, filed on October 26, 2022, the contents of which are incorporated herein by reference. [Technical Field]

[0002] The present disclosure relates to a driving assistance device. [Background technology]

[0003] BACKGROUND ART There is known a technique for providing driving assistance to a vehicle in accordance with the lighting status of traffic lights present in the vehicle's traveling direction (Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-92129 [Patent Document 2] Japanese Patent Application Laid-Open No. 2010-152494 Summary of the Invention

[0005] However, when multiple traffic lights with different lighting conditions are recognized, it may be difficult to identify the traffic light that the vehicle should follow. In this case, the content of the driving assistance cannot be determined, and the driving assistance cannot be stably executed.

[0006] The present disclosure can be realized in the following forms. [Form 1] A driving assistance device (200) is mounted on a host vehicle (M), and includes: a signal recognition unit (210) that recognizes the lighting status of a traffic light ahead, which is a traffic light present in the traveling direction of the host vehicle, using the detection results of a sensor (100) that detects the position of the host vehicle or the conditions around the host vehicle; and a driving control unit (240) that performs driving assistance for the host vehicle according to the lighting status of the traffic light ahead. When a plurality of traffic lights ahead are recognized, and the lighting statuses of at least two of the recognized traffic lights are different from each other and the content of the driving assistance cannot be determined, the driving control unit stops or suppresses the driving assistance; and when a plurality of traffic lights ahead are recognized, and the lighting statuses of at least two of the recognized traffic lights are different from each other, the driving control unit performs a common driving assistance among the driving assistances that are predetermined to be performed according to the lighting statuses of the respective traffic lights.

[0007] According to one aspect of the present disclosure, there is provided a driving assistance device including: a signal recognition unit that is mounted on a host vehicle and that recognizes a lighting status of a traffic light ahead that is a traffic light present in a traveling direction of the host vehicle by using a detection result of a sensor that detects the position of the host vehicle or a situation around the host vehicle; and a driving control unit that performs driving assistance for the host vehicle according to the lighting status of the traffic light ahead, wherein the driving control unit stops or suppresses the driving assistance when a plurality of traffic lights ahead are recognized and the lighting statuses of at least two of the recognized traffic lights ahead are different from each other and the content of the driving assistance cannot be determined.

[0008] According to this type of driving assistance device, if a mixture of traffic lights with different lighting conditions is recognized and the content of the driving assistance cannot be determined, the driving assistance is stopped or canceled, so that behavior can be determined when the content of the driving assistance cannot be determined, and a decrease in the stability of the driving assistance can be suppressed. [Brief explanation of the drawings]

[0009] The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: [Figure 1] FIG. 1 is a block diagram showing a schematic configuration of a driving assistance device according to the present embodiment. [Figure 2] FIG. 2 is a flowchart showing the procedure of the driving assistance process according to this embodiment. [Figure 3] FIG. 3 is an explanatory diagram illustrating an example of an image acquired in step S10 of the driving assistance process. [Figure 4] FIG. 4 is an explanatory diagram showing an example of the process in step S40 of the driving support process. DETAILED DESCRIPTION OF THE INVENTION

[0010] A. Implementation: A-1.Device configuration: A driving assistance device 200 of this embodiment shown in FIG. 1 is mounted on a vehicle M and controls the vehicle M. In this embodiment, the vehicle M is also referred to as a "host vehicle M." In this embodiment, the host vehicle M is a vehicle equipped with an engine. The host vehicle M is a vehicle capable of performing automatic driving, and is configured to be able to switch between automatic driving and manual driving. "Automatic driving" refers to driving in which engine control, brake control, and steering control are automatically performed on behalf of the occupant. "Manual driving" refers to driving in which the occupant performs operations for engine control (depressing the accelerator pedal), brake control (depressing the brake pedal), and steering control (turning the steering wheel). Note that the vehicle M is not limited to a vehicle equipped with an engine, and may be an electric vehicle (EV) or a fuel cell vehicle (FCV).

[0011] The driving assistance device 200 is connected to the information acquisition device 100 and the vehicle operation device 300 via an in-vehicle network such as a CAN (Controller Area Network). The driving assistance device 200 controls the vehicle operation device 300 using information indicating the position of the vehicle M or the situation around the vehicle M acquired by the information acquisition device 100, and performs driving assistance.

[0012] In this embodiment, the driving assistance device 200 performs driving assistance by issuing a warning to the occupant using a screen display, sound, vibration, etc., and controlling the acceleration / deceleration of the host vehicle M. More specifically, when the driving assistance device 200 recognizes that a red or yellow light is on, it executes at least one of issuing a warning to the occupant to decelerate or stop the host vehicle M, and automatically decelerating or stopping the host vehicle M. Furthermore, when the driving assistance device 200 recognizes that the lighting status has changed from a red light to a green light or a right-turn arrow signal, it executes at least one of issuing a warning to the occupant to start the host vehicle M, and automatically starting the host vehicle M.

[0013] The information acquisition device 100 acquires information about the current position, driving status, and surrounding conditions of the host vehicle M. In this embodiment, the information acquisition device 100 includes a camera 110, a GNSS receiver 120, and a wireless communication device 130. The camera 110 captures an image of the traveling direction of the host vehicle M. The "traveling direction" refers to the radial area captured by the camera 110 in front of the host vehicle M. The GNSS receiver 120 detects the current position (longitude and latitude) of the host vehicle M based on GNSS signals received from artificial satellites constituting the GNSS (Global Navigation Satellite System). The wireless communication device 130 performs wireless communication with an Intelligent Transport System, communication with other vehicles, and communication with roadside wireless devices installed on road facilities such as traffic lights. This allows information about the status of the host vehicle M and the surrounding conditions to be exchanged. In this embodiment, the "information about the surrounding conditions" includes information indicating the lighting status of traffic lights present near the host vehicle M (hereinafter also referred to as "light information"). The information acquisition device 100 corresponds to a "sensor" in this disclosure.

[0014] The vehicle operation device 300 includes an engine mechanism 310, a brake mechanism 320, a steering mechanism 330, and a warning device 340. The engine mechanism 310 is made up of a group of devices that perform operations such as opening and closing the throttle valve, igniting the igniter, and opening and closing the intake valve. The brake mechanism 320 is made up of a group of devices related to brake control, such as sensors, motors, valves, and pumps. The steering mechanism 330 is made up of a group of devices related to steering, such as a power steering motor. The warning device 340 is made up of a group of devices that alert the occupants, such as a display device, speaker, and vibration generator.

[0015] In this embodiment, the driving assistance device 200 is configured as a computer including a CPU and a memory. An example of such a computer is an ECU (Electronic Control Unit). The driving assistance device 200 includes a signal recognition unit 210, a first sorting unit 220, a second sorting unit 230, and a driving control unit 240 as functional units realized by the CPU executing a program stored in advance in the memory.

[0016] The traffic light recognition unit 210 uses information acquired by the information acquisition device 100 to recognize traffic lights (hereinafter also referred to as "forward traffic lights") present in the traveling direction of the host vehicle M. The first selection unit 220 selects, from the forward traffic lights, traffic lights that control traffic in the lane in which the host vehicle M is traveling (hereinafter also referred to as "host lane traffic lights"). The second selection unit 230 selects, from the forward traffic lights, traffic lights that are present at the intersection closest to the host vehicle M (hereinafter also referred to as "nearest intersection traffic lights"). The driving control unit 240 controls the host vehicle M according to the lighting status of the forward traffic lights, and performs the above-mentioned driving assistance.

[0017] A-2. Driving assistance processing: 2, the driving assistance device 200 controls the vehicle operation device 300 and performs driving assistance using information indicating the current position of the vehicle M or the situation around the vehicle M, which information is acquired by the information acquisition device 100. The driving assistance process is repeatedly executed while the driving assistance device 200 is running.

[0018] In step S10, the signal recognition unit 210 acquires an image captured by the camera 110 and performs image analysis processing on the acquired image to recognize the positions and lighting status of traffic lights present in the image. In the example shown in FIG. 3, traffic lights TL1 to TL4 are recognized. Traffic lights TL1 to TL4 correspond to the above-mentioned "forward traffic lights." The lighting status of each recognized traffic light corresponds to the above-mentioned "light information."

[0019] 2, the driving control unit 240 determines whether multiple traffic lights ahead are recognized. If only one traffic light ahead is recognized (step S20: No), the driving control unit 240 performs the above-described driving assistance in accordance with the light information of the recognized traffic light ahead (step S82), and the driving assistance device 200 performs step S10 again.

[0020] If multiple traffic lights ahead are recognized (step S20: Yes), the driving control unit 240 determines whether the light information of all the traffic lights ahead is the same (step S30). If the light information of all the traffic lights ahead is the same (step S30: Yes), the driving control unit 240 performs the above-mentioned driving assistance in accordance with the light information commonly indicated by each traffic light ahead (step S82), and the driving assistance device 200 performs step S10 again.

[0021] If the light information is not uniform (step S30: No), in other words, if the lighting statuses of at least two of the traffic lights ahead are different from each other, the first sorting unit 220 sorts out the traffic lights in the same lane from among the traffic lights ahead (step S40). In this embodiment, as shown in the example of Fig. 4, the first sorting unit 220 sorts out traffic lights TL1 and TL3 as traffic lights in the same lane by excluding traffic lights TL2 and TL4 included in the exclusion area Ar shown with hatching from the recognition targets. The exclusion area Ar is set in advance as a rectangular area of ​​a size determined in advance through experiments or the like.

[0022] In step S50, the second sorting unit 230 sorts out the nearest intersection traffic light from the sorted current lane traffic lights. In this embodiment, the second sorting unit 230 compares the areas of the pixel regions representing traffic lights TL1 and TL3 recognized as current lane traffic lights in the acquired image, and excludes traffic light TL3, which has a smaller area than traffic light TL1 and is located farther away, thereby sorting out traffic light TL1 as the nearest intersection traffic light. Note that if only one traffic light is sorted out as the current lane traffic light in step S40, the second sorting unit 230 does not need to perform this step.

[0023] In step S60, the driving control unit 240 determines whether the light information of each selected traffic light is a single signal. If the light information is a single signal (step S60: Yes), the driving control unit 240 performs the driving assistance described above in accordance with the light information indicated by the selected traffic light (step S82), and the driving assistance device 200 performs step S10 again.

[0024] If the light information is not a single type (step S60: No), the driving control unit 240 determines whether the driving assistance content can be determined from the light information of each selected traffic light (step S70). For example, if a driving assistance system that alerts the occupants by displaying a screen, making a sound, vibrating, or the like is pre-set as a driving assistance system when a red or yellow light is recognized, it is possible to determine that the driving assistance system should provide the above-mentioned attention even if the light information of the selected traffic light includes both red and yellow lights. On the other hand, if the above-mentioned attention is pre-set as a driving assistance system when a red light is recognized and not as a driving assistance system when a yellow light is recognized, the driving assistance content cannot be determined if the light information of the selected traffic light includes both red and yellow lights. Another example of a combination of light information that can determine the driving assistance content is when the vehicle M is located in a straight-only lane and the light information of the selected traffic lights includes both red and right-turn arrow signals. When the host vehicle M is located in a straight-through lane, the host vehicle M needs to stop regardless of whether the lighting status of the traffic light for the host vehicle M is a red light or a right-turn arrow signal, and in this case, driving assistance for stopping the vehicle can be determined. In other words, even if the lighting statuses of the selected traffic lights are different from each other, the driving control unit 240 can determine the content of driving assistance if there is a common driving assistance among the driving assistances to be performed according to each lighting status.

[0025] If the driving assistance content cannot be determined (step S70: No), the driving control unit 240 cancels or suppresses the driving assistance (step S80). "Canceling" the driving assistance means not executing at least one of the above-mentioned driving assistance contents. Furthermore, "suppressing" the driving assistance means weakening the level of driving assistance, and in this embodiment, at least one of suppressing the acceleration / deceleration of the vehicle M, suppressing the degree of emphasis of the screen display on the display device of the vehicle M, suppressing the volume of the notification sound, and suppressing vibrations that attract the attention of the occupants is executed. After step S80 is completed, the driving assistance device 200 executes step S10 again.

[0026] If the driving assistance content can be determined (step S70: Yes), the driving control unit 240 executes the determined driving assistance (step S82), and the driving assistance device 200 executes step S10 again.

[0027] According to the driving assistance device 200 described above, when a mixture of traffic lights with different lighting conditions is recognized and the content of driving assistance cannot be determined, driving assistance is stopped or canceled, so that behavior when the content of driving assistance cannot be determined can be determined and a decrease in the stability of driving assistance can be suppressed. Note that "stability of driving assistance" means an index that indicates whether it is possible to determine whether or not to perform driving assistance depending on the position of the host vehicle M or the situation around the host vehicle M.

[0028] In addition, the driving assistance device 200 selects the traffic lights in the vehicle's own lane and performs driving assistance according to the lighting status of the traffic lights in the vehicle's own lane, making it easier to narrow down the traffic lights that are targeted at the vehicle M, thereby further suppressing a decrease in the stability of driving assistance.

[0029] In addition, the driving assistance device 200 selects the nearest intersection traffic light and performs driving assistance according to the lighting status of the nearest intersection traffic light, making it easier to narrow down the traffic lights that are targeted at the vehicle M, thereby further suppressing a decrease in the stability of driving assistance.

[0030] Furthermore, even if the lighting conditions of at least two of the multiple traffic lights ahead are different from each other, the driving assistance device 200 executes a common driving assistance among the driving assistance preset to be executed according to each lighting condition, thereby preventing the content of the driving assistance from being unable to be determined and further preventing a decrease in the stability of the driving assistance.

[0031] B. Other Embodiments: (B1) In the above embodiment, the driving assistance device 200 selects the traffic light in the vehicle's own lane and the nearest intersection traffic light using images acquired by the camera 110 during the driving assistance process. However, the present disclosure is not limited to this. The driving assistance device 200 may select the traffic light in the vehicle's own lane and the nearest intersection traffic light using position information of the vehicle M acquired by the GNSS receiver 120 or light information of traffic lights around the vehicle M received by the wireless communication device 130. The driving assistance device 200 may also be mounted on a vehicle M equipped with a distance measuring device, and may select the traffic light in the vehicle's own lane and the nearest intersection traffic light using the distance between the vehicle M and the traffic lights around the vehicle M detected by the distance measuring device. Note that millimeter-wave radar or Lidar may be used as the distance measuring device. A driving assistance device 200 configured in this manner also achieves the same effects as the above embodiment.

[0032] (B2) In the above embodiment, the driving assistance device 200 selects the traffic light in the current lane (step S40) and then selects the nearest intersection traffic light (step S50) in the driving assistance process, but the present disclosure is not limited to this. The driving assistance device 200 may select the traffic light in the current lane after selecting the nearest intersection traffic light. Furthermore, the driving assistance device 200 may execute only one of step S40 and step S50 in the driving assistance process. A driving assistance device 200 configured in this manner also achieves the same effects as the above embodiment.

[0033] (B3) In the above embodiment, driving assistance device 200 executes steps S40 to S70 after step S30 in the driving assistance process, but the present disclosure is not limited to this. Driving assistance device 200 may execute step S80 without executing steps S40 to S70 if the lighting information is not single in step S30 (step S30: No). Driving assistance device 200 configured in this way can also determine behavior when the content of driving assistance cannot be determined, and can suppress a decrease in the stability of driving assistance.

[0034] The present disclosure is not limited to the above-described embodiments and can be realized in various configurations without departing from the spirit thereof. For example, the technical features in each embodiment corresponding to the technical features in the form described in the Summary of the Invention section can be appropriately replaced or combined to solve some or all of the above-described problems or achieve some or all of the above-described effects. Furthermore, if a technical feature is not described as essential in this specification, it can be appropriately deleted.

[0035] The driving assistance device 200 and the method described herein may be implemented by a special-purpose computer configured with a processor and memory programmed to execute one or more functions embodied in a computer program. Alternatively, the driving assistance device 200 and the method described herein may be implemented by a special-purpose computer configured with a processor configured with one or more dedicated hardware logic circuits. Alternatively, the driving assistance device 200 and the method described herein may be implemented by one or more special-purpose computers configured with a combination of a processor and memory programmed to execute one or more functions and a processor configured with one or more hardware logic circuits. Furthermore, the computer program may be stored as instructions executed by a computer on a computer-readable non-transitory tangible storage medium.

Claims

1. A driving assistance device (200), a signal recognition unit (210) mounted on the vehicle (M) and using a detection result of a sensor (100) that detects the position of the vehicle or the situation around the vehicle, to recognize the lighting status of a traffic light ahead that is a traffic light present in the traveling direction of the vehicle; A driving control unit (240) that executes driving assistance for the vehicle according to the lighting status of the forward traffic light; Equipped with When a plurality of traffic lights are recognized, and the lighting statuses of at least two of the recognized traffic lights are different from each other and the content of the driving assistance cannot be determined, the driving control unit stops or suppresses the driving assistance, When a plurality of traffic lights are recognized and the lighting conditions of at least two of the recognized traffic lights are different from each other, the driving control unit executes a common driving assistance among the driving assistances that are predetermined to be executed according to the lighting conditions. Driving assistance device.

2. The driving assistance device according to claim 1, The vehicle further includes a first selection unit (220) that selects a current lane traffic light that controls traffic in the lane in which the vehicle is traveling from among the preceding traffic lights, the driving control unit, when the first selection unit has selected a plurality of the own lane traffic lights and the lighting statuses of the own lane traffic lights are the same, executes the driving assistance in accordance with the lighting statuses of the own lane traffic lights. Driving assistance device.

3. The driving assistance device according to claim 1 or 2, The vehicle further includes a second selection unit (230) that selects a nearest intersection traffic light, which is a traffic light that exists at the intersection closest to the vehicle, from the traffic lights ahead, the driving control unit, when the second selection unit has selected a plurality of nearest intersection traffic lights and the lighting conditions of the nearest intersection traffic lights are the same, executes the driving assistance in accordance with the lighting conditions of the nearest intersection traffic lights. Driving assistance device.

4. The driving assistance device according to claim 1 or 2, The driving control unit suppresses the driving assistance by executing at least one of suppressing an acceleration / deceleration rate of the vehicle, suppressing an emphasis level of a screen display on a display device of the vehicle, suppressing a volume of a notification sound, and suppressing a vibration that attracts the attention of an occupant. Driving assistance device.

Images