Driving support system

The driving support system uses a camera to detect and notify taillight abnormalities in preceding vehicles at low cost, improving safety by reducing equipment costs and enabling timely repairs.

JP2024170151AInactive Publication Date: 2024-12-06TOYOTA JIDOSHA KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023087155
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-12-06
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 2024170151000001_ABST
    Figure 2024170151000001_ABST
Patent Text Reader

Abstract

To enable a subsequent vehicle to inexpensively detect and report an abnormality of a front vehicle.SOLUTION: A driving support system for enabling a subsequent vehicle to detect and report an abnormality in a tail lamp of a front vehicle includes the steps of: allowing the subsequent vehicle 10 to photograph a rear part of the front vehicle 20; determining whether or not the tail lamps are lit in the photographed rear part of the front vehicle 20; determining whether or not the tail lamps are lit in a bilateral symmetric state from the photographed rear image of the front vehicle; acquiring a license plate from the photographed rear image of the front vehicle when the tail lamps are not lit in a bilateral symmetric state, and transmitting the acquired information of the license plate of the front vehicle and information of a tail lamp state to a server; and reporting the received information of the tail lamp state of the front vehicle to a registered contact destination as information related to the front vehicle when the server 30 pre-holds the information related to the front vehicle.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a driving assistance system. [Background technology]

[0002] Automobiles are equipped with tail lights, and by changing the lighting state of the tail lights, the vehicle can clearly notify following vehicles of the vehicle's operation.

[0003] In recent years, LEDs and other light sources have been used for tail lights. Although this has extended the lifespan of tail lights, it does not mean that bulbs can burn out. Also, tail lights can fail to light up if a malfunction occurs in the contacts due to an accident or vehicle vibration.

[0004] Generally, when an abnormal operation occurs in a system or device, a notification is given to the user or surroundings. In particular, Patent Document 1 discloses a system that alerts a vehicle in which a malfunction or abnormality occurs and other vehicles traveling around the vehicle about a malfunction or abnormality that cannot be detected by the vehicle itself but can be detected by other vehicles. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2021-157333 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, the system disclosed in Patent Document 1 is a large-scale system that requires multiple sensors and radars, which increases costs and makes it difficult to spread. In addition, when the driver of a following vehicle detects an abnormality in the vehicle ahead, even if the driver tries to notify the driver of the vehicle ahead of the abnormality by honking the horn or flashing the lights on the spot, it is difficult to convey the intention, and it is even more difficult to notify the owner of the vehicle ahead of the abnormality when the contact information of the owner is unknown.

[0007] The present disclosure provides a driving assistance system that enables a following vehicle to detect an abnormality in a vehicle ahead at low cost and provide a notification. [Means for solving the problem]

[0008] The driving assistance system disclosed herein is a driving assistance system in which a following vehicle detects and notifies of an abnormality in the tail lights of a vehicle in front, and includes the following steps: photographing the rear of the vehicle in front, determining whether the tail lights are on in the photographed rear of the vehicle in front, determining from the photographed rear image of the vehicle in front whether the tail lights are on symmetrically, acquiring the license plate from the photographed rear image of the vehicle in front if the tail lights are not on symmetrically, transmitting the acquired license plate information and information on the status of the tail lights of the vehicle in front to a server, and, if the server has information about the vehicle in front in advance, notifying a contact registered as information about the vehicle in front of the received information on the status of the tail lights of the vehicle in front. This allows abnormal conditions in the taillights of the vehicle itself, which may be difficult for the driver to notice, to be detected by monitoring by other vehicles. Effect of the Invention

[0009] According to the present disclosure, it is possible to provide a driving assistance system that enables a following vehicle to detect an abnormality in a vehicle ahead and provide a notification at low cost. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a driving assistance system. [Diagram 2] 10A and 10B are diagrams illustrating an example of an acquired image of a forward vehicle and a process for determining the image. [Diagram 3] 4 is a flowchart showing an example of an operation flow of the driving assistance system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] First embodiment Hereinafter, a driving assistance system according to the present embodiment will be described with reference to the drawings. Here, the description will be given on the assumption that a plurality of vehicles are traveling in a line as shown in FIG.

[0012] The driving assistance system 1 includes a first vehicle 10 and a server 30. Note that the following description is given assuming that a second vehicle 20 is traveling ahead of the first vehicle 10. That is, the second vehicle 20 is the leading vehicle, and the first vehicle 10 is the following vehicle.

[0013] The first vehicle 10 includes an acquisition unit 11 that acquires a rear image captured of the second vehicle 20, a lighting determination unit 12 that determines whether the tail lights of the second vehicle 20 are on from the rear image acquired by the acquisition unit 11, a symmetry determination unit 13 that determines whether the tail lights of the second vehicle 20 are on symmetrically from the rear image acquired by the acquisition unit 11, and a transmission unit 14 that transmits the determination result and information on the image acquired by the acquisition unit 11 to the server 30 according to the determination result of the symmetry determination unit 13. Note that hereinafter, the rear image of the second vehicle 20 acquired by the acquisition unit 11 of the first vehicle 10 may be simply described as an image.

[0014] The acquisition unit 11 photographs the rear of the second vehicle and acquires information on whether the tail lights of the photographed rear of the second vehicle 20 are on or not. Fig. 2(a) is an example of an image of the rear of the second vehicle acquired by the acquisition unit 11. Note that the image acquired by the acquisition unit 11 includes at least the outline of the entire body of the second vehicle 20, and the tail lights and license plate are captured within this outline.

[0015] In the following description, the acquisition unit 11 is described as using a camera capable of capturing images of the second vehicle 20, but a camera capable of capturing video images or a camera capable of capturing images outside the visible light range may be used. In addition, if a drive recorder is installed in the first vehicle 10, the acquisition unit 11 may use a camera used in the drive recorder.

[0016] The lighting determination unit 12 determines whether or not the tail lights of the second vehicle 20 are on, from the image of the rear part of the second vehicle 20 acquired by the acquisition unit 11. Here, a tail light is a lamp for notifying a following vehicle of the presence of the vehicle when visibility is poor at night or in bad weather, and is described as a red lamp, but a brake light provided at the rear of the vehicle can also be treated in the same way.

[0017] The symmetry determination unit 13 determines whether the taillights of the second vehicle 20 are turned on normally based on whether the taillights of the second vehicle 20 are positioned symmetrically on the left and right from the image of the rear of the second vehicle 20 acquired by the acquisition unit 11.

[0018] More specifically, as shown in FIG. 2(b), the symmetry determination unit 13 extracts the contour of the second vehicle 20 from the image acquired by the acquisition unit 11 to facilitate image processing. The symmetry determination unit 13 then uses information on the extracted contour to define a center line in the left-right direction of the second vehicle 20. The symmetry determination unit 13 can then determine whether or not the red taillights are located symmetrically. FIG. 2(c) shows an example of a state in which the taillights of the second vehicle 20 have burned out and the red taillights are not located symmetrically.

[0019] The lighting determination unit 12 and the symmetry determination unit 13 may be realized by one arithmetic device, or each may be realized by a separate arithmetic device. Typically, these determination units can use a storage device that stores the image acquired by the acquisition unit 11 and temporary image information when performing the determination process, or a arithmetic device such as a CPU (Central Processing Unit).

[0020] The transmission unit 14 transmits information on the image of the rear part of the second vehicle 20 acquired by the acquisition unit 11 and information on the determination results of the lighting determination unit 12 and the symmetry determination unit 13 to the server 30.

[0021] More specifically, when the lighting determination unit 12 determines that the tail lights of the second vehicle 20 are detected, and the symmetry determination unit 13 determines that the tail lights of the second vehicle 20 are not lit symmetrically, the transmission unit 14 transmits information to the server 30, assuming that there is a problem. The information transmitted by the transmission unit 14 to the server 30 here may be the image itself acquired by the acquisition unit 11, but it is sufficient that the information includes at least the license plate information of the second vehicle 20, which is the vehicle ahead, and information that the tail lights of the second vehicle 20 are in an abnormal state.

[0022] For example, if the timing at which the transmission unit 14 transmits information to the server 30 is limited to when the taillights of the second vehicle 20, which is the vehicle ahead, are in an abnormal state, then only the information on the license plate of the second vehicle 20 may be transmitted. In other words, the information that the transmission unit 14 transmits to the server 30 can be changed arbitrarily.

[0023] The server 30 includes a receiving unit 31 that receives information transmitted from the first vehicle 10, a storage unit 32 that pre-stores information related to a plurality of vehicles, and a transmitting unit 33. The server 30 is located at a remote location from the first vehicle 10 and the second vehicle 20.

[0024] The receiving unit 31 receives information transmitted from the first vehicle 10. Note that the receiving unit 31 and the transmitting unit 33 may use a single transmitting / receiving device having both functions. Note that typically, a wireless network connection can be used to transmit and receive information between the first vehicle 10 and the server 30 as shown in FIG. 1.

[0025] The storage unit 32 stores information related to a plurality of vehicles in advance. Here, the storage unit 32 stores information related to vehicles receiving the service of the driving assistance system, such as license plate information and contact information, in association with each other.

[0026] The transmitter 33 transmits information to the contact information when the license plate information of the multiple vehicles stored in the memory unit 32 matches the information of the second vehicle 20 received by the receiver 31. For example, the transmitter 33 can notify the driver of the second vehicle 20 of an abnormality in the tail light by email, or can notify the dealer of the second vehicle 20 of an abnormality in the tail light, according to the registered contact information. That is, the network line connection can also be used for the transmission of the notification by the transmitter 33.

[0027] Fig. 3 is a diagram showing an example of a flow in the driving assistance system in which a first vehicle 10 determines whether there is an abnormality in the taillights of a second vehicle 20, which is a vehicle ahead, and notifies a contact point as necessary via a server 30. An example of a processing flow of the driving assistance system will be described below with reference to Fig. 3.

[0028] The acquisition unit 11 of the first vehicle 10 acquires an image of the rear of the second vehicle 20, which is a vehicle ahead (step S1). Here, the acquisition unit 11 acquires an image of at least the outline, license plate, and taillights of the second vehicle 20 traveling ahead.

[0029] The lighting determination unit 12 determines whether or not the tail lights of the second vehicle 20 are on from the image acquired by the acquisition unit 11 (step S2). As an example, the lighting determination unit 12 can determine whether or not the tail lights of the second vehicle 20 are on by using the brightness of red in the acquired image and position information on the image of an area where this red is concentrated. As a more specific example, the lighting determination unit 12 can determine that the tail lights are on if there is a group of red colors of a predetermined brightness or higher within a certain range within the outline of the outer shape of the second vehicle 20 in the image acquired by the acquisition unit 11.

[0030] If the lighting determination unit 12 determines that the tail lights of the second vehicle 20 are not on (No in step S2), it is not possible to determine whether there is an abnormality, and so the process ends. If the lighting determination unit 12 determines that the tail lights of the second vehicle 20 are on (Yes in step S2), the process proceeds to step S3.

[0031] The symmetry determination unit 13 determines whether the tail lights of the second vehicle 20 are lit in symmetrical positions from the image acquired by the acquisition unit 11 (step S3). More specifically, the symmetry determination unit 13 determines a center line in the left-right direction from the outline of the second vehicle 20 as a line of symmetry as shown in Fig. 2(b), and determines whether there are tail lights that are lit in symmetrical positions as shown in Fig. 2(c). As an example, the symmetry determination unit 13 can determine whether there are tail lights that are lit in symmetrical positions by using position information on the image recognized as tail lights in step S2.

[0032] If the symmetry determination unit 13 determines that the tail lights of the second vehicle 20 are lit symmetrically (Yes in step S3), there is no problem and the process ends. If the symmetry determination unit 13 determines that the tail lights of the second vehicle 20 are not lit symmetrically (No in step S3), the process proceeds to step S4.

[0033] The transmitter 14 transmits the license plate information of the second vehicle 20 and information indicating that the taillights are in an abnormal state to the server 30 (step S4).

[0034] The server 30 checks whether the information of the second vehicle 20 received from the first vehicle 10 is stored in the storage unit 32 (step S5). That is, the server 30 checks whether the information of the second vehicle 20 is stored in advance in the storage unit 32 by referring to the license plate information.

[0035] If the information of the second vehicle 20 is not stored in the memory unit 32 (No in step S5), it is assumed that the user of the second vehicle 20 is not using the driving assistance system 1, and the process ends. On the other hand, if the information of the second vehicle 20 is pre-stored in the memory unit 32 (Yes in step S5), the server 30 sends a notification to the contact information for the second vehicle 20 stored in the memory unit 32 (step S6). More specifically, the server 30 can use the transmission unit 33 to send a notification to the pre-registered contact information via a network line.

[0036] This allows the driver of the second vehicle 20 to check for abnormal conditions in the taillights, which would be difficult for the driver to check by himself, by having the image acquired by the following vehicle, the first vehicle 10, and further allows him to receive a notification from the server 30 if an abnormality occurs.

[0037] Here, in the first vehicle 10, there is no need to use an expensive sensor or the like as the acquisition unit 11, and an inexpensive camera can be used. Therefore, in the driving assistance system 1, the cost of the equipment of the acquisition unit 11 installed in each vehicle can be reduced.

[0038] Furthermore, the server 30 can be set to notify not only the owner of the vehicle with the taillight malfunction but also the dealer, etc., as the contact information in case of a taillight malfunction. This allows the dealer to quickly order the part and prepare for part replacement.

[0039] Therefore, by using the driving assistance system 1, multiple vehicles can monitor and notify each other of abnormalities in the tail lights that are difficult for the driver to notice for their own vehicle. Therefore, the driving assistance system 1 can shorten the period during which the tail lights of each vehicle are in an abnormal state, thereby supporting safe driving.

[0040] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention. In other words, the above description has been omitted or simplified as appropriate for the purpose of clarity, and a person skilled in the art can easily modify, add, or convert each element of the embodiment within the scope of the present invention. [Explanation of symbols]

[0041] 10 First Car 11 Acquisition Department 12 Lighting determination section 13. Symmetry Determination Unit 14 Transmitter 20 Second Car 30 Servers 31 Receiving section 32 Storage section 33 Transmitter

Claims

[Claim 1] A driving assistance system that detects and notifies a following vehicle of an abnormality in the taillights of a forward vehicle, a step of the following vehicle photographing a rear portion of the forward vehicle; determining whether a tail light is on at the rear of the photographed forward vehicle; determining whether the tail lights are lit symmetrically from the captured rear image of the forward vehicle; When the tail lights are not lit symmetrically, acquiring a license plate number from the captured rear image of the vehicle ahead, and transmitting the acquired license plate number and tail light status information of the vehicle ahead to a server; and when the server has information about the vehicle ahead in advance, notifying the received information about the state of the taillights of the vehicle ahead to a contact point registered as information about the vehicle ahead. Driving assistance system.

Citation Information

Patent Citations

  • Abnormality determination system, object device, abnormality determination device, determination method, and program

    JP2017102585A

  • Server device, broken-down vehicle estimation method, and broken-down vehicle estimation program

    JP2019101502A

  • Abnormal vehicle detection device, abnormal vehicle detection system, abnormal vehicle detection method, and program

    JP2021157333A