Vehicle-mounted device, driving recording method, and driving recording system

Abstract

The invention provides a vehicle-mounted device for recording events by using a camera arranged on a surrounding vehicle. A vehicle-mounted device is provided with: an imaging unit (101) for imaging at least the license plate of a peripheral vehicle (203) from a host vehicle (201); a license plate recognition unit (102) that recognizes license plate information on the basis of the captured license plates of the surrounding vehicles; an event information detection unit (103) that detects event information of the host vehicle; and a transmission unit (104) that transmits license plate information of the surrounding vehicle and transmits event information of the host vehicle for controlling so that the specified surrounding vehicle records an event image.

Description

Technical Field

[0001] The invention relates to a vehicle-mounted device, a driving recording method and a driving recording system. Background Art

[0002] A vehicle-mounted device that records images immediately before an accident has been developed. Patent document 1 describes a vehicle-mounted device that simultaneously records image information from a CCD (charge-coupled device) camera and sensor information from a vehicle speed sensor 3 to an acceleration sensor 6 in a random access memory 12 under the control of a control circuit 11. In addition, the recorded information in the random access memory 12 is transferred to a flash memory 13 through the action of a collision sensor 2, and is retrieved from an output terminal 15 via an encoder 14 to replay image information immediately before the accident.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2000-6854 Summary of the invention

[0006] In the above-mentioned documents, it is considered to use a camera mounted on the vehicle to take pictures. In the past, there were only cameras in the front, but now there are vehicle-mounted devices that can take pictures of the rear, the interior of the vehicle, and even the surrounding 360°. However, due to the performance of the camera such as lens performance, sensor resolution, and exposure time, image jitter, rolling shutter distortion, highlight overflow, and field of view angle limitations occur. Therefore, sometimes it is impossible to record all matters of an accident or other event. For example, it is impossible to reliably record a hit license plate only by a camera installed on the vehicle.

[0007] Therefore, an object of the present disclosure is to provide a vehicle-mounted device that records an event using not only a camera installed in the vehicle but also cameras (drive recorders) installed in surrounding vehicles.

[0008] The vehicle-mounted device disclosed in the present invention comprises: A photographing unit, for photographing at least license plates of surrounding vehicles from the own vehicle; A license plate recognition unit, which recognizes license plate information based on the license plates of the surrounding vehicles photographed; an event information detection unit, detecting event information of the host vehicle; and The transmitting unit transmits the license plate information of the surrounding vehicles and the event information of the own vehicle, wherein the event information is used to control the surrounding vehicles determined by the control unit in such a manner that the surrounding vehicles record event images.

[0009] The driving recording method disclosed in the present invention comprises the following steps: Take photos of at least the license plates of surrounding vehicles from your own vehicle; Identify license plate information according to the license plates of the surrounding vehicles photographed; Detecting event information of the vehicle; Sending the event information of the own vehicle and the license plate information of the surrounding vehicles to a control unit of a server; and The license plate information of the surrounding vehicles is sent, and the event information of the own vehicle is sent, wherein the event information is used to control in a manner of determining the surrounding vehicles based on the license plate information of the surrounding vehicles and causing the determined surrounding vehicles to record event images.

[0010] The driving record system disclosed in the present invention has: A photographing unit, for photographing at least license plates of surrounding vehicles from the own vehicle; A license plate recognition unit, which recognizes license plate information based on the license plates of the surrounding vehicles photographed; An event information detection unit, detecting event information of the vehicle; A sending unit, sending the event information of the vehicle and the license plate information of the surrounding vehicles to a control unit of a server; The control unit of the server determines the surrounding vehicles based on the license plate information of the surrounding vehicles sent, and controls the determined surrounding vehicles in such a manner that they record the event image of the own vehicle; and The recording unit non-temporarily records the event image recorded by the surrounding vehicles.

[0011] According to the present embodiment, it is possible to provide a vehicle-mounted device that records an event using not only a camera installed in the vehicle but also cameras (drive recorders) installed in surrounding vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 This is a block diagram of a vehicle-mounted device according to an embodiment.

[0013] Figure 2 Schematic diagram of a driving record system according to an embodiment.

[0014] Figure 3 : is a flowchart of a driving recording method according to an embodiment.

[0015] Figure 4 This is a diagram showing surrounding vehicles in an accident that occurs when turning right in a priority lane according to an embodiment.

[0016] Figure 5 This is a diagram showing surrounding vehicles in an accident that occurs when turning right in a priority lane according to an embodiment.

[0017] Figure 6 This is a diagram showing surrounding vehicles in an accident that occurs when a vehicle turns left in a non-priority lane according to an embodiment.

[0018] Figure 7 This is a diagram showing surrounding vehicles in an accident that occurs when a vehicle turns left in a non-priority lane according to an embodiment. DETAILED DESCRIPTION

[0019] Implementation

[0020] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. However, the invention of the claims is not limited to the following embodiments. In addition, not all structures described in the embodiments are necessary as means for solving the problems. For the sake of clarity of the description, the following description and drawings are appropriately omitted and simplified. In each of the drawings, the same elements are marked with the same reference numerals, and repeated descriptions are omitted as needed.

[0021] (Description of vehicle-mounted device and driving recording system according to the embodiment)

[0022] Figure 1 This is a block diagram of a vehicle-mounted device according to an embodiment. Figure 2 Schematic diagram of a driving record system according to an embodiment. Figure 1 and Figure 2 The vehicle-mounted device and the driving recording system according to the embodiment will be described.

[0023] like Figure 1 As shown, the vehicle-mounted device 100 according to the embodiment includes a photographing unit 101, a license plate recognition unit 102, an event information detection unit 103, and a transmission unit 104. Figure 1 as well as Figure 2 As shown, the driving record system involved in the implementation method includes: a vehicle-mounted device 100, which includes a shooting unit 101, a license plate recognition unit 102, an event information detection unit 103 and a sending unit 104; a vehicle 201; a server 202; surrounding vehicles 203; a driving recorder 204; a control unit 205; a recording unit 206; and a recording unit 207.

[0024] The photographing unit 101 can use, for example, a CCD camera or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The photographing unit 101 can use a driving recorder mounted on the vehicle 201. The photographing unit 101 captures images of at least the license plates of surrounding vehicles 203 from the vehicle 201. Therefore, the photographing unit 101 preferably has a wide photographing range. The photographing unit 101 preferably can capture not only images in front but also images inside and behind the vehicle cabin. The photographing unit 101 is particularly preferably capable of capturing 360° all-round images including the sides. In addition, the image contains a plurality of images (also called frames) in a time series, so the image and the video can be interchangeably referred to.

[0025] The license plate recognition unit 102 is a part that has the function of recognizing license plate information. The license plate recognition unit 102 includes an image analysis based on AI (Artificial Intelligence). The license plate recognition unit 102 recognizes at least part of the license plate based on the surrounding vehicles 203 photographed. The license plate recognition unit 102 can also recognize the number of the license plate through image analysis. The license plate information can be the numbers and characters recorded on the license plate recognized by image analysis, or it can be an image where the license plate is recognized and only the part is cut out.

[0026] The event information detection unit 103 detects event information of the vehicle 201. Event information can be obtained from various sensors such as acceleration sensors and speed sensors, and image analysis of a driving recorder. For example, an acceleration sensor detects an impact caused by a collision of a vehicle. In addition, environmental sensors (radio sensors, optical sensors, event-based visual sensors, and sound wave sensors) detect theft in the vehicle. In addition, image analysis of a driving recorder based on AI detects aggressive driving. In this way, the event information detection unit 103 detects events such as impact caused by an accident and aggressive driving that occur in the vehicle 201. In addition, the event information also includes time information such as the time of occurrence of the event.

[0027] The transmission unit 104 is a part having a function of transmitting the event information of the own vehicle 201 and the license plate information of the surrounding vehicles 203 to the control unit 205 of the external server 202 when event information is detected. The transmission unit 104 can use the existing network to transmit the event information and the license plate information. The existing network is a mobile phone line such as LTE (Long Term Evolution), 4G (4th Generation), 5G (5th Generation), an Internet line using WiFi and Bluetooth (registered trademark), and VICS (Vehicle Information and Communication System) (registered trademark). The transmission unit 104 specifies the surrounding vehicles 203 based on the received license plate information, obtains the record of the driving recorder 204, and transmits the event information to the control unit 205 which controls the recording unit 206 and the recording unit 207 to record the records obtained.

[0028] The functions of the vehicle-mounted device 100 may be implemented by a single device or by a plurality of devices having the functions dispersed therein. In the case where the functions are dispersed therein, the devices are combined into a single vehicle-mounted device 100 .

[0029] The host vehicle 201 is a vehicle driven by a driver. The host vehicle 201 is equipped with the vehicle-mounted device 100 .

[0030] As the server 202, a computer composed of a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a hard disk, an I / O (Input / Output) interface, etc. can be used. The server 202 can be composed of one device or a plurality of devices. In addition, a part or all of the server 202 can also be configured at the edge or in the cloud. Furthermore, the server 202 can also configure various functions in a distributed manner in the cloud. The server 202 sends event information from a plurality of vehicles via the network. The server 202 is set at a location away from the vehicle 201. In order to monitor the accident recorded by the driving recorder 204, the server 202 can use a server set up by an insurance company.

[0031] The surrounding vehicles 203 are vehicles existing around the host vehicle 201. The surrounding vehicles 203 correspond to vehicles in front of and behind the host vehicle 201 in the same lane, oncoming vehicles, and vehicles crossing at an intersection. The surrounding vehicles 203 may be one or more.

[0032] The driving recorder 204 is a driving recorder mounted on the surrounding vehicles 203. The driving recorder 204 captures images of the surroundings of the surrounding vehicles 203. Therefore, it is possible to capture images of the vehicle 201. Similar to the vehicle-mounted device 100, the driving recorder 204 is connected to the network via a transceiver. That is, the vehicle-mounted device 100, the server 202, and the driving recorder 204 are connected via a network. However, the connection between the vehicle-mounted device 100 and the server 202 and the connection between the server 202 and the driving recorder 204 may be based on the same network or may be based on different networks. The driving recorder 204 is connected to the control unit 205 of the server 202 via the network and can be controlled by the control unit 205. The recording of the driving recorder 204 is a temporary recording recorded in a ring buffer manner.

[0033] The control unit 205 of the server 202 corresponds to, for example, a CPU. The control unit 205 sends the license plate information together with the event information. The control unit 205 identifies the surrounding vehicles 203 based on the license plate information. The control unit 205 performs control in such a manner that the driving recorder 204 records the event images of the identified surrounding vehicles 203 generated due to the event of the own vehicle 201. The driving recorder 204 is controlled after the event, but the control in such a manner that the driving recorder 204 records the event images also includes obtaining the records of the driving recorder 204 before the event. That is, controlling the surrounding vehicles 203 in such a manner that the event images of the own vehicle 201 are recorded includes retroactively obtaining the images of the event recorded in the driving recorder 204 after the event.

[0034] The recording unit 206 is a medium that the server 202 has and that records the recording of the driving recorder 204 in a non-temporary manner. The recording unit 206 includes a magnetic recording medium (e.g., a floppy disk, a magnetic tape, a hard disk drive), a magneto-optical recording medium (e.g., a magneto-optical disk), a CD-R, a CD-R / W, and a semiconductor memory. The recording unit 206 can record event images in a non-temporary manner.

[0035] The recording unit 207 is a non-temporary recording medium of the drive recorder 204. The recording unit 207 includes a hard disk drive and a memory card. The recording unit 207 can record event images non-temporarily.

[0036] The control unit 205 controls the event image recorded by the driving recorder 204 of the surrounding vehicle 203 in the non-temporary recording unit 206, 207. As described above, the recording unit 206, 207 is sometimes set in the server 202, and sometimes set in the surrounding vehicle 203. The recording unit 206, 207 can be set in either the server 202 or the surrounding vehicle 203, or can be set in both. When the record of the driving recorder 204 is written to the recording unit 206 of the server 202, the recording unit 206 will not be interfered with by others, so it is preferred. In addition, when writing to the non-temporary recording unit 207 of the driving recorder 204, since the surrounding vehicles 203 and their owners are determined, the driver of the vehicle 201 can negotiate with the owner to recover the recording unit 207 or its data. The database of the insurance company sometimes grasps whether the contract vehicle is equipped with a driving recorder. Therefore, the insurance company can provide the driver of the vehicle 201 with the image of the accident as an intermediary.

[0037] By using such a vehicle-mounted device 100 and a driving recording system, not only the camera installed in the vehicle 201 but also the cameras (driving recorders 204) installed in the surrounding vehicles 203 can be used to record the event. Therefore, it is possible to collect information more comprehensively and extensively. For example, when the vehicle 201 performs a collision avoidance, even if the license plate of the avoided vehicle is not recorded in the driving recorder of the vehicle 201, the driver can know that the driving recorder 204 of the surrounding vehicle 203 is recording the scene.

[0038] (Description of driving recording method according to embodiment)

[0039] Figure 3 : is a flowchart of a driving recording method according to an embodiment. Figure 3 A driving recording method according to an embodiment will be described.

[0040] First, the license plate information of the surrounding vehicles 203 is photographed (step S301). That is, at least the license plates of the surrounding vehicles 203 are photographed from the host vehicle 201. Normally, the photographing unit 101 photographs the surrounding vehicles 203 including the scenery and the license plates.

[0041] Next, the license plate information is identified (step S302). The license plate information is identified based on the license plates of the surrounding vehicles 203 that are photographed. The numbers and characters recorded on the license plate can also be identified by image analysis. In addition, when the license plate information is sent to the control unit 205, the control unit 205 can also identify the numbers and characters recorded on the license plate.

[0042] Next, event information of the vehicle 201 is detected (step S303). Events do not occur frequently. Therefore, event information is detected not using a dedicated sensor but using other sensors, and preferably using a speed sensor and an acceleration sensor mounted on the vehicle 201.

[0043] When an event is detected, event information and license plate information are sent to the control unit 205 of the server 202 (step S304 ). That is, when event information is detected, event information of the host vehicle 201 and license plate information of the surrounding vehicles 203 are sent to the control unit 205 of the server 202 .

[0044] Next, the control unit 205 controls the surrounding vehicles 203 so as to identify them and record the event images of the own vehicle 201 (step S305). That is, when the event information of the own vehicle 201 is sent to the control unit 205 of the server 202, the control unit 205 identifies the surrounding vehicles 203 based on the license plate information of the surrounding vehicles 203 sent. Then, the control unit 205 controls the driving recorder 204 of the surrounding vehicles 203 so that the identified surrounding vehicles 203 record the event images reflecting the state of the event of the own vehicle 201 in the driving recorder 204.

[0045] Finally, the recording units 206 and 207 non-temporarily record the event image (step S306). The recording of the drive recorder 204 is directly overwritten, so it is necessary to write to the recording units 206 and 207 that can store non-temporarily. The process ends.

[0046] Such a driving recording method can record an event using not only a camera installed in the own vehicle 201 but also cameras (drive recorders 204 ) installed in surrounding vehicles 203 .

[0047] Here, the license plate information of the surrounding vehicles 203 is identified before the event information is detected, and the license plate information identified before the event information is detected is sent to the control unit 205 when the event occurs. By sending the event information only when the event occurs, it is possible to prevent useless information from being sent. In addition, by identifying the license plate information before detecting the event information, it is possible to prepare for sending the license plate information. In the case where the license plate information of the surrounding vehicles 203 is identified before the event information is detected, the license plate information before a certain period of time from the event is updated. That is, the license plate information is recorded in a ring buffer manner. The license plate information recorded together with the event occurrence is utilized.

[0048] On the other hand, the license plate information of the surrounding vehicles 203 can also be identified after the event information is detected, and the identified license plate information can be sent to the control unit 205 after the event information is detected. In this way, more powerful information can be obtained. However, it is preferred to identify the license plate information before the event information is detected. This is because the license plate information can be prepared to be sent.

[0049] (Description of Surrounding Vehicles in an Accident According to Embodiment)

[0050] Figure 4 This is a diagram showing surrounding vehicles in an accident that occurs when turning right in a priority lane according to an embodiment. Figure 5 This is a diagram showing surrounding vehicles in an accident that occurs when turning right in a priority lane according to an embodiment. Figure 6 This is a diagram showing surrounding vehicles in an accident that occurs when a vehicle turns left in a non-priority lane according to an embodiment. Figure 7 FIG. 1 is a diagram showing surrounding vehicles in an accident that occurs when turning left in a non-priority lane according to an embodiment. Figures 4 to 7 , the surrounding vehicles in the accident involved in the implementation method are described.

[0051] like Figure 4 As shown, the vehicle 201 and the other vehicle 401 are traveling towards each other in the priority lane. Figure 5 As shown, it is assumed that the host vehicle 201 collides with another vehicle 401 when turning right. In this case, the license plate information of the white surrounding vehicle 203 around the host vehicle 201 is recognized before the accident. Therefore, the driving recorder 204 of the surrounding vehicle 203 is used to capture the state of the accident.

[0052] Here, the surrounding vehicles 203 are shown as vehicles traveling in the same lane and vehicles traveling in the opposite lane as vehicles having license plate information that can be recognized before the accident. However, the surrounding vehicles 203 that capture the event of recognizing the license plate information after the accident may also include vehicles 501 in a non-priority lane that are stopped due to waiting for a traffic light, represented by hatching. If the vehicle 201 is equipped with a camera for capturing side images, such a vehicle 501 can be selected as the surrounding vehicle 203. The determination of which direction the image from the surrounding is needed can also be inferred based on sensor information. For example, in the event that another vehicle 401 collides with the left side of the vehicle 201, a vehicle equipped with a driving recorder 204 that is likely to capture the collision is determined.

[0053] In addition, the driving recorder mounted on the vehicle 201 can also always provide GPS or acceleration sensor information to the server. In this case, the vehicle and camera that can be photographed can be determined based on the vehicle's position information (GPS (Global Positioning System)) and direction information. In order not to collect irrelevant images, the license plate information of the opposite vehicle that was far away before the event can also be excluded from the object.

[0054] like Figure 6 As shown, the vehicle 201 is traveling in the non-priority lane, and the other vehicle 401 is traveling in the priority lane. Figure 7 As shown, the vehicle 201 collides with another vehicle 401 when turning left. In this case, the dashcam 204 of the white surrounding vehicle 203 around the vehicle 201 can record the accident. The vehicle traveling in the same lane as the vehicle 201 and the vehicle traveling in the same lane as the other vehicle 401. The vehicle traveling in the same lane as the vehicle 201 far from the accident scene and the vehicle traveling in the same lane as the other vehicle 401 can also record powerful information.

[0055] In addition, part or all of the processing in the above-mentioned vehicle-mounted device 100 and server 202 can be implemented as a computer program. Such a program can be stored and provided to the computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of physical storage media. Examples of non-transitory computer-readable media include magnetic recording media (such as floppy disks, magnetic tapes, hard disk drives), optical magnetic recording media (such as optical magnetic disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, semiconductor memory (such as mask ROM, PROM (Programmable ROM, Programmable Read-Only Memory), EPROM (Erasable PROM, Erasable Programmable Read-Only Memory), Flash ROM, RAM (Random Access Memory)). The program can be provided to the computer through various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical signals, optical signals, and electromagnetic waves. Temporary computer-readable media can provide the program to the computer via a wired communication path such as wires and optical fibers or a wireless communication path.

[0056] In addition, the present invention is not limited to the above-mentioned embodiment, and can be appropriately modified within a range not departing from the gist.

[0057] This application claims the benefit of priority based on Japanese patent application No. 2022-102071, filed on June 24, 2022, the disclosure of which is incorporated herein in its entirety.

[0058] Industrial Applicability

[0059] This embodiment can record an image of an accident using a vehicle-mounted device mounted on a vehicle.

[0060] Description of symbols

[0061] 101 Filming Department

[0062] 102 License Plate Recognition Department

[0063] 103 Event Information Detection Department

[0064] 104 Sending Department

[0065] 201 This vehicle

[0066] 202 Server

[0067] 203 Surrounding vehicles

[0068] 204 Driving Recorder

[0069] 205 Control Department

[0070] 206 Records Department

[0071] 207 Records Department

[0072] 401 Other vehicles

Claims

1. A vehicle-mounted device, comprising: A photographing unit, for photographing at least license plates of surrounding vehicles from the own vehicle; A license plate recognition unit, which recognizes license plate information based on the license plates of the surrounding vehicles photographed; an event information detection unit, detecting event information of the host vehicle; and The sending unit sends the license plate information of the surrounding vehicles to the control unit, and sends the event information of the own vehicle, wherein the event information is used to control the surrounding vehicles determined by the control unit in such a manner that the surrounding vehicles record event images.

2. The vehicle-mounted device according to claim 1, wherein: Before detecting the event information, the license plate recognition unit recognizes the license plate information of the surrounding vehicles. When the event information is detected, the transmission unit transmits the license plate information recognized before the event information is detected to the control unit.

3. The vehicle-mounted device according to claim 1, wherein: When the event information is detected, the sending unit sends the license plate information recognized by the license plate recognition unit before detecting the event information to the control unit, and sends the license plate information recognized by the license plate recognition unit after detecting the event information to the control unit.

4. A driving record method, comprising the following steps: Take photos of at least the license plates of surrounding vehicles from your own vehicle; Identify license plate information according to the license plates of the surrounding vehicles photographed; Detecting event information of the vehicle; as well as The license plate information of the surrounding vehicles is sent, and the event information of the own vehicle is sent, wherein the event information is used to control in a manner of determining the surrounding vehicles based on the license plate information of the surrounding vehicles and causing the determined surrounding vehicles to record event images.

5. A driving record system comprising: A photographing unit, for photographing at least license plates of surrounding vehicles from the own vehicle; A license plate recognition unit, which recognizes license plate information based on the license plates of the surrounding vehicles photographed; An event information detection unit, detecting event information of the vehicle; A sending unit, sending the event information of the vehicle and the license plate information of the surrounding vehicles to a control unit of a server; The control unit of the server determines the surrounding vehicles based on the license plate information of the surrounding vehicles sent, and controls the determined surrounding vehicles in such a manner that they record the event image of the own vehicle; and The recording unit non-temporarily records the event image recorded by the surrounding vehicles.

Images