Vehicle information collection system and vehicle information collection method

Abstract

We collect information to reduce the processing load and enable the rapid delivery of search results. [Solution] The control unit of the vehicle recording device includes an image acquisition unit that acquires images captured by an external camera, and a communication control unit that transmits the surrounding images to the server device as vehicle information along with the vehicle's location information and shooting date and time information. The control unit of the server device includes a data acquisition unit that collects vehicle information from multiple vehicle recording devices, a first storage control unit that stores the identification information, location information, and shooting date and time information as vehicle information if the identification information of other vehicles can be recognized from the images of the collected vehicle information, and a second storage control unit that, when the identification information matches among the multiple stored vehicle information and at least a portion of the location information and shooting date and time information matches, deletes at least one of the multiple vehicle information and the remaining at least a portion of the remaining information based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that captured the images corresponding to the identification information.

Description

Technical Field

[0001] The present invention relates to a vehicle information collection system and a vehicle information collection method.

Background Art

[0002] There is known a technique of receiving, from a moving body, imaging information in which position information of the moving body, at least one of front-side and rear-side imaging images of other moving bodies captured from the moving body, and an imaging date and time are associated with each other, and storing, in a database, moving body analysis information in which imaging character information included in the imaging image, position information included in the imaging information, and the imaging date and time are associated with each other (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a technique of collecting video from in-vehicle cameras arranged in a plurality of vehicles and storing information as in the technique described in Patent Document 1, the information based on the collected video becomes an enormous amount. Therefore, for example, the load of a process of searching for necessary information from the stored information becomes excessive, and there is a possibility that it takes time to provide a search result. Therefore, it is desired to collect information so as to reduce the load of the process and enable the search result to be provided quickly.

[0005] The present disclosure has been made in view of the above, and an object thereof is to reduce the load of a process and quickly provide a search result.

Means for Solving the Problems

[0006] To solve the above-mentioned problems and achieve the objective, the vehicle information collection system according to this disclosure comprises a vehicle recording device equipped with a camera unit and arranged in multiple vehicles, and a server device that collects and stores vehicle information from the vehicle recording device, wherein the control unit of the vehicle recording device comprises an image acquisition unit that acquires images of the area around the vehicle taken by the camera unit, and a communication control unit that transmits the images of the area taken by the camera unit to the server device as vehicle information, along with the vehicle's location information and the date and time of shooting information, and the control unit of the server device collects the vehicle information from the multiple vehicle recording devices. The system includes a data collection unit, a first storage control unit that stores the identification information, location information, and shooting date and time information as vehicle information if the identification information of another vehicle can be recognized from the video of the vehicle information collected by the data collection unit, and a second storage control unit that, when the identification information matches among the multiple stored vehicle information and at least a portion of the location information and shooting date and time information matches, deletes at least one of the multiple vehicle information and the remaining portion based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that took the video corresponding to the identification information.

[0007] The vehicle information collection method relating to this disclosure is a vehicle information collection method performed by a vehicle information collection system comprising a vehicle recording device equipped with a shooting unit and arranged in a plurality of vehicles, and a server device that collects and stores vehicle information from the vehicle recording device, wherein the control unit of the vehicle recording device performs the following: acquires video footage of the area around the vehicle taken by the shooting unit, and transmits the video footage of the area taken by the shooting unit to the server device as vehicle information, along with the vehicle's location information and shooting date and time information; the control unit of the server device performs the following: collects the vehicle information from the plurality of vehicle recording devices, and if identification information of another vehicle can be recognized from the video footage of the collected vehicle information, stores the identification information, the location information, and the shooting date and time information as vehicle information; and if, among the plurality of stored vehicle information, the identification information matches and at least a portion of the location information and shooting date and time information matches, deletes at least a portion of the remaining vehicle information, leaving at least one of the plurality of vehicle information, based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that took the video footage corresponding to the identification information. [Effects of the Invention]

[0008] According to this disclosure, the information can be collected in a way that reduces the processing load and enables the rapid provision of search results. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a schematic diagram showing an example configuration of a vehicle information collection system according to an embodiment. [Figure 2] Figure 2 is a block diagram showing an example configuration of a vehicle recording device according to an embodiment. [Figure 3] Figure 3 is a block diagram showing an example configuration of a server device according to the embodiment. [Figure 4] Figure 4 illustrates an example of the relative positions of multiple vehicles. [Figure 5] Figure 5 illustrates an example of the video footage captured by each vehicle in Figure 4(a). [Figure 6] Figure 6 illustrates an example of vehicle information stored in the vehicle information storage unit when the video shown in Figure 5 is captured. [Figure 7] Figure 7 illustrates an example of the video footage captured by each vehicle in Figure 4(b). [Figure 8] Figure 8 illustrates an example of vehicle information stored in the vehicle information storage unit when the video shown in Figure 7 is captured. [Figure 9] Figure 9 illustrates an example of the video footage captured by each vehicle in Figure 4(c). [Figure 10] Figure 10 illustrates an example of vehicle information stored in the vehicle information storage unit when the video shown in Figure 9 is captured. [Figure 11] Figure 11 is a flowchart showing an example of the processing flow in a vehicle recording device according to an embodiment.

[0010] Embodiments of the vehicle information collection system and vehicle information collection method according to this disclosure will be described in detail below with reference to the attached drawings. However, the present invention is not limited to the following embodiments. [Modes for carrying out the invention]

[0011] [Embodiment] <Vehicle Information Collection System> Figure 1 is a schematic diagram showing an example configuration of a vehicle information collection system according to an embodiment. The vehicle information collection system 1 is a system that collects and stores data from an in-vehicle camera to be stored in a search database for tracking vehicles traveling on the road. For example, when a crime occurs and a user wants to track a specific vehicle, the user specifies search conditions such as the license plate number of the specific vehicle to the search database and obtains information including location information related to the specific vehicle.

[0012] The vehicle information collection system 1 includes a vehicle recording device 10 disposed in a plurality of vehicles and equipped with an external camera (imaging unit) 11, and a server device 30 that collects and stores vehicle information from the vehicle recording device 10. The vehicle recording device 10 and the server device 30 are connected so as to be able to transmit and receive data.

[0013] <Vehicle recording device> FIG. 2 is a block diagram showing a configuration example of the vehicle recording device according to the embodiment. The vehicle recording device 10 records an image of the periphery of the vehicle. The vehicle recording device 10 transmits the image of the periphery of the vehicle to the server device 30. The vehicle recording device 10 is, for example, a so-called drive recorder.

[0014] The vehicle recording device 10 always records an image, that is, performs so-called loop recording, from when the engine starts until it stops, that is, while the vehicle is operating rather than in a parked state.

[0015] In addition to being mounted on the vehicle, the vehicle recording device 10 may be a portable device that can be used in the vehicle. Further, the vehicle recording device 10 may be realized including functions or configurations of a device pre-installed in the vehicle, a navigation device, etc. The vehicle recording device 10 includes an external camera 11, a GNSS (Global Navigation Satellite System) receiving unit 12, a communication unit 19, and a control unit 20.

[0016] The external camera 11 is one or more cameras that image the periphery of the vehicle. In the present embodiment, the external camera 11 has a front camera (not shown) capable of imaging the front and a rear camera (not shown) capable of imaging the rear. The front camera is disposed, for example, in front of the vehicle interior of the vehicle. The rear camera is disposed, for example, behind the vehicle interior of the vehicle. In the following description, when it is not necessary to distinguish between a plurality of cameras, it will be described as the external camera 11. The external camera 11 outputs the captured image to the image acquisition unit 来21. The image is, for example, a moving image composed of images at 30 frames per second.

[0017] The GNSS receiving unit 12 consists of a GNSS receiver and other components that receive GNSS signals from GNSS satellites. The GNSS receiving unit 12 outputs the received GNSS signals to the position information acquisition unit 22.

[0018] The communication unit 19 is a communication unit. The communication unit 19 may communicate by any of the following methods: short-range wireless communication, the internet, or a mobile phone line. The communication unit 19 communicates data with the server device 30. In this embodiment, the communication unit 19 transmits the surrounding video captured by the external camera 11 to the server device 30 as vehicle information, along with the vehicle's location information and the date and time of capture.

[0019] The control unit 20 is an arithmetic processing unit composed of, for example, a CPU (Central Processing Unit) or an image processing processor. The control unit 20 loads a program stored in a storage unit (not shown) into memory and executes the instructions contained in the program. The control unit 20 includes an image acquisition unit 21, a location information acquisition unit 22, and a communication control unit 29. The control unit 20 includes an internal memory (not shown), which is used for temporary storage of data in the control unit 20. The control unit 20 may be composed of one or more devices.

[0020] The video acquisition unit 21 acquires video footage of the area around the vehicle. More specifically, the video acquisition unit 21 acquires video footage output by the external camera 11.

[0021] The location information acquisition unit 22 acquires location information indicating the vehicle's current location. The location information acquisition unit 22 calculates the vehicle's current location information by a known method, for example, based on the GNSS signal from the GNSS receiver unit 260.

[0022] The communication control unit 29 controls communication in the communication unit 19. The communication control unit 29 controls the communication of data with the server device 30 via the communication unit 19.

[0023] <Server equipment> Figure 3 is a block diagram showing an example configuration of a server device according to an embodiment. The server device 30 collects and stores vehicle information from vehicle recording devices 10. In this embodiment, the server device 30 collects and stores vehicle information from vehicle recording devices 10 located within a predetermined range, such as a city, town, village, or a predetermined section of a road. The server device 30 comprises a map information storage unit 31, a vehicle information storage unit 32, a communication unit 39, and a control unit 40.

[0024] The map information storage unit 31 stores map information, including road and intersection information. The map information storage unit 31 is shared with other systems, such as a navigation system. The map information storage unit 31 may also store traffic information, including congestion, construction, and accidents, obtained from external organizations via the communication unit 39.

[0025] The vehicle information storage unit 32 stores vehicle information, for example, a search database for tracking vehicles traveling on a road. The vehicle information storage unit 32 is, for example, a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a storage device such as a hard disk or optical disc. Alternatively, it may be an external storage device wirelessly connected via a communication device (not shown).

[0026] The vehicle information stored in the vehicle information storage unit 32 includes, for example, vehicle identification information, location information, and date and time of shooting information. The vehicle information may also include the results of driver face recognition.

[0027] The communication unit 39 is a communication unit. The communication unit 39 may communicate by any of the following methods: short-range wireless communication, the internet, or a mobile phone line. The communication unit 39 communicates data with the vehicle recording device 10. The communication unit 39 receives video, vehicle location information, and shooting date and time information as vehicle information from the vehicle recording device 10.

[0028] The control unit 40 is an arithmetic processing unit composed of, for example, a CPU or an image processing processor. The control unit 40 loads a program stored in a storage unit (not shown) into memory and executes the instructions contained in the program. The control unit 40 includes a data collection unit 41, a map information acquisition unit 42, a vehicle information processing unit 45, a storage control unit 47, a search request processing unit 48, and a communication control unit 49. The control unit 40 includes an internal memory (not shown), which is used for temporary storage of data in the control unit 40. The control unit 40 may be composed of one or more devices.

[0029] The data acquisition unit 41 collects vehicle information from multiple vehicle recording devices 10. More specifically, the data acquisition unit 41 acquires the captured surrounding video from the multiple vehicle recording devices 10 as vehicle information, along with the vehicle's location information and the date and time of capture.

[0030] The map information acquisition unit 42 acquires map information from the map information storage unit 31.

[0031] The vehicle information processing unit 45 performs a process to determine whether or not to store the vehicle information in the vehicle information storage unit 32. The vehicle information processing unit 45 determines whether or not identification information of other vehicles can be recognized from the vehicle information video collected by the data collection unit. More specifically, the vehicle information processing unit 45 determines, for example, whether or not the license plate number (digits) of other vehicles can be recognized from the vehicle information video collected by the data collection unit. The vehicle information processing unit 45 comprises a first processing unit 451 and a second processing unit 452.

[0032] The first processing unit 451 determines whether or not to temporarily store the vehicle information collected from the vehicle recording device 10 by the data acquisition unit 41 in the vehicle information storage unit 32. For example, if the video of the collected vehicle information shows identification information of another vehicle, it is stored in the vehicle information storage unit 32. For example, if the video of the collected vehicle information does not show identification information of another vehicle, it is not necessary to store it in the vehicle information storage unit 32.

[0033] The first processing unit 451 determines whether it is possible to recognize the identification information of other vehicles from the video of vehicle information collected from the vehicle recording device 10 by the data acquisition unit 41. More specifically, the first processing unit 451 determines, for example, whether it is possible to recognize the license plate number (digits) of other vehicles from the video of vehicle information collected by the data acquisition unit 41. For example, if there are no other vehicles between the photographed vehicle and the other vehicle, it is possible to recognize the license plate number (digits) of the other vehicle from the video taken by the external camera 11 mounted on the vehicle. For example, if the other vehicle is located one vehicle in front of the photographed vehicle, or one vehicle is located one vehicle behind the photographed vehicle, it is possible to recognize the license plate number (digits) of the other vehicle from the video taken by the external camera 11 mounted on the vehicle.

[0034] The first processing unit 451 may determine whether it is possible to recognize identification information of other vehicles from the vehicle information video, and further whether it is possible to recognize the face of the driver of the other vehicle. For example, for other vehicles that are not located between the vehicle being filmed and the vehicle that is visible from the front of the vehicle, the license plate number (digits) of the other vehicle can be recognized from the video captured by the external camera 11 mounted on the vehicle. For example, for other vehicles located one vehicle behind the vehicle being filmed, the license plate number (digits) of the other vehicle can be recognized from the video captured by the external camera 11 mounted on the vehicle.

[0035] The first processing unit 451 may determine whether it is possible to recognize identification information of other vehicles from the vehicle information video, whether it is possible to recognize the face of the driver of the other vehicle, and whether it is possible to recognize the appearance of the other vehicle, such as its color and make. For example, if there are no other vehicles between the photographed vehicle and the other vehicle, and the entire vehicle or a characteristic part of the vehicle's body is visible from the perspective of the photographed vehicle, the appearance of the other vehicle can be recognized from the video captured by the external camera 11 mounted on the vehicle. For example, if the other vehicle is located one vehicle in front of the photographed vehicle, or one vehicle is located one vehicle behind the photographed vehicle, the appearance of the other vehicle can be recognized from the video captured by the external camera 11 mounted on the vehicle.

[0036] The second processing unit 452 determines whether there is any overlap in the multiple vehicle information stored in the vehicle information storage unit 32 via the first processing unit 451. The second processing unit 452 determines, with respect to the vehicle information temporarily stored by the first storage control unit 471, at least one of the necessary vehicle information to be kept in the vehicle information storage unit 32 and the vehicle information to be deleted. More specifically, if the identification information, namely the license plate number (digit), matches among the multiple vehicle information stored by the first storage control unit 471, and at least a part of the location information and the date and time of shooting information matches, the second processing unit 452 determines, at least one of the necessary vehicle information to be kept in the vehicle information storage unit 32 and the vehicle information to be deleted.

[0037] The case where at least part of the location information and the shooting date and time information match means, for example, when the difference in the location information is within a predetermined range of a few meters, and the difference in the shooting date and time information is within a predetermined range of about one second.

[0038] The second processing unit 452 may change the criteria for determining the degree of agreement between location information and shooting date and time information among the vehicle information, based on traffic information including congestion, construction, and accidents, and map information.

[0039] The following explains how to change the determination criteria. For example, when the server device 30 determines whether at least a portion of the vehicle's location information and the date and time of shooting information match within a predetermined range for vehicle information collected from a vehicle recording device 10 located in a predetermined section of a road, the server device 30 changes the predetermined range of the location information or the predetermined range of the date and time of shooting information in the determination criteria for the degree of match based on traffic information and map information in the predetermined section.

[0040] The specified range for location information refers, for example, to a difference of a few meters or less in the vehicle's position. For instance, if the difference in the vehicle's position is a few meters or less, the location information is determined to match.

[0041] The specified range for shooting date and time information refers, for example, to a difference of approximately 1 second or less in the shooting date and time information. For example, if the difference in shooting date and time is approximately 1 second or less, it will be determined that the shooting dates and times match.

[0042] When a vehicle is traveling at a low speed, it is presumed that the temporal change in the vehicle's location information is small. Therefore, it is desirable to efficiently process a large number of similar vehicle data by expanding the predetermined range of location information or the predetermined range of shooting date and time information in the matching criteria. For example, if it is presumed that a vehicle is traveling at a low speed in a predetermined section of road due to congestion, construction, accidents, etc., based on traffic information and map information, the predetermined range of location information or the predetermined range of shooting date and time information in that predetermined section of road is expanded compared to when the vehicle is traveling at a normal speed. When a vehicle is traveling at a speed lower than normal, for example, the predetermined range of the vehicle's location information is changed from a few meters or less to a few tens of meters or less. When a vehicle is traveling at a speed lower than normal, for example, the predetermined range of shooting date and time information is changed from a second or less to a few tens of seconds or less.

[0043] Low speed refers to a speed of approximately 10 kilometers per hour or less on a regular road, for example.

[0044] A normal speed refers to a speed of around 40 kilometers per hour on a regular road, for example.

[0045] The second processing unit 452 determines, from the vehicle information in which the identification information, namely the license plate number (digit), matches and at least part of the location information and date and time of shooting information matches, which is at least one of the vehicle information to be kept in the vehicle information storage unit 32 and the vehicle information to be deleted.

[0046] The second processing unit 452 determines at least one of the necessary vehicle information and vehicle information to be deleted, based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that took the video corresponding to the identification information. Based on the above positional relationship, the second processing unit 452 determines the vehicle information corresponding to the video in which it is estimated that the license plate number (digits) of the other vehicle is likely to be recognized more accurately as necessary vehicle information. Based on the above positional relationship, the second processing unit 452 determines the vehicle information corresponding to the video in which it is estimated that the license plate number (digits) of the other vehicle is unlikely to be recognized more accurately as vehicle information to be deleted.

[0047] For example, the second processing unit 452 prioritizes vehicle information collected from vehicles that are close to other vehicles over vehicle information collected from other vehicles, and uses this information as necessary. This is because when the distance to other vehicles is short, it is possible to accurately recognize the license plate numbers (digits) of those vehicles.

[0048] For example, the second processing unit 452 prioritizes deleting vehicle information collected from vehicles with short distances from other vehicles, over vehicle information collected from other vehicles. This is because, when the distance between a vehicle and other vehicles is short, there is a high possibility that the license plate numbers (digits) of other surrounding vehicles other than the vehicle with the short distance cannot be accurately recognized.

[0049] For example, the second processing unit 452 prioritizes deleting vehicle information collected from a vehicle where the surrounding vehicles are large vehicles, over vehicle information collected from other vehicles. This is because, when the surrounding vehicles are large vehicles, there is a high possibility that the driver's view will be obstructed by the large vehicles, making it difficult to accurately recognize the license plate numbers (digits) of the other vehicles in the vicinity.

[0050] Furthermore, the second processing unit 452 may determine, based on the above positional relationship, vehicle information corresponding to images in which it is estimated that there is a high probability of more accurately recognizing the face of the driver of another vehicle or the exterior of another vehicle, as necessary vehicle information. The second processing unit 452 may also determine, based on the above positional relationship, vehicle information corresponding to images in which it is estimated that there is a low probability of more accurately recognizing the face of the driver of another vehicle or the exterior of another vehicle, as vehicle information to be deleted.

[0051] Furthermore, in order to reduce the processing load on the second processing unit 452, the following may be done: The second processing unit 452 may limit the vehicle information it processes. For example, if a predetermined section of a road is a highway or a road without junctions, the second processing unit 452 may determine the degree of matching of the vehicle information only if the location information is near a highway entrance / exit or near a junction, and decide which of the necessary vehicle information and which vehicle information to delete. For example, if a predetermined section of a road is a highway or a road without junctions, and the location information is not near a highway entrance / exit or near a junction, the second processing unit 452 may decide to delete the vehicle information without determining the degree of matching.

[0052] The memory control unit 47 controls the storage of vehicle information in the vehicle information storage unit 32. The memory control unit 4 comprises a first memory control unit 471 and a second memory control unit 472.

[0053] If the first memory control unit 471 can recognize the identification information of other vehicles from the video of vehicle information collected by the data acquisition unit 41, it temporarily stores the identification information, location information, and shooting date and time information as vehicle information.

[0054] If the first memory control unit 471 can recognize identification information of other vehicles from the vehicle information video, and can also recognize the face of the driver of the other vehicle, it may temporarily store the recognition result of the driver's face in addition to the identification information, location information, and shooting date and time information as vehicle information.

[0055] The first memory control unit 471 can recognize identification information of other vehicles from the vehicle information video, and if it can also recognize the appearance of other vehicles such as their color and make, it may temporarily store information indicating the appearance of other vehicles as vehicle information, in addition to the identification information, location information, and shooting date and time information.

[0056] The first memory control unit 471 may restrict the storage of new vehicle information if the identification information matches and at least a portion of the location information and shooting date and time information matches, if the amount of vehicle information stored exceeds a threshold, and at least a portion of the identification information matches and at least a portion of the location information and shooting date and time information matches. This prevents an inadvertent increase in the amount of vehicle information stored in the vehicle information storage unit 32.

[0057] The threshold can be, for example, three or more.

[0058] Vehicle information temporarily stored in the vehicle information storage unit 32 by the first storage control unit 471 is then processed by the second storage control unit 472, which removes duplicate vehicle information while retaining the necessary vehicle information.

[0059] The second memory control unit 472, when it finds that the identification information matches among the stored vehicle information and at least a portion of the location information and shooting date and time information matches, deletes at least one of the vehicle information entries and the remaining portion based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that took the video corresponding to the identification information. In this embodiment, the second memory control unit 472 keeps the vehicle information determined to be necessary by the second processing unit 452 in the vehicle information storage unit 32 and deletes the vehicle information determined to be deleted from the vehicle information storage unit 32.

[0060] The second memory control unit 472 may change the determination criteria for the degree of matching of vehicle information based on traffic information, including congestion, construction, and accidents, and map information. In this embodiment, the change in the determination criteria is performed in the second processing unit 452 described above.

[0061] The second memory control unit 472 may determine the degree of matching of vehicle information based on map information, but only if the location information satisfies predetermined road conditions. In this embodiment, this process is performed in the second processing unit 452 described above.

[0062] The search request processing unit 48 executes processing for search requests from the user. Upon receiving a search request, the search request processing unit 48 obtains vehicle information matching the search criteria from the vehicle information storage unit 32. The search request processing unit 48 transmits the obtained vehicle information to the source of the search request. The search request processing unit 48 transmits vehicle information, such as the history of location information of vehicles that meet the search criteria.

[0063] The communication control unit 49 controls the communication unit 39 to control data communication with the vehicle recording device 10. In this embodiment, the communication control unit 49 controls the communication unit 39 to receive vehicle information from the vehicle recording device 10. The communication control unit 49 receives video, vehicle location information, and shooting date and time information as vehicle information from the vehicle recording device 10 via the communication unit 39.

[0064] The storage of vehicle information will be explained using Figures 4 to 10. Figure 4 is a diagram illustrating an example of the positional relationship of multiple vehicles. It shows point A on the road, point B which is an intersection, and point C on the road opposite point A, with point B in between. Here, the area shown in Figure 4 is the predetermined area. North is at the top of the diagram and south is at the bottom. Figure 4(b) shows a certain point in time, Figure 4(a) shows a point in time slightly before Figure 4(b), and Figure 4(c) shows a point in time slightly after Figure 4(b). In Figure 4(a), vehicles 1 and 2 are heading north near point C, and vehicles 4 and 5 are heading south near point A. In Figure 4(b), vehicle 1 is heading north near point B, vehicles 2 and 3 are heading north near point C, vehicle 4 is heading south near point C, and vehicle 5 is heading south near point A. In Figure 4(c), Vehicle 1 is traveling north near point A, Vehicle 2 is traveling north near point B, Vehicle 3 is traveling north near point C, Vehicle 4 is traveling south near point C, and Vehicle 5 is traveling south near point B. Vehicle 2 is a large vehicle. The other vehicles are standard vehicles.

[0065] Figures 5 and 6 will be used to explain the time point in Figure 4(a). Figure 5 is a diagram illustrating an example of an image taken by each vehicle in Figure 4(a). Figure 6 is a diagram illustrating an example of vehicle information stored in the vehicle information storage unit when the image shown in Figure 5 is taken. As shown in Figure 5, the external camera 11 of the vehicle recording device 10 mounted on vehicle 1, located near point C, photographs vehicle 2. The external camera 11 of the vehicle recording device 10 mounted on vehicle 1 cannot photograph vehicle 4, located near point A, because of the distance. The external camera 11 of the vehicle recording device 10 mounted on vehicle 2, located near point C, photographs vehicle 1. The external camera 11 of the vehicle recording device 10 mounted on vehicle 4, located near point A, photographs vehicle 5. The external camera 11 of the vehicle recording device 10 mounted on vehicle 4 cannot photograph vehicle 1, located near point C, because of the distance. The external camera 11 of the vehicle recording device 10 mounted on vehicle 5, located near point A, photographs vehicle 4.

[0066] As shown in Figure 6, the identification information for vehicle 1 can be recognized from the image captured by the external camera 11 of the vehicle recording device 10 mounted on vehicle 2. The vehicle information storage unit 32 stores the vehicle information collected from the vehicle recording device 10 mounted on vehicle 2 as the identification information for vehicle 1. The identification information for vehicle 2 can be recognized from the image captured by the external camera 11 of the vehicle recording device 10 mounted on vehicle 1. The vehicle information storage unit 32 stores the vehicle information collected from the vehicle recording device 10 mounted on vehicle 1 as the identification information for vehicle 2. The identification information for vehicle 4 can be recognized from the image captured by the external camera 11 of the vehicle recording device 10 mounted on vehicle 5. The vehicle information storage unit 32 stores the vehicle information collected from the vehicle recording device 10 mounted on vehicle 5 as the identification information for vehicle 4. The identification information for vehicle 5 can be recognized from the image captured by the external camera 11 of the vehicle recording device 10 mounted on vehicle 4. The vehicle information storage unit 32 stores vehicle information collected from the vehicle recording device 10 installed in vehicle 4 as identification information for vehicle 5.

[0067] Figures 7 and 8 will be used to explain the time point in Figure 4(b). Figure 7 is a diagram illustrating an example of images taken by each vehicle in Figure 4(b). Figure 8 is a diagram illustrating an example of vehicle information stored in the vehicle information storage unit when the images shown in Figure 7 are taken. As shown in Figure 7, the external camera 11 of the vehicle recording device 10 mounted on vehicle 1 located near point B photographs vehicles 2, 4, and 5. The external camera 11 of the vehicle recording device 10 mounted on vehicle 2 located near point C photographs vehicles 1, 3, and 4. The external camera 11 of the vehicle recording device 10 mounted on vehicle 3 located near point C photographs vehicle 2. The external camera 11 of the vehicle recording device 10 mounted on vehicle 3 cannot photograph vehicle 4 because the preceding vehicle, vehicle 2, is a large vehicle and the distance between vehicles is short. The external camera 11 of the vehicle recording device 10 mounted on vehicle 4 located near point C photographs vehicles 1, 2, and 5. The external camera 11 of the vehicle recording device 10 mounted on vehicle 4 cannot photograph vehicle 3, which is hidden behind vehicle 2 of the large vehicle. The external camera 11 of the vehicle recording device 10 mounted on vehicle 5, which is located near point A, can photograph vehicle 1 and vehicle 4.

[0068] As shown in Figure 8, the identification information of vehicle 1 can be recognized from images taken by the external cameras 11 of the vehicle recording devices 10 mounted on vehicles 2, 4, and 5, respectively. The face of the driver of vehicle 1 can be recognized from images taken by the external camera 11 of the vehicle recording device 10 mounted on vehicle 5, which is an oncoming vehicle. The vehicle information storage unit 32 stores the vehicle information collected from the vehicle recording device 10 mounted on vehicle 5 as the identification information of vehicle 1. The identification information of vehicle 2 can be recognized from images taken by the external cameras 11 of the vehicle recording devices 10 mounted on vehicles 1, 3, and 4. The face of the driver of vehicle 2 can be recognized from images taken by the external camera 11 of the vehicle recording device 10 mounted on vehicle 4, which is an oncoming vehicle. The vehicle information storage unit 32 stores the vehicle information collected from the vehicle recording device 10 mounted on vehicle 4 as the identification information of vehicle 2. Vehicle information collected from the vehicle recording device 10 mounted on vehicle 1 may be considered a second candidate. The identification information for vehicle 3 can be recognized from images taken by the external camera 11 of the vehicle recording device 10 mounted on vehicle 2. The vehicle information storage unit 32 stores the vehicle information collected from the vehicle recording device 10 mounted on vehicle 2 as the identification information for vehicle 3. The identification information for vehicle 4 can be recognized from images taken by the external cameras 11 of the vehicle recording devices 10 mounted on vehicle 1, vehicle 2, and vehicle 5. The face of the driver of vehicle 4 can be recognized from images taken by the external camera 11 of the vehicle recording device 10 mounted on vehicle 2, which is an oncoming vehicle. The vehicle information storage unit 32 stores the vehicle information collected from the vehicle recording device 10 mounted on vehicle 2 as the identification information for vehicle 4. The identification information for vehicle 5 can be recognized from images taken by the external cameras 11 of the vehicle recording devices 10 mounted on vehicle 1 and vehicle 4. The driver's face of vehicle 5 can be recognized from the image captured by the external camera 11 of the vehicle recording device 10 mounted on vehicle 1, which is an oncoming vehicle. The vehicle information storage unit 32 stores vehicle information collected from the vehicle recording device 10 mounted on vehicle 1 as identification information for vehicle 5.

[0069] The time point in Figure 4(c) will be explained using Figures 9 and 10. Figure 9 is a diagram illustrating an example of an image taken by each vehicle in Figure 4(c). Figure 10 is a diagram illustrating an example of vehicle information stored in the vehicle information storage unit when the image shown in Figure 9 is taken. As shown in Figure 9, the external camera 11 of the vehicle recording device 10 mounted on vehicle 1 located near point A photographs vehicles 2 and 5. The external camera 11 of the vehicle recording device 10 mounted on vehicle 2 located near point B photographs vehicles 1, 3 and 4. The external camera 11 of the vehicle recording device 10 mounted on vehicle 3 located near point C photographs vehicles 2 and 5. The external camera 11 of the vehicle recording device 10 mounted on vehicle 4 located near point C photographs vehicles 2 and 5. The external camera 11 of the vehicle recording device 10 mounted on vehicle 5 located near point B photographs vehicles 1, 3 and 4.

[0070] As shown in Figure 10, the identification information of vehicle 1 can be recognized from images taken by the external cameras 11 of the vehicle recording devices 10 mounted on vehicles 2 and 5. The identification information of vehicle 1 can be recognized more accurately from images taken by the external camera 11 of the vehicle recording device 10 mounted on vehicle 2, which is a following vehicle. The vehicle information storage unit 32 stores vehicle information collected from the vehicle recording device 10 mounted on vehicle 2 as the identification information of vehicle 1. The identification information of vehicle 2 can be recognized from images taken by the external cameras 11 of the vehicle recording devices 10 mounted on vehicles 1, 3, and 4. The identification information of vehicle 2 can be recognized more accurately from images taken by the external camera 11 of the vehicle recording device 10 mounted on vehicle 1, which is a preceding vehicle. The vehicle information storage unit 32 stores vehicle information collected from the vehicle recording device 10 mounted on vehicle 1 as the identification information of vehicle 2. The identification information for vehicle 3 can be recognized from images taken by the external cameras 11 of the vehicle recording devices 10 mounted on vehicles 2 and 5. The identification information for vehicle 3 can be recognized more accurately from images taken by the external camera 11 of the vehicle recording device 10 mounted on the preceding vehicle, vehicle 2. The vehicle information storage unit 32 stores vehicle information collected from the vehicle recording device 10 mounted on vehicle 2 as the identification information for vehicle 3. The identification information for vehicle 4 can be recognized from images taken by the external cameras 11 of the vehicle recording devices 10 mounted on vehicles 2 and 5. The identification information for vehicle 4 can be recognized more accurately from images taken by the external camera 11 of the vehicle recording device 10 mounted on the following vehicle, vehicle 5. The vehicle information storage unit 32 stores vehicle information collected from the vehicle recording device 10 mounted on vehicle 5 as the identification information for vehicle 4. The identification information for vehicle 5 can be recognized from images captured by the external cameras 11 of the vehicle recording devices 10 mounted on vehicles 1, 3, and 4. The identification information for vehicle 5 can be recognized more accurately from images captured by the external camera 11 of the vehicle recording device 10 mounted on vehicle 3, which is an oncoming vehicle. The vehicle information storage unit 32 stores the vehicle information collected from the vehicle recording device 10 mounted on vehicle 3 as the identification information for vehicle 5. The vehicle information collected from the vehicle recording device 10 mounted on vehicle 4 may be considered a second candidate.

[0071] <Processing in vehicle recording devices> Next, the processing flow in the server device 30 of the vehicle information collection system 1 will be explained using Figure 11. Figure 11 is a flowchart showing an example of the processing flow in a vehicle recording device according to this embodiment.

[0072] The control unit 40 determines, by the first processing unit 451, whether or not the license plate number of another vehicle can be recognized from the vehicle information video collected by the data acquisition unit 41 (step S101). If the control unit 40 determines, by the first processing unit 451, that the license plate number can be recognized (step S101; Yes), it proceeds to step S102. If the control unit 40 does not determine, by the first processing unit 451, that the license plate number can be recognized (step S101; No), it terminates the processing of this flowchart.

[0073] If it is determined that the license plate can be recognized (step S101; Yes), the control unit 40 temporarily stores vehicle information using the first memory control unit 471 (step S102). More specifically, the control unit 40 temporarily stores identification information, location information, and shooting date and time information as vehicle information using the first memory control unit 471. The control unit 40 then proceeds to step S103.

[0074] The control unit 40, using the second processing unit 452, determines whether or not there is duplicate vehicle information (step S103). More specifically, the control unit 40, using the second processing unit 452, determines whether or not there are any vehicle information entries in which the identification information matches and at least a portion of the location information and shooting date and time information matches among the multiple vehicle information entries. If the identification information matches and at least a portion of the location information and shooting date and time information matches among the multiple vehicle information entries, it is determined that there is duplicate vehicle information. If the control unit 40 determines, using the second processing unit 452, that there is duplicate vehicle information (step S103; Yes), it proceeds to step S104. If the control unit 40 does not determine, using the second processing unit 452, that there is duplicate vehicle information (step S103; No), it terminates the processing of this flowchart.

[0075] If it is determined that there is duplicate vehicle information (step S103; Yes), the control unit 40, with the second processing unit 452, determines which vehicle information to save. More specifically, the control unit 40, with the second processing unit 452, determines from the vehicle information determined to match in step S103 whether it is necessary vehicle information to be kept in the vehicle information storage unit 32 or vehicle information to be deleted. Based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that took the video corresponding to the identification information, the control unit 40 determines that the vehicle information corresponding to the video in which the license plate number (digits) of the other vehicle is estimated to be more likely to be accurately recognized is necessary vehicle information, in other words, vehicle information to be saved. The control unit 40, with the second processing unit 452, determines that the vehicle information corresponding to the video in which the license plate number (digits) of the other vehicle is estimated to be less likely to be accurately recognized is to be deleted. The control unit 40 proceeds to step S105.

[0076] The control unit 40 deletes all vehicle information except that which is to be saved, using the second storage control unit 472 (step S105). More specifically, the control unit 40 deletes at least a portion of the remaining vehicle information, leaving at least one of the multiple vehicle information items. The control unit 40 deletes all vehicle information except that which was determined to be saved in step S104, using the second storage control unit 472. The control unit 40 then terminates the processing of this flowchart.

[0077] <Effects> As described above, in this embodiment, if identification information of other vehicles can be recognized from the collected vehicle information video, the identification information, location information, and shooting date and time information are temporarily stored as vehicle information. In this embodiment, if the identification information matches among the stored vehicle information and at least a portion of the location information and shooting date and time information also matches, at least one of the vehicle information entries is retained, and at least a portion of the remaining entries are deleted, based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that took the video corresponding to the identification information. According to this embodiment, information can be collected in a way that reduces the processing load and enables the rapid provision of search results.

[0078] In this embodiment, if it is possible to recognize the identification information of other vehicles from the video, and further, if the face of the driver of the other vehicle can be recognized, the identification information, location information, and date and time of shooting information can be stored as vehicle information.

[0079] In this embodiment, if vehicle information whose identification information matches and whose location information and shooting date and time information match at least a portion of it is stored above a threshold, the storage of new vehicle information whose identification information matches and whose location information and shooting date and time information match at least a portion of it can be restricted.

[0080] In this embodiment, the criteria for determining the degree of matching of vehicle information can be changed based on traffic information, including congestion, construction, and accidents, and map information. In this embodiment, for example, if it is presumed that vehicles will be traveling at a low speed in a predetermined section of road due to congestion, construction, accidents, etc., the predetermined range of location information or the predetermined range of shooting date and time information in the predetermined section of road is widened compared to when vehicles are traveling at a normal speed. According to this embodiment, by widening the predetermined range of location information or the predetermined range of shooting date and time information in the criteria for determining the degree of matching, a large number of similar vehicle information can be processed efficiently. According to this embodiment, the processing load on the server device 30 can be reduced.

[0081] In this embodiment, based on map information, if a predetermined section of a road is a highway or a road without junctions, the degree of matching of vehicle information can be determined only if the location information is near a highway entrance / exit or near a junction, and at least one of the necessary vehicle information and the vehicle information to be deleted can be determined. In this embodiment, if a predetermined section of a road is a highway or a road without junctions, and the location information is not near a highway entrance / exit or near a junction, the vehicle information can be determined to be deleted without determining the degree of matching of vehicle information. According to this embodiment, the processing load on the server device 30 can be reduced.

[0082] Now, although we have described the vehicle information collection system related to this disclosure, it may be implemented in various other forms besides the embodiments described above.

[0083] The components of the illustrated vehicle information collection system are functionally conceptual and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage of each device.

[0084] The configuration of the vehicle information collection system is implemented, for example, as software, such as a program loaded into memory. In the above embodiment, these were described as functional blocks realized through the cooperation of hardware or software. That is, these functional blocks can be implemented in various forms using hardware alone, software alone, or a combination thereof.

[0085] The components described above include those that are easily conceivable by those skilled in the art, and those that are substantially identical. Furthermore, the components described above can be combined as appropriate. In addition, various omissions, substitutions, or modifications of the components are possible without departing from the spirit of the present invention.

[0086] In the above description, the vehicle recording device 10 is assumed to transmit all vehicle information to the server device 30, but it is not limited to this. The vehicle recording device 10 may transmit vehicle information to the server device 30 only if it is possible to recognize the identification information of other vehicles from the video captured by the external camera 11. This reduces the amount of vehicle information transmitted to the server device 30, thereby reducing the processing load on the server device 30. [Explanation of Symbols]

[0087] 1. Vehicle Information Collection System 10. Vehicle recording device 11. External camera (filming unit) 12 GNSS receiver 19 Communications Department 20 Control Unit 21 Video Acquisition Unit 22 Location information acquisition section 29 Communication Control Unit 30 Server device (vehicle information collection device) 31 Map Information Storage Unit 32 Vehicle Information Storage Unit 39 Communications Department 40 Control Unit 41 Data Collection Unit 42 Map Information Acquisition Unit 45. Vehicle Information Processing Unit 451 First Processing Unit 452 Second Processing Unit 47 Memory Control Unit 471 First Memory Control Unit 472 Second Memory Control Unit 48 Search Request Processing Unit 49 Communication Control Unit

Claims

1. A vehicle information collection system comprising a vehicle recording device equipped with a camera unit and positioned in multiple vehicles, and a server device that collects and stores vehicle information from the vehicle recording device, The control unit of the vehicle recording device is: A video acquisition unit acquires video footage of the area around the vehicle captured by the camera unit, The system includes a communication control unit that transmits the surrounding video captured by the aforementioned camera unit, along with the vehicle's location information and the date and time of capture, as vehicle information to the server device. The control unit of the server device is A data collection unit that collects vehicle information from multiple vehicle recording devices, If identification information of other vehicles can be recognized from the video of the vehicle information collected by the data collection unit, a first storage control unit stores the identification information, the location information, and the shooting date and time information as the vehicle information. The system includes a second storage control unit that, when the identification information matches among the multiple stored vehicle information entries and at least a portion of the location information and the shooting date and time information match, deletes at least a portion of the remaining vehicle information entries, leaving at least one of the multiple vehicle information entries, based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that took the video corresponding to the identification information. Vehicle information collection system.

2. The first memory control unit, if it can recognize identification information of other vehicles from the video of the vehicle information and can further recognize the face of the driver of the other vehicle, stores the identification information, the location information, and the date and time of shooting information as the vehicle information. The vehicle information collection system according to claim 1.

3. The first storage control unit restricts the storage of new vehicle information where the identification information matches and at least a portion of the location information and the shooting date and time information matches, if the number of vehicle information items stored exceeds a threshold value. The vehicle information collection system according to claim 1 or 2.

4. The second memory control unit modifies the criteria for determining the degree of matching of the vehicle information based on at least one of traffic information, including congestion, construction, and accidents, and map information. The vehicle information collection system according to claim 1 or 2.

5. A vehicle information collection method performed by a vehicle information collection system comprising a vehicle recording device equipped with a camera unit and positioned in multiple vehicles, and a server device that collects and stores vehicle information from the vehicle recording device, The control unit of the vehicle recording device is: The camera unit captures images of the area around the vehicle, The camera unit transmits the surrounding video footage it captures, along with the vehicle's location information and the date and time of capture, to the server device as vehicle information. The control unit of the server device is Collecting vehicle information from multiple vehicle recording devices, If identification information of other vehicles can be recognized from the video of the collected vehicle information, the identification information, location information, and date and time of shooting information are stored as the vehicle information. In the stored vehicle information, if the identification information matches and at least a portion of the location information and the shooting date and time information matches, then, based on the positional relationship between the other vehicle corresponding to the identification information and the vehicle that took the video corresponding to the identification information, at least one of the vehicle information entries is retained, and at least a portion of the remaining entries is deleted. Methods for collecting vehicle information.

Images