Information processing device, driving diagnosis method and program
The information processing device and method address erroneous driving diagnoses by converting and supplementing missing or abnormal regulatory display data, ensuring accurate vehicle driving diagnosis.
Patent Information
- Application Number
- JP2022076204
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-05-02
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2042-05-02
AI Technical Summary
Conventional technologies for reading traffic signs from moving vehicles risk interpolating incorrect signs, leading to erroneous vehicle driving diagnoses.
An information processing device and method that acquires and processes vehicle travel information and regulatory display data, converting missing or abnormal data into reliable information before or after the missing part to suppress incorrect driving diagnoses.
Suppresses incorrect driving diagnoses by ensuring accurate conversion and supplementation of missing or abnormal regulatory display data, thereby enhancing the reliability of driving diagnosis systems.
Smart Images

Figure 0007586130000001 
Figure 0007586130000002 
Figure 0007586130000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, a driving diagnosis method, and a program. [Background technology]
[0002] Patent Document 1 discloses a technology for displaying an image of the surroundings taken by a wearable device on another wearable device, and for compensating for defects in the image taken by the wearable device. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] WO2018 / 051815 Summary of the Invention [Problem to be solved by the invention]
[0004] When the conventional technology is applied to reading traffic signs captured in a moving vehicle, there is a possibility that the image of the sign may be incorrectly completed. Therefore, when performing a driving diagnosis of the vehicle based on the read traffic signs, there is a risk of an erroneous diagnosis being made.
[0005] An object of the present invention is to provide an information processing device, a driving diagnosis method, and a program that make it possible to suppress erroneous driving diagnosis. [Means for solving the problem]
[0006] The information processing device described in claim 1 includes an acquisition unit that acquires driving information related to the driving of a vehicle and information on a regulatory display that has been digitized from an image of the regulatory display captured by a camera mounted on the vehicle, a pre-processing unit that, when digitization of the regulatory display fails or there is a missing part including an abnormal value in the information, sets data of the missing part to information that was successfully digitized before or after the missing part, and a diagnosis unit that performs driving diagnosis of the vehicle with respect to the regulatory display based on the digitized information of the regulatory display and the driving information.
[0007] In the information processing device according to claim 1, an acquisition unit acquires driving information related to the driving of the vehicle and information on the restriction display that has been digitized from an image of the restriction display captured by a camera mounted on the vehicle. Here, the restriction display is, for example, a display related to a speed limit or a display related to a prohibited act. When the preprocessing unit fails to digitize the restriction display or the information has a missing part including an abnormal value, the preprocessing unit sets the data of the missing part to information that has been successfully digitized before or after the missing part. Here, the failure to digitize the restriction display means, for example, that the reliability of the information on the restriction display that has been digitized from the captured image of the restriction display is less than a threshold value. A diagnosis unit executes a driving diagnosis of the vehicle with respect to the restriction display based on the digitized information on the restriction display and the driving information.
[0008] In the information processing device, when the digitization of the restriction display fails or when there is a missing part including an abnormal value in the information, the data of the missing part is set to the information that was successfully digitized before or after the missing part. Therefore, the information processing device can suppress erroneous driving diagnosis.
[0009] The information processing device of claim 2 is the information processing device of claim 1, in which, when there is a missing portion and the result of a driving diagnosis performed based on information that has been successfully digitized before or after the missing portion is good, the pre-processing unit sets the data of the missing portion to the information of the restriction display when the result was good.
[0010] In the information processing device described in claim 2, when there is the missing portion and the result of a driving diagnosis performed based on information that has been successfully digitized before or after the missing portion is good, the data of the missing portion is set to the information of the restriction display when the result is good. According to this information processing device, the data of the missing portion is set to the information of the restriction display when the result of a driving diagnosis performed based on information that has been successfully digitized before or after the missing portion is good. Therefore, erroneous driving diagnosis can be further suppressed.
[0011] The information processing device according to claim 3 is the information processing device according to claim 1, wherein, when there is a missing portion, the pre-processing unit sets the data of the missing portion to the maximum value of the information that has been successfully digitized before or after the missing portion.
[0012] In the information processing device according to claim 3, when there is a missing portion, the data of the missing portion is set to the maximum value of the information that has been successfully digitized before or after the missing portion. According to the information processing device, the data of the missing portion is set to the maximum value of the information that has been successfully digitized before or after the missing portion. Therefore, it is possible to further suppress erroneous driving diagnosis.
[0013] The driving diagnosis method described in claim 4 acquires driving information related to the driving of the vehicle and information on a regulatory display that has been digitized from an image of the regulatory display captured by a camera mounted on the vehicle, and if the digitization of the regulatory display fails or there is a missing part in the information that includes an abnormal value, the data of the missing part is set to the information that was successfully digitized before or after the missing part, and a computer executes a process of performing a driving diagnosis of the vehicle regarding the regulatory display based on the digitized information of the regulatory display and the driving information.
[0014] In the driving diagnosis method described in claim 4, a computer acquires driving information related to the driving of the vehicle and information on the restriction sign that has been digitized from an image of the restriction sign captured by a camera mounted on the vehicle. If the computer fails to digitize the restriction sign or the information has a missing part including an abnormal value, the data of the missing part is set to the information that was successfully digitized before or after the missing part. The computer executes a driving diagnosis of the vehicle with respect to the restriction sign based on the digitized information of the restriction sign and the driving information.
[0015] In the driving diagnosis method, when the digitization of the restriction display fails or when there is a missing part including an abnormal value in the information, the data of the missing part is set to the information that was successfully digitized before or after the missing part. Therefore, according to the driving diagnosis method, it is possible to suppress erroneous driving diagnosis.
[0016] The program described in claim 5 is a program that causes a computer to execute a process of acquiring driving information related to the driving of a vehicle and information on a regulatory display that has been digitized from an image of the regulatory display captured by a camera mounted on the vehicle, and if digitization of the regulatory display fails or there is a missing part including an abnormal value in the information, setting the data of the missing part to the information that was successfully digitized before or after the missing part, and performing a driving diagnosis of the vehicle regarding the regulatory display based on the digitized information of the regulatory display and the driving information.
[0017] A computer that executes the program according to claim 5 acquires information on a regulation sign that is digitized from driving information related to the driving of the vehicle and an image of the regulation sign captured by a camera mounted on the vehicle. If the computer fails to digitize the regulation sign or the information has a missing part including an abnormal value, the data of the missing part is set to information that was successfully digitized before or after the missing part. The computer executes a driving diagnosis of the vehicle with respect to the regulation sign based on the digitized information on the regulation sign and the driving information.
[0018] In the case where the program fails to convert the restriction display into digital data or where there is a missing part including an abnormal value in the data, the program sets the data of the missing part to the information that was successfully converted before or after the missing part. Therefore, the program can suppress erroneous driving diagnosis. Effect of the Invention
[0019] According to the present invention, erroneous driving diagnosis can be suppressed. [Brief description of the drawings]
[0020] [Figure 1] 1 is a diagram showing a schematic configuration of a driving diagnosis system according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing a hardware configuration of a vehicle according to an embodiment of the present invention; [Diagram 3] 2 is a block diagram showing the configuration of a ROM of the vehicle-mounted device of the embodiment; FIG. [Figure 4] FIG. 2 is a block diagram showing a configuration of a storage of the vehicle-mounted device according to the embodiment; [Diagram 5] FIG. 2 is a block diagram showing a functional configuration of the vehicle-mounted device according to the embodiment; [Figure 6] FIG. 2 is a block diagram showing a hardware configuration of a center server of the present embodiment. [Figure 7] FIG. 2 is a block diagram showing the functional configuration of a center server of the present embodiment. [Figure 8] 4 is a flowchart showing a flow of a restriction display information transmission process executed in the vehicle-mounted device of the present embodiment. [Figure 9] 4 is a flowchart showing the flow of a driving diagnosis process executed in the center server of the present embodiment. [Figure 10] 13 is a flowchart showing the flow of processing by a pre-processing unit executed in the center server of the present embodiment. [Figure 11] 11 is a diagram showing an example of a plurality of pieces of regulatory display information in a case where the regulatory display information is a speed limit sign; FIG. [Figure 12]13 is a diagram showing an example of a plurality of pieces of regulatory display information in a case where the regulatory display information is a no parking sign; FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0021] A driving diagnosis system including an information processing device of the present invention will be described. The driving diagnosis system is a system that performs driving diagnosis using traffic sign information collected in a vehicle and vehicle running information.
[0022] (Overall composition) As shown in Fig. 1, a driving diagnosis system 10 of this embodiment includes a vehicle 12 and a center server 30 as an information processing device. The vehicle 12 is equipped with an on-board device 20. The on-board device 20 and the center server 30 are connected to each other via a network N. Although Fig. 1 illustrates one vehicle 12 and one on-board device 20 for one center server 30, the numbers of vehicles 12 and on-board devices 20 are not limited to this.
[0023] The center server 30 is installed, for example, at a manufacturer that produces the vehicle 12, a car dealer, or any other business entity.
[0024] (vehicle) As shown in FIG. 2, the vehicle 12 according to this embodiment includes an in-vehicle device 20, a plurality of ECUs (Electronic Control Units) 22, and a plurality of in-vehicle devices 24.
[0025] The vehicle-mounted device 20 includes a central processing unit (CPU) 20A, a read only memory (ROM) 20B, a random access memory (RAM) 20C, a storage 20D, a wireless communication interface (I / F) 20E, and an in-vehicle communication I / F 20F. The CPU 20A, the ROM 20B, the RAM 20C, the storage 20D, the wireless communication interface (I / F) 20E, and the in-vehicle communication I / F 20F are connected to each other so as to be able to communicate with each other via an internal bus 20G.
[0026] The CPU 20A is a central processing unit that executes various programs and controls each part. That is, the CPU 20A reads a program from the ROM 20B or the storage 20D, and executes the program using the RAM 20C as a working area.
[0027] ROM 20B stores various programs and various data. As shown in Fig. 3, ROM 20B of this embodiment stores a control program 100. The control program 100 is a program for transmitting information on restriction displays that is digitized from an image captured by a camera to the center server 30.
[0028] As shown in FIG. 2, the RAM 20C temporarily stores programs or data as a working area.
[0029] The storage 20D, which is a memory, is configured with a HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs and various data. As shown in Fig. 4, the storage 20D of this embodiment stores a regulation information DB (database) 120, which is a data group of information on digitized regulation display. The storage 20D may store the control program 100 and the regulation information DB 120.
[0030] 2, the wireless communication I / F 20E is a wireless communication module for communicating with the center server 30. The wireless communication module uses a communication standard such as 5G, LTE, or Wi-Fi (registered trademark). The wireless communication I / F 20E is connected to a network N.
[0031] The in-vehicle communication I / F 20F is an interface for connecting to each ECU 22. The interface uses a communication standard based on the CAN protocol. The in-vehicle communication I / F 20F is connected to the external bus 20H.
[0032] The ECU 22 includes at least an ADAS (Advanced Driver Assistance System)-ECU 22A, a steering ECU 22B, a brake ECU 22C, and an engine ECU 22D.
[0033] The ADAS-ECU 22A controls the advanced driving assistance system. A vehicle speed sensor 24A, a yaw rate sensor 24B, and a camera 24C that configure the in-vehicle device 24 are connected to the ADAS-ECU 22A. The camera 24C is a camera that captures images of the surroundings of the vehicle 12.
[0034] The steering ECU 22B controls the power steering. A steering angle sensor 24D constituting the in-vehicle device 24 is connected to the steering ECU 22B. The steering angle sensor 24D is a sensor that detects the steering angle of the steering wheel.
[0035] As shown in FIG. 5, in the vehicle-mounted device 20 of this embodiment, a CPU 20A executes a control program 100 to function as an acquisition unit 200, a processing unit 210, and a transmission unit 220.
[0036] The acquisition unit 200 has a function of acquiring vehicle information. The vehicle information is information such as the state of the in-vehicle device 24, the state of the vehicle 12 obtained from the in-vehicle device 24, and captured images captured in the vehicle 12. The vehicle information in this embodiment includes driving information such as position information, vehicle speed, yaw rate, and steering angle. The vehicle information also includes captured images of the outside of the vehicle 12 captured by the camera 24C.
[0037] The processing unit 210 has a function of storing the vehicle information acquired by the acquisition unit 200 in the storage 20D, and converting the information into information on restriction signs by recognizing restriction signs from an image captured by the camera 24C. Specifically, the processing unit 210 of this embodiment temporarily stores the vehicle information in the storage 20D, and then transmits the information to the center server 30 by the transmission unit 220 when requested by the center server 30. The processing unit 210 also converts the image captured by the camera 24C into information on restriction signs by image recognition processing, and derives the reliability of the information on restriction signs.
[0038] More specifically, the processing unit 210 recognizes the speed limit sign or prohibition sign (stop sign, no parking sign, or no turn sign) that is a regulatory indication shown in the captured image, and converts it into a flag indicating the presence or absence of the speed limit or prohibition sign.
[0039] The transmission unit 220 has a function of transmitting the vehicle information and the restriction display information stored in the storage 20D to the center server 30. Specifically, the transmission unit 220 of the present embodiment transmits the vehicle information and the restriction display information stored in the storage 20D to the center server 30 when requested by the center server 30.
[0040] (Center server) As shown in Fig. 6, the center server 30 includes a CPU 30A, a ROM 30B, a RAM 30C, a storage 30D, and a communication I / F 30E. The CPU 30A, the ROM 30B, the RAM 30C, the storage 30D, and the communication I / F 30E are connected to each other so as to be able to communicate with each other via an internal bus 30G. The functions of the CPU 30A, the ROM 30B, the RAM 30C, the storage 30D, and the communication I / F 30E are the same as the functions of the CPU 20A, the ROM 20B, the RAM 20C, the storage 20D, and the wireless communication I / F 20E of the vehicle-mounted device 20 described above. The communication I / F 30E may perform wired communication. The CPU 30A is an example of a processor.
[0041] The storage 30D of this embodiment stores a processing program 150 as a program, and a regulation value information DB 160. The processing program 150 and regulation value information DB 160 may be stored in the ROM 30B.
[0042] The processing program 150 is a program for controlling the center server 30. With the execution of the processing program 150, the center server 30 collects information on restriction signs from the vehicle 12 and executes various processes for performing driving diagnosis on the driving information of the vehicle 12.
[0043] The regulation value information DB 160 stores information on regulation signs collected from the vehicles 12 and their reliability.
[0044] Specifically, flags representing the presence or absence of a speed limit, stop sign, no parking sign, or no turn sign encoded at each location are stored along with a reliability.
[0045] As shown in FIG. 7, in the center server 30 of this embodiment, a CPU 30A executes a processing program 150 to function as a collection unit 250, an acquisition unit 260, a preprocessing unit 270, and a diagnosis unit 280.
[0046] The collection unit 250 has a function of acquiring information on restriction indications from the in-vehicle device 20 of the vehicle 12. The collection unit 250 stores the acquired information on restriction indications in the restriction value information DB 160 together with the reliability and location information indicating the digitized location.
[0047] The acquisition unit 260 has a function of acquiring vehicle information of the vehicle 12 from the vehicle-mounted device 20 of the vehicle 12 .
[0048] When the preprocessing unit 270 fails to convert the restriction display into digital data or when the data contains a missing portion including an abnormal value, the preprocessing unit 270 sets the data of the missing portion to the information that was successfully converted into digital data before or after the missing portion.
[0049] Specifically, when there is a missing portion, the preprocessing unit 270 sets the data of the missing portion to the maximum value of the information that has been successfully digitized before or after the missing portion.
[0050] More specifically, if the reliability of the speed limit sign is equal to or greater than a threshold (eg, 50%), the converted speed limit is recorded.
[0051] In addition, if the reliability of the speed limit sign is less than a threshold value (e.g., 50%), it is determined that there is a missing part where the digitization of the regulatory sign has failed, and the speed limit of the missing part is set to the maximum value of the speed limits that have been successfully digitized before or after the missing part.
[0052] In addition, if the difference between the previous or next speed limit that has been successfully digitized is equal to or greater than a threshold value (e.g., 40 km / h), it is determined that the information is a missing part containing an abnormal value, and the speed limit of the missing part is set to the maximum value of the speed limit that has been successfully digitized before or after the missing part.
[0053] In addition, when the digitized regulatory display is a display related to a prohibited act (a stop sign, a no parking sign, a no turn sign), if the reliability of the flag indicating the presence or absence of the digitized display related to a prohibited act is equal to or greater than a threshold value (e.g., 50%), the pre-processing unit 270 records a flag indicating the presence or absence of a display related to a prohibited act.
[0054] Furthermore, if the reliability of the flag indicating the presence or absence of a digitized display relating to prohibited acts is less than a threshold value (e.g., 50%), it is determined to be a missing portion where the digitization of the regulated display has failed, and the flag of the missing portion is set to the maximum value (0 or 1) of the flags before and after the missing portion that were successfully digitized. Here, a flag of 1 indicates the presence of a display relating to prohibited acts.
[0055] The diagnosis unit 280 diagnoses a violation when the driving of the vehicle based on the driving information included in the vehicle information acquired from the vehicle-mounted device 20 of the vehicle 12 satisfies a violation condition based on the updated regulation value.
[0056] Specifically, the diagnosis unit 280 diagnoses whether the driving of the vehicle 12 is in violation, using a condition of driving significantly over the speed limit around a speed limit sign as a violation condition.
[0057] For example, the violation condition is vehicle speed > speed limit + excessive speed. The excessive speed is 20km / h, 30km / h, or 40km / h.
[0058] Furthermore, the diagnosis unit 280 diagnoses whether the driving of the vehicle 12 violates a traffic violation condition, which is failure to stop around a stop sign.
[0059] For example, if a flag related to a stop sign is on, a violation is provisionally diagnosed, but if the vehicle speed falls below a threshold value (e.g., 1 km / h), the provisional diagnosis of a violation is deleted and a diagnosis of no violation is made.
[0060] Furthermore, the diagnosis unit 280 diagnoses whether the driving of the vehicle 12 is in violation of a no parking sign, taking parking in the vicinity of a no parking sign as a violation condition.
[0061] For example, if the flag related to the no parking sign is on and the vehicle speed is below a threshold value (e.g., 1 km / h), a provisional diagnosis of a violation is made, and if the duration during which the vehicle speed is below the threshold value (1 km / h) is less than a threshold value (e.g., 180 seconds), the provisional diagnosis of a violation is removed and a diagnosis of no violation is made.
[0062] Furthermore, the diagnosis unit 280 diagnoses whether the driving of the vehicle 12 is in violation of a no turn sign, using the violation condition of making a turn around the no turn sign.
[0063] For example, if the flag related to the no turn sign is on, a violation is provisionally diagnosed, and if the maximum yaw angle of the vehicle 12 is less than a threshold value (e.g., 150°) and the maximum steering angle of the steering wheel of the vehicle 12 is less than a threshold value (e.g., 400°), the provisional diagnosis of a violation is removed and a diagnosis of no violation is made.
[0064] (Flow of Control) The flow of processing executed in the driving diagnosis system 10 of this embodiment will be described with reference to the flowcharts of Fig. 8 to Fig. 10. The processing in the vehicle-mounted device 20 is executed by the CPU 20A of the vehicle-mounted device 20 functioning as an acquisition unit 200, a processing unit 210, and a transmission unit 220. The processing in the center server 30 is executed by the CPU 30A of the center server 30 functioning as a collection unit 250, an acquisition unit 260, a pre-processing unit 270, and a diagnosis unit 280.
[0065] First, while the vehicle 12 is traveling, the CPU 20A of the vehicle-mounted device 20 executes a restriction display information transmission process shown in FIG.
[0066] In step S100 of FIG. 8, the processing unit 210 acquires a captured image of the outside of the vehicle 12 captured by the camera 24C.
[0067] In step S102, the processing unit 210 recognizes the restriction sign from the captured image captured by the camera 24C, converts the restriction sign into information, derives the reliability of the information of the restriction sign, and temporarily stores it in the restriction information DB 120.
[0068] In step S104, the processing unit 210 judges whether or not the restriction display has been recognized by the processing in step S102. If the restriction display has been recognized by the processing in step S102, the processing proceeds to step S106. On the other hand, if the restriction display has not been recognized by the processing in step S102, the processing for transmitting restriction display information is terminated.
[0069] In step S106, the transmission unit 220 transmits the information on the restriction display obtained as the recognition result in step S102 to the center server 30 together with the reliability and position information of the information on the restriction display, and ends the restriction display information transmission process.
[0070] The center server 30 stores the restriction display information received from the vehicle-mounted device 20 in the restriction value information DB 160 together with the reliability and the location information of the digitized location.
[0071] Furthermore, while the vehicle 12 is traveling, the vehicle-mounted device 20 transmits the acquired vehicle information to the center server 30. At this time, in the center server 30, the CPU 30A repeatedly executes the driving diagnosis process shown in FIG.
[0072] In step S110 of FIG. 9, the acquisition unit 260 acquires the vehicle information of the vehicle 12 from the vehicle-mounted device 20 of the vehicle 12.
[0073] In step S112, the preprocessing unit 270 acquires information on restriction signs corresponding to the position information included in the acquired vehicle information and the reliability of the information on restriction signs from the restriction value information DB 160. Here, it is assumed that multiple pieces of information on restriction signs corresponding to the position information included in the acquired vehicle information are acquired.
[0074] Specifically, when the regulatory display is a speed limit sign, the pre-processing unit 270 obtains from the regulatory value information DB 160 the speed limit, which is the regulatory value corresponding to the location information included in the acquired vehicle information, and the reliability of the sign related to the speed limit.
[0075] In addition, when the regulatory display is a stop sign, the preprocessing unit 270 obtains from the regulatory value information DB 160 a flag related to the stop sign, which is a regulatory value corresponding to the position information included in the acquired vehicle information, and the reliability of the stop sign.
[0076] In addition, if the restriction indication is a no turn sign, the pre-processing unit 270 obtains from the restriction value information DB 160 a flag related to the no turn sign, which is a restriction value corresponding to the location information included in the acquired vehicle information, and the reliability of the no turn sign.
[0077] In addition, if the regulatory indication is a no parking sign, the pre-processing unit 270 obtains from the regulatory value information DB 160 a flag related to the no parking sign, which is a regulatory value corresponding to the location information included in the acquired vehicle information, and the reliability of the no parking sign.
[0078] In step S114, if the pre-processing unit 270 fails to convert the regulated display information acquired in step S112 into digital form or if the information has a missing part including an abnormal value, the pre-processing unit 270 sets the data of the missing part to the information that was successfully converted into digital form before or after the missing part.
[0079] The above step S114 is realized by the processing routine shown in Fig. 10. The processing routine shown in Fig. 10 is executed for each piece of restriction sign information at each target position among the pieces of restriction sign information acquired in the above step S112.
[0080] In step S120, the preprocessing unit 270 judges whether the reliability of the information on the restriction display at the target position is less than a threshold value (e.g., 50%) or whether the difference between the information on the restriction display before and after the target position is equal to or greater than a threshold value (e.g., 40 km / h). If the reliability of the information on the restriction display at the target position is less than a threshold value (e.g., 50%) or if the difference between the information on the restriction display before and after the target position is equal to or greater than the threshold value, the process proceeds to step S122. On the other hand, if the reliability of the information on the restriction display at the target position is equal to or greater than a threshold value (e.g., 50%) and the difference between the information on the restriction display before and after the target position is less than a threshold value (e.g., 40 km / h), the process ends the processing routine without changing the information on the restriction display at the target position.
[0081] In step S122, the preprocessing unit 270 determines whether the reliability of the information on the restriction display before or after the target position is equal to or greater than a threshold value (for example, 50%).
[0082] In step S122, if the reliability of the information on the restriction display before or after the target position is equal to or greater than the threshold, the preprocessing unit 270 proceeds to step S124. On the other hand, if the reliability of the information on the restriction display before and after the target position is less than the threshold, the preprocessing unit 270 ends the processing routine without updating the information on the restriction display at the target position.
[0083] In step S124, the pre-processing unit 270 updates the information on the restriction display at the target position with the maximum value of the information on the restriction display before and after the target position, and ends the processing routine.
[0084] 11 shows an example of multiple pieces of restriction sign information acquired in step S112 above when the restriction sign information is a speed limit sign. In this example, the reliability of the restriction sign information at location No. "4" is 30%, which is less than the threshold, so the speed limit at location No. "4" is updated to the speed limit at location No. "5", which is the maximum value among the restriction sign information that was successfully digitized before and after location No. "4".
[0085] 12 shows an example of the multiple pieces of regulatory display information acquired in step S112 above when the regulatory display information is a no parking sign. In this example, the reliability of the regulatory display information at position No. "4" is 30%, which is less than the threshold, so the flag related to the no parking sign at position No. "4" is updated to the flag related to the no parking sign "1", which is the maximum value among the regulatory display information before and after position No. "4" that was successfully digitized.
[0086] Then, in step S116 of FIG. 9, if the vehicle driving based on the driving information included in the vehicle information acquired from the vehicle-mounted device 20 of the vehicle 12 satisfies the violation condition based on the updated regulatory value, the diagnosis unit 280 diagnoses it as a violation and terminates the driving diagnosis process.
[0087] Specifically, when the regulatory display information is a speed limit sign, the diagnosis unit 280 diagnoses whether the driving of the vehicle 12 is in violation, based on the condition that the vehicle is driving significantly faster than the speed limit around the speed limit sign.
[0088] Furthermore, when the regulatory display information is a stop sign, the diagnosis unit 280 diagnoses whether the driving of the vehicle 12 is in violation, with the violation condition being failure to stop around the stop sign.
[0089] Furthermore, when the regulatory display information is a no parking sign, the diagnosis unit 280 diagnoses whether the driving of the vehicle 12 is in violation, taking parking in the vicinity of the no parking sign as a violation condition.
[0090] Furthermore, when the information on the restriction display is a no turn sign, the diagnosis unit 280 diagnoses whether the driving of the vehicle 12 is in violation, using the fact that the vehicle 12 has made a turn around the no turn sign as a violation condition.
[0091] (Summary of the embodiment)
[0092] In the present embodiment, when the center server 30 fails to digitalize the restriction display or when there is a missing part including an abnormal value in the information, the center server 30 updates the data of the missing part to information that was successfully digitalized before or after the missing part. In this way, by complementing the data of the missing part with information that was successfully digitalized, it is possible to prevent erroneous driving diagnosis.
[0093] [remarks] In the above embodiment, the data of the missing part is set to the maximum value of the information that has been successfully digitized before or after the missing part, but this is not limited to this. If there is a missing part and the result of the driving diagnosis performed based on the information that has been successfully digitized before or after the missing part is good, the data of the missing part may be set to the information of the regulation display when the result is good. For example, when driving at 55 km / h at a position where the speed limit is 60 km / h, the result of the driving diagnosis is good. Here, if the speed limit of the missing part before or after the position where the speed limit is 60 km / h is 40 km / h, the speed limit of the missing part may be updated to the speed limit of 60 km / h at the position where the diagnosis result is good.
[0094] In addition, various processes executed by the CPU 20A and the CPU 30A by reading the software (programs) in the above embodiment may be executed by various processors other than the CPU. In this case, examples of the processor include a PLD (Programmable Logic Device) such as an FPGA (Field-Programmable Gate Array) whose circuit configuration can be changed after manufacture, and a dedicated electric circuit such as an ASIC (Application Specific Integrated Circuit) which is a processor having a circuit configuration designed exclusively for executing a specific process. In addition, each of the above-mentioned processes may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same or different types (for example, a plurality of FPGAs, a combination of a CPU and an FPGA, etc.). In addition, the hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements.
[0095] In the above embodiment, each program has been described as being prestored (installed) in a non-transitory computer-readable recording medium. For example, the control program 100 in the vehicle-mounted device 20 is prestored in the ROM 20B, and the processing program 150 in the center server 30 is prestored in the storage 30D. However, the present invention is not limited to this, and each program may be provided in a form recorded in a non-transitory recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. Also, the program may be downloaded from an external device via a network.
[0096] The process flow described in the above embodiment is merely an example, and unnecessary steps may be deleted, new steps may be added, or the process order may be changed without departing from the spirit of the invention. [Explanation of symbols]
[0097] 12 Vehicles 20 Onboard equipment 30 Center server (information processing device) 30A CPU (processor) 30D Storage (Memory) 150 Processing Program (Program) 250 Collection Department 260 Acquisition Department 270 Pretreatment section 280 Diagnostic Department
Claims
1. an acquisition unit that acquires driving information related to the driving of a vehicle and information on a regulatory display that is digitized from an image of the regulatory display captured by a camera mounted on the vehicle; A pre-processing unit that sets data of the missing part to information that was successfully digitized before or after the missing part when the digitization of the regulatory display fails or when there is a missing part including an abnormal value in the information; a diagnosis unit that performs a driving diagnosis of the vehicle with respect to the restriction sign based on the converted information of the restriction sign and the driving information; Including, The regulatory notice is a notice relating to a prohibited act, The information on the restriction display is a flag that indicates the presence or absence of a display related to a prohibited act by using a value of 1 or 0, The pre-treatment unit includes: If there is a missing portion, the information processing device sets the data of the missing portion to the maximum value of the flag that was successfully digitized before or after the missing portion.
2. Acquiring driving information related to the driving of a vehicle and information on a regulatory display that is digitized from an image of the regulatory display captured by a camera mounted on the vehicle; If the digitization of the regulatory indication fails or there is a missing part including an abnormal value in the information, the data of the missing part is set to the information that was successfully digitized before or after the missing part; A driving diagnosis of the vehicle with respect to the restriction sign is performed based on the information of the restriction sign and the driving information. Including, The regulatory notice is a notice relating to a prohibited act, The information on the restriction display is a flag that indicates the presence or absence of a display related to a prohibited act by using a value of 1 or 0, By setting the above, If there is a missing portion, the data of the missing portion is set to the maximum value of the flag that has been successfully digitized before or after the missing portion. A driving diagnosis method in which processing is performed by a computer.
3. Acquiring driving information related to the driving of a vehicle and information on a regulatory display that is digitized from an image of the regulatory display captured by a camera mounted on the vehicle; If the digitization of the regulatory indication fails or there is a missing part including an abnormal value in the information, the data of the missing part is set to the information that was successfully digitized before or after the missing part; A driving diagnosis of the vehicle with respect to the restriction sign is performed based on the information of the restriction sign and the driving information. Including, The regulatory notice is a notice relating to a prohibited act, The information on the restriction display is a flag that indicates the presence or absence of a display related to a prohibited act by using a value of 1 or 0, By setting the above, If there is a missing portion, the data of the missing portion is set to the maximum value of the flag that has been successfully digitized before or after the missing portion. A program that causes a computer to carry out processing.
Citation Information
Patent Citations
Method for notifying speed-limit sign recognition result
JP2010205160A
Driving behavior diagnosis device, driving behavior diagnosis method and driving behavior diagnosis program
JP2013254443A
Marker information display system and marker information display method
JP2016095739A
Driving support device
JP2017083989A
Vehicle driving support device, vehicle driving support method and program
JP2022040533A
