Information processing apparatus, driving diagnosis method, and storage medium

Abstract

The present application provides an information processing device, a driving diagnosis method, and a storage medium. The information processing device includes: an acquisition unit that acquires travel information related to travel of a vehicle and information of a regulation display obtained by informatization of a captured image of a regulation display captured by a camera mounted on the vehicle; a preprocessing unit that, in a case where a reliability of the information obtained by the informatization is equal to or higher than a threshold value, sets the information as a regulation value and updates the regulation value at a certain time with any value of the regulation values within a certain interval including the time; and a diagnosis unit that, in a case where the travel of the vehicle based on the travel information satisfies a violation condition based on the updated regulation value, diagnoses a violation.

Description

Technical Field

[0001] This invention relates to an information processing device, a driving diagnostic method, and a storage medium. Background Technology

[0002] Japanese Patent Application Publication No. 2006-321354 discloses a cruise control device for a vehicle that transmits speeding information to the driver based on speed control values ​​obtained from a vehicle navigation system. This cruise control device prompts the driver to reduce the cruise set speed to a safe speed below the speed limit. Summary of the Invention

[0003] While driving diagnostics can be performed by acquiring traffic control displays from captured images, there is room for improvement in accurately reading various traffic control displays and performing driving diagnostics without fluctuations.

[0004] The purpose of this invention is to provide an information processing device, a driving diagnostic method, and a storage medium that can perform stable driving diagnostics based on a control display obtained from captured images.

[0005] The information processing device described in technical solution 1 includes: an acquisition unit that acquires driving information related to the driving of a vehicle and control display information obtained by informatizing a control display image captured by a camera mounted on the vehicle; a preprocessing unit that, when the reliability of the control display information obtained by informatization is above a threshold, sets the information as a control value and updates the control value at a certain moment with any value of the control value within a certain interval including that moment; and a diagnosis unit that, when the driving of the vehicle based on the driving information meets the violation conditions based on the updated control value, diagnoses a violation.

[0006] In the information processing apparatus described in technical solution 1, the acquisition unit acquires driving information related to the vehicle's movement and control display information obtained by informatizing images captured by a camera mounted on the vehicle. The preprocessing unit, when the reliability of the control display information obtained by informatization is above a threshold, sets the information as a control value and updates the control value at a certain moment with any value of the control value within a certain interval including that moment. Here, the reliability of the control display information refers to the likelihood value of the control display information obtained by informatizing images captured by control display. The diagnosis unit diagnoses a violation if the vehicle's movement based on the driving information meets the violation conditions based on the updated control value. Here, the violation conditions based on the control value are the conditions specified using the control value for diagnosing a vehicle's driving violation.

[0007] In this information processing device, when the reliability of the control display information obtained through informatization is above a threshold, the information is set as a control value, and the control value at a certain moment is updated using any value of the control value within a certain interval including that moment. Therefore, according to this information processing device, stable driving diagnostics can be performed based on the control display obtained from the captured image.

[0008] Regarding the information processing device described in technical solution 2, in the information processing device described in technical solution 1, the control display is a speed limit related display, the information displayed in the control display is a speed limit, and the preprocessing unit updates all control values ​​in the certain interval with the maximum value of the control values ​​in the certain interval.

[0009] In the information processing device described in technical solution 2, when the reliability of the speed limit-related display information obtained through informatization is above a threshold, the speed limit is set as a control value, and all control values ​​within the specified range are updated using the maximum value of the control values ​​within the specified range. According to this information processing device, stable driving diagnostics can be performed based on the speed limit-related display obtained from the captured image.

[0010] Regarding the information processing device described in technical solution 3, in the information processing device described in technical solution 1, the control display is a display related to prohibited behavior, and the information of the control display is a flag indicating whether or not there is a display related to the prohibited behavior. When the reliability of the control display information obtained by information processing is above a threshold, the preprocessing unit sets the flag that serves as the control value to be turned on. When there are flags that serve as the control value within a certain range that are turned on, the preprocessing unit updates all flags that serve as control values ​​within the certain range to be turned on.

[0011] In the information processing apparatus described in technical solution 3, when the reliability of the information related to prohibited behavior obtained through informatization is above a threshold, the flag serving as the control value is set to "on". If any flag serving as the control value is "on" within a certain range, all flags serving as control values ​​within that range are updated to "on". Here, the display related to prohibited behavior refers, for example, to a temporary stop sign, a no-stopping sign, and a no-turn sign. According to this information processing apparatus, stable driving diagnostics can be performed based on the display related to prohibited behavior obtained from captured images.

[0012] Regarding the information processing device described in technical solution 4, the information processing device described in technical solution 1 further includes an extraction unit, which extracts the captured image based on the condition that the violation conditions are met.

[0013] In the information processing apparatus described in technical solution 4, the captured image is extracted based on the condition that the violation conditions are met. According to this information processing apparatus, the captured image at the time of diagnosis of a violation can be recorded.

[0014] Regarding the information processing device described in technical solution 5, in the information processing device described in technical solution 4, the extraction unit terminates the extraction of the captured image when the violation conditions are not met.

[0015] In the information processing apparatus described in technical solution 5, the extraction of the captured image is terminated when the violation conditions are not met. According to this information processing apparatus, the extraction of the captured image when a violation is diagnosed can be appropriately terminated.

[0016] Regarding the information processing device described in technical solution 6, in the information processing device described in technical solution 4, if the violation clearance conditions based on the driving information are met, the extraction unit deletes the extracted captured image.

[0017] In the information processing apparatus described in technical solution 6, the extracted captured image is deleted when the prescribed violation clearance conditions based on the driving information are met. Here, the prescribed violation clearance conditions are the conditions used to diagnose a violation and then determine that no violation has occurred. According to this information processing apparatus, the extracted captured image can be deleted after a temporary diagnosis of a violation has been made, and when the diagnosis is changed to no violation.

[0018] The driving diagnosis method described in technical solution 7 is performed by a computer as follows: obtaining driving information related to the vehicle's driving and information on the control display obtained by digitizing images captured by a camera mounted on the vehicle; setting the information as a control value if the reliability of the control display obtained by digitizing is above a threshold; updating the control value at a certain moment with any value of the control value within a certain interval including that moment; and diagnosing a violation if the driving of the vehicle based on the driving information meets the violation conditions based on the updated control value.

[0019] In the driving diagnosis method described in technical solution 7, the computer acquires driving information related to the vehicle's movement and control display information obtained by digitizing images captured by a camera mounted on the vehicle. If the reliability of the control display information obtained by digitization is above a threshold, the computer sets the information as a control value and updates the control value at a certain moment with any value within a certain interval including that moment. If the vehicle's movement based on the driving information meets the violation conditions based on the updated control value, the computer diagnoses a violation.

[0020] In this driving diagnostic method, if the reliability of the control display information obtained through informatization is above a threshold, the information is set as a control value, and the control value at a certain moment is updated using any value of the control value within a certain interval including that moment. Therefore, according to this driving diagnostic method, driving diagnostics without fluctuations can be performed based on the control display obtained from the captured image.

[0021] In the storage medium described in technical solution 8, the program causes the computer to perform the following processing: obtaining driving information related to the vehicle's driving, and information on the control display obtained by informatizing the images captured by the camera mounted on the vehicle; setting the information as a control value if the reliability of the control display obtained by informatization is above a threshold; updating the control value at a certain moment with any value of the control value within a certain interval including that moment; and diagnosing a violation if the driving of the vehicle based on the driving information meets the violation conditions based on the updated control value.

[0022] In the storage medium described in technical solution 8, the computer acquires driving information related to the vehicle's movement and control display information obtained by digitizing images captured by a camera mounted on the vehicle. If the reliability of the control display information obtained through digitization is above a threshold, the computer sets the information as a control value and updates the control value at a certain moment with any value within a certain interval including that moment. If the vehicle's movement based on the driving information meets the violation conditions based on the updated control value, the computer diagnoses a violation.

[0023] In this procedure, if the reliability of the control display information obtained through informatization is above a threshold, the information is set as a control value, and the control value at a certain moment is updated using any value of the control value within a certain interval including that moment. Therefore, according to this driving diagnosis method, driving diagnosis without fluctuations can be performed based on the control display obtained from the captured image.

[0024] According to the present invention, it is possible to perform stable driving diagnostics based on the control display obtained from the captured images. Attached Figure Description

[0025] The features, advantages, and technical and industrial importance of exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, in which like reference numerals denote like elements, and wherein:

[0026] Figure 1 This is a diagram showing the general structure of the driving diagnostic system according to this embodiment.

[0027] Figure 2 This is a block diagram illustrating the hardware structure of the vehicle according to this embodiment.

[0028] Figure 3 This is a block diagram showing the structure of the ROM of the vehicle-mounted device in this embodiment.

[0029] Figure 4 This is a block diagram showing the structure of the memory of the vehicle-mounted device in this embodiment.

[0030] Figure 5 This is a block diagram illustrating the functional structure of the vehicle-mounted device in this embodiment.

[0031] Figure 6 This is a block diagram illustrating the hardware structure of the central server in this embodiment.

[0032] Figure 7 This is a block diagram illustrating the functional structure of the central server in this embodiment.

[0033] Figure 8 This is a flowchart illustrating the process of sending control display information performed in the vehicle-mounted device according to this embodiment.

[0034] Figure 9 This is a flowchart illustrating the process of driving diagnostics performed in the central server of this embodiment.

[0035] Figure 10 This is a flowchart illustrating the process of driving diagnostics performed in the central server of this embodiment.

[0036] Figure 11This is a flowchart illustrating the process of driving diagnostics performed in the central server of this embodiment. Detailed Implementation

[0037] A driver diagnostic system incorporating the information processing apparatus of the present invention will be described. The driver diagnostic system uses traffic sign information and vehicle driving information collected from the vehicle to perform driver diagnostics. Furthermore, the driver diagnostic system records images captured when a traffic violation is determined to be incurred.

[0038] (Overall structure)

[0039] like Figure 1 As shown, the driving diagnostic system 10 of this embodiment is configured to include a vehicle 12 and a central server 30 as an information processing device. Additionally, a vehicle-mounted unit 20 is mounted on the vehicle 12. The vehicle-mounted unit 20 and the central server 30 are interconnected via a network N. Figure 1 In the illustration, a vehicle 12 and a vehicle-mounted device 20 are shown relative to a central server 30, but the number of vehicles 12 and vehicle-mounted devices 20 is not limited to this.

[0040] The central server 30 may be located, for example, at the manufacturer of the vehicle 12, the car dealership, or any operator.

[0041] (vehicle)

[0042] like Figure 2 As shown, the vehicle 12 involved in this embodiment is configured to include a vehicle-mounted unit 20, multiple ECUs (Electronic Control Units) 22 and multiple vehicle-mounted devices 24.

[0043] The vehicle-mounted unit 20 is configured to include a CPU (Central Processing Unit) 20A, a ROM (Read Only Memory) 20B, a RAM (Random Access Memory) 20C, a memory 20D, a wireless communication I / F (Interface) 20E, and an in-vehicle communication I / F 20F. The CPU 20A, ROM 20B, RAM 20C, memory 20D, wireless communication I / F 20E, and in-vehicle communication I / F 20F are interconnected in a communicative manner via an internal bus 20G.

[0044] CPU 20A is the central processing unit, which executes various programs or controls various parts. That is, CPU 20A reads programs from ROM 20B or memory 20D and uses RAM 20C as the working area to execute the programs.

[0045] ROM20B stores various programs and data. For example... Figure 3 As shown, in this embodiment, ROM 20B stores a control program 100. The control program 100 is a program for sending control display information obtained by digitizing images captured by a camera to a central server 30.

[0046] like Figure 2 As shown, RAM20C is used as a work area to temporarily store programs or data.

[0047] The 20D, acting as a memory device, is composed of either an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs and data. For example... Figure 4 As shown, in this embodiment, the memory 20D stores a data set of control information DB (database) 120, which is a control display data set obtained for information processing. Additionally, the memory 20D may also store the control program 100 and the control information DB 120.

[0048] like Figure 2 As shown, the wireless communication I / F20E is a wireless communication module used to communicate with the central server 30. This wireless communication module uses communication standards such as 5G, LTE, and Wi-Fi (registered trademark). The wireless communication I / F20E is connected to the network N.

[0049] The in-vehicle communication I / F20F is an interface used to connect with ECU22. This interface uses a communication standard based on the CAN protocol. The in-vehicle communication I / F20F is connected to the external bus 20H.

[0050] ECU22 includes at least ADAS (Advanced Driver Assistance System) ECU22A, steering ECU22B, brake ECU22C, and engine ECU22D.

[0051] ADAS-ECU22A provides comprehensive control of the advanced driver assistance system. Connected to ADAS-ECU22A are vehicle speed sensor 24A, yaw rate sensor 24B, and camera 24C, which constitute the on-board equipment 24. Camera 24C is a camera that takes pictures of the surroundings of the vehicle 12.

[0052] The steering ECU 22B controls the power steering. A steering angle sensor 24D, constituting the on-board equipment 24, is connected to the steering ECU 22B. The steering angle sensor 24D is a sensor that detects the steering angle of the steering wheel.

[0053] like Figure 5 As shown, in the vehicle-mounted device 20 of this embodiment, the CPU 20A functions as the acquisition unit 200, the processing unit 210, and the transmission unit 220 by executing the control program 100.

[0054] The acquisition unit 200 has the function of acquiring vehicle information. Vehicle information includes the status of the on-board device 24, the status of the vehicle 12 obtained from the on-board device 24, and images captured in the vehicle 12. In this embodiment, the vehicle information includes driving information such as position information, vehicle speed, yaw rate, or steering angle. Additionally, the vehicle information includes images of the exterior of the vehicle 12 captured by the camera 24C.

[0055] The processing unit 210 has the following functions: storing vehicle information acquired by the acquisition unit 200 in the memory 20D, or identifying control display information based on images captured by the camera 24C, thereby converting the information into control display information. Specifically, in this embodiment, the processing unit 210 temporarily stores vehicle information in the memory 20D, and then, upon receiving a request from the central server 30, sends it to the central server 30 via the sending unit 220. Furthermore, the processing unit 210 converts the captured images from the camera 24C into control display information using image recognition processing, and derives the reliability of the control display information.

[0056] More specifically, the processing unit 210 identifies the speed limit signs or prohibition signs displayed as control measures in the captured images and converts them into information such as speed limit, temporary stop, no stopping, and no turning.

[0057] The sending unit 220 has the function of sending vehicle information stored in the memory 20D and information displayed in the traffic control system to the central server 30. Specifically, when a request is made from the central server 30, the sending unit 220 of this embodiment sends the vehicle information stored in the memory 20D and information displayed in the traffic control system to the central server 30.

[0058] (Central Server)

[0059] like Figure 6As shown, the central server 30 is configured to include a CPU 30A, ROM 30B, RAM 30C, memory 30D, and communication I / F 30E. The CPU 30A, ROM 30B, RAM 30C, memory 30D, and communication I / F 30E are interconnected via an internal bus 30G in a communicative manner. The functions of the CPU 30A, ROM 30B, RAM 30C, memory 30D, and communication I / F 30E are the same as those of the CPU 20A, ROM 20B, RAM 20C, memory 20D, and wireless communication I / F 20E of the vehicle-mounted device 20 described above. Additionally, the communication I / F 30E can also perform wired communication. The CPU 30A is an example of a processor.

[0060] In this embodiment, the memory 30D stores a processing program 150, control value information DB160, and extracted image DB170. Alternatively, the processing program 150 and control value information DB160 may be stored in the ROM 30B.

[0061] Processor 150 is a program used by the control center server 30. As processor 150 is executed, the center server 30 collects information from the vehicle 12 for control display and performs various processes for driving diagnosis of the vehicle 12's driving information.

[0062] The control value information DB160 stores the control display information and reliability collected from vehicle 12.

[0063] Specifically, information on speed limits, temporary stops, no-stopping, and no-turning restrictions obtained from information processing at various locations will be stored together with the reliability data.

[0064] The DB170 image contains the captured image containing vehicle information when a traffic violation is diagnosed.

[0065] like Figure 7 As shown, in the central server 30 of this embodiment, the CPU 30A functions as a collection unit 250, an acquisition unit 260, a preprocessing unit 270, a diagnostic unit 280, and an extraction unit 290 by executing the processing program 150.

[0066] The collection unit 250 has the function of obtaining control display information from the vehicle-mounted device 20 of the vehicle 12. The collection unit 250 stores the obtained control display information together with the reliability and the location information that represents the position in the control value information DB160.

[0067] The acquisition unit 260 has the function of acquiring vehicle information of vehicle 12 from vehicle 12's on-board unit 20.

[0068] If the reliability of the control display information obtained through informatization is above a threshold, the preprocessing unit 270 sets the information as a control value and updates the control value at a certain moment with any value within a certain range that includes the control value at that moment.

[0069] Specifically, when the information-based control display is related to speed limits, the preprocessing unit 270 updates all control values ​​within a certain range using the maximum speed limit value within that range.

[0070] More specifically, when the reliability of speed limit-related signs is above a threshold (e.g., 50%), the speed limit obtained through information processing is recorded. Then, to avoid false detection or non-detection of speed limit-related signs, the recorded speed limit is replaced with the maximum value of the preceding and following seconds within a certain interval, and this maximum value is used to update all speed limits within the certain interval.

[0071] Furthermore, if the information displayed by the preprocessing unit 270 is related to prohibited behavior, and the reliability of the information obtained from the information display is above a threshold (e.g., 50%), then the flag used as a control value will be set to "on". If there are flags used as control values ​​within a certain range that are "on", then all flags used as control values ​​within that range will be updated to "on".

[0072] For example, if the reliability of the temporary stop flag is 50% or higher, the flags associated with the temporary stop flag are set to "on" (1) and recorded. Then, in order to avoid false detection or non-detection of the temporary stop flag, the recorded flags are replaced with the maximum value of 0.2 seconds before and after a certain interval, and the maximum value is used to update all flags in the certain interval.

[0073] In addition, when the reliability of the no-parking sign is above 50%, the sign associated with the no-parking sign is set to open (1) and recorded. Then, in order to avoid false detection or non-detection of the no-parking sign, the recorded sign is replaced with the maximum value of 0.2 seconds before and after a certain interval, and this maximum value is used as the update for all signs in the certain interval.

[0074] In addition, when the reliability of the no-turn sign is 50% or higher, the signs associated with the no-turn sign are set to open (1) and recorded. Then, in order to avoid false detection or non-detection of the no-turn sign, the recorded signs are replaced with the maximum value of 0.2 seconds before and after a certain interval, and the maximum value is used to update all signs in the certain interval.

[0075] If the vehicle's driving information, which is based on the vehicle information obtained from the vehicle's on-board unit 20 of the vehicle 12, meets the violation conditions based on the updated control values, the diagnostic unit 280 diagnoses a violation.

[0076] Specifically, the diagnostic unit 280 will use the situation of driving significantly exceeding the speed limit around the speed limit-related sign as a condition for a violation, and diagnose whether the driving of vehicle 12 is in violation.

[0077] For example, a speed exceeding the speed limit plus the speed exceeding the limit can be considered a violation. The speed exceeding the limit is 20 km / h, 30 km / h, or 40 km / h.

[0078] In addition, the diagnostic unit 280 will use the failure to temporarily stop near the temporary stop sign as a condition for a violation to diagnose whether the driving of vehicle 12 is in violation.

[0079] For example, if the sign associated with the temporary stop sign is on, a pre-diagnosis of a violation is made. If the vehicle speed is less than a threshold (e.g., 1 km / h), the pre-diagnosis of a violation is removed, and the vehicle is diagnosed as not having violated the rules.

[0080] In addition, the diagnostic department 280 will use the parking situation around the no-parking sign as a condition for violation to diagnose whether the driving of vehicle 12 is in violation.

[0081] For example, if the sign associated with the no-stopping sign is open and the vehicle speed is less than a threshold (e.g., 1 km / h), a violation is pre-diagnosed. If the duration of the state of the vehicle speed being less than the threshold (1 km / h) is less than the threshold (e.g., 180 seconds), the violation pre-diagnosis is deleted and the vehicle is diagnosed as not violating the rules.

[0082] In addition, the diagnostic unit 280 will use the situation of turning around a no-turn sign as a condition for violation to diagnose whether the driving of vehicle 12 is in violation.

[0083] For example, if the sign associated with the no-turn sign is on, a pre-diagnosis of a violation is made. If the maximum yaw angle of vehicle 12 is less than a threshold (e.g., 150°) and the maximum steering angle of vehicle 12's steering wheel is less than a threshold (e.g., 400°), the pre-diagnosis of a violation is removed and the vehicle is diagnosed as not violating the rules.

[0084] Taking advantage of the situation where a violation condition is met, the extraction unit 290 extracts the captured image contained in the vehicle information obtained from the vehicle-mounted device 20 of the vehicle 12 and stores it in the extracted image DB170.

[0085] In addition, the extraction unit 290 takes the situation where the violation conditions are not met as an opportunity to end the extraction of the captured image contained in the vehicle information obtained from the vehicle 12's on-board unit 20, and stores the extracted captured image in the extracted image DB170.

[0086] In addition, if the conditions for resolving traffic violations based on driving information are met, the extraction unit 290 deletes the extracted captured image.

[0087] Specifically, when a violation condition is met, such as driving significantly exceeding the speed limit in the vicinity of a speed limit-related sign, the extraction of images contained in the vehicle information obtained from the vehicle's on-board unit 20 is initiated. If the violation condition is not met, the extraction of images is terminated, and the extracted images are stored in the extracted image DB170.

[0088] Additionally, when the sign related to the temporary stop sign is turned on, the extraction of images contained in the vehicle information obtained from the vehicle's on-board unit 20 begins. After a predetermined time (e.g., 10 seconds), the extraction of images ends, and the extracted images are stored in the extracted image DB170. A minimum vehicle speed of less than a threshold (e.g., 1 km / h) is used as a violation clearance condition. If the violation clearance condition is met, it is considered that a temporary stop has been performed, and the extracted images are deleted.

[0089] Furthermore, taking the condition that the sign related to the no-parking sign is open and the vehicle speed is less than a threshold (e.g., 1 km / h) as an opportunity, the extraction of images contained in the vehicle information obtained from the vehicle-mounted device 20 of vehicle 12 begins. If the vehicle speed reaches or exceeds the threshold (1 km / h), the extraction of images ends, and the extracted images are stored in the extracted image DB170. Additionally, if the duration of the state where the vehicle speed is less than the threshold (1 km / h) is less than a predetermined time (e.g., 180 seconds), it is considered a violation clearance condition. If the violation clearance condition is met, it is considered that the vehicle did not stop, and the extracted images are deleted. If the condition that the vehicle speed is less than the threshold (e.g., 1 km / h) and the predetermined time (e.g., 5 seconds) before that period is not the case, it is considered a violation clearance condition. If the violation clearance condition is met, the extracted images are deleted.

[0090] In addition, situations where a passenger gets on or off the vehicle (front passenger seat or rear seat) within a speed range below a threshold (e.g., 1 km / h) will be considered as violations to be lifted. If the violation lifting conditions are met, the vehicle will be considered not to have stopped, and the captured images will be deleted.

[0091] Additionally, taking the activation of signs related to no-turn signs as a trigger, the extraction of images contained in vehicle information obtained from the vehicle's on-board unit 20 begins. After a predetermined time (e.g., 10 seconds), the extraction of images ends, and the extracted images are stored in the extracted image DB170. Violation clearance conditions are set as the maximum yaw angle of vehicle 12 being less than a threshold (e.g., 150°) and the maximum steering angle of vehicle 12's steering wheel being less than a threshold (e.g., 400°). If these conditions are met, the extracted images are deleted.

[0092] (Control process)

[0093] use Figures 8-11 The flowchart below describes the processing flow performed by the driving diagnostic system 10 of this embodiment. The processing in the vehicle-mounted unit 20 is performed by the CPU 20A of the vehicle-mounted unit 20, which functions as an acquisition unit 200, a processing unit 210, and a transmission unit 220. Furthermore, the processing in the central server 30 is performed by the CPU 30A of the central server 30, which functions as a collection unit 250, an acquisition unit 260, a preprocessing unit 270, a diagnostic unit 280, and an extraction unit 290.

[0094] First, while vehicle 12 is in motion, CPU 20A in onboard unit 20 executes... Figure 8 The control display information is sent and processed as shown.

[0095] exist Figure 8 In step S100, the processing unit 210 acquires a photographed image of the exterior of the vehicle 12 captured by the camera 24C.

[0096] In step S102, the processing unit 210 identifies the control display based on the captured image by the camera 24C, thereby converting it into control display information, and derives the reliability of the control display information, which is temporarily stored in the control information DB120.

[0097] In step S104, the processing unit 210 determines whether the control display has been identified through the processing in step S102. If the control display has been identified through the processing in step S102, the process proceeds to step S106. On the other hand, if the control display has not been identified through the processing in step S102, the control display information transmission process ends.

[0098] In step S106, the sending unit 220 sends the control display information obtained as the identification result of step S102, together with the reliability and location information of the control display information, to the central server 30, and ends the control display information sending process.

[0099] The central server 30 stores the control display information received from the vehicle-mounted device 20, along with the reliability and location information that has been digitized, in the control value information DB160.

[0100] Additionally, while vehicle 12 is in motion, the on-board unit 20 sends the acquired vehicle information to the central server 30. At this time, in the central server 30, CPU 30A repeatedly executes... Figures 9-11 The driving diagnostic process shown.

[0101] Specifically, the CPU30A repeatedly executes the speed limit display, which serves as a control indicator. Figure 9 The driving diagnostic process shown.

[0102] exist Figure 9 In step S110, the acquisition unit 260 obtains vehicle information of vehicle 12 from the vehicle-mounted device 20 of vehicle 12.

[0103] In step S112, the preprocessing unit 270 obtains from the control value information DB160 the control value corresponding to the location information contained in the obtained vehicle information, namely the speed limit, and the reliability of the speed limit-related sign.

[0104] In step S114, if the reliability of the speed limit-related identifier obtained in step S112 is above a threshold (e.g., 50%), the preprocessing unit 270 records the speed limit obtained through information processing. Then, the preprocessing unit 270 performs a filtering process that replaces the recorded speed limit with the maximum value of one second before and after a certain interval, thereby updating all speed limits in the certain interval with this maximum value.

[0105] In step S116, the diagnostic unit 280 considers driving significantly exceeding the speed limit around a speed limit-related sign as a violation condition and determines whether the violation condition is met. If the violation condition is met, a driving violation is diagnosed for vehicle 12, and the process proceeds to step S118. On the other hand, if the violation condition is not met, the process proceeds to step S120.

[0106] In step S118, the extraction unit 290 begins to extract the captured images contained in the vehicle information obtained from the vehicle-mounted device 20 of the vehicle 12.

[0107] In step S120, the extraction unit 290 determines whether it is currently extracting a captured image. If it is, the process proceeds to step S122, the extraction ends, and the extracted image is stored in the extracted image DB170. Conversely, if it is not currently extracting a captured image, the driving diagnostic process ends.

[0108] In addition, the CPU30A repeatedly executes the temporary stop sign, which is displayed as a control indicator. Figure 10 The driving diagnostic process shown above. Additionally, regarding the above... Figure 9 The same treatment will be described using the same label.

[0109] exist Figure 10 In step S110, the acquisition unit 260 obtains vehicle information of vehicle 12 from the vehicle-mounted device 20 of vehicle 12.

[0110] In step S112, the preprocessing unit 270 obtains from the control value information DB160 the control value corresponding to the location information contained in the obtained vehicle information, namely the sign related to the temporary stop sign and the reliability of the temporary stop sign.

[0111] In step S114, if the reliability of the temporary stop flag obtained in step S112 is a threshold (e.g., 50%) or higher, the preprocessing unit 270 sets the flag associated with the temporary stop flag to "on" (1) and records it. Then, the preprocessing unit 270 performs a filtering process that replaces the recorded flag with the maximum value of 0.2 seconds before and after a certain interval, thereby updating all flags in the certain interval with the maximum value.

[0112] In step S200, the diagnostic unit 280 determines whether the sign related to the temporary stop sign obtained in step S112 is open. If the sign related to the temporary stop sign obtained in step S112 is not open, the driving diagnostic process ends. On the other hand, if the sign related to the temporary stop sign obtained in step S112 is open, in step S202, the diagnostic unit 280 pre-diagnoses a traffic violation, and the extraction unit 290, taking the case where the sign related to the temporary stop sign is open as an opportunity, begins to extract the captured image contained in the vehicle information obtained from the vehicle's on-board unit 20 of the vehicle 12. After a predetermined time (e.g., 10 seconds), the image extraction ends, and the extracted image is stored in the extracted image DB170.

[0113] In step S204, the extraction unit 290 uses a minimum vehicle speed less than a threshold (e.g., 1 km / h) as a violation clearance condition and determines whether the violation clearance condition is met. If the violation clearance condition is not met, a violation diagnosis is confirmed, and the driving diagnosis process ends. On the other hand, if the violation clearance condition is met, it is considered that a temporary stop has been made, and the process proceeds to step S206.

[0114] In step S206, the extraction unit 290 deletes the pre-diagnosis of the traffic violation and the extracted captured image, and ends the driving diagnosis process.

[0115] In addition, for the "No Turn" sign displayed as a traffic control indicator, the CPU30A repeatedly executes the above steps, similar to the "Temporary Stop" sign. Figure 10 The driving diagnostic process shown.

[0116] Here, in step S112, the preprocessing unit 270 obtains from the control value information DB160 the control value corresponding to the location information contained in the obtained vehicle information, namely the sign related to the no-turn sign and the reliability of the no-turn sign.

[0117] In step S114, if the reliability of the no-turn sign obtained in step S112 is a threshold (e.g., 50%) or higher, the preprocessing unit 270 sets the flag associated with the no-turn sign to "on" (1) and records it. Then, the preprocessing unit 270 performs a filtering process that replaces the recorded flag with the maximum value of 0.2 seconds before and after a certain interval, thereby updating all flags in the certain interval with the maximum value.

[0118] In step S200, the diagnostic unit 280 determines whether the sign related to the no-turn sign obtained in step S112 is open. If the sign related to the no-turn sign obtained in step S112 is not open, the driving diagnostic process ends. On the other hand, if the sign related to the no-turn sign obtained in step S112 is open, in step S202, the diagnostic unit 280 pre-diagnoses a traffic violation, and the extraction unit 290, taking the open sign as an opportunity, begins to extract the captured image contained in the vehicle information obtained from the vehicle's onboard unit 20. After a predetermined time (e.g., 10 seconds), the extraction of the captured image ends, and the extracted captured image is stored in the extracted image DB170.

[0119] In step S204, the extraction unit 290 uses the maximum yaw angle of the vehicle 12 being less than a threshold (e.g., 150°) and the maximum steering angle of the vehicle 12's steering wheel being less than a threshold (e.g., 400°) as violation clearance conditions, and determines whether these conditions are met. If the violation clearance conditions are not met, a violation diagnosis is confirmed, and the driving diagnosis process ends. On the other hand, if the violation clearance conditions are met, it is considered that no turn was made, and the process proceeds to step S206.

[0120] In step S206, the extraction unit 290 deletes the pre-diagnosis of the traffic violation and the extracted captured image, and ends the driving diagnosis process.

[0121] In addition, the CPU30A repeatedly executes the no-stopping sign, which is used as a control display. Figure 11 The driving diagnostic process shown above. Additionally, regarding the above... Figure 9The same treatment will be described using the same label.

[0122] exist Figure 11 In step S110, the acquisition unit 260 obtains vehicle information of vehicle 12 from the vehicle-mounted device 20 of vehicle 12.

[0123] In step S112, the preprocessing unit 270 obtains from the control value information DB160 the control value corresponding to the location information contained in the obtained vehicle information, namely the sign related to the no-parking sign and the reliability of the no-parking sign.

[0124] In step S114, if the reliability of the no-stopping flag obtained in step S112 is above a threshold (e.g., 50%), the preprocessing unit 270 sets the flag associated with the no-stopping flag to "on" (1) and records it. Then, the preprocessing unit 270 performs a filtering process that replaces the recorded flag with the maximum value of 0.2 seconds before and after a certain interval, thereby updating all flags in the certain interval with the maximum value.

[0125] In step S116, the diagnostic unit 280 considers parking near a no-parking sign as a violation condition and determines whether the violation condition is met. If the violation condition is met, a driving violation is diagnosed for vehicle 12, and the process proceeds to step S118. On the other hand, if the violation condition is not met, the process proceeds to step S120.

[0126] In step S118, the extraction unit 290 begins to extract the captured images contained in the vehicle information obtained from the vehicle-mounted device 20 of the vehicle 12.

[0127] In step S120, the extraction unit 290 determines whether it is currently extracting a captured image. If it is, the process proceeds to step S122, the extraction ends, and the extracted image is stored in the extracted image DB170. Conversely, if it is not currently extracting a captured image, the driving diagnostic process ends.

[0128] In step S300, the extraction unit 290 uses the condition that the duration of the vehicle speed being less than a threshold (e.g., 1 km / h) is less than a predetermined time (e.g., 180 seconds) as a violation clearance condition, and determines whether the violation clearance condition is met. If the violation clearance condition is not met, a violation diagnosis is confirmed, and the driving diagnosis process ends. On the other hand, if the violation clearance condition is met, it is considered that no stopping was performed, and the process proceeds to step S302.

[0129] In step S302, the extraction unit 290 deletes the pre-diagnosis of the traffic violation and the extracted captured image, and ends the driving diagnosis process.

[0130] (Summary of Implementation Methods)

[0131] In this embodiment, when the reliability of the control display information obtained through informatization is above a threshold, the central server 30 sets the control display information obtained through informatization as a control value, and updates the control value at a certain moment with the maximum value of the control values ​​within a certain interval including that moment. Therefore, according to the central server 30, stable driving diagnosis can be performed based on the control display obtained from the captured image.

[0132] Furthermore, in this embodiment, the central server 30 extracts the captured image based on the condition that a violation is met. Therefore, according to the central server 30, it is possible to record the captured image when a violation is diagnosed.

[0133] Furthermore, if the violation clearance conditions stipulated based on driving information are met, the central server 30 in this embodiment deletes the extracted captured images. Therefore, according to the central server 30, if a violation is temporarily diagnosed and then diagnosed as not being a violation, the extracted captured images can be deleted.

[0134] [Remark]

[0135] In the above implementation, all control values ​​within a certain range are updated using the maximum value of the control values ​​within that range. However, this is not the only option; all control values ​​within a certain range can also be updated using the frequency value or the central value of the control values ​​within that range.

[0136] Alternatively, various processors other than the CPU can execute the various processes that are read into the software (program) by the CPU20A and CPU30A in the above embodiments. Examples of processors in this case include FPGAs (Field-Programmable Gate Arrays) and PLDs (Programmable Logic Devices) whose circuit structure can be changed after manufacturing, as well as ASICs (Application Specific Integrated Circuits) and other processors with circuit structures specifically designed for executing specific processes, i.e., dedicated circuits. Furthermore, one of the aforementioned processors can be used to execute each of the above processes, or a combination of two or more processors of the same or different types (e.g., multiple FPGAs, and a combination of a CPU and an FPGA) can be used to execute each of the above processes. More specifically, the hardware structure of the aforementioned processors is a circuit composed of circuit elements such as semiconductor elements.

[0137] Furthermore, in the above embodiments, the description assumes that each program is pre-stored (installed) on a computer-readable non-transitory recording medium (storage medium). For example, the control program 100 in the vehicle loader 20 is pre-stored in ROM 20B, and the processing program 150 in the central server 30 is pre-stored in memory 30D. However, this is not a limitation; each program may also be provided in the form of a non-transitory recording medium (storage medium) such as CD-ROM (Compact Disk Read Only Memory), DVD-ROM (Digital Versatile Disk Read Only Memory), and USB (Universal Serial Bus) memory. Alternatively, the program may also be downloaded from an external device via a network.

[0138] The processing flow described in the above embodiments is an example, and unnecessary steps can be deleted, new steps can be added, or the processing order can be changed without departing from the main idea.

Claims

1. An information processing apparatus, comprising: The acquisition unit acquires driving information related to the vehicle's movement and control display information obtained by digitizing images captured by a camera mounted on the vehicle. The preprocessing unit, when the reliability of the control display information obtained through informatization is above a threshold, sets the information as a control value and updates the control value at a certain moment with any value of the control value within a certain interval including that moment; and The diagnostic department, if the vehicle's driving based on the driving information meets the violation conditions based on the updated control values, diagnoses a violation. The control display is related to speed limits. The information displayed by the control system is a speed limit. The preprocessing unit updates all control values ​​within the specified interval using the maximum value of the control values ​​within one second before and after the specified interval.

2. The information processing apparatus according to claim 1, wherein, The information processing device further includes an extraction unit that extracts the captured image based on the condition that the violation is met.

3. The information processing apparatus according to claim 2, wherein, The extraction unit terminates the extraction of the captured image when the violation conditions are not met.

4. The information processing apparatus according to claim 2, wherein, If the conditions for resolving traffic violations based on the driving information are met, the extraction unit deletes the extracted captured image.

5. A driving diagnostic method, wherein a computer performs the following processing: The vehicle obtains driving information related to its operation and control display information obtained by digitizing images captured by a camera mounted on the vehicle. If the reliability of the control display information obtained through informatization is above a threshold, the information is set as a control value; The control value at a certain moment is updated with any value of the control value within a certain interval that includes that moment; and If the vehicle's driving based on the driving information meets the violation conditions based on the updated control value, a violation is diagnosed. The control display is related to speed limits. The information displayed by the control system is a speed limit. The control values ​​within the specified interval are updated using the maximum value of the control values ​​within one second before and after the specified interval.

6. A storage medium storing a program that causes a computer to perform the following processes: The vehicle obtains driving information related to its operation and control display information obtained by digitizing images captured by a camera mounted on the vehicle. If the reliability of the control display information obtained through informatization is above a threshold, the information is set as a control value; The control value at a certain moment is updated with any value of the control value within a certain interval that includes that moment; and If the vehicle's driving based on the driving information meets the violation conditions based on the updated control value, a violation is diagnosed. The control display is related to speed limits. The information displayed by the control system is a speed limit. The control values ​​within the specified interval are updated using the maximum value of the control values ​​within one second before and after the specified interval.

Images