Method and system for detecting and handling traffic violations

Abstract

The present disclosure relates to a method and system for detecting and processing traffic violations. In a system for detecting and processing traffic violations, a processing unit, when confirming that a vehicle is traveling on the outermost lane of the highway by analyzing the driving record data and lane line detection data of a vehicle traveling on the highway, determines whether another vehicle has violated the road shoulder driving behavior on the highway according to the road shoulder opening information, the GPS data of the vehicle and the blind spot detection data; when the confirmation result is positive, extracts an image frame containing the violating vehicle and its license plate from the blind spot detection data, obtains the violation time point and the position coordinates of the vehicle at the violation time point from the GPS data; and stores or sends the reporting information about the violation road shoulder driving behavior and including the image frame, the violation time point and the position coordinates to the user terminal.

Description

[Technical field]

[0001] The present invention relates to the detection of traffic violations, and more particularly to a method and system for detecting and handling traffic violations. [Background technology]

[0002] As disclosed in TW 201123097A1, the existing traffic violation detection system uses one or more cameras to capture a specific area such as a lane, and uses a variety of image processing technologies to analyze the monitoring images to obtain the location information and movement information of the relevant vehicles, and cooperates with the detection areas and conditions set by traffic regulations to detect vehicles that have violated traffic regulations such as illegal driving in special lanes, illegal occupation, illegal parking, etc.

[0003] However, although the above-mentioned method of detecting traffic violation vehicles can replace the method of manually taking photos to report traffic violations, it can only detect traffic violation vehicles in a static manner that is limited to a specific area. Therefore, how to detect traffic violation behaviors in a dynamic manner that is not limited to a specific area to improve traffic safety and public safety has become one of the issues that the relevant technical field wants to solve. [Summary of the invention]

[0004] It is therefore an object of the present invention to provide a method and system for detecting and handling traffic violations that overcomes at least one disadvantage of the prior art.

[0005] Therefore, the method for detecting and handling traffic violations provided by the present invention is executed by a processing unit installed in a vehicle, and the vehicle can be driven on a highway or a general road. The method includes the following steps: (A) obtaining information about the shoulder opening of the highway; (B) receiving driving record data, GPS data, lane detection data and blind spot detection data from the vehicle's onboard system during the driving of the vehicle; (C) when the vehicle is driving on the highway, using image recognition technology to analyze the driving record data and the lane detection data to determine whether the vehicle is driving on the outermost lane of the highway; (D) when it is determined that the vehicle is driving on the outermost lane of the highway, at least based on the shoulder opening information, the GPS data and the blind spot detection data , determine whether there is another vehicle illegally driving on the shoulder of the highway; (E) when it is determined that another vehicle has illegally driven on the shoulder of the highway, extract at least one image frame containing the other vehicle and its license plate from the blind spot detection data, and obtain the violation time point when the other vehicle's illegal driving on the shoulder is determined to have occurred and the first position coordinates of the other vehicle at the violation time point from the GPS data; and (F) store or send first reporting information about the illegal driving on the shoulder of the highway and including the at least one image frame, the violation time point and the first position coordinates to the user terminal.

[0006] Preferably, the method for detecting and handling traffic violations of the present invention, after step (C), further comprises the following steps: (G) when it is determined that the vehicle is traveling on the outermost lane of the highway, analyzing the driving record data to determine whether the vehicle has crossed the right lane line of the outermost lane of the highway and entered the shoulder; (H) when it is determined that the vehicle has crossed the right lane line of the outermost lane of the highway and entered the shoulder, determining whether the vehicle itself has violated the road shoulder driving behavior based on the shoulder open information and the GPS data; and (I) when it is determined that the vehicle itself has violated the road shoulder driving behavior, generating a warning output indicating that the vehicle has violated the road shoulder driving behavior.

[0007] Preferably, the method for detecting and handling traffic violations of the present invention, after step (B), further comprises the following steps: (J) determining whether there is an oncoming vehicle in the right lane adjacent to the lane in which the vehicle is traveling based on the blind spot detection data; (K) when it is determined that another vehicle is approaching the vehicle in the right lane, determining based on the driving record data whether the approaching other vehicle switches from the right lane to the lane in front of the vehicle within a predetermined range from the vehicle; and (L) when it is determined that the approaching other vehicle switches from the right lane to the lane in front of the vehicle within the predetermined range, extracting from the blind spot detection data the information containing the other vehicle traveling in the right lane. (M) extracting from the driving record data a first image frame containing the other vehicle within the predetermined range and located in front of the right side of the vehicle, and a third image frame containing the other vehicle within the predetermined range and located in front of the vehicle and its license plate, and extracting from the GPS data the second position coordinates of the vehicle corresponding to the overtaking time point when the approaching other vehicle switches from the right lane to the lane in front of the vehicle within the predetermined range; and (M) storing or sending to the user terminal second reporting information about the other vehicle regarding the illegal overtaking behavior and including the first image frame, the second image frame, the third image frame, the overtaking time point and the second position coordinates.

[0008] Preferably, in the method for detecting and handling traffic violations of the present invention, in step (D) and step (H), the illegal driving on the shoulder includes at least one of driving on a non-open shoulder, driving on a vehicle that does not meet the requirements for driving on an open shoulder, speeding on an open shoulder, and changing lanes when driving on an open shoulder where lane changes are prohibited.

[0009] Preferably, in the method for detecting and handling traffic violations of the present invention, in step (B), the GPS data also includes the vehicle speed data of the vehicle; in step (D), the processing unit also determines whether another vehicle has violated the road shoulder driving behavior on the highway based on the driving record data; and in step (H), the processing unit also determines whether the vehicle itself has violated the road shoulder driving behavior based on the driving record data.

[0010] Therefore, the system for detecting and processing traffic violations provided by the present invention is suitable for being installed in vehicles traveling on highways or general roads, and includes a driving record module, a GPS module, a lane detection module, a blind spot detection module, a storage module, and a processing unit.

[0011] The driving record module is operated to capture the external environment of the vehicle during the driving of the vehicle to obtain driving record data.

[0012] The GPS module operates to locate the vehicle during the travel to obtain GPS data.

[0013] The lane line detection module is connected to the driving record module and operates to detect the lane line of the lane in which the vehicle is traveling according to the driving record data from the driving record module to obtain lane line detection data.

[0014] The blind spot detection module is operated to capture at least a right blind spot relative to a driver of the vehicle during the driving to obtain blind spot detection data corresponding to the right blind spot.

[0015] The storage module stores the shoulder opening information about the highway.

[0016] The processing unit is connected to the driving record module, the GPS module, the lane line detection module, the blind spot detection module and the storage module to receive the driving record data from the driving record module, the GPS data from the GPS module, the lane line detection data from the lane line detection module and the blind spot detection data from the blind spot detection module. During the driving of the vehicle, the processing unit performs the following operations: when the vehicle is driving on the expressway, the driving record data and the lane line detection data are analyzed using image recognition technology to determine whether the vehicle is driving on the outermost lane of the expressway; when it is determined that the vehicle is driving on the outermost lane of the expressway, whether another vehicle has violated the road shoulder driving behavior on the expressway based on at least the road shoulder opening information, the GPS data and the blind spot detection data stored in the storage module; when it is determined that another vehicle has violated the road shoulder driving behavior, at least one image frame containing the other vehicle and its license plate is extracted from the blind spot detection data, and the violation time point when the other vehicle's violation of the road shoulder driving behavior is determined to have occurred and the first position coordinates of the other vehicle at the violation time point are obtained from the GPS data; and first reporting information about the violation of the road shoulder driving behavior and including the at least one image frame, the violation time point and the first position coordinates is stored in the storage module or sent to the user terminal.

[0017] Preferably, in the system for detecting and handling traffic violations of the present invention, the processing unit also performs the following operations: when it is determined that the vehicle is traveling on the outermost lane of the highway, analyzing the driving record data to determine whether the vehicle has crossed the right lane line of the outermost lane of the highway and entered the shoulder; when it is determined that the vehicle has crossed the right lane line of the outermost lane of the highway and entered the shoulder, determining whether the vehicle itself has violated the road shoulder regulations based on the road shoulder open information and the GPS data; and when it is determined that the vehicle itself has violated the road shoulder regulations, generating a warning output indicating that the vehicle has violated the road shoulder regulations.

[0018] Preferably, in the system for detecting and handling traffic violations of the present invention, the processing unit further performs the following operations: determining whether there is an oncoming vehicle in the right lane relative to the lane in which the vehicle is traveling based on the blind spot detection data; when it is determined that another vehicle is approaching the vehicle in the right lane, determining based on the driving record data whether the approaching other vehicle switches from the right lane to the lane in front of the vehicle within a predetermined range from the vehicle; when it is determined that the approaching other vehicle switches from the right lane to the lane in front of the vehicle within the predetermined range, extracting a first image frame containing the other vehicle traveling in the right lane from the blind spot detection data, and obtaining a first image frame from the blind spot detection data; The driving record data extracts a second image frame containing the other vehicle within the predetermined range and located in front of the right side of the vehicle, and a third image frame containing the other vehicle within the predetermined range and located in front of the vehicle and its license plate, and extracts from the GPS data the second position coordinates of the vehicle corresponding to the overtaking time point when it is determined that the approaching other vehicle switches from the right lane to the lane in front of the vehicle within the predetermined range; and stores the second reporting information about the other vehicle regarding the illegal overtaking behavior and including the first image frame, the second image frame, the third image frame, the overtaking time point and the second position coordinates in the storage module or sends it to the user terminal.

[0019] Preferably, the present invention is used in a system for detecting and handling traffic violations, wherein the illegal shoulder driving behavior includes driving on a non-open shoulder, driving on a vehicle that does not meet the requirements for driving on an open shoulder, speeding on an open shoulder, and changing lanes when driving on an open shoulder where lane changes are prohibited.

[0020] Preferably, in the system for detecting and processing traffic violations of the present invention, the GPS data also includes the vehicle speed data; when the vehicle is traveling on the highway, the processing unit determines whether another vehicle has violated the road shoulder driving behavior on the highway based not only on the road shoulder opening information, the GPS data and the blind spot detection data, but also on the driving record data, and the processing unit determines whether the vehicle itself has violated the road shoulder driving behavior based not only on the road shoulder opening information and the GPS data, but also on the driving record data.

[0021] Compared with the prior art, the processing unit of the present invention can dynamically detect whether other vehicles have violated the road shoulder regulations when driving on a highway, whether the vehicle itself has or will violate the road shoulder regulations when driving on a highway (and issue a warning in time to remind the driver of the vehicle to avoid violations when it detects that there is or will be illegal driving on the road shoulder), and whether other vehicles have violated the regulations when driving on a highway or a general road. In addition, the reporting information on illegal driving on the road shoulder or illegal overtaking can be completely stored or sent to the user terminal. In this way, the complete reporting information on relevant traffic violations can be collected in a dynamic and effective manner without regional restrictions, so as to facilitate subsequent reporting to relevant units, thereby helping to improve overall traffic safety and public safety.

Brief Description of the Drawings

[0022] Other features and effects of the present invention will be clearly presented in the embodiments with reference to the accompanying drawings, in which:

[0023] Figure 1 is a block diagram, exemplarily illustrating a system for detecting and processing traffic violations according to an embodiment of the present invention;

[0024] Figure 2 is a flow chart, which exemplarily illustrates how the processing unit of the embodiment performs a detection and processing procedure regarding another vehicle's illegal shoulder driving behavior when driving on a highway;

[0025] Figure 3 is a flow chart, which exemplarily illustrates how the processing unit determines that another vehicle has violated the road shoulder driving behavior on the highway;

[0026] Figure 4 is a flow chart illustrating how the processing unit performs a detection and processing procedure for the vehicle's own illegal shoulder driving behavior when driving on the expressway;

[0027] Figure 5is a flow chart, which exemplarily illustrates how the processing unit determines that the vehicle has violated the roadside driving rules; and

[0028] Figure 6 is a flow chart that exemplarily illustrates how the processing unit performs the detection and processing procedures related to the illegal overtaking behavior of another vehicle when driving on the expressway or general roads. [Specific implementation method]

[0029] Before the present invention is described in detail, it should be noted that similar elements are denoted by the same reference numerals in the following description.

[0030] See also Figure 1 , exemplarily depicts a system 100 for detecting and handling traffic violations according to an embodiment of the present invention, which is suitable for being arranged or installed in a vehicle (not shown) traveling on a highway or a general road. The system 100 can be implemented in a vehicle-mounted system configured in the vehicle, and includes a driving record module 1, a GPS module 2, a lane detection module 3, a blind spot detection module 4, a storage module 5, and a processing unit 6.

[0031] The driving record module 1 is operated to capture the external environment of the vehicle during the driving of the vehicle to obtain driving record data. Specifically, the driving record module 1 needs to capture at least the front image of the vehicle, but is not limited thereto.

[0032] The GPS module 2 operates to locate the vehicle during the driving to obtain GPS data. In this embodiment, the GPS data may include the location data and vehicle speed data of the vehicle.

[0033] The lane line detection module 3 is connected to the driving record module 1 and operates to receive the driving record data from the driving record module 1, and analyzes and processes the driving record data to detect the lane line of the lane in which the vehicle is traveling, so as to obtain lane line detection data.

[0034] The blind spot detection module 4 is operated to capture at least a right blind spot relative to a driver of the vehicle during the driving to obtain blind spot detection data corresponding to the right blind spot, but is not limited thereto.

[0035] The storage module 5 stores the shoulder opening information of the highway in advance. Specifically, the shoulder opening information may include or indicate all sections of the highway with open shoulders, the types of vehicles that can travel on the open shoulders of each section, and the opening time, speed limit and related regulations (e.g., prohibition of lane change) of the open shoulders of each section.

[0036] The processing unit 6 is connected to the driving record module 1, the GPS module 2, the lane line detection module 3, the blind spot detection module 4 and the storage module 5 to receive the driving record data from the driving record module 1, the GPS data from the GPS module 2, the lane line detection data from the lane line detection module 3 and the blind spot detection data from the blind spot detection module 4.

[0037] In this embodiment, when the vehicle is traveling on the expressway, the system 100 can be used to detect and handle the illegal shoulder driving behavior of another vehicle, and at the same time detect and handle the illegal shoulder driving behavior of the vehicle itself; and when the vehicle is traveling on the expressway or a general road, the system 100 can be used to detect and handle the illegal overtaking behavior of another vehicle.

[0038] Below, we will refer to Figure 1 and Figure 2 To illustrate in detail how the processing unit 6 performs the detection and processing procedures for another vehicle's illegal driving on the shoulder of the road during the vehicle's driving on the highway, the detection and processing procedures include the following steps S21 to S24.

[0039] First, in step S21, the processing unit 6 uses image recognition technology to analyze the driving record data and the lane detection data to determine whether the vehicle is traveling in the outermost lane of the highway. When the determination result is positive, the process will proceed to step S22, otherwise the process will repeat step S21.

[0040] When it is determined that the vehicle is traveling on the outermost lane of the highway, in step S22, the processing unit 6 determines whether another vehicle has violated the road shoulder driving behavior on the highway based on the road shoulder opening information, the driving record data, the GPS data and the blind spot detection data stored in the storage module 5. When the determination result is positive, the process will proceed to step S23, otherwise the process will repeat step S22. In this embodiment, the illegal road shoulder driving behavior includes, for example, driving on a non-open shoulder, a vehicle type that does not meet the requirements for driving on an open shoulder, speeding on an open shoulder, and changing lanes when driving on an open shoulder where lane changes are prohibited.

[0041] More specifically, refer to Figure 3 , the procedure of how the processing unit 6 determines in step S22 that another vehicle has violated the roadside driving rules on the expressway will be further described. In other words, step S22 may include the following sub-steps S30 to S39.

[0042] First, in sub-step S30, the processing unit 6 uses image recognition technology to analyze the blind spot detection data to confirm whether there is another vehicle on the shoulder of the road. When it is confirmed that there is another vehicle on the shoulder of the road, the process proceeds to sub-step S31; otherwise, sub-step S30 is repeated.

[0043] In sub-step S31, the processing unit 6 obtains the positioning position of the vehicle according to the GPS data and confirms whether the shoulder of the current road section where the vehicle is located is an open shoulder according to the shoulder opening information. If the shoulder of the current road section is confirmed to be an open shoulder, the process will proceed to sub-step S32. On the contrary, if the shoulder of the current road section is confirmed to be a non-open shoulder, the processing unit 6 determines that the other vehicle has violated the road shoulder driving rules by driving on a non-open shoulder (sub-step S36).

[0044] In sub-step S32 , the processing unit 6 further identifies the image portion of the other vehicle in the blind spot detection data to obtain the type of the other vehicle.

[0045] Then, in sub-step S33, the processing unit 6 confirms whether the type of the other vehicle meets the type of vehicle that can be driven on the open shoulder of the current road section (for example, a small car) based on the road shoulder opening information. If the confirmation result is positive, the process will proceed to sub-step S34. On the contrary, if it is confirmed that the type of the other vehicle does not meet the type of vehicle that can be driven on the open shoulder of the current road section, the processing unit 6 determines that the other vehicle has violated the road shoulder driving behavior because it does not meet the type of vehicle that can be driven on the open shoulder (sub-step S37).

[0046] In sub-step S34, the processing unit 6 obtains the speed of the vehicle according to the GPS data so as to estimate the speed of the other vehicle according to the blind spot detection data and the speed, and confirms whether the speed of the other vehicle exceeds the speed limit of the shoulder of the current road section according to the shoulder opening information, that is, whether the other vehicle is speeding on the open shoulder. If the confirmation result is negative, the process will proceed to sub-step S35. On the contrary, if it is confirmed that the other vehicle is speeding on the open shoulder, the processing unit 6 determines that the other vehicle has an illegal shoulder driving behavior due to speeding on the open shoulder (sub-step S38).

[0047] Specifically, the processing unit 6, in sub-step S34, can first obtain the vehicle speed corresponding to the two time points respectively from the GPS data and extract two image frames corresponding to the two time points respectively and containing the other vehicle from the blind spot detection data (when the vehicle is ahead of the other vehicle) or the driving record data (when the other vehicle is ahead of the vehicle), and then analyze the distance-related features in the two image frames (for example, the line segments of the lane dashed lines) to estimate the distance change of the other vehicle relative to the vehicle, and obtain the relative speed of the other vehicle relative to the vehicle based on the time difference between the two time points and the distance change, and finally estimate the speed of the other vehicle based on the speed of the vehicle at the (later) time point and the relative speed. For example, if the speed of the vehicle at a later time is 100 km / h, and the distance change of the other vehicle relative to the vehicle in the 2-second time difference is 10 meters ahead, in this case, the processing unit 6 can obtain the relative speed of the other vehicle relative to the vehicle as 18 km / h, and thus estimate the speed of the other vehicle to be 118 km / h. Therefore, if the speed limit of the shoulder of the current road section is 60 km / h, the processing unit 6 will confirm that the other vehicle is speeding on the open shoulder.

[0048] However, in order to reduce the processing and calculation of the processing unit 6 on image recognition, in other embodiments, the processing unit 6 can also be used in conjunction with a radar (not shown) for detecting other objects near the vehicle in step 34. Therefore, when the radar also detects the other vehicle, the processing unit 6 can obtain the change in the distance between the vehicle and the other vehicle more quickly than the image recognition processing method based on the change in the return time of the radar signal, and estimate the relative speed of the other vehicle relative to the vehicle, and then confirm whether the other vehicle is speeding based on the speed of the vehicle itself and the relative speed. In this way, the speeding shoulder of the other vehicle can be confirmed more quickly than the image recognition processing method, and combined with the extraction of the above two image frames, the image evidence of the speeding shoulder of the other vehicle can be preserved.

[0049] In sub-step S35, for example, when the processing unit 6 has previously confirmed that the shoulder of the current road section is an open shoulder where lane changes are prohibited based on the shoulder open information, in this case, the processing unit 6 can confirm whether the other vehicle has changed from the open shoulder of the current road section (illegally) to other lanes by analyzing and processing the driving record data and / or the blind spot detection data. If the confirmation result is negative, this means that the other vehicle has no illegal shoulder driving behavior, and the process will return to sub-step S30. On the contrary, if it is confirmed that the other vehicle has changed lanes, the processing unit 6 determines that the other vehicle has illegal shoulder driving behavior due to illegal lane changes due to driving on an open shoulder (sub-step S39).

[0050] It is worth mentioning that if the shoulder of the current road section is an open shoulder that allows lane changes, when the processing unit 6 confirms in sub-step S34 that the other vehicle is not speeding on the open shoulder, the process will return to sub-step S30 and omit the above-mentioned sub-steps S35 and S39.

[0051] After sub-steps S36 to S39, the process proceeds to step S23.

[0052] When it is determined that another vehicle has violated the road shoulder driving rules, in step S23, the processing unit 6 extracts one or more image frames containing the other vehicle and its license plate from the blind spot detection data, and obtains the violation time point when the other vehicle's violation of the road shoulder driving rules is determined to have occurred and the first position coordinates of the other vehicle at the violation time point from the GPS data. For example, if the violation of the road shoulder driving rules is driving on a non-open road shoulder or a vehicle that does not meet the requirements for driving on an open road shoulder, the processing unit 6 can only extract the image frames containing the other vehicle and its license plate from the blind spot detection data, and if the violation of the road shoulder driving rules is speeding on an open road shoulder or illegal lane change on an open road shoulder, the processing unit 6 can extract two or more image frames sufficient to prove speeding or lane change from at least one of the blind spot detection data and the driving record data.

[0053] Finally, in step S24, the processing unit 6 stores the first reporting information about the illegal shoulder driving behavior and including the image frame(s), the illegal time point and the first position coordinates in the storage module 5, or sends the first reporting information to the user terminal 200 via a communication module (not shown). It is worth noting that the user terminal 200 can be a mobile phone held by the driver of the vehicle, or a reporting platform provided by the traffic supervision unit.

[0054] Below, we will refer to Figure 1 and Figure 4 The following is an example of how the processing unit 6 performs the detection and processing procedures for the vehicle's own illegal driving on the shoulder during the vehicle's driving on the expressway. The detection and processing procedures include the following steps S41 to S44.

[0055] First, in step S41, similar to Figure 2 In step S21, the processing unit 6 uses image recognition technology to analyze the driving record data and the lane line detection data to determine whether the vehicle is traveling in the outermost lane of the highway. When the determination result is positive, the process will proceed to step S42, otherwise the process will repeat step S41.

[0056] When it is determined that the vehicle is traveling in the outermost lane of the expressway, in step S42, the processing unit 6 analyzes the driving record data to determine whether the vehicle crosses the right lane line of the outermost lane of the expressway and enters the shoulder. When it is determined that the vehicle crosses the right lane line of the outermost lane of the expressway and enters the shoulder, the process will proceed to step S43; otherwise, the process will repeat step S42.

[0057] In step S43, the processing unit 6 determines whether the vehicle itself has violated the road shoulder driving behavior based on the road shoulder opening information and the GPS data. If the determination result is positive, the process will proceed to step S44; otherwise, the process will repeat step S43.

[0058] More specifically, refer to Figure 1 and Figure 5 , the procedure of how the processing unit 6 determines in step S43 that the vehicle itself has violated the road shoulder driving rules will be further described in detail. In other words, step S43 may include the following sub-steps S51 to S56.

[0059] First, in sub-step S51, similar to Figure 3 In sub-step S31, the processing unit 6 obtains the positioning position of the vehicle according to the GPS data and confirms whether the shoulder of the current road section where the vehicle is located is an open shoulder according to the shoulder opening information. If it is confirmed that the shoulder of the current road section is an open shoulder, the process will proceed to sub-step S52. On the contrary, if it is confirmed that the shoulder of the current road section is a non-open shoulder, the processing unit 6 determines that the vehicle has violated the road shoulder driving behavior by driving on a non-open shoulder (sub-step S55).

[0060] In sub-step S52, the processing unit 6 confirms (has been obtained in advance) whether the type of the vehicle meets the type of vehicle that can be driven on the open shoulder of the current road section (for example, a small car) based on the road shoulder opening information. If the confirmation result is positive, the process will proceed to sub-step S53. On the contrary, if it is confirmed that the type of the vehicle does not meet the type of vehicle that can be driven on the road shoulder of the current road section, the processing unit 6 determines that the vehicle has violated the road shoulder driving behavior because it does not meet the type of vehicle that can be driven on the open shoulder (sub-step S56).

[0061] In sub-step S53, the processing unit 6 confirms whether the speed of the vehicle obtained from the GPS data exceeds the speed limit of the open shoulder of the current road section according to the shoulder open information, that is, whether the vehicle is speeding on the open shoulder. If the confirmation result is negative, the process will proceed to sub-step S54. On the contrary, if it is confirmed that the vehicle is speeding on the open shoulder, the processing unit 6 determines that the vehicle has violated the road shoulder driving behavior by speeding on the open shoulder (sub-step S57).

[0062] In sub-step S54, for example, when the processing unit 6 has previously confirmed that the shoulder of the current road section is an open shoulder where lane changes are prohibited based on the shoulder open information, in this case, the processing unit 6 can confirm whether the vehicle has changed from the open shoulder of the current road section (illegally) to other lanes by analyzing and processing the driving record data or the relevant information provided by the driving computer. If the confirmation result is negative, it means that the vehicle has no illegal shoulder driving behavior, and the process will return to sub-step S51. On the contrary, if it is confirmed that the vehicle has changed lanes, the processing unit 6 determines that the vehicle has illegal shoulder driving behavior due to illegal lane changes due to driving on an open shoulder (sub-step S58).

[0063] Similarly, if the shoulder of the current road section is an open shoulder that allows lane changes, when the processing unit 6 confirms in sub-step S53 that the vehicle is not speeding on the open shoulder, the process will return to sub-step S51 and omit the above-mentioned sub-steps S54 and S58.

[0064] After sub-steps S55 to S58, the process proceeds to step S44.

[0065] When it is determined that the vehicle itself has violated the road shoulder driving behavior, in step S44, the processing unit 6 generates a warning output indicating that the vehicle has violated the road shoulder driving behavior. More specifically, the processing unit 6 can enable the display module or speaker module (not shown) of the vehicle-mounted system to display or regenerate the warning output, thereby reminding the driver of the vehicle to make appropriate operations to avoid violations. In addition, the warning output can further indicate the exact violation of the illegal driving shoulder, such as driving on a non-open shoulder, vehicles that do not meet the requirements of the open shoulder, speeding on the open shoulder, and changing lanes when driving on an open shoulder where lane changes are prohibited. Or further, the driving assistance system (not shown) in the vehicle-mounted system can automatically assist in manipulating the vehicle to avoid violations in response to the warning output, such as automatically controlling the vehicle speed to avoid speeding, or keeping driving on the open shoulder to avoid illegal lane changes.

[0066] Below, we will refer to Figure 1 and Figure 6To illustrate in detail how the processing unit 6 performs the detection and processing procedures for the illegal overtaking behavior of another vehicle while the vehicle is traveling on a road (highway or ordinary road), the detection and processing procedures include the following steps S61 to S64.

[0067] First, in step S61, the processing unit 6 determines whether there is an oncoming vehicle in the right lane relative to the lane in which the vehicle is traveling based on the blind spot detection data. When it is determined that another vehicle is approaching the vehicle in the right lane, the process proceeds to step S62; otherwise, the process repeats step S61.

[0068] In step S62, the processing unit 6 determines whether the approaching other vehicle switches from the right lane to the lane and drives in front of the vehicle within a predetermined range from the vehicle, that is, whether the approaching other vehicle overtakes the vehicle from the right side of the vehicle within the predetermined range (this right-side overtaking behavior is regarded as an illegal overtaking behavior). In this embodiment, the predetermined range is related to the current speed of the vehicle. When it is determined that the approaching other vehicle switches from the right lane to the lane and drives in front of the vehicle within the predetermined range, the process will proceed to step S63; otherwise, the process will return to repeat step S61.

[0069] In step S63, the processing unit 6 extracts a first image frame containing the other vehicle traveling in the right lane from the blind spot detection data, extracts a second image frame containing the other vehicle within the predetermined range and located in front of the right of the vehicle from the driving record data, and a third image frame containing the other vehicle and its license plate within the predetermined range and located in front of the vehicle, and extracts from the GPS data the second position coordinates of the vehicle corresponding to the overtaking time point when it is determined that the approaching other vehicle switches from the right lane to the lane in front of the vehicle within the predetermined range.

[0070] Finally, in step S64, the processing unit 6 stores the second reporting information about the other vehicle that has committed the illegal overtaking behavior and includes the first image frame, the second image frame, the third image frame, the overtaking time point and the second position coordinates in the storage module 5, or sends the second reporting information to the user terminal 200 via the communication module.

[0071] In summary, the processing unit 6 can dynamically detect, based on the driving record data, GPS data, lane detection data and blind spot detection data during vehicle driving: such as whether other vehicles have violated the roadside shoulder when driving on the highway; such as whether the vehicle itself has or will violate the roadside shoulder when driving on the highway (and when it is detected that there is or will be a violation of the roadside shoulder, a warning is issued in time to remind the driver of the vehicle to avoid violations); and such as whether other vehicles have violated the overtaking behavior when driving on the highway or general roads. In addition, the reporting information on the violation of the roadside shoulder or the violation of the overtaking behavior can be completely stored or sent to the user terminal. In this way, the complete reporting information of the relevant traffic violations can be collected in a dynamic and effective manner without regional restrictions, so as to facilitate the subsequent reporting to the relevant units, thereby helping to improve the overall traffic safety and public safety. Therefore, the system 100 for detecting and processing traffic violations of the present invention can indeed achieve the purpose of the present invention.

[0072] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A method for detecting and handling traffic violations, performed by a processing unit disposed in a vehicle, the vehicle being capable of traveling on a highway or a general road, characterized in that: The method comprises the following steps: (A) obtaining information regarding the shoulder opening of the highway; (B) receiving driving record data, GPS data, lane detection data, and blind spot detection data from an onboard system of the vehicle while the vehicle is traveling; (C) when the vehicle is traveling on the expressway, analyzing the driving record data and the lane line detection data using image recognition technology to determine whether the vehicle is traveling on the outermost lane of the expressway; (D) when it is determined that the vehicle is traveling in the outermost lane of the highway, determining whether another vehicle is illegally traveling on the shoulder of the highway based on at least the roadside shoulder open information, the GPS data, and the blind spot detection data; (E) when it is determined that another vehicle has violated the roadside driving rules, extracting at least one image frame containing the other vehicle and its license plate from the blind spot detection data, and obtaining the violation time point at which the other vehicle's violation of the roadside driving rules is determined and the first position coordinates of the other vehicle at the violation time point from the GPS data; and (F) storing or sending first reporting information about the illegal shoulder driving behavior and including the at least one image frame, the illegal time point and the first position coordinates to a user terminal.

2. The method for detecting and handling traffic violations according to claim 1, characterized in that: After step (C), the method further comprises the following steps: (G) when it is determined that the vehicle is traveling in the outermost lane of the highway, analyzing the driving record data to determine whether the vehicle crosses the right lane line of the outermost lane of the highway and enters the shoulder; (H) after determining that the vehicle has crossed the right lane line of the outermost lane of the expressway and entered the road shoulder, determining whether the vehicle itself has violated the road shoulder driving rules based at least on the road shoulder opening information and the GPS data; and (I) When it is determined that the vehicle has violated the roadside regulations, a warning output is generated indicating that the vehicle has violated the roadside regulations.

3. The method for detecting and handling traffic violations according to claim 1 or 2, characterized in that: After step (B), the method further comprises the following steps: (J) determining whether there is an oncoming vehicle in a right lane adjacent to the lane in which the vehicle is traveling based on the blind spot detection data; (K) when it is determined that another vehicle is approaching the vehicle in the right lane, determining, based on the driving record data, whether the approaching other vehicle switches from the right lane to the lane ahead of the vehicle within a predetermined range from the vehicle; and (L) when it is determined that the approaching other vehicle switches from the right lane to the lane traveling in front of the vehicle within the predetermined range, extracting from the blind spot detection data a first image frame containing the other vehicle traveling in the right lane, extracting from the driving record data a second image frame containing the other vehicle within the predetermined range and located in front of the right side of the vehicle, and extracting from the driving record data a third image frame containing the other vehicle within the predetermined range and located in front of the vehicle and its license plate, and extracting from the GPS data a second position coordinate of the vehicle corresponding to the overtaking time point when it is determined that the approaching other vehicle switches from the right lane to the lane traveling in front of the vehicle within the predetermined range; and (M) storing or sending second reporting information about the other vehicle that has violated the overtaking rule and including the first image frame, the second image frame, the third image frame, the overtaking time point, and the second position coordinates to the user terminal.

4. The method for detecting and handling traffic violations according to claim 2, wherein: In step (D) and step (H), the illegal shoulder driving behavior includes at least one of driving on a non-open shoulder, driving a vehicle that does not meet the requirements for driving on an open shoulder, speeding on an open shoulder, and changing lanes when driving on an open shoulder where lane changes are prohibited.

5. The method for detecting and handling traffic violations according to claim 4, characterized in that: In step (B), the GPS data also includes the vehicle speed data of the vehicle; In step (D), the processing unit further determines whether another vehicle has violated the roadside shoulder regulations on the highway based on the driving record data; and In step (H), the processing unit also determines whether the vehicle itself has violated the road shoulder regulations based on the driving record data.

6. A system for detecting and handling traffic violations, suitable for being installed in a vehicle traveling on a highway or a general road, characterized in that: Include: A driving record module, which is operated to photograph the external environment of the vehicle during the driving of the vehicle to obtain driving record data; a GPS module operative to locate the vehicle during the travel to obtain GPS data; A lane line detection module is connected to the driving record module and operates to detect the lane line of the lane in which the vehicle is traveling according to the driving record data from the driving record module to obtain lane line detection data; a blind spot detection module, operative to photograph at least a right blind spot relative to a driver of the vehicle during the driving to obtain blind spot detection data corresponding to the right blind spot; A storage module stores the shoulder opening information of the expressway; and a processing unit connected to the driving record module, the GPS module, the lane line detection module, the blind spot detection module and the storage module to receive the driving record data from the driving record module, the GPS data from the GPS module, the lane line detection data from the lane line detection module and the blind spot detection data from the blind spot detection module; During the driving of the vehicle, the processing unit performs the following operations: When the vehicle is traveling on the expressway, the driving record data and the lane line detection data are analyzed using image recognition technology to determine whether the vehicle is traveling on the outermost lane of the expressway; When it is determined that the vehicle is traveling on the outermost lane of the highway, determining whether another vehicle is illegally traveling on the shoulder of the highway based on at least the road shoulder opening information, the GPS data, and the blind spot detection data stored in the storage module; When it is determined that another vehicle has violated the roadside driving rules, extract at least one image frame containing the other vehicle and its license plate from the blind spot detection data, and obtain the violation time point when the other vehicle's violation of the roadside driving rules is determined and the first position coordinates of the other vehicle at the violation time point from the GPS data; and The first reporting information about the illegal shoulder driving behavior and including the at least one image frame, the illegal time point and the first position coordinates is stored in the storage module or sent to the user terminal.

7. The system for detecting and handling traffic violations as claimed in claim 6, characterized in that: The processing unit also performs the following operations: When it is determined that the vehicle is traveling in the outermost lane of the highway, analyzing the driving record data to determine whether the vehicle crosses the right lane line of the outermost lane of the highway and enters the shoulder; After it is determined that the vehicle crosses the right lane line of the outermost lane of the expressway and enters the road shoulder, it is determined whether the vehicle itself has violated the road shoulder driving rules based on the road shoulder opening information and the GPS data; and When it is determined that the vehicle itself has violated the road shoulder regulations, a warning output is generated indicating that the vehicle has violated the road shoulder regulations.

8. The system for detecting and handling traffic violations according to claim 6 or 7, characterized in that: The processing unit also performs the following operations: Determine whether there is an oncoming vehicle in the right lane relative to the lane in which the vehicle is traveling based on the blind spot detection data; When it is determined that another vehicle is approaching the vehicle in the right lane, determining, based on the driving record data, whether the approaching other vehicle switches from the right lane to the lane in front of the vehicle within a predetermined range from the vehicle; When it is determined that the approaching other vehicle switches from the right lane to the lane to travel in front of the vehicle within the predetermined range, a first image frame containing the other vehicle traveling in the right lane is extracted from the blind spot detection data, a second image frame containing the other vehicle within the predetermined range and located in front of the right of the vehicle, and a third image frame containing the other vehicle within the predetermined range and located in front of the vehicle and its license plate are extracted from the driving record data, and a second position coordinate of the vehicle corresponding to the overtaking time point when it is determined that the approaching other vehicle switches from the right lane to the lane to travel in front of the vehicle within the predetermined range is extracted from the GPS data; and The second reporting information about the other vehicle with the illegal overtaking behavior and including the first image frame, the second image frame, the third image frame, the overtaking time point and the second position coordinates is stored in the storage module or sent to the user terminal.

9. The system for detecting and handling traffic violations according to claim 6 or 7, characterized in that: The illegal shoulder driving behavior includes at least one of driving on a non-open shoulder, driving a vehicle that does not meet the requirements for driving on an open shoulder, speeding on an open shoulder, and changing lanes when driving on an open shoulder where lane changes are prohibited.

10. The system for detecting and handling traffic violations as claimed in claim 9, characterized in that: The GPS data also includes the vehicle speed data of the vehicle; and When the vehicle is traveling on the expressway, the processing unit determines whether another vehicle has violated the road shoulder regulations on the expressway based not only on the road shoulder open information, the GPS data and the blind spot detection data, but also on the driving record data. The processing unit determines whether the vehicle itself has violated the road shoulder regulations based not only on the road shoulder open information and the GPS data, but also on the driving record data.

Images