Variable traffic safety information display apparatus capable of unmanned enforcement of traffic law violations
Patent Information
- Application Number
- KR1020260075564
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2026-04-27
- Publication Date
- 2026-09-21
- Estimated Expiration
- 2046-04-27
Smart Images

Figure 112026051020910-PAT00010_ABST
Abstract
Description
Technology Field
[0001] The present invention relates to a variable traffic safety information display device capable of unmanned traffic law violation enforcement, and more specifically, to an invention capable of outputting notification information regarding the fact of a traffic law violation to a variable traffic sign when a violation of a traffic law is detected. Background Technology
[0003] On July 12, 2022, the Road Traffic Act was amended to protect pedestrians walking on crosswalks when turning right.
[0004] In Korea, right turns are permitted under the RTOR (Right Turn On Red) system, which allows for unprotected turns even in red light situations. This results in a high rate of vehicle-pedestrian accidents, often leading to fatalities or serious injuries; therefore, the Road Traffic Act was amended as part of efforts to address this issue.
[0005] A survey of 7,207 people nationwide prior to the amendment of the Road Traffic Act showed that 94.9% (6,839 people) of the total respondents felt threatened or thought it was dangerous when crossing a crosswalk at a traffic island intersection.
[0006] It was found that the driving speed of vehicles turning right at traffic island intersections was 7.3% higher than at regular intersections, indicating that the installation of traffic islands affects vehicle speed.
[0007] According to the results of the 'Experiment on Pedestrian Crossing Safety of Right-Turn Flow Control Facilities (November 2021),' all vehicles turning right at unsignaled crosswalks connected to traffic islands are required to stop temporarily when pedestrians are crossing, but only 25 out of 202 vehicles (12.4%) complied with the stop line. Furthermore, 54.5% of drivers passed by without yielding even when pedestrians were crossing the crosswalk, while the remaining 33.2% yielded to pedestrians but either encroached on the crosswalk to stop or passed by while driving slowly without coming to a complete stop.
[0008] It was found that only 3 out of 369 drivers, or 0.8%, yielded to pedestrians waiting to cross the crosswalk on traffic islands.
[0009] Recently, with the installation of unmanned traffic enforcement devices that identify and crack down on vehicles running red lights and speeding, the risk of traffic accidents caused by speeding vehicles or vehicles running red lights in child protection zones and elderly protection zones has been significantly reduced.
[0010] However, casualties from traffic accidents are still occurring.
[0011] Most of the casualties were caused by accidents resulting from right-turning vehicles entering blind spots where pedestrians were not visible, or by failure to stop.
[0012] Most of these accidents can be prevented through driver caution.
[0013] Currently, traffic signs have been installed so that drivers can see them to encourage temporary stops and slow down when turning right, but the effectiveness is limited due to visibility issues.
[0014] Meanwhile, as a result of the prior art search for the present invention, no identical prior art was found.
[0015] However, as prior art similar to the present invention, the "System for Enforcing Vehicles Violating Temporary Stops When Turning Right at an Intersection" under application number "10-2021-0130026" has been patented and registered. The said System for Enforcing Vehicles Violating Temporary Stops When Turning Right at an Intersection includes a detection means, an enforcement device that receives information from the detection means and performs enforcement of violations regarding crosswalks when a vehicle turns right, and an enforcement device of a competent authority that shares enforcement information from the enforcement device. Prior art literature
[0017] Republic of Korea Patent Registration No. "10-2339213" (2021.12.14) The problem to be solved
[0018] Accordingly, the objective of the present invention is to provide a variable traffic safety information display device capable of unmanned enforcement of traffic law violations, such as signal violations and stop violations by right-turning vehicles, in order to solve the aforementioned problems.
[0019] In addition, another objective of the present invention is to provide an invention capable of variably displaying traffic safety signs according to traffic conditions.
[0020] In addition, another objective of the present invention is to provide an invention capable of cracking down on speeding vehicles and vehicles violating traffic signals.
[0021] In addition, another objective of the present invention is to provide an invention capable of determining whether a vehicle is stopped in front of a stop line on a road and enforcing a stop line violation against a vehicle that does not stop in front of the stop line. means of solving the problem
[0023] A variable traffic safety information display device capable of unmanned traffic law violation enforcement according to the present invention for achieving the above objective comprises: a camera (1) for photographing a vehicle passing through a traffic law violation enforcement point; a control means (3) for recognizing a vehicle number from an image frame input from the camera (1) and determining whether the vehicle corresponding to the recognized vehicle number has violated a temporary stop rule; and a variable traffic sign (5) for displaying information regarding whether the temporary stop rule has been violated according to a control signal of the control means (3). Effects of the invention
[0025] The variable traffic safety information display device according to the present invention, configured as such, capable of enforcing unmanned traffic law violations, can enforce unmanned traffic law violations such as signal violations and temporary stop violations by vehicles turning right.
[0026] In addition, the present invention can variably display traffic safety signs according to traffic conditions and can crack down on vehicles turning right when a right-turn prohibition signal is given.
[0027] In addition, the present invention can detect speeding vehicles and vehicles violating traffic signals, determine whether a vehicle is stopped in front of a stop line on the road, and detect whether a vehicle that is not stopped in front of a stop line is violating the stop line. Brief explanation of the drawing
[0029] Drawing 1 is a front view of the present invention, Figure 2 is a side view of the present invention, Figure 3 is a control block diagram of the present invention, Figure 4 is a control block diagram of a control means, Figure 5 is a control block diagram of a pause determination unit, Figure 6 is a drawing illustrating a vehicle license plate recognized in a reference image frame, Figure 7 is a drawing of one patch image extracted from a vehicle license plate, Figure 8 is a drawing of three patch images extracted from a vehicle license plate, Figure 9 is a drawing in which horizontal edge information is extracted from three patch images through Sobel operation, Figure 10 is the mask used in the Sobel operation, Drawings 11 to 14 are flowcharts for explaining the operation process of the present invention, Drawing 15 is a drawing showing a slow (slow) sign on a variable traffic sign, Drawing 16 is a drawing in which the stop line violation situation is displayed in real time on a variable traffic sign when the stop line is violated. Specific details for implementing the invention
[0030] The present invention will be described in detail below with reference to the attached drawings.
[0031] As illustrated in Drawings 1 to 3, the variable traffic safety information display device capable of unmanned traffic law violation enforcement according to the present invention includes: a camera (1) that photographs a vehicle passing through a traffic law violation enforcement point; a control means (3) that recognizes a vehicle number from an image frame input from the camera (1) and determines whether the vehicle corresponding to the recognized vehicle number has violated the temporary stop rule; and a variable traffic sign (5) that displays information regarding whether the temporary stop rule has been violated according to a control signal of the control means (3).
[0032] The camera (1) is installed at the upper center of the front of the variable traffic sign (5), as shown in Drawings 1 and 2.
[0033] The above variable traffic sign (5) can be composed of an electronic display or electronic paper.
[0034] As illustrated in Figure 4, the above control means (3) includes a vehicle detection unit (7) that detects a vehicle from an image frame input from a camera (1); a vehicle number recognition unit (9) that recognizes the number of the vehicle detected in the image frame; a pause determination unit (11) that analyzes the image frame input from the camera (1) to determine whether the vehicle with the recognized number is paused; and a variable traffic sign control unit (13) that displays information on a variable traffic sign (5) according to whether the vehicle is paused as determined by the pause determination unit (11).
[0035] The vehicle detection unit (7) and the vehicle number recognition unit (9) recognize a vehicle and a vehicle number within an image frame using a deep learning method based on a Convolutional Neural Network (CNN).
[0036] As illustrated in Figure 5, the above-mentioned pause determination unit (11) comprises: a patch setting unit (15) that sets 'N' patch images in a reference image frame in which a vehicle number is recognized; a patch information extraction and storage unit (17) that stores together in a patch information storage queue the vehicle number recognized in the reference image frame, rectangle coordinate information for 'N' patch images within the reference image frame, and horizontal edge information extracted through Sobel operations from each of the 'N' patch images; a cropped image extraction unit (19) that extracts 'N' cropped images per image frame for each image frame input from the camera (1) after the reference image frame; and a cropped image edge information extraction unit (21) that extracts horizontal edge information for each of the 'N' cropped images extracted by the cropped image extraction unit (19) through Sobel operations. The system includes: an edge information similarity measuring unit (23) that measures similarity by performing a Normalized Cross Correlation (NCC) operation between horizontal edge information for 'N' patch images and horizontal edge information for 'N' crop images; a coordinate distance calculating unit (25) that calculates a straight-line distance between a region among the crop images where the similarity with the patch image exceeds a threshold and the patch image; a stop patch setting and comparison unit (27) that sets a crop image among the 'N' crop images included in each image frame input from the camera (1) where the similarity exceeds a threshold and the straight-line distance is smaller than the threshold as a stop patch, and compares whether the number of set stop patches is greater than or equal to the threshold; and a stop vehicle information deletion unit (29) that determines a vehicle in which the number of stop patches per image frame is less than the threshold for each image frame input from the camera (1) as a vehicle violating the temporary stop, and deletes the number of a vehicle in which the number of stop patches is less than the threshold from a queue for storing stop vehicle information.
[0037] Here, the above 'N' is a natural number ranging from 1 to 3.
[0038] When the vehicle number recognition unit (9) succeeds in recognizing a vehicle number, it checks whether the recognized vehicle number is stored in the patch information storage queue, and if the recognized vehicle number is not stored in the patch information storage queue, it stores the recognized vehicle number in the patch information storage queue.
[0039] The patch setting unit (15) sets 'N' patch images in the vehicle license plate area within the reference image frame.
[0040] The size of the above patch image is set at a ratio pre-set by the user based on the size of the vehicle license plate recognized from the reference image frame.
[0041] For example, as illustrated in Figures 6 and 7, when the number of patch images in the vehicle number image recognized from the reference image frame is 1, the 1 patch image is as shown in Figure 7.
[0042] In addition, when the number of patch images is 3, the 3 patch images are as shown in Figure 8.
[0043] The patch information extraction and storage unit (17) above is the result of extracting horizontal edge information from 'N' patch images through Sobel operation as shown in Figure 9.
[0044] To minimize the amount of processing computation, only horizontal edge information was extracted, and the mask used is as shown in Figure 10.
[0045] The above crop image extraction unit (19) extracts a crop image to reduce the amount of computation because the amount of computation is large when extracting horizontal edges through Sobel operation for the entire area of each image frame input from the camera (1) after the reference image frame.
[0046] The above crop image is extracted as a crop image by adding 'a' to the left boundary coordinate and the right boundary coordinate and adding 'b' to the bottom boundary coordinate in each video frame input from the camera (1) after the reference video frame, based on the square coordinates of the patch image.
[0047] The above 'a' and 'b' are constant values that are pre-set by the user.
[0048] For example, the above coordinate distance calculation unit (25) is the upper-left coordinate within the image frame of the area where the similarity with the patch image among the cropped images exceeds a threshold. , and, the top-left coordinates of the patch image stored in the queue for storing patch information , Calculate the straight-line distance 'd' between them.
[0049] The straight-line distance is calculated using the Euclidean distance, and the formula is as follows.
[0050]
[0051] The above stop patch setting and comparison unit (27) determines that the calculated straight distance 'd' is a stop patch if it is smaller than, for example, the threshold '1' set by the user.
[0052] The above-mentioned stop vehicle information deletion unit (29) determines that a vehicle with a number of stop patches per video frame less than a threshold, for example, '2', is a vehicle that has violated the stop rule.
[0053] Additionally, the above-mentioned pause determination unit (11), as illustrated in Figure 5, determines that for each video frame input from the camera (1), a vehicle in which the number of stop patches per video frame is greater than or equal to a threshold is a vehicle that complies with the pause, determines that the shooting time of the first video frame in which the number of stop patches is greater than or equal to the threshold is the first stop time of the vehicle, and stores the vehicle number and minimum stop time for the vehicle that complies with the pause in a queue for storing vehicle information that complies with the pause; and further includes a vehicle confirmation and event generation unit (33) that confirms a vehicle in which the elapsed time from the minimum stop time stored in the vehicle queue to the current time is greater than or equal to a set threshold as a vehicle that complies with the pause, and generates an event for the occurrence of a vehicle that complies with the pause.
[0054] The above-mentioned stopped vehicle information storage unit (31) determines a vehicle recognized from a reference video frame as a vehicle compliant with temporary stop when the number of stop patches per video frame is greater than a threshold, for example, '2'.
[0055] The process of operation of the present invention, which is configured as described above, is explained sequentially with reference to Drawings 11 to 14 as follows.
[0056] As illustrated in Figure 11, the control means (3) performs a second step (S2) of recognizing the license plate of a detected vehicle after a first step (S1) of detecting a vehicle from an image frame input from a camera (1) and recognizing the license plate number of the detected vehicle.
[0057] The control means (3) that has successfully recognized the vehicle number plate performs a third step (S3) to check whether the recognized vehicle number exists in a queue for storing patch information, as illustrated in Figure 12.
[0058] If there is no recognized vehicle number in the queue for storing patch information, the control means (3) performs a fourth step (S4) of setting 'N' patch images from the vehicle number plate in the reference image frame where the vehicle number plate is recognized.
[0059] Next, the control means (3) performs a fifth step (S5) of extracting horizontal edge information within each patch image area through a Sobel operation.
[0060] Next, the control means (3) performs a sixth step (S6) of storing together the vehicle number recognized in the reference image frame, square coordinate information for 'N' patch images within the reference image frame, and horizontal edge information extracted from each of the 'N' patch images in a queue for storing patch information.
[0061] Next, the control means (3) performs a seventh step (S7) of extracting 'N' cropped images per image frame for each image frame input from the camera (1) based on square coordinate information for 'N' patch images stored in a queue for storing patch information, as illustrated in Figure 13.
[0062] Next, the control means (3) performs the eighth step (S8) of extracting horizontal edge information for each of the 'N' cropped images.
[0063] Next, the control means (3) performs a ninth step (S9) of performing an NCC operation between horizontal edge information for a patch image and horizontal edge information for a crop image.
[0064] Next, the control means (3) performs a 10th step (S10) to check whether the straight-line distance between the area in the cropped image where the similarity to the patch image exceeds a threshold and the patch image is less than or equal to a threshold set by the user.
[0065] Next, the control means (3) performs step 11 (S11), which sets a cropped image as a stop patch in which the straight-line distance between the area of the cropped image where the similarity to the patch image exceeds a threshold and the patch image is less than or equal to a threshold set by the user.
[0066] Next, the control means (3) performs a 12th step (S12) to check whether the accumulated number of stop patches is greater than or equal to the number set by the user by repeating steps 9 (S9) to 11 (S11) in one video frame as many times as the number of patches stored at the 'i'th position in a queue for storing patch information.
[0067] Next, if the number of accumulated stop patches is less than the number set by the user, the control means (3) performs step 13 (S13), which confirms the detected vehicle as a vehicle violating the temporary stop and deletes information about the vehicle from the queue for storing information about the stopped vehicle.
[0068] Next, if the number of accumulated stop patches is greater than or equal to the number set by the user, the control means (3) performs step 14 (S14), which stores information about the detected vehicle in a queue for storing stop vehicle information and stores the initial stop time of the vehicle in a queue for storing stop vehicle information.
[0069] The above steps 7 (S7) to 14 (S14) are repeated for every video frame as many times as the number of data stored in the queue for storing patch information, that is, the number of detected vehicles.
[0070] Through this process, the initial stopping time of a vehicle that has been continuously stopped for a certain period of time is maintained.
[0071] As illustrated in Figure 14, the control means (3) determines that a vehicle whose elapsed time from the initial stop time to the current time exceeds a set threshold is a vehicle that complies with the temporary stop, and performs step 15 (S15) of generating an event for the vehicle that complies with the temporary stop.
[0072] In addition, as illustrated in Figures 1 to 3, the present invention further includes a speed measuring device (35) installed on the variable traffic sign (5) and measuring the speed of a vehicle passing through the road where the variable traffic sign (5) is installed, and a signal information collector (37) installed on the variable traffic sign (5) and collecting traffic signals at the location where the variable traffic sign (5) is installed, and the control means (3) detects speeding vehicles using the camera (1) and the speed measuring device (35), and detects signal violation vehicles using the camera (1) and the signal information collector (37).
[0073] As illustrated in Figure 15, the present invention displays traffic safety signs according to the current traffic signal and performs the function of displaying a STOP sign, a slow sign, a temporary stop violation, and a right turn signal violation on a variable traffic sign (5) according to the user's settings.
[0074] The present invention outputs stop and slow (slow) signs as a basis on a variable traffic sign (5).
[0075] In addition, as illustrated in Figure 16, when there is a vehicle caught violating traffic laws, the present invention outputs a notification of the violation of traffic laws (e.g., violation of stop line, violation of temporary stop, violation of right turn signal, violation of signal, violation of speed, etc.) on a variable traffic sign (5).
[0076] The speed measuring device (35) can be installed at the lower center of the front of the variable traffic sign (5), as shown in Figure 1.
[0077] The above control means (3) variably displays a traffic safety sign on a variable traffic sign (5) according to the traffic situation.
[0078] When a signal prohibiting right turns is input through the signal information collector (37), the above control means (3) analyzes the image input from the camera (1) to detect a vehicle turning right and enforces the detected vehicle turning right as a vehicle violating the signal.
[0079] The above control means (3) analyzes the image input from the camera (1) to determine whether the vehicle in front of the stop line is stopped, and enforces the stop line violation against vehicles that are not stopped.
[0080] The variable traffic safety information display device according to the present invention, configured as such, capable of enforcing unmanned traffic law violations, can enforce unmanned traffic law violations such as signal violations and temporary stop violations by vehicles turning right.
[0081] In addition, the invention can determine whether a vehicle has stopped in a temporary stop section on the road and can crack down on vehicles violating the temporary stop.
[0082] In addition, the present invention can variably display traffic safety signs according to traffic conditions and can crack down on vehicles turning right when a right-turn prohibition signal is given.
[0083] In addition, the present invention can detect speeding vehicles and vehicles violating traffic signals, determine whether a vehicle is stopped in front of a stop line on the road, and detect whether a vehicle that is not stopped in front of a stop line is violating the stop line. Explanation of the symbols
[0085] 1. Camera 3. Control means 5. Variable traffic sign 7. Vehicle detection unit 9. License plate recognition unit 11. Pause determination unit 13. Variable traffic sign control unit 15. Patch setting unit 17. Patch Information Extraction and Storage Unit 19. Crop Image Extraction Unit 21. Cropped image edge information extraction unit 23. Edge information similarity measurement unit 25. Coordinate Distance Calculation Unit 27. Stop Patch Setting and Comparison Unit 29. Stopped vehicle information deletion unit 31. Stopped vehicle information storage unit 33. Stopped Vehicle Confirmation and Event Generation Unit 35. Speed Meter 37. Signal intelligence collector
Claims
Claim 1 The system includes a camera (1) for photographing a vehicle passing through a traffic law violation enforcement point; a control means (3) for recognizing a vehicle number from an image frame input from the camera (1) and determining whether the vehicle corresponding to the recognized vehicle number has violated a temporary stop; and a variable traffic sign (5) for displaying information regarding whether the vehicle has violated a temporary stop according to a control signal of the control means (3). The control means (3) includes a vehicle detection unit (7) for detecting a vehicle from an image frame input from the camera (1); a vehicle number recognition unit (9) for recognizing the vehicle number detected in the image frame; a temporary stop determination unit (11) for analyzing an image frame input from the camera (1) to determine whether the vehicle with the recognized vehicle number has violated a temporary stop; and a variable traffic sign control unit (13) for displaying information on the variable traffic sign (5) according to whether the vehicle has violated a temporary stop determined by the temporary stop determination unit (11). The temporary stop determination unit (11) includes 'N' of the vehicle numbers in a reference image frame where the vehicle number has been recognized. A patch setting unit (15) for setting patch images; a patch information extraction and storage unit (17) for storing together in a patch information storage queue the vehicle number recognized in the reference image frame, rectangle coordinate information for 'N' patch images within the reference image frame, and horizontal edge information extracted from each of the 'N' patch images through Sobel operation; a cropped image extraction unit (19) for extracting 'N' cropped images per image frame for each image frame input from the camera (1) after the reference image frame; and a cropped image edge information extraction unit (21) for extracting horizontal edge information for each of the 'N' cropped images extracted by the cropped image extraction unit (19) through Sobel operation;The system includes: an edge information similarity measuring unit (23) that measures similarity by performing a Normalized Cross Correlation (NCC) operation between horizontal edge information for 'N' patch images and horizontal edge information for 'N' crop images; a coordinate distance calculating unit (25) that calculates a straight-line distance between a patch image and an area among the crop images where the similarity with the patch image exceeds a threshold; a stop patch setting and comparison unit (27) that sets a crop image among the 'N' crop images included in each image frame input from the camera (1) where the similarity exceeds a threshold and the straight-line distance is smaller than the threshold as a stop patch, and compares whether the number of set stop patches is greater than or equal to a threshold; and a stop vehicle information deletion unit (29) that determines a vehicle with a number of stop patches per image frame that is less than a threshold for each image frame input from the camera (1) as a vehicle violating the temporary stop rule, and deletes the number of a vehicle with a number of stop patches less than a threshold from a queue for storing stop vehicle information, wherein for each image frame input from the camera (1), the stop patches per image frame A vehicle with a number greater than or equal to a threshold is determined to be a vehicle compliant with the temporary stop, and the time of the first video frame in which the number of stop patches exceeds the threshold is determined to be the first stop time of the vehicle, and a vehicle number and minimum stop time for the vehicle compliant with the temporary stop are stored in a queue for storing vehicle information;The system further includes a stopping vehicle confirmation and event generation unit (33) that confirms a vehicle as a vehicle complying with the temporary stop and generates an event regarding the occurrence of a vehicle complying with the temporary stop, wherein the elapsed time from the minimum stopping time stored in the queue for the stopping vehicle to the current time is greater than or equal to a set threshold, and further includes a speed measuring device (35) installed on the variable traffic sign (5) and measuring the speed of a vehicle passing through the road where the variable traffic sign (5) is installed, and a signal information collector (37) installed on the variable traffic sign (5) and collecting traffic signals at the location where the variable traffic sign (5) is installed, wherein the control means (3) enforces speeding vehicles using the camera (1) and the speed measuring device (35), enforces signal violation vehicles using the camera (1) and the signal information collector (37), and when a signal prohibiting right turn is input through the signal information collector (37), the control means (3) analyzes the image input from the camera (1) to detect a right-turning vehicle, and enforces the detected right-turning vehicle as a signal violation vehicle, and the control A variable traffic safety information display device capable of unmanned traffic law violation enforcement, characterized in that the means (3) variably displays a traffic safety sign according to traffic conditions on a variable traffic sign (5), the control means (3) analyzes an image input from a camera (1) to determine whether a vehicle in front of a stop line is stopped, and enforces a stop line violation on a vehicle that is not stopped, the camera (1) is installed at the upper center of the front of the variable traffic sign (5), the stopped vehicle information deletion unit (29) determines that a vehicle is a vehicle violating the temporary stop if the number of stop patches per image frame is less than a threshold of '2', the stopped vehicle information storage unit (31) determines that a vehicle recognized from a reference image frame is a vehicle compliant with the temporary stop if the number of stop patches per image frame is greater than the threshold of '2', and the speed measuring device (35) is installed at the lower center of the front of the variable traffic sign (5). Here, 'N' is a natural number ranging from 1 to 3. Claim 2 delete Claim 3 delete Claim 4 In claim 1, the patch setting unit (15) sets 'N' patch images in the vehicle license plate area within the reference image frame, and the crop image is extracted as a crop image in each image frame input from the camera (1) after the reference image frame by adding 'a' to the left boundary coordinate and the right boundary coordinate based on the square coordinate of the patch image and adding 'b' to the bottom boundary coordinate of the square coordinate, and the coordinate distance calculation unit (25) is the upper left coordinate within the image frame of the area where the similarity with the patch image among the crop images exceeds a threshold. , and, the top-left coordinates of the patch image stored in the queue for storing patch information , A variable traffic safety information display device capable of unmanned traffic law violation enforcement, characterized by calculating the straight-line distance 'd' between them. Here, 'a' and 'b' are constants. Claim 5 delete Claim 6 delete
Citation Information
Patent Citations
A system for detecting car being violated trafficsignal at the intersection
KR1020120019828A
Traffic control system for managing vehicle around crosswalk
KR102293068B1
System and Method for Recognising Parked or Temporary-Stopped Vehicles on the Road by Recognising Number Plate
KR102436731B1
Traffic violation enforcement system using rear license plate recognition and method for rear license plate recognition
KR102477410B1
Traffic safety system for managing vehicle in school zone
KR102488476B1