A safe driving control method and system
By monitoring light data on the vehicle and shooting videos with infrared cameras, combining license plate recognition and image analysis to identify and remind potential dangerous objects, the problem of poor vision in dim light is solved and driving safety is improved.
Patent Information
- Application Number
- CN202210861116.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-20
- Publication Date
- 2025-08-05
- Estimated Expiration
- 2042-07-20
AI Technical Summary
In the prior art, vehicles are prone to poor vision in dim light conditions, resulting in the risk of traffic accidents.
By monitoring the ambient light data of the vehicle, the infrared camera is activated to shoot front and rear videos, the dangerous objects are judged using license plate recognition technology and image analysis, and the reminder equipment is controlled to issue reminders.
Improves the accuracy and efficiency of identifying and reminding potential hazardous objects in dim light environments, and enhances driving safety.
Smart Images

Figure CN115482684B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of control technology, and in particular to a safe driving control method and system. Background Art
[0002] In the prior art, when a vehicle is driving, especially at night, traffic accidents often occur due to poor visibility caused by dim light.
[0003] Therefore, there is an urgent need for a technology that can help remind drivers of dangerous situations on the road ahead in dim light. Summary of the Invention
[0004] The embodiments of the present invention provide a safe driving control method and system.
[0005] An embodiment of the present invention provides a safe driving control method, comprising:
[0006] Monitor light data in the vehicle's environment;
[0007] Determining whether the vehicle is in a preset light environment based on light data in the vehicle's environment;
[0008] When it is determined that the vehicle is in a preset light environment, an infrared camera provided on the vehicle is activated to capture a video in front of and / or behind the vehicle to obtain a monitoring video;
[0009] Performing real-time image analysis on the currently captured surveillance video to determine whether any dangerous objects that may affect the safe driving of the vehicle appear in the currently captured surveillance video;
[0010] When a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video, the reminder device of the vehicle is controlled to issue a reminder.
[0011] In one embodiment, the preset light environment includes a dark environment with a light intensity lower than a first preset light intensity and / or an overly bright environment with a light intensity higher than a second preset light intensity; the first preset light intensity is lower than the second preset light intensity.
[0012] In one embodiment, the dangerous object includes any one or more of the high beams of a vehicle traveling in the opposite direction in front of the vehicle, animals or people on the road in front of the vehicle, stationary vehicles on the road in front of the vehicle, and target nearby vehicles with curved travel trajectories on the road in front of or behind the vehicle.
[0013] In one embodiment, when the dangerous object is an object approaching the vehicle with a curved trajectory on the road ahead of or behind the vehicle, the real-time image analysis of the currently captured surveillance video to determine whether the dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video includes:
[0014] First, the license plate recognition technology is used to identify and locate the license plates of adjacent vehicles traveling on the road in front of or behind the vehicle in the currently captured surveillance video. At the same time, the vertical distance value between the located license plate and the white solid lines on both sides of the road in the same horizontal direction is obtained. According to the vertical distance value between each located license plate and the white solid lines on both sides of the road in the same horizontal direction, it is judged whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory. If there is a target adjacent vehicle with a curved driving trajectory on the road in front of or behind the vehicle, it is determined that a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video. The specific steps include:
[0015] Step A1: Use license plate recognition technology to identify the license plate number of the adjacent vehicle traveling on the road in front of or behind the vehicle in the currently captured surveillance video and use formula (1) to image locate the license plate number of the adjacent vehicle.
[0016]
[0017] Wherein, [i(e_a), j(e_a)] represents the license plate location point of the ath adjacent vehicle in the eth frame of the currently captured surveillance video; [I e_a (k),J e_a (k)] indicates that the kth pixel in the license plate of the ath adjacent vehicle in the eth frame of the currently captured surveillance video is located in the ith frame of the image. e_a (k) Row J e_a (k) Column position; K e_a Indicates the total number of pixels belonging to the license plate of the ath adjacent vehicle in the eth frame of the currently captured surveillance video;
[0018] Identify the white solid lines on both sides of the road in front of or behind the adjacent vehicle in the e-th frame of the currently captured surveillance video, and draw perpendicular lines from the license plate positioning point [i(e_a), j(e_a)] of the a-th adjacent vehicle in the e-th frame to the white solid lines on both sides to obtain the vertical distance values between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid lines on the left and right sides, and record them as L0(e_a) and L1(e_a). L0(e_a) represents the vertical distance value between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid line on the left; L1(e_a) represents the vertical distance value between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid line on the right.
[0019] Step A2: Use formula (2) to determine whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory based on the vertical distance between each located license plate and the white solid lines on both sides of the road in the same horizontal direction.
[0020]
[0021] Where W(a) represents the judgment value of whether the ath adjacent vehicle in the currently captured surveillance video has a curved driving trajectory; ΔL(e_a) represents the intermediate value of the operation, which is used to simplify the operation; m represents the total number of frames in the currently captured surveillance video; F[] represents a sign function. If the value in the brackets is greater than 0, the function value is 1; if the value in the brackets is less than 0, the function value is -1; if the value in the brackets is equal to 0, the function value is 0;
[0022] Step A3: Using formula (3), based on the judgment of whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory, control whether to identify the dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video.
[0023]
[0024] Where D represents the identification value of dangerous objects that affect the safe driving of the vehicle in the currently captured surveillance video. When D=1, it means that dangerous objects that affect the safe driving of the vehicle appear in the currently captured surveillance video; when D=0, it means that no dangerous objects that affect the safe driving of the vehicle appear in the previously captured surveillance video. A represents the total number of vehicles in the currently captured surveillance video. Indicates the existence of a function. Substitute the value of a from 1 to A into the brackets. When there are one or more values of a that satisfy the formula in the brackets, the function value is 1, otherwise the function value is 0.
[0025] The beneficial effects of the above technical solution are as follows: using the formula (1) of step A1 to perform image positioning on the license plate number of the vehicle traveling on the road in front of or behind the vehicle in the currently captured surveillance video, so that each vehicle is quantified as a positioning point through license plate recognition, which can simplify the calculation, save calculation time, and improve system efficiency; then using the formula (2) of step A2 to judge whether the vehicle corresponding to each located license plate has a curved driving trajectory based on the image vertical distance value between each located license plate and the white solid lines on both sides of the road in the same horizontal direction, thereby automatically analyzing and judging each vehicle in the captured video, so as to know whether each vehicle has a curved driving trajectory; finally, using the formula (3) of step A3 to control whether to identify a dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video based on the judgment of whether the vehicle corresponding to each located license plate has a curved driving trajectory, and then identifying the dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video by formula calculation, firstly, it can improve the accuracy of identifying dangerous objects, and secondly, it saves personnel identification and improves efficiency.
[0026] In one embodiment, when a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video, controlling the reminder device of the vehicle to issue a reminder includes:
[0027] Determining the distance between the vehicle and the dangerous object in real time based on the surveillance video;
[0028] The reminder device of the vehicle is controlled to issue a reminder according to the distance.
[0029] In one embodiment, the step of controlling the reminder device of the vehicle to issue a reminder based on the distance includes:
[0030] determining a distance range within which the distance lies;
[0031] The reminder device of the vehicle is controlled to issue a reminder according to the distance range of the distance, wherein the reminder intensity of the reminder device corresponding to a larger distance range is smaller than the reminder intensity of the reminder device corresponding to a smaller distance range.
[0032] An embodiment of the present invention provides a driving safety control system, comprising:
[0033] A monitoring module, used to monitor light data in the vehicle's environment;
[0034] a judgment module, configured to judge whether the vehicle is in a preset light environment based on light data in the environment in which the vehicle is located;
[0035] an activation module, configured to activate an infrared camera provided on the vehicle to capture a video of the front and / or rear of the vehicle to obtain a monitoring video when it is determined that the vehicle is in a preset light environment;
[0036] An analysis module is used to analyze the currently captured surveillance video in real time to determine whether there is any dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video;
[0037] The control module is used to control the reminder device of the vehicle to issue a reminder when a dangerous object that affects the safe driving of the vehicle appears in the currently captured monitoring video.
[0038] In one embodiment, the preset light environment includes a dark environment with a light intensity lower than a first preset light intensity and / or an overly bright environment with a light intensity higher than a second preset light intensity; the first preset light intensity is lower than the second preset light intensity.
[0039] In one embodiment, the dangerous object includes any one or more of the high beams of a vehicle traveling in the opposite direction in front of the vehicle, animals or people on the road in front of the vehicle, stationary vehicles on the road in front of the vehicle, and vehicles with curved trajectories on the road in front of or behind the vehicle.
[0040] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purposes and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.
[0041] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:
[0043] Figure 1 The figure is a flow chart of a safe driving control method according to an embodiment of the present invention. DETAILED DESCRIPTION
[0044] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.
[0045] The embodiment of the present invention provides a safe driving control method, such as Figure 1 As shown, including:
[0046] Step S1: monitoring light data in the vehicle's environment.
[0047] Step S2: determining whether the vehicle is in a preset light environment based on light data in the vehicle's environment.
[0048] Step S3: When it is determined that the vehicle is in a preset light environment, the infrared camera provided on the vehicle is activated to shoot a video of the front and / or rear of the vehicle to obtain a monitoring video.
[0049] Step S4: performing real-time image analysis on the currently captured surveillance video to determine whether any dangerous object that may affect the safe driving of the vehicle appears in the currently captured surveillance video.
[0050] Step S5: When a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video, the reminder device of the vehicle is controlled to issue a reminder.
[0051] In one embodiment, the preset light environment includes a dark environment with a light intensity lower than a first preset light intensity and / or an overly bright environment with a light intensity higher than a second preset light intensity; the first preset light intensity is lower than the second preset light intensity. The first and second preset light intensities can be adjusted as needed. Any low-light environment that affects the driver's vision, such as entering a tunnel or at night, can be considered a dark environment.
[0052] The beneficial effect of the above technical solution is that when a vehicle is in an environment that affects the driver's field of vision, the above technical solution can promptly activate the infrared camera to capture video of the vehicle's front or rear. Based on the captured surveillance video, the system can analyze whether there are any dangerous objects in the environment that may affect the vehicle's safe driving. If so, the warning device is promptly controlled to issue a warning, allowing the driver to be promptly informed of the potential danger and take timely measures. The above technical solution provides a technology that intelligently warns drivers of dangerous situations in advance, thereby improving driving safety.
[0053] In one embodiment, the dangerous object includes any one or more of the high beams of a vehicle traveling in the opposite direction in front of the vehicle, animals or people on the road in front of the vehicle, stationary vehicles on the road in front of the vehicle, and vehicles with curved trajectories on the road in front of or behind the vehicle.
[0054] In one embodiment, the real-time image analysis of the currently captured surveillance video to determine whether a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video includes:
[0055] First, the license plate recognition technology is used to identify and locate the license plates of adjacent vehicles traveling on the road in front of or behind the vehicle in the currently captured surveillance video. At the same time, the vertical distance value between the located license plate and the white solid lines on both sides of the road in the same horizontal direction is obtained. According to the vertical distance value between each located license plate and the white solid lines on both sides of the road in the same horizontal direction, it is judged whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory. If there is a target adjacent vehicle with a curved driving trajectory on the road in front of or behind the vehicle, it is determined that a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video. The specific steps include:
[0056] Step A1: Use license plate recognition technology to identify the license plate number of the adjacent vehicle traveling on the road in front of or behind the vehicle in the currently captured surveillance video and use formula (1) to image locate the license plate number of the adjacent vehicle.
[0057]
[0058] Wherein, [i(e_a), j(e_a)] represents the license plate location point of the ath adjacent vehicle in the eth frame of the currently captured surveillance video; [I e_a (k),J e_a (k)] indicates that the kth pixel in the license plate of the ath adjacent vehicle in the eth frame of the currently captured surveillance video is located in the ith frame of the image. e_a (k) Row J e_a (k) Column position; K e_a Indicates the total number of pixels belonging to the license plate of the ath adjacent vehicle in the eth frame of the currently captured surveillance video;
[0059] Identify the white solid lines on both sides of the road in front of or behind the adjacent vehicle in the e-th frame of the currently captured surveillance video, and draw perpendicular lines from the license plate positioning point [i(e_a), j(e_a)] of the a-th adjacent vehicle in the e-th frame to the white solid lines on both sides to obtain the vertical distance values between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid lines on the left and right sides, and record them as L0(e_a) and L1(e_a). L0(e_a) represents the vertical distance value between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid line on the left; L1(e_a) represents the vertical distance value between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid line on the right.
[0060] Step A2: Use formula (2) to determine whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory based on the vertical distance between each located license plate and the white solid lines on both sides of the road in the same horizontal direction.
[0061]
[0062] Where W(a) represents the judgment value of whether the ath adjacent vehicle in the currently captured surveillance video has a curved driving trajectory; ΔL(e_a) represents the intermediate value of the operation, which is used to simplify the operation; m represents the total number of frames in the currently captured surveillance video; F[] represents a sign function. If the value in the brackets is greater than 0, the function value is 1; if the value in the brackets is less than 0, the function value is -1; if the value in the brackets is equal to 0, the function value is 0;
[0063] Step A3: Using formula (3), based on the judgment of whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory, control whether to identify the dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video.
[0064]
[0065] Where D represents the identification value of dangerous objects that affect the safe driving of the vehicle in the currently captured surveillance video. When D=1, it means that dangerous objects that affect the safe driving of the vehicle appear in the currently captured surveillance video; when D=0, it means that no dangerous objects that affect the safe driving of the vehicle appear in the previously captured surveillance video. A represents the total number of vehicles in the currently captured surveillance video. Indicates the existence of a function. Substitute the value of a from 1 to A into the brackets. When there are one or more values of a that satisfy the formula in the brackets, the function value is 1, otherwise the function value is 0.
[0066] The beneficial effects of the above technical solution are as follows: using the formula (1) of step A1 to perform image positioning on the license plate number of the vehicle traveling on the road in front of or behind the vehicle in the currently captured surveillance video, so that each vehicle is quantified as a positioning point through license plate recognition, which can simplify the calculation, save calculation time, and improve system efficiency; then using the formula (2) of step A2 to judge whether the vehicle corresponding to each located license plate has a curved driving trajectory based on the image vertical distance value between each located license plate and the white solid lines on both sides of the road in the same horizontal direction, thereby automatically analyzing and judging each vehicle in the captured video, so as to know whether each vehicle has a curved driving trajectory; finally, using the formula (3) of step A3 to control whether to identify a dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video based on the judgment of whether the vehicle corresponding to each located license plate has a curved driving trajectory, and then identifying the dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video by formula calculation, firstly, it can improve the accuracy of identifying dangerous objects, and secondly, it saves personnel identification and improves efficiency.
[0067] In one embodiment, when a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video, controlling the reminder device of the vehicle to issue a reminder includes:
[0068] Determining the distance between the vehicle and the dangerous object in real time based on the surveillance video;
[0069] The reminder device of the vehicle is controlled to issue a reminder according to the distance.
[0070] The reminder device may be a microphone, a speaker, a flash light, etc.
[0071] Preferably, the reminding device for controlling the vehicle to issue a reminder based on the distance includes:
[0072] determining a distance range within which the distance lies;
[0073] The reminder device of the vehicle is controlled to issue a reminder according to the distance range of the distance, wherein the reminder intensity of the reminder device corresponding to a larger distance range is smaller than the reminder intensity of the reminder device corresponding to a smaller distance range.
[0074] The beneficial effect of the above technical solution is that the above technical solution can enable the vehicle to remind the driver with increasingly stronger reminder intensity when the vehicle is getting closer to the dangerous object, thereby improving the warning effect on the driver.
[0075] Corresponding to the aforementioned method, an embodiment of the present invention further provides a driving safety control system, comprising:
[0076] A monitoring module, used to monitor light data in the vehicle's environment;
[0077] a judgment module, configured to judge whether the vehicle is in a preset light environment based on light data in the environment in which the vehicle is located;
[0078] an activation module, configured to activate an infrared camera provided on the vehicle to capture a video of the front and / or rear of the vehicle to obtain a monitoring video when it is determined that the vehicle is in a preset light environment;
[0079] An analysis module is used to analyze the currently captured surveillance video in real time to determine whether there is any dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video;
[0080] The control module is used to control the reminder device of the vehicle to issue a reminder when a dangerous object that affects the safe driving of the vehicle appears in the currently captured monitoring video.
[0081] In one embodiment, the preset light environment includes a dark environment with a light intensity lower than a first preset light intensity and / or an overly bright environment with a light intensity higher than a second preset light intensity; the first preset light intensity is lower than the second preset light intensity.
[0082] In one embodiment, the dangerous object includes any one or more of the high beams of a vehicle traveling in the opposite direction in front of the vehicle, animals or people on the road in front of the vehicle, stationary vehicles on the road in front of the vehicle, and vehicles with curved trajectories on the road in front of or behind the vehicle.
[0083] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.
Claims
1. A safe driving control method, characterized in that: include: Monitor light data in the vehicle's environment; Determining whether the vehicle is in a preset light environment based on light data in the vehicle's environment; When it is determined that the vehicle is in a preset light environment, an infrared camera provided on the vehicle is activated to capture a video in front of and / or behind the vehicle to obtain a monitoring video; Performing real-time image analysis on the currently captured surveillance video to determine whether any dangerous objects that may affect the safe driving of the vehicle appear in the currently captured surveillance video; When a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video, controlling the reminder device of the vehicle to issue a reminder; When the dangerous object is an object with a curved driving trajectory approaching the vehicle on the road in front of or behind the vehicle, the real-time image analysis of the currently captured surveillance video to determine whether the dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video includes: First, the license plate recognition technology is used to identify and locate the license plates of adjacent vehicles traveling on the road in front of or behind the vehicle in the currently captured surveillance video. At the same time, the vertical distance value between the located license plate and the white solid lines on both sides of the road in the same horizontal direction is obtained. According to the vertical distance value between each located license plate and the white solid lines on both sides of the road in the same horizontal direction, it is judged whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory. If there is a target adjacent vehicle with a curved driving trajectory on the road in front of or behind the vehicle, it is determined that a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video. The specific steps include: Step A1: Use license plate recognition technology to identify the license plate number of the adjacent vehicle traveling on the road in front of or behind the vehicle in the currently captured surveillance video and use formula (1) to image locate the license plate number of the adjacent vehicle. Wherein, [i(e_a), j(e_a)] represents the license plate location point of the ath adjacent vehicle in the eth frame of the currently captured surveillance video; [I e_a (k),J e_a (k)] indicates that the kth pixel in the license plate of the ath adjacent vehicle in the eth frame of the currently captured surveillance video is located in the ith frame of the image. e_a (k) Row J e_a (k) Column position; K e_a Indicates the total number of pixels belonging to the license plate of the ath adjacent vehicle in the eth frame of the currently captured surveillance video; Identify the white solid lines on both sides of the road in front of or behind the adjacent vehicle in the e-th frame of the currently captured surveillance video, and draw perpendicular lines from the license plate positioning point [i(e_a), j(e_a)] of the a-th adjacent vehicle in the e-th frame to the white solid lines on both sides to obtain the vertical distance values between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid lines on the left and right sides, and record them as L0(e_a) and L1(e_a). L0(e_a) represents the vertical distance value between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid line on the left; L1(e_a) represents the vertical distance value between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid line on the right. Step A2: Use formula (2) to determine whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory based on the vertical distance between each located license plate and the white solid lines on both sides of the road in the same horizontal direction. Where W(a) represents the judgment value of whether the ath adjacent vehicle in the currently captured surveillance video has a curved driving trajectory; ΔL(e_a) represents the intermediate value of the operation, which is used to simplify the operation; m represents the total number of frames in the currently captured surveillance video; F[] represents a sign function. If the value in the brackets is greater than 0, the function value is 1; if the value in the brackets is less than 0, the function value is -1; if the value in the brackets is equal to 0, the function value is 0; Step A3: Using formula (3), based on the judgment of whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory, control whether to identify the dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video. Where D represents the identification value of dangerous objects that affect the safe driving of the vehicle in the currently captured surveillance video. When D=1, it means that dangerous objects that affect the safe driving of the vehicle appear in the currently captured surveillance video; when D=0, it means that no dangerous objects that affect the safe driving of the vehicle appear in the previously captured surveillance video. A represents the total number of vehicles in the currently captured surveillance video. Indicates the existence of a function. Substitute the value of a from 1 to A into the brackets. When there are one or more values of a that satisfy the formula in the brackets, the function value is 1, otherwise the function value is 0.
2. The method according to claim 1, wherein The preset light environment includes a dark environment with a light intensity lower than a first preset light intensity and / or an overly bright environment with a light intensity higher than a second preset light intensity; the first preset light intensity is lower than the second preset light intensity.
3. The method according to claim 1, wherein The dangerous objects include any one or more of the high beams of a vehicle traveling in the opposite direction in front of the vehicle, animals or people on the road in front of the vehicle, stationary vehicles on the road in front of the vehicle, and target nearby vehicles with curved driving trajectories on the road in front of or behind the vehicle.
4. The method according to claim 1, wherein When a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video, controlling the reminder device of the vehicle to issue a reminder includes: Determining the distance between the vehicle and the dangerous object in real time based on the surveillance video; The reminder device of the vehicle is controlled to issue a reminder according to the distance.
5. The method according to claim 4, wherein The step of controlling the reminder device of the vehicle to issue a reminder based on the distance includes: determining a distance range within which the distance lies; The reminder device of the vehicle is controlled to issue a reminder according to the distance range of the distance, wherein the reminder intensity of the reminder device corresponding to a larger distance range is smaller than the reminder intensity of the reminder device corresponding to a smaller distance range.
6. A driving safety control system, characterized in that: include: A monitoring module, used to monitor light data in the vehicle's environment; a judgment module, configured to judge whether the vehicle is in a preset light environment based on light data in the environment in which the vehicle is located; an activation module, configured to activate an infrared camera provided on the vehicle to capture a video of the front and / or rear of the vehicle to obtain a monitoring video when it is determined that the vehicle is in a preset light environment; An analysis module is used to analyze the currently captured surveillance video in real time to determine whether there is any dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video; a control module, configured to control a reminder device of the vehicle to issue a reminder when a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video; When the dangerous object is an object with a curved driving trajectory approaching the vehicle on the road in front of or behind the vehicle, the real-time image analysis of the currently captured surveillance video to determine whether the dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video includes: First, the license plate recognition technology is used to identify and locate the license plates of adjacent vehicles traveling on the road in front of or behind the vehicle in the currently captured surveillance video. At the same time, the vertical distance value between the located license plate and the white solid lines on both sides of the road in the same horizontal direction is obtained. According to the vertical distance value between each located license plate and the white solid lines on both sides of the road in the same horizontal direction, it is judged whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory. If there is a target adjacent vehicle with a curved driving trajectory on the road in front of or behind the vehicle, it is determined that a dangerous object that affects the safe driving of the vehicle appears in the currently captured surveillance video. The specific steps include: Step A1: Use license plate recognition technology to identify the license plate number of the adjacent vehicle traveling on the road in front of or behind the vehicle in the currently captured surveillance video and use formula (1) to image locate the license plate number of the adjacent vehicle. Wherein, [i(e_a), j(e_a)] represents the license plate location point of the ath adjacent vehicle in the eth frame of the currently captured surveillance video; [I e_a (k),J e_a (k)] indicates that the kth pixel in the license plate of the ath adjacent vehicle in the eth frame of the currently captured surveillance video is located in the ith frame of the image. e_a (k) Row J e_a (k) Column position; K e_a Indicates the total number of pixels belonging to the license plate of the ath adjacent vehicle in the eth frame of the currently captured surveillance video; Identify the white solid lines on both sides of the road in front of or behind the adjacent vehicle in the e-th frame of the currently captured surveillance video, and draw perpendicular lines from the license plate positioning point [i(e_a), j(e_a)] of the a-th adjacent vehicle in the e-th frame to the white solid lines on both sides to obtain the vertical distance values between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid lines on the left and right sides, and record them as L0(e_a) and L1(e_a). L0(e_a) represents the vertical distance value between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid line on the left; L1(e_a) represents the vertical distance value between the license plate positioning point of the a-th adjacent vehicle in the e-th frame and the white solid line on the right. Step A2: Use formula (2) to determine whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory based on the vertical distance between each located license plate and the white solid lines on both sides of the road in the same horizontal direction. Where W(a) represents the judgment value of whether the ath adjacent vehicle in the currently captured surveillance video has a curved driving trajectory; ΔL(e_a) represents the intermediate value of the operation, which is used to simplify the operation; m represents the total number of frames in the currently captured surveillance video; F[] represents a sign function. If the value in the brackets is greater than 0, the function value is 1; if the value in the brackets is less than 0, the function value is -1; if the value in the brackets is equal to 0, the function value is 0; Step A3: Using formula (3), based on the judgment of whether the adjacent vehicle corresponding to each located license plate has a curved driving trajectory, control whether to identify the dangerous object that affects the safe driving of the vehicle in the currently captured surveillance video. Where D represents the identification value of dangerous objects that affect the safe driving of the vehicle in the currently captured surveillance video. When D=1, it means that dangerous objects that affect the safe driving of the vehicle appear in the currently captured surveillance video; when D=0, it means that no dangerous objects that affect the safe driving of the vehicle appear in the previously captured surveillance video. A represents the total number of vehicles in the currently captured surveillance video. Indicates the existence of a function. Substitute the value of a from 1 to A into the brackets. When there are one or more values of a that satisfy the formula in the brackets, the function value is 1, otherwise the function value is 0.
7. The system according to claim 6, wherein: The preset light environment includes a dark environment with a light intensity lower than a first preset light intensity and / or an overly bright environment with a light intensity higher than a second preset light intensity; the first preset light intensity is lower than the second preset light intensity.
8. The system according to claim 6, wherein: The dangerous objects include any one or more of the high beams of a vehicle traveling in the opposite direction in front of the vehicle, animals or people on the road in front of the vehicle, stationary vehicles on the road in front of the vehicle, and vehicles with curved trajectories on the road in front of or behind the vehicle.
Citation Information
Patent Citations
Method and system for recognizing road condition through automobile data recorder
CN107856671A