Traffic violation alarm prompt method, terminal and computer readable storage medium

Abstract

The embodiment of the present invention discloses a violation alarm prompt method, terminal and computer-readable storage medium, and relates to the field of mobile terminal technology. The method includes: according to the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process, identifying and marking the characteristic contour of the traffic sign in the vehicle driving road picture; controlling the black and white camera to scan the marked characteristic contour, and filtering the marked characteristic contour according to the scanning result; judging whether the light intensity in the filtered characteristic contour is greater than the preset light intensity threshold; if so, color-filling the marked characteristic contour in the filtered vehicle driving road picture according to the picture information collected by the color camera; identifying whether the vehicle has a violation risk according to the vehicle driving road picture after color filling, and outputting the corresponding violation risk alarm prompt information when there is a violation risk. The embodiment of the present invention can realize early warning of violation risks that users may ignore.

Description

Technical Field

[0001] The embodiments of the present invention relate to the technical field of mobile terminals, and in particular to a traffic violation alarm prompting method, a terminal and a computer-readable storage medium. Background Art

[0002] Common problems that plague drivers include being distracted while driving, accidentally running red lights, crossing yellow lines, and deviating from white lane lines at high speeds. Currently, vehicles generally use a single-camera electronic dog to provide driving prompts to drivers. However, since a single camera has difficulty recognizing color features and its judgment is inaccurate, most vehicles' electronic dogs cannot detect the status of traffic lights, whether the vehicle crosses the yellow line, or whether the vehicle deviates from the white lane. Summary of the invention

[0003] In view of this, the purpose of the embodiments of the present invention is to provide a traffic violation alarm prompt method, terminal and computer-readable storage medium to solve the problem that the driving electronic dog of the above-mentioned vehicle has difficulty in recognizing color features and inaccurate judgment, resulting in the inability to detect the status of traffic lights, whether the vehicle crosses the yellow line or whether the vehicle deviates from the white lane.

[0004] The technical solution adopted by the embodiment of the present invention to solve the above technical problems is as follows:

[0005] According to one aspect of an embodiment of the present invention, a traffic violation alarm prompting method is provided, which is applied to a terminal, wherein the terminal includes a wide-angle camera, a black-and-white camera, and a color camera, and the traffic violation alarm prompting method includes:

[0006] According to the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process, the characteristic contour of the traffic sign in the vehicle driving road picture is identified, and the characteristic contour is marked;

[0007] Controlling the black-and-white camera to scan the characteristic contours marked in the vehicle driving road picture, and filtering the characteristic contours marked in the vehicle driving road picture according to the scanning result;

[0008] Determining whether the light intensity within the characteristic contour marked in the filtered vehicle driving road picture is greater than a preset light intensity threshold;

[0009] If it is greater than a preset light intensity threshold, color filling is performed on the feature contour marked in the filtered vehicle driving road image according to the image information collected by the color camera;

[0010] According to the color-filled vehicle driving road picture, it is identified whether the vehicle has a risk of violation, and when there is a risk of violation, the corresponding violation risk alarm prompt information is output.

[0011] Wherein, the identifying characteristic contours of traffic signs in the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process and marking the characteristic contours comprises:

[0012] Performing grayscale processing on the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process to obtain a grayscale picture of the vehicle driving road picture;

[0013] Perform contour detection on the grayscale image to obtain contour information of objects in the grayscale image, compare the contour information of objects in the grayscale image with a pre-stored standard contour template of traffic signs, and identify and mark the characteristic contour of the traffic sign contained in the grayscale image.

[0014] Wherein, marking the characteristic contour comprises:

[0015] The characteristic contours corresponding to the different types of traffic signs included in the recognized vehicle driving road picture are marked with marking icons of different shapes.

[0016] Wherein, judging whether the light intensity within the characteristic contour marked in the filtered vehicle driving road picture is greater than a preset light intensity threshold comprises:

[0017] Identify the type of traffic sign corresponding to the characteristic contour marked in the filtered vehicle driving road picture, and obtain a preset light intensity threshold that matches the type of the traffic sign; different types of traffic signs correspond to preset light intensity thresholds of different sizes;

[0018] The light intensity within the characteristic contour marked in the vehicle driving road picture is compared with the preset light intensity threshold value matching the corresponding traffic sign type.

[0019] Wherein, filling the color of the feature contour marked in the filtered vehicle driving road picture according to the picture information collected by the color camera includes:

[0020] Acquire the color within the feature outline marked in the vehicle driving road picture according to the picture information collected by the color camera;

[0021] The acquired color within the characteristic contour is subjected to RGB decomposition, and the characteristic contour marked in the vehicle driving road picture is filled with color according to the RGB decomposition result.

[0022] Wherein, the traffic signs include at least one of traffic lights and lane lines.

[0023] The method of identifying whether the vehicle has a risk of violating traffic rules based on the vehicle driving road picture filled with colors, and outputting corresponding warning information of the risk of violating traffic rules when there is a risk of violating traffic rules includes:

[0024] If the color-filled vehicle driving road picture includes the characteristic outline of the traffic light, and the characteristic outline of the traffic light is displayed in red, then outputting red light running risk warning information; and / or,

[0025] If the vehicle driving road picture after color filling includes a characteristic outline of a lane line, and the characteristic outline of the lane line is displayed in yellow, and the distance between the characteristic outline position of the lane line and the vehicle tire is less than a first preset distance, then output yellow line risk warning information; and / or,

[0026] If the color-filled vehicle driving road picture includes a characteristic outline of a lane line, and the characteristic outline of the lane line is displayed in white, and the distance between the characteristic outline position of the lane line and the vehicle tire is less than a second preset distance, then a lane change risk warning information is output.

[0027] Wherein, the method of identifying whether the vehicle has a risk of violating traffic rules according to the vehicle driving road picture filled with colors, and outputting corresponding warning prompt information of the risk of violating traffic rules when there is a risk of violating traffic rules also includes:

[0028] The terminal is controlled to display the vehicle driving road picture filled with color to the user.

[0029] According to another aspect of an embodiment of the present invention, a terminal is provided, which includes a processor and a wide-angle camera, a black and white camera, and a color camera electrically connected to the processor. The terminal also includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps of the traffic violation alarm prompt method as described in any one of the above items are implemented.

[0030] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the violation alarm prompt method as described in any one of the above items are implemented.

[0031] The violation alarm prompt method, terminal and computer-readable storage medium provided by the embodiment of the present invention are designed for a terminal including three cameras. First, a wide-angle camera is used to capture a vehicle driving road picture at a large angle, and the characteristic contours of traffic signs in the vehicle driving road picture are roughly calibrated; then the black and white camera is controlled to scan the characteristic contours of traffic signs marked in the vehicle driving road picture, accurate contour information is obtained, and the characteristic contours that are incorrectly marked in the vehicle driving road picture are filtered out; then, according to the picture information captured by the color camera, the characteristic contours in the vehicle driving road picture screened by the black camera are filled with color; finally, according to the vehicle driving road picture after color filling, whether the vehicle has a violation risk is identified, and when there is a violation risk, the corresponding violation risk alarm prompt information is output, so that the traffic signs in the vehicle driving road can be accurately identified during the vehicle driving process, and timely reminders and alarms are realized for violation risks such as running a red light and crossing a yellow line that may be ignored by the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0033] Figure 1 is a schematic diagram of the hardware structure of a terminal implementing various embodiments of the present invention;

[0034] Figure 2 This is a schematic diagram of a specific implementation flow of the traffic violation alarm prompt method provided in the first embodiment of the present invention;

[0035] Figure 3 This is a schematic diagram of a specific implementation flow of the traffic violation alarm prompt method provided in the second embodiment of the present invention;

[0036] Figure 4 It is a schematic diagram of the structure of the software and hardware combination of the terminal provided in the third embodiment of the present invention. DETAILED DESCRIPTION

[0037] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer and more understandable, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only for explaining the present invention and are not intended to limit the present invention.

[0038] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present invention, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0039] The terminal may be implemented in various forms. For example, the terminal described in the present invention may include terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, and fixed terminals such as digital TVs and desktop computers.

[0040] The following description will be made by taking a terminal as an example, and those skilled in the art will appreciate that, in addition to components specifically used for mobile purposes, the configuration according to the embodiments of the present invention can also be applied to fixed-type terminals.

[0041] See also Figure 1 , which is a schematic diagram of the hardware structure of a terminal for implementing various embodiments of the present invention, the terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The terminal structure shown in the figure does not constitute a limitation on the terminal. The terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0042] Combine the following Figure 1 The following is a detailed introduction to each component of the terminal:

[0043] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution), etc.

[0044] WiFi is a short-range wireless transmission technology. The terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the terminal and can be omitted as required without changing the essence of the invention.

[0045] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0046] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0047] The terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can also be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0048] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. It should be noted that, although not shown in the figure, the terminal in the present invention has a two-dimensional and three-dimensional dual-screen display function, that is, the terminal includes two display units: a two-dimensional display unit and a three-dimensional display unit.

[0049] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Specifically, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0050] Furthermore, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of the touch event. Then, the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Figure 1 In the embodiment, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the terminal, which is not limited here.

[0051] The interface unit 108 serves as an interface through which at least one external device can be connected to the terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the terminal 100 or may be used to transmit data between the terminal 100 and an external device.

[0052] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0053] The processor 110 is the control center of the terminal. It uses various interfaces and lines to connect various parts of the entire terminal. It executes various functions of the terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0054] The terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0055] although Figure 1 Not shown, the terminal 100 further includes a wide-angle camera, a black-and-white camera, and a color camera. The terminal 100 may also include a Bluetooth module, etc., which will not be described in detail here.

[0056] Based on the above terminal hardware structure, various embodiments of the method of the present invention are proposed.

[0057] Embodiment 1

[0058] Figure 2 is a schematic diagram of a specific implementation flow of the violation alarm prompt method provided in the first embodiment of the present invention, and the execution subject of the method is Figure 1 See the terminal shown. Figure 2 As shown, the violation alarm prompt method provided by this embodiment includes the following steps:

[0059] Step S201, based on the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process, the characteristic contour of the traffic sign in the vehicle driving road picture is identified, and the characteristic contour is marked.

[0060] In a specific implementation example, the wide-angle camera, the black-and-white camera, and the color camera are arranged on the back of the terminal, and the three cameras are arranged adjacent to each other. The terminal is placed on the windshield of the vehicle during driving, so that the three cameras of the terminal can collect the vehicle driving road picture information in real time during driving. A supporting fixing structure can be arranged on the back of the terminal so that the terminal can be fixed on the windshield of the vehicle through the supporting fixing structure.

[0061] In a specific implementation example, the identifying characteristic contours of traffic signs in the vehicle driving road picture collected by the wide-angle camera during vehicle driving, and marking the characteristic contours includes:

[0062] Performing grayscale processing on the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process to obtain a grayscale picture of the vehicle driving road picture;

[0063] Perform contour detection on the grayscale image to obtain contour information of objects in the grayscale image, compare the contour information of objects in the grayscale image with a pre-stored standard contour template of traffic signs, and identify and mark the characteristic contour of the traffic sign contained in the grayscale image.

[0064] The traffic sign includes at least one of a traffic light and a lane line. The terminal is pre-configured with a standard outline template of the traffic sign, and different types of traffic signs have different standard outline templates. When the terminal obtains the outline information of the object in the grayscale image, it queries whether there is an outline in the grayscale image that is the same as the standard outline template according to the pre-configured standard outline template of the traffic sign. If so, the feature outline that matches the standard outline template of the traffic sign is marked.

[0065] In a specific implementation example, marking the feature contour includes:

[0066] The characteristic contours corresponding to the different types of traffic signs included in the recognized vehicle driving road picture are marked with marking icons of different shapes.

[0067] In this embodiment, different types of traffic sign feature contours correspond to different marking icons, so that it is easy to distinguish the types of traffic signs corresponding to the marked feature contours through icons. Preferably, the shape of the marking icon of the characteristic contour of the traffic sign is similar to the characteristic contour of the traffic sign. For example, a circular icon is used to mark the characteristic contour of a traffic light, and an icon in the shape of two horizontal bars is used to mark the characteristic contour of a lane line.

[0068] Step S202, controlling the black-and-white camera to scan the characteristic contours marked in the vehicle driving road picture, and filtering the characteristic contours marked in the vehicle driving road picture according to the scanning result.

[0069] Since wide-angle cameras are generally in the shape of fisheyes, the outlines of traffic signs in the images of the vehicle traveling on the road collected by them are distorted to a certain extent, so the characteristic outlines of the traffic signs recognized by them have certain errors. Therefore, the characteristic outlines marked by the wide-angle camera are further scanned by a black and white camera to obtain accurate outline information, and then the characteristic outlines marked in the vehicle traveling road image are filtered according to the accurate outline information to delete the marks of the characteristic outlines mistakenly recognized by the wide-angle camera.

[0070] Step S203, determining whether the light intensity within the marked characteristic contour in the filtered vehicle driving road picture is greater than a preset light intensity threshold, if it is greater than the preset light intensity threshold, proceeding to step S204.

[0071] In a specific implementation example, determining whether the light intensity within the feature contour marked in the filtered vehicle driving road picture is greater than a preset light intensity threshold comprises:

[0072] Identify the type of traffic sign corresponding to the characteristic contour marked in the filtered vehicle driving road picture, and obtain a preset light intensity threshold that matches the type of the traffic sign; different types of traffic signs correspond to preset light intensity thresholds of different sizes;

[0073] The light intensity within the characteristic contour marked in the vehicle driving road picture is compared with the preset light intensity threshold value matching the corresponding traffic sign type.

[0074] The terminal is pre-configured with different preset light intensity thresholds for different types of traffic signs, for example: the preset light intensity threshold for a traffic light is 50; the preset light intensity threshold for a lane line is 30. When the light intensity within the characteristic contour of the traffic light is identified to be less than or equal to 50, it means that the traffic light is damaged and no processing is performed; when the light intensity within the characteristic contour of the traffic light is identified to be greater than 50, it means that the traffic light is working normally, so the process goes to step S204; when the light intensity within the characteristic contour of the lane line is identified to be less than or equal to 30, it means that the lane line is an old and damaged unused lane line, and no processing is performed at this time; when the light intensity within the characteristic contour of the lane line is identified to be greater than 30, it means that the lane line is in normal use, so the process goes to step S204.

[0075] Step S204, filling the marked feature contours in the filtered vehicle driving road picture with colors according to the picture information collected by the color camera.

[0076] In a specific implementation example, step S204 specifically includes:

[0077] Acquire the color within the feature outline marked in the vehicle driving road picture according to the picture information collected by the color camera;

[0078] The acquired color within the characteristic contour is subjected to RGB decomposition, and the characteristic contour marked in the vehicle driving road picture is filled with color according to the RGB decomposition result.

[0079] In this embodiment, after the black camera is used to identify the characteristic contour of the traffic sign in the vehicle driving road picture, the color camera is controlled to scan the characteristic contour marked in the vehicle driving road picture to obtain the color information in the characteristic contour, and then the characteristic contour in the vehicle driving road picture is filled with color according to the obtained color information in the characteristic contour. The color filling specifically includes: firstly performing color decomposition on the obtained color information, and then filling the characteristic contour in the vehicle driving road picture with color according to the decomposition result. For example: R is red, G is green, B is blue, R+B is yellow, and R+B+G is white.

[0080] Step S205, identifying whether the vehicle has a risk of violating traffic rules based on the color-filled vehicle driving road picture, and outputting corresponding warning prompt information of the risk of violating traffic rules when there is a risk of violating traffic rules.

[0081] The terminal can provide the user with violation risk warning information by voice playback, and different types of violation risk warning information correspond to different voice prompt contents.

[0082] In a specific implementation example, step S205 specifically includes:

[0083] If the color-filled vehicle driving road picture includes the characteristic outline of the traffic light, and the characteristic outline of the traffic light is displayed in red, then outputting red light running risk warning information; and / or,

[0084] If the vehicle driving road picture after color filling includes a characteristic outline of a lane line, and the characteristic outline of the lane line is displayed in yellow, and the distance between the characteristic outline position of the lane line and the vehicle tire is less than a first preset distance, then output yellow line risk warning information; and / or,

[0085] If the color-filled vehicle driving road picture includes a characteristic outline of a lane line, and the characteristic outline of the lane line is displayed in white, and the distance between the characteristic outline position of the lane line and the vehicle tire is less than a second preset distance, then a lane change risk warning information is output.

[0086] From the above, it can be seen that the violation alarm prompt method provided in the present embodiment first uses a wide-angle camera to take a wide-angle view, collects the vehicle driving road picture, and roughly calibrates the characteristic contours of the traffic signs in the vehicle driving road picture; then controls the black and white camera to scan the characteristic contours of the traffic signs marked in the vehicle driving road picture, obtains accurate contour information, and filters out the characteristic contours that are incorrectly marked in the vehicle driving road picture; then fills the characteristic contours in the vehicle driving road picture screened by the black camera with color according to the picture information captured by the color camera; finally, identifies whether the vehicle has a violation risk based on the vehicle driving road picture after color filling, and outputs corresponding violation risk alarm prompt information when there is a violation risk, so that the traffic signs in the vehicle driving road can be accurately identified during the vehicle driving process, and timely reminders and alarms are provided for violation risks that users may ignore, such as running a red light, crossing a yellow line, etc.

[0087] Embodiment 2

[0088] Figure 3 is a schematic diagram of a specific implementation flow of the violation alarm prompt method provided in the second embodiment of the present invention, and the execution subject of the method is Figure 1 See the terminal shown. Figure 3 As shown, the violation alarm prompt method provided by this embodiment includes the following steps:

[0089] Step S301, based on the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process, identifying the characteristic contour of the traffic sign in the vehicle driving road picture, and marking the characteristic contour.

[0090] Step S302, controlling the black and white camera to scan the characteristic contours marked in the vehicle driving road picture, and filtering the characteristic contours marked in the vehicle driving road picture according to the scanning result.

[0091] Step S303, determining whether the light intensity within the marked characteristic contour in the filtered vehicle driving road picture is greater than a preset light intensity threshold; if it is greater than the preset light intensity threshold, proceeding to step S304.

[0092] Step S304 , filling the marked feature contours in the filtered vehicle driving road picture with colors according to the picture information collected by the color camera.

[0093] Step S305, identifying whether the vehicle has a risk of violating traffic rules based on the color-filled vehicle driving road picture, and outputting corresponding warning prompt information of the risk of violating traffic rules when there is a risk of violating traffic rules.

[0094] Step S306, controlling the terminal to display the vehicle driving road picture filled with color to the user.

[0095] In a specific implementation example, controlling the terminal to display the vehicle driving road picture filled with color to the user includes:

[0096] The terminal is controlled to display the vehicle driving road picture filled with colors to the user in real time. This facilitates the user to obtain the vehicle driving road picture information in real time, understand the traffic sign information on the vehicle driving road, and avoid illegal driving.

[0097] In another specific implementation example, controlling the terminal to display the vehicle driving road picture filled with color to the user includes:

[0098] When the terminal determines that the vehicle has a risk of violating traffic rules, the terminal is controlled to display the vehicle's driving road image filled with color to the user, and the terminal is controlled to turn off the screen after monitoring that the risk of violating traffic rules has been eliminated. In this implementation example, after the terminal turns on the vehicle's violation alarm prompt function, the violation alarm prompt process is processed in the screen-off state. When it is detected that the vehicle has a risk of violating traffic rules, the screen is lit up to display the vehicle's driving road image filled with color to the user, and the terminal is controlled to turn off the screen again after the risk of violating traffic rules has been eliminated. This not only allows users to understand the vehicle's driving road conditions when the vehicle has a risk of violating traffic rules, but also saves energy consumption of the terminal, further improving the user experience.

[0099] It should be noted that the implementation of steps S301 to S305 in this embodiment is completely the same as the implementation of steps S201 to S205 in the previous embodiment, and thus will not be described in detail here.

[0100] It can be seen from the above that, compared with the previous embodiment, the violation alarm prompt method provided in this embodiment allows the user to understand the vehicle driving road conditions more intuitively and avoid driving violations because the control terminal displays the vehicle driving road picture information filled with color to the user.

[0101] Embodiment 3

[0102] Figure 4 1 is a schematic diagram of the structure of the software and hardware combination of the terminal provided in the third embodiment of the present invention. For the convenience of explanation, only the parts related to this embodiment are shown.

[0103] See also Figure 4As shown, the terminal 100 provided in this embodiment includes a processor 110 and a wide-angle camera 112, a black and white camera 113 and a color camera 114 electrically connected to the processor 110. The terminal 100 also includes a memory 115, a processor 110 and a computer program 1151 stored in the memory 115 and executable on the processor 110. When the computer program 1151 is executed by the processor 110, the steps of the violation alarm prompt method described in the above-mentioned embodiment 1 or embodiment 2 are implemented.

[0104] The terminal of the embodiment of the present invention and the violation alarm prompt method of the above-mentioned embodiment 1 and embodiment 2 belong to the same concept. The specific implementation process is detailed in the method embodiment, and the technical features in the method embodiment are correspondingly applicable in the device embodiment, which will not be repeated here.

[0105] Embodiment 4

[0106] Embodiment 4 of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the resource allocation method of the violation alarm prompt method as described in the above embodiment 1 or embodiment 2 are implemented.

[0107] The computer-readable storage medium of the embodiment of the present invention belongs to the same concept as the method of the above-mentioned embodiment 1 or embodiment 2. The specific implementation process is detailed in the corresponding method embodiment, and the technical features in the method embodiment are correspondingly applicable in the embodiment of the computer-readable storage medium, which will not be repeated here.

[0108] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0109] In hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some physical components or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0110] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the present invention is not limited thereby. Any modification, equivalent substitution and improvement made by those skilled in the art without departing from the scope and essence of the present invention shall be within the scope of the present invention.

Claims

1. A traffic violation alarm prompt method, applied to a terminal, wherein the terminal includes a wide-angle camera, a black-and-white camera, and a color camera. It is characterized in that The violation alarm prompting method comprises: According to the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process, the characteristic contour of the traffic sign in the vehicle driving road picture is identified, and the characteristic contour is marked; Controlling the black-and-white camera to scan the characteristic contours marked in the vehicle driving road picture, and filtering the characteristic contours marked in the vehicle driving road picture according to the scanning result; Determining whether the light intensity within the characteristic contour marked in the filtered vehicle driving road picture is greater than a preset light intensity threshold; If it is greater than a preset light intensity threshold, color filling is performed on the feature contour marked in the filtered vehicle driving road image according to the image information collected by the color camera; According to the color-filled vehicle driving road picture, it is identified whether the vehicle has a risk of violation, and when there is a risk of violation, the corresponding violation risk alarm prompt information is output.

2. The traffic violation alarm prompting method according to claim 1, It is characterized in that The identifying, based on the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process, the characteristic contour of the traffic sign in the vehicle driving road picture, and marking the characteristic contour comprises: Performing grayscale processing on the vehicle driving road picture collected by the wide-angle camera during the vehicle driving process to obtain a grayscale picture of the vehicle driving road picture; Perform contour detection on the grayscale image to obtain contour information of objects in the grayscale image, compare the contour information of objects in the grayscale image with a pre-stored standard contour template of traffic signs, and identify and mark the characteristic contour of the traffic sign contained in the grayscale image.

3. The traffic violation alarm prompting method according to claim 1, It is characterized in that Marking the characteristic contour includes: The characteristic contours corresponding to the different types of traffic signs included in the recognized vehicle driving road picture are marked with marking icons of different shapes.

4. The traffic violation alarm prompting method according to claim 1, It is characterized in that Determining whether the light intensity within the characteristic contour marked in the filtered vehicle driving road picture is greater than a preset light intensity threshold comprises: Identify the type of traffic sign corresponding to the characteristic contour marked in the filtered vehicle driving road picture, and obtain a preset light intensity threshold that matches the type of the traffic sign; different types of traffic signs correspond to preset light intensity thresholds of different sizes; The light intensity within the characteristic contour marked in the vehicle driving road picture is compared with the preset light intensity threshold value matching the corresponding traffic sign type.

5. The traffic violation alarm prompting method according to claim 1, It is characterized in that The step of filling the color of the feature contour marked in the filtered vehicle driving road picture according to the picture information collected by the color camera comprises: Acquire the color within the feature outline marked in the vehicle driving road picture according to the picture information collected by the color camera; The acquired color within the characteristic contour is subjected to RGB decomposition, and the characteristic contour marked in the vehicle driving road picture is filled with color according to the RGB decomposition result.

6. The traffic violation alarm prompting method according to claim 1, It is characterized in that The traffic sign includes at least one of a traffic light and a lane line.

7. The traffic violation alarm prompting method as claimed in claim 6, It is characterized in that The method of identifying whether the vehicle has a risk of violating traffic rules based on the vehicle driving road picture filled with colors, and outputting corresponding warning information of the risk of violating traffic rules when there is a risk of violating traffic rules comprises: If the color-filled vehicle driving road picture includes the characteristic outline of the traffic light, and the characteristic outline of the traffic light is displayed in red, then outputting red light running risk warning information; and / or, If the vehicle driving road picture after color filling includes a characteristic outline of a lane line, and the characteristic outline of the lane line is displayed in yellow, and the distance between the characteristic outline position of the lane line and the vehicle tire is less than a first preset distance, then output yellow line risk warning information; and / or, If the color-filled vehicle driving road picture includes a characteristic outline of a lane line, and the characteristic outline of the lane line is displayed in white, and the distance between the characteristic outline position of the lane line and the vehicle tire is less than a second preset distance, then a lane change risk warning information is output.

8. The traffic violation alarm prompting method according to claim 1, It is characterized in that The method further includes: identifying whether the vehicle has a risk of violating traffic rules according to the vehicle driving road picture filled with colors, and outputting corresponding warning prompt information of the risk of violating traffic rules when there is a risk of violating traffic rules; The terminal is controlled to display the vehicle driving road picture filled with color to the user.

9. A terminal, It is characterized in that The terminal comprises a processor and a wide-angle camera, a black-and-white camera and a color camera electrically connected to the processor. The terminal also comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps of the traffic violation alarm prompt method as described in any one of claims 1 to 8 are implemented.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the traffic violation alarm prompt method according to any one of claims 1 to 8 are implemented.

Images