Traffic information prompting method and device, electronic equipment and readable storage medium

Abstract

The application provides a traffic information prompting method and device, electronic equipment and a readable storage medium, which can be used in the field of traffic management. The method comprises the following steps: acquiring a monitoring image of a target vehicle shot by a first road monitoring device; sending a face image of a driver extracted from the monitoring image to an operator big data system for face recognition; receiving identity information and communication information of the driver returned by the operator big data system; determining a driving route of the target vehicle according to a driving direction of the target vehicle and a position of the first road monitoring device; determining historical traffic violation data of the driver on the driving route according to the identity information and the driving route; generating traffic prompting information according to the historical traffic violation data during the driving of the target vehicle, and sending the traffic prompting information to the driver based on the communication information. The method of the application effectively improves the risk warning ability of the driver and reduces the traffic accident rate through the pre-prompting mode.

Description

Technical Field

[0001] This application relates to the field of traffic management, and more particularly to a traffic information prompting method, device, electronic device, and readable storage medium. Background Technology

[0002] With social development, the number of motor vehicles in my country has been increasing year by year, which has placed higher demands on motor vehicle traffic management.

[0003] In existing technologies, traffic management for motor vehicles mainly relies on vehicle violation penalty systems. These systems utilize road monitoring equipment installed around roads to collect images of motor vehicles in motion and determine whether a vehicle has violated traffic rules based on these images. If a motor vehicle violates traffic rules, it is penalized according to the specific traffic violation.

[0004] However, this post-accident-based traffic management approach cannot improve drivers' risk awareness and thus reduce the traffic accident rate. Summary of the Invention

[0005] This application provides a traffic information prompting method, device, electronic device, and readable storage medium to address the problem that existing traffic management technologies cannot effectively improve drivers' risk warning capabilities to reduce traffic accident rates.

[0006] According to the first aspect disclosed in this application, a method for providing traffic information is provided, including:

[0007] Acquire surveillance images of the target vehicle captured by the first road monitoring equipment;

[0008] The driver's facial image is extracted from the surveillance image and sent to the operator's big data system; wherein the facial image is used by the operator's big data system for facial recognition.

[0009] Receive the facial recognition result sent by the operator's big data system; wherein, the facial recognition result includes the driver's identity information and communication information;

[0010] The driving direction of the target vehicle is identified based on the surveillance image, and the driving route of the target vehicle is determined according to the driving direction and the location of the first road monitoring device.

[0011] Based on the identity information and the driving route, the driver's historical traffic violation data on the driving route is determined;

[0012] During the driving of the target vehicle, traffic alert information is generated based on the historical traffic violation data, and the traffic alert information is sent to the driver based on the communication information.

[0013] In one feasible implementation, determining the driver's historical traffic violation data on the driving route based on the identity information and the driving route includes:

[0014] A plurality of second road monitoring devices are identified on the driving route; wherein, the plurality of second road monitoring devices include a predetermined number of second road monitoring devices located on the driving route in front of the first road monitoring device, or second road monitoring devices located within a predetermined distance range in front of the first road monitoring device;

[0015] For each second road monitoring device, the driver's historical traffic violation data within the shooting range of the second road monitoring device is queried based on the identity information within a preset time range.

[0016] In one feasible implementation, the step of generating traffic alert information based on the historical traffic violation data and sending the traffic alert information to the driver based on the communication information includes:

[0017] Based on the communication information, obtain the driver's mobile phone number;

[0018] The mobile phone number is sent to the navigation service system so that the navigation service system can query whether there is a corresponding registered account based on the mobile phone number;

[0019] If the navigation service system has a registered account corresponding to the mobile phone number, and the registered account is using the navigation service of the navigation service system, then the vehicle location of the target vehicle is obtained through the navigation information of the registered account;

[0020] When the vehicle's location is a preset distance from the location of a traffic violation in the historical traffic violation data, a corresponding traffic alert is generated based on the traffic violation behavior in the historical traffic violation data.

[0021] The traffic alert information is sent to the navigation service system so that the navigation service system can send the traffic alert information to the registered account.

[0022] In one feasible implementation, the method further includes:

[0023] Based on the vehicle's location and the current date, obtain the traffic restriction rules for the target vehicle's location on that day; wherein, the traffic restriction rules include restricted license plate numbers, restricted time periods, and restricted areas;

[0024] Based on the surveillance image, extract the license plate number information of the target vehicle;

[0025] If the license plate number matches the restricted license plate number and the current time is within the restricted time period, then when the vehicle's location is a preset distance from the restricted area, a traffic restriction reminder will be sent to the navigation service system, so that the navigation service system can send the traffic restriction reminder to the registered account.

[0026] In one feasible implementation, the method further includes:

[0027] If the navigation service system does not have a registered account corresponding to the mobile phone number, or if the registered account does not use the navigation service of the navigation service system, then the traffic alert information is sent to the mobile phone number.

[0028] In one feasible implementation, the identity information further includes nationality information, and the method further includes:

[0029] The nationality information is sent to the navigation service system so that the navigation service system can select the corresponding language or text based on the nationality information and send the traffic information to the registered account.

[0030] In one feasible implementation, the method further includes:

[0031] The monitoring image is input into the traffic violation recognition model to obtain the traffic violation recognition result; wherein, the traffic violation recognition model is obtained by deep learning training based on traffic violation images labeled with traffic violation behavior;

[0032] Based on the traffic violation recognition results, when it is determined that the target vehicle has violated traffic rules, the traffic violation behavior of the target vehicle is obtained;

[0033] Based on the surveillance image, the license plate number of the target vehicle is extracted, and the owner information of the target vehicle is obtained based on the license plate number.

[0034] Based on the traffic violation, the surveillance image, the license plate number, the vehicle owner information, the driver's identity and communication information, the identifier of the first road monitoring device, and the location and time of the traffic violation, current traffic violation data is generated; wherein, the location of the traffic violation is the location of the first road monitoring device, and the time of the traffic violation is the time when the surveillance image was captured.

[0035] According to a second aspect of this application, a traffic information display device is provided, comprising:

[0036] The image acquisition module is used to acquire monitoring images of the target vehicle captured by the first road monitoring device;

[0037] An image extraction module is used to extract the driver's facial image from the monitoring image and send the facial image to the operator's big data system; wherein, the facial image is used by the operator's big data system for facial recognition;

[0038] The data receiving module is used to receive the facial recognition results sent by the operator's big data system; wherein, the facial recognition results include the driver's identity information and communication information;

[0039] The route determination module is used to identify the driving direction of the target vehicle based on the monitoring image, and determine the driving route of the target vehicle according to the driving direction and the position of the first road monitoring device;

[0040] The traffic violation inquiry module is used to determine the driver's historical traffic violation data on the driving route based on the identity information and the driving route;

[0041] The prompt sending module is used to generate traffic prompt information based on the historical traffic violation data during the driving of the target vehicle, and send the traffic prompt information to the driver based on the communication information.

[0042] According to a third aspect disclosed in this application, an electronic device is provided, including a processor and a memory communicatively connected to the processor;

[0043] The memory stores computer-executed instructions;

[0044] The processor executes computer execution instructions stored in the memory to implement the method described in any one of the first aspects.

[0045] According to a fourth aspect disclosed in this application, a computer-readable storage medium is provided, wherein computer-executable instructions are stored therein, which, when executed by a processor, are used to implement the method described in any one of the first aspects.

[0046] According to the fifth aspect disclosed in this application, a computer program product is provided, comprising a computer program that, when executed by a processor, is used to implement the method described in any one of the first aspects.

[0047] Compared with the prior art, this application has the following beneficial effects:

[0048] The traffic information prompting method, device, electronic equipment, and readable storage medium provided in this application acquire monitoring images of target vehicles using road monitoring equipment. Based on the driver's facial image in the monitoring image, driver identity and communication information are obtained through facial recognition. Furthermore, based on the driver's identity and communication information, historical traffic violation data along the driver's driving route is obtained. Based on this historical traffic violation data, targeted traffic prompts are issued to the driver to remind them to pay attention to sections of road with past violations and to drive safely. This advance warning approach effectively improves the driver's risk awareness and reduces the traffic accident rate. Attached Figure Description

[0049] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without inventive effort. Wherein:

[0050] Figure 1 This is a schematic diagram illustrating an application scenario of a traffic information prompting method provided in an embodiment of this application;

[0051] Figure 2 A flowchart illustrating a traffic information prompting method provided in an embodiment of this application;

[0052] Figure 3 This application provides a schematic diagram of a process for sending traffic alert information to drivers.

[0053] Figure 4 A schematic diagram of a process for generating current traffic violation data of a target vehicle, provided as an embodiment of this application;

[0054] Figure 5 This is a schematic diagram of the structure of a traffic information display device provided in an embodiment of this application;

[0055] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0056] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0057] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0058] In existing technologies, traffic management for motor vehicles mainly relies on vehicle violation penalty systems. These systems utilize roadside monitoring equipment to collect images of vehicles in motion and determine whether a vehicle has violated traffic rules based on these images. If a vehicle violates traffic rules, it is penalized according to the specific violation. However, this reactive traffic management approach does not improve drivers' risk awareness and thus fail to reduce traffic accident rates.

[0059] Below, in conjunction with Figure 1 This paper describes the application scenarios involved in the traffic information prompting method of this application.

[0060] Figure 1 This is a schematic diagram illustrating an application scenario of the traffic information prompting method provided in the embodiments of this application. (See attached diagram.) Figure 1 The application scenario includes a target vehicle 101, a road monitoring device 102, a vehicle violation penalty system 103, an operator big data system 104, and a navigation service system 105. The vehicle violation penalty system 103 is connected to the road monitoring device 102, the operator big data system 104, and the navigation service system 105 via a network. Specifically, the network can be a wide area network, a local area network, or a combination of both.

[0061] Specifically, road monitoring equipment 102 includes electronic eyes and surveillance cameras. An electronic eye is a device used for traffic monitoring and capturing traffic violations. It typically uses image recognition and video analysis technology to automatically monitor traffic violations and record evidence. Electronic eyes are generally installed in specific locations on roads or at intersections, such as traffic lights or speed-limited areas.

[0062] Specifically, the vehicle violation penalty system 103, the operator big data system 104, and the navigation service system 105 can be independent physical servers, server clusters or distributed systems composed of multiple physical servers, or cloud servers that provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0063] It should be noted that, Figure 1This is merely a schematic diagram illustrating an application scenario provided by an embodiment of this application. This embodiment of the application does not necessarily represent an application scenario. Figure 1 The document does not limit the actual form of the various devices included, nor does it specify the form of the devices. Figure 1 The interaction or connection methods between various devices are limited, and can be set according to actual needs in the specific application of the technical solution.

[0064] It should be noted that the traffic information prompting method provided in this application embodiment is executed by the vehicle violation penalty system, and correspondingly, the traffic information prompting device is also set in the vehicle violation penalty system.

[0065] In light of the above scenarios, the technical solution of the traffic information prompting method provided in this application will be described in detail below through specific embodiments. It should be noted that the following embodiments may exist independently or in combination with each other; for the same or similar content, descriptions may not be repeated in different embodiments.

[0066] Figure 2 A flowchart illustrating a traffic information prompting method provided in this application embodiment is shown below. Figure 2 In some embodiments, the traffic information prompting method includes the following steps:

[0067] S201, acquire the monitoring image of the target vehicle captured by the first road monitoring device.

[0068] The road monitoring equipment uses methods such as coil triggering, radar triggering, or video detection to capture images of target vehicles and uploads the captured images to the vehicle violation penalty system.

[0069] Preferably, if the road monitoring equipment has image processing capabilities, the monitored images can be processed by the road monitoring equipment, and the extracted driver's facial image, the target vehicle's license plate number, and other data can be directly sent to the vehicle violation penalty system.

[0070] S202, extract the driver's face image from the monitoring image and send the face image to the operator's big data system; the face image is used by the operator's big data system for face recognition.

[0071] The operator's big data system preprocesses and extracts features from the driver's face image, then compares the features with face images in the operator's big data system's large face database (the face data storage and management center), and identifies the face image that meets the preset similarity conditions as the driver.

[0072] Specifically, the operator's big data system includes facial recognition algorithms. These algorithms utilize deep learning and neural networks to learn from massive amounts of facial images. Using the input images, they extract feature vectors to distinguish different faces, replacing manually designed features. Each face has a corresponding set of feature values ​​in the algorithm, which forms the basis for face comparison. Feature values ​​extracted from different facial images of the same person are close in feature space, while those from different people are far apart. The distance between the feature values ​​extracted from two facial images in feature space is used as a similarity criterion to identify whether two facial images belong to the same person. The facial recognition algorithm can be a Convolutional Neural Network (CNN), a Support Vector Machine (SVM), or a eigenface, among others.

[0073] S203 receives the facial recognition results sent by the operator's big data system; the facial recognition results include the driver's identity information and communication information.

[0074] Because facial images in the facial database are linked to users' identity information (name, ID number, nationality, etc.) and communication information (mobile phone number, landline number, mailing address, etc.), once the driver's facial image is identified, the associated identity and communication information can be obtained. After obtaining the driver's identity and communication information, the operator's big data system returns the facial recognition results to the vehicle violation penalty system. This system then uses the identity and communication information from the facial recognition results to query the driver's historical traffic violation data and issue traffic alerts to the driver.

[0075] S204, based on the surveillance image, identify the driving direction of the target vehicle, and determine the driving route of the target vehicle according to the driving direction and the location of the first road monitoring equipment.

[0076] The direction of travel of a target vehicle can be determined by the direction the vehicle is facing in the surveillance image. Combined with the location of the first road monitoring device, the route of the target vehicle can be easily determined.

[0077] S205 determines the driver's historical traffic violation data along the driving route based on identity information and driving route.

[0078] Traffic violation data typically includes information such as the violator's information, the location of the violation, and the time of the violation. After obtaining the driver's identity information and the target vehicle's route, the system can use these information as search criteria to query the driver's historical traffic violation data along that route in the vehicle violation penalty system.

[0079] Preferably, based on the driver's identity information and driving route, the driver's historical traffic violation data on the driving route is determined, including: identifying multiple second road monitoring devices on the driving route; wherein, the multiple second road monitoring devices include a predetermined number of second road monitoring devices located on the driving route in front of the first road monitoring device, or second road monitoring devices located within a predetermined distance range in front of the first road monitoring device; for each second road monitoring device, the driver's historical traffic violation data within the shooting range of the second road monitoring device within a predetermined time range is queried based on the identity information.

[0080] Since the location of traffic violations in the traffic violation data is determined by the location of road monitoring equipment, the location of a second road monitoring device along the target vehicle's route can be used to query whether the driver has any traffic violation records along that route. However, because the target vehicle's route is determined by the vehicle's direction of travel and the location of the first road monitoring device, the accuracy of the predicted route is limited; the further the route is from the first road monitoring device, the lower the prediction accuracy. Therefore, a second road monitoring device within a certain limited range can be obtained to ensure that the selected second road monitoring device is on the target vehicle's route. This limited range can be a preset number range or a preset distance range. A query time range is also set to query the driver's traffic violation data within a certain time period to reflect the driver's traffic violation status as accurately as possible.

[0081] By limiting the acquisition range of the second road monitoring equipment and the query time range of historical traffic violation data, the scope of obtaining drivers' historical traffic violation records is effectively defined.

[0082] S206: During the driving process of the target vehicle, traffic alert information is generated based on historical traffic violation data, and the traffic alert information is sent to the driver based on communication information.

[0083] Once the driver's historical traffic violation data on the driving route is obtained, traffic reminders can be sent to the driver in a targeted manner based on the driver's previous historical traffic violation data on the road ahead.

[0084] For example, assuming a driver has a speeding violation record on the road ahead, a traffic alert message can be sent to the driver based on the speeding violation record: "You have a speeding violation record at the location ahead, please pay attention!" This is to remind the driver to improve their risk warning ability and drive safely.

[0085] In this embodiment, monitoring images of the target vehicle are acquired using road monitoring equipment. Based on the driver's facial image in the monitoring image, facial recognition is used to obtain the driver's identity and communication information. Furthermore, based on the driver's identity and communication information, historical traffic violation data along the driving route is obtained. According to this historical traffic violation data, targeted traffic alerts are issued to the driver to remind them to pay attention to sections of road with past violations and to drive safely. This proactive approach effectively improves the driver's risk awareness and reduces the traffic accident rate.

[0086] exist Figure 2 The traffic information notification method shown requires generating traffic notification information based on historical traffic violation data during the target vehicle's journey, and then sending the traffic notification information to the driver based on communication information. The following section will combine... Figure 3 The technical solution for the aforementioned traffic information prompting method will be further described, specifically regarding the sending of traffic prompt information to drivers.

[0087] Figure 3 This is a schematic diagram illustrating a process for sending traffic alert information to drivers, provided as an embodiment of this application. (See attached diagram.) Figure 3 In some embodiments, the process of sending traffic alert information to the driver includes the following steps:

[0088] S301, based on communication information, obtains the driver's mobile phone number.

[0089] In particular, since user communication information in the operator's big data system generally includes information such as mobile phone number and communication address, the driver's mobile phone number can be obtained based on the user's communication information.

[0090] S302, send the mobile phone number to the navigation service system so that the navigation service system can query whether there is a corresponding registered account based on the mobile phone number.

[0091] Sending the driver's mobile phone number to the navigation service system allows you to check if that number is registered with the system. If it is, a corresponding account exists.

[0092] Specifically, a navigation service system refers to an application based on geographic information and positioning technology, designed to help users navigate accurately, plan routes, and provide relevant navigation information. Navigation service systems typically have the following functions: map display, providing users with visualized geographic information through map display functions. These maps can be built based on satellite imagery or vector data, and users can browse, zoom in, and zoom out on the maps; positioning services, using the Global Positioning System (GPS), BeiDou Navigation Satellite System, or other positioning technologies to obtain the user's current location information to provide accurate navigation guidance; route planning, planning the optimal driving route on the map based on the user's origin and destination. This may take into account factors such as traffic congestion, road restrictions, speed limits, and traffic signals; navigation guidance, providing step-by-step navigation guidance, including turn prompts, distance and time estimates, to help users reach their destination smoothly. This guidance can be presented through voice prompts, icon displays, or vibrations; and traffic information, providing real-time traffic information, including traffic congestion, accident reports, and temporary road closures. This helps users choose the best driving route and avoid congested areas; Points of Interest (POI) search: Navigation service systems typically offer search functions for points of interest (such as restaurants, gas stations, banks, attractions, etc.). Users can find specific types of places and obtain relevant information and navigation guidance.

[0093] Navigation service systems are widely used in in-vehicle navigation devices, mobile navigation applications, and internet map services, providing users with a convenient and accurate navigation experience, helping people better plan their travel routes, and saving time and effort.

[0094] S303 If the navigation service system has a registered account corresponding to the mobile phone number, and the registered account is using the navigation service of the navigation service system, then the vehicle location of the target vehicle is obtained through the navigation information of the registered account.

[0095] If the navigation service system has a registered account corresponding to the driver's mobile phone number, and the registered account is using the navigation service of the navigation service system, then it means that the driver is using the navigation service system for navigation. At this time, the location of the target vehicle can be obtained based on the navigation information of the registered account.

[0096] S304 When the vehicle's location is at a preset distance from the location of a traffic violation in the historical traffic violation data, a corresponding traffic prompt message is generated based on the traffic violation behavior in the historical traffic violation data.

[0097] Since historical traffic violation data includes the location of the traffic violation, when the vehicle's location obtained from navigation information from the navigation service system is at a preset distance from the location of the traffic violation in the historical data, corresponding traffic alert information will be generated based on the traffic violation in the historical data. Specifically, because the historical traffic violation data is acquired by second-party road monitoring equipment, the location of the traffic violation in the historical data is the location of the corresponding second-party road monitoring equipment.

[0098] When the distance to the location of a traffic violation is within a preset distance, a corresponding traffic alert message is generated based on the traffic violation at that location. For example, if the driver's historical traffic violation was running a red light, a corresponding traffic alert message will be generated, such as "You have a record of running a red light ahead, please be careful!" If the traffic violation was speeding, the corresponding traffic alert message will be "You have a record of speeding ahead, please be careful!"

[0099] Preferably, if a driver has multiple violations at the same location in the historical traffic violation data, multiple traffic alert messages corresponding to each violation are generated in order of violation time and sent to the driver sequentially thereafter.

[0100] S305 sends traffic alert information to the navigation service system so that the navigation service system can send traffic alert information to registered accounts.

[0101] The generated traffic alert information will be sent to the navigation service system, which will then send the traffic alert information to the registered account corresponding to the driver's mobile phone number to remind the driver to drive safely.

[0102] Specifically, the navigation service system sends traffic alerts to the corresponding registered account and then sends the traffic alerts to the driver's navigation service client. The navigation service client can be an in-vehicle navigation device or a mobile terminal. The navigation service client will send traffic alerts to the driver through text, voice broadcasts, vibration reminders, etc., to remind the driver to pay attention to the road ahead and avoid traffic violations.

[0103] In this embodiment, traffic alerts can be generated specifically based on the driver's historical traffic violation data and the driver's past violations, thus improving the intelligence of traffic alerts. Simultaneously, using a navigation service system to send traffic alerts to the driver can more effectively remind them to pay attention to the road ahead and drive safely.

[0104] Preferred, in Figure 3Based on the illustrated embodiment, a technical solution can be added to send a notification to the driver via the navigation service system regarding whether a target vehicle is subject to traffic restrictions. Specifically, this includes: obtaining the traffic restriction rules for the target vehicle's location on that day based on the vehicle's location and the current date; wherein the traffic restriction rules include restricted license plate numbers, restricted time periods, and restricted areas; extracting the target vehicle's license plate number information from surveillance images; if the license plate number information matches a restricted license plate number and the current time is within the restricted time period, then when the vehicle's location is a preset distance from the restricted area, a traffic restriction reminder is sent to the navigation service system for the navigation service system to send the reminder to the registered account.

[0105] The system obtains the traffic restriction rules for the vehicle's location by using its location and the current date, and then retrieves the vehicle's license plate number based on surveillance images. This information allows the system to determine if the target vehicle is subject to traffic restrictions. If the target vehicle meets the restriction requirements, the navigation service system sends a traffic restriction reminder to the driver, intelligently alerting them not to violate the traffic restriction rules.

[0106] Preferably, if the navigation service system does not have a registered account corresponding to the mobile phone number, or if the registered account does not use the navigation service of the navigation service system, then traffic alert information is sent to the mobile phone number.

[0107] In cases where the navigation service system does not have a registered account corresponding to the mobile phone number, or the registered account has not used the navigation service system, traffic alert information cannot be sent to the driver through the navigation service system. In such cases, traffic alert information can be sent directly to the driver via SMS or other means using the mobile phone number.

[0108] Preferably, the identity information also includes nationality information, and the method further includes: sending the nationality information to the navigation service system so that the navigation service system can select the corresponding language or text to send traffic prompt information to the registered account based on the nationality information.

[0109] Among these methods, sending traffic alerts to drivers using the appropriate language or script based on their nationality can expand the scope of application of traffic information alerts and improve their intelligence.

[0110] exist Figure 2 The traffic information notification method shown also requires generating the target vehicle's current traffic violation data when the target vehicle commits a violation. The following section will explain this in conjunction with... Figure 4 The technical solution for the aforementioned traffic information prompting method further describes the content regarding the generation of current traffic violation data for the target vehicle.

[0111] Figure 4 This application provides a schematic diagram of a process for generating current traffic violation data for a target vehicle, as illustrated in the embodiments of this application. Figure 4In some embodiments, the process of generating current traffic violation data for the target vehicle includes the following steps:

[0112] S401, input the monitoring image into the traffic violation recognition model to obtain the traffic violation recognition result; wherein, the traffic violation recognition model is obtained by deep learning training based on traffic violation images labeled with traffic violation behavior.

[0113] The traffic violation images labeled with traffic violations can include various traffic violations, such as running red lights, frequent lane changes, exceeding the speed limit, and failing to use turn signals when changing lanes. Using these images as a training set and training them with deep learning, a traffic violation recognition model capable of identifying traffic violations can be obtained. Specifically, deep learning algorithms include neural networks, convolutional neural networks (CNNs), recurrent neural networks (RNNs), and long short-term memory networks (LSTMs).

[0114] S402, based on the traffic violation recognition results, when it is determined that the target vehicle has violated traffic rules, the traffic violation behavior of the target vehicle is obtained.

[0115] Specifically, when the traffic violation recognition model identifies a target vehicle violating traffic rules in a surveillance image, it will output the traffic violation behavior of the target vehicle. Conversely, if the target vehicle has not violated traffic rules, the traffic violation recognition model will output a result indicating that it has not violated any rules.

[0116] S403 extracts the license plate number information of the target vehicle based on the surveillance image, and obtains the owner information of the target vehicle based on the license plate number information.

[0117] After identifying the target vehicle's violation, the system extracts the vehicle's license plate number and, based on that information, obtains the vehicle owner's information.

[0118] S404 generates current traffic violation data based on traffic violation behavior, surveillance images, license plate information, vehicle owner information, driver's identity and communication information, the identifier of the first road monitoring device, as well as the location and time of the traffic violation; where the location of the traffic violation is the location of the first road monitoring device, and the time of the traffic violation is the time when the surveillance image was captured.

[0119] Once the target vehicle is identified as violating traffic regulations, the system comprehensively generates complete current traffic violation data by integrating the traffic violation behavior, surveillance images, license plate information, vehicle owner information, driver's identity and communication information, the identification and location of the first road monitoring equipment, and the time the surveillance images were captured. This data is then stored in the vehicle violation penalty system.

[0120] In this embodiment, it is possible to effectively determine whether the target vehicle has committed a traffic violation when passing the first road monitoring device, and generate complete traffic violation data after the target vehicle commits a violation, so as to retain the driver's traffic violation record, facilitate the punishment of the driver for traffic violations, and facilitate the subsequent query of traffic violation records.

[0121] For example, the generated current traffic violation data is shown in Table 1.

[0122] Table 1 Traffic Violation Data Table

[0123]

[0124]

[0125] Figure 5 This is a schematic diagram of the structure of a traffic information display device provided in an embodiment of this application. (See attached diagram.) Figure 5 The traffic information display device includes various functional modules for implementing the aforementioned traffic information display method, and any functional module can be implemented by software and / or hardware.

[0126] In some embodiments, the traffic information notification device 500 includes an image acquisition module 501, an image extraction module 502, a data receiving module 503, a route determination module 504, a traffic violation inquiry module 505, and a notification sending module 506; wherein:

[0127] The image acquisition module 501 is used to acquire the monitoring image of the target vehicle captured by the first road monitoring device;

[0128] The image extraction module 502 is used to extract the driver's face image from the monitoring image and send the face image to the operator's big data system; the face image is used by the operator's big data system for face recognition.

[0129] The data receiving module 503 is used to receive the facial recognition results sent by the operator's big data system; the facial recognition results include the driver's identity information and communication information;

[0130] The route determination module 504 is used to identify the driving direction of the target vehicle based on the monitoring image, and determine the driving route of the target vehicle according to the driving direction and the position of the first road monitoring device;

[0131] The traffic violation inquiry module 505 is used to determine the driver's historical traffic violation data along the driving route based on identity information and driving route;

[0132] The prompt sending module 506 is used to generate traffic prompt information based on historical traffic violation data during the driving of the target vehicle, and send the traffic prompt information to the driver based on communication information.

[0133] In some embodiments, the traffic violation inquiry module 505 is specifically used for:

[0134] The driving route is determined to include multiple second road monitoring devices; wherein, the multiple second road monitoring devices include a predetermined number of second road monitoring devices located on the driving route in front of the first road monitoring device, or second road monitoring devices located within a predetermined distance range in front of the first road monitoring device.

[0135] For each secondary road monitoring device, historical traffic violation data of the driver within the preset time range and within the area captured by the secondary road monitoring device are retrieved based on the driver's identity information.

[0136] In some embodiments, the prompt sending module 506 is specifically used for:

[0137] Based on communication information, obtain the driver's mobile phone number;

[0138] Send your mobile phone number to the navigation service system so that the system can check if a corresponding registered account exists based on the mobile phone number;

[0139] If the navigation service system has a registered account corresponding to the mobile phone number, and the registered account is using the navigation service of the navigation service system, then the vehicle location of the target vehicle can be obtained through the navigation information of the registered account.

[0140] When the vehicle's location is at a preset distance from the location of a traffic violation in the historical traffic violation data, a corresponding traffic alert message is generated based on the traffic violation behavior in the historical traffic violation data.

[0141] Traffic alerts are sent to the navigation service system so that the navigation service system can send traffic alerts to registered accounts.

[0142] In some embodiments, the device further includes a traffic restriction reminder module 507, which is specifically used for:

[0143] Based on the vehicle's location and the current date, obtain the traffic restriction rules for the target vehicle's location on that day; the traffic restriction rules include restricted license plate numbers, restricted time periods, and restricted areas;

[0144] Extract the license plate number information of the target vehicle based on the surveillance images;

[0145] If the license plate number matches the restricted license plate number and the current time is within the restricted period, then when the vehicle's location is at a preset distance from the restricted area, a traffic restriction reminder will be sent to the navigation service system, which will then send the reminder to the registered account.

[0146] In some embodiments, the prompt sending module 506 is specifically used for:

[0147] If the navigation service system does not have a registered account corresponding to the mobile phone number, or if the registered account has not used the navigation service system, traffic alert information will be sent to the mobile phone number.

[0148] In some embodiments, the prompt sending module 506 is specifically used for:

[0149] The nationality information is sent to the navigation service system so that the system can select the corresponding language or script to send traffic information to the registered account.

[0150] In some embodiments, the device further includes a violation generation module 508, which is specifically used for:

[0151] The surveillance images are input into the traffic violation recognition model to obtain the traffic violation recognition results; the traffic violation recognition model is obtained by deep learning training based on traffic violation images labeled with traffic violation behaviors.

[0152] Based on the traffic violation recognition results, when it is determined that the target vehicle has violated traffic rules, the traffic violation behavior of the target vehicle is obtained;

[0153] Based on the surveillance images, extract the license plate number information of the target vehicle, and obtain the owner information of the target vehicle based on the license plate number information;

[0154] The current traffic violation data is generated based on the traffic violation behavior, surveillance images, license plate information, vehicle owner information, driver's identity and communication information, the identifier of the first road monitoring equipment, as well as the location and time of the traffic violation; where the location of the traffic violation is the location of the first road monitoring equipment, and the time of the traffic violation is the time when the surveillance image was captured.

[0155] The traffic information prompting device 500 provided in this application embodiment is used to execute the technical solution provided in the aforementioned traffic information prompting method embodiment. Its implementation principle and technical effects are similar to those in the aforementioned method embodiment, and will not be repeated here.

[0156] It should be noted that the division of the various modules in the above device is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, these modules can be implemented entirely in software via processing elements, entirely in hardware, or partially in software via processing elements and partially in hardware. For example, the image acquisition module can be a separate processing element, or it can be integrated into a chip within the device. Alternatively, it can be stored as program code in the device's memory, invoked and executed by a processing element. The implementation of other modules is similar. Moreover, these modules can be fully or partially integrated together, or implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. During implementation, each step of the above method or each of the above modules can be completed through integrated logic circuits in the processor element or through software instructions.

[0157] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. (See attached diagram.) Figure 6 The electronic device 600 includes: a processor 601, and a memory 602 communicatively connected to the processor 601;

[0158] Memory 602 stores computer-executed instructions;

[0159] The processor 601 executes computer execution instructions stored in the memory 602 to implement the aforementioned traffic information prompting method.

[0160] In the aforementioned electronic device 600, the memory 602 and the processor 601 are electrically connected directly or indirectly to achieve data transmission or interaction. For example, these components can be electrically connected to each other through one or more communication buses or signal lines, such as bus connections. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be classified as address buses, data buses, control buses, etc., but this does not mean that there is only one bus or one type of bus. The memory 602 stores computer execution instructions for implementing the aforementioned traffic information prompting method, including at least one software functional module that can be stored in the memory 602 in the form of software or firmware. The processor 601 executes various functional applications and data processing by running the software program and module stored in the memory 602.

[0161] The memory 602 includes at least one type of readable storage medium, not limited to Random Access Memory (RAM), Read Only Memory (ROM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), etc. The memory 602 stores programs, and the processor 601 executes the programs after receiving execution instructions. Furthermore, the software programs and modules within the memory 602 may also include an operating system, which may include various software components and / or drivers for managing system tasks (e.g., memory management, storage device control, power management, etc.) and can communicate with various hardware or software components to provide an operating environment for other software components.

[0162] Processor 601 can be an integrated circuit chip with signal processing capabilities. The aforementioned processor 601 can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor, or processor 601 can be any conventional processor.

[0163] The electronic device 600 is used to execute the technical solution provided in the aforementioned traffic information prompting method embodiment. Its implementation principle and technical effect are similar to those in the aforementioned method embodiment, and will not be repeated here.

[0164] This application also provides a computer-readable storage medium storing computer-executable instructions. When a processor executes the computer-executable instructions, it implements the technical solution of the aforementioned traffic information prompting method.

[0165] The aforementioned computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The computer-readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0166] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Alternatively, the readable storage medium can be an integral part of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components within the control device of the traffic information display device.

[0167] This application also provides a computer program product, including a computer program, which, when executed by a processor, is used to implement the technical solution of the aforementioned traffic information prompting method.

[0168] In the above embodiments, those skilled in the art will understand that the above method embodiments can be implemented entirely or partially by software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented entirely or partially in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of the present invention is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless network, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The applicable media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)). Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0169] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A traffic information prompting method, characterized in that, include: Acquire surveillance images of the target vehicle captured by the first road monitoring equipment; The driver's facial image is extracted from the surveillance image and sent to the operator's big data system; wherein, the facial image is used by the operator's big data system for facial recognition. Receive the facial recognition result sent by the operator's big data system; wherein, the facial recognition result includes the driver's identity information and communication information; The driving direction of the target vehicle is identified based on the surveillance image, and the driving route of the target vehicle is determined according to the driving direction and the location of the first road monitoring device. A plurality of second road monitoring devices are identified on the driving route; wherein, the plurality of second road monitoring devices include a predetermined number of second road monitoring devices located on the driving route in front of the first road monitoring device, or second road monitoring devices located within a predetermined distance range in front of the first road monitoring device; For each second road monitoring device, query the driver's historical traffic violation data within the shooting range of the second road monitoring device within a preset time range based on the identity information; During the driving of the target vehicle, based on the communication information, the driver's mobile phone number is obtained and sent to the navigation service system so that the navigation service system can query whether there is a corresponding registered account based on the mobile phone number; If the navigation service system has a registered account corresponding to the mobile phone number, and the registered account is using the navigation service of the navigation service system, then the vehicle location of the target vehicle is obtained through the navigation information of the registered account; When the vehicle's location is a preset distance from the location of a traffic violation in the historical traffic violation data, a corresponding traffic alert is generated based on the traffic violation behavior in the historical traffic violation data. The traffic alert information is sent to the navigation service system so that the navigation service system can send the traffic alert information to the registered account.

2. The method according to claim 1, characterized in that, The method further includes: Based on the vehicle's location and the current date, obtain the traffic restriction rules for the target vehicle's location on that day; wherein, the traffic restriction rules include restricted license plate numbers, restricted time periods, and restricted areas; Based on the surveillance image, extract the license plate number information of the target vehicle; If the license plate number matches the restricted license plate number and the current time is within the restricted time period, then when the vehicle's location is a preset distance from the restricted area, a traffic restriction reminder will be sent to the navigation service system, so that the navigation service system can send the traffic restriction reminder to the registered account.

3. The method according to claim 1, characterized in that, The method further includes: If the navigation service system does not have a registered account corresponding to the mobile phone number, or if the registered account does not use the navigation service of the navigation service system, then the traffic alert information is sent to the mobile phone number.

4. The method according to claim 1, characterized in that, The identity information also includes nationality information, and the method further includes: The nationality information is sent to the navigation service system so that the navigation service system can select the corresponding language or text based on the nationality information and send the traffic information to the registered account.

5. The method according to any one of claims 1-4, characterized in that, The method further includes: The monitoring image is input into the traffic violation recognition model to obtain the traffic violation recognition result; wherein, the traffic violation recognition model is obtained by deep learning training based on traffic violation images labeled with traffic violation behavior; Based on the traffic violation recognition results, when it is determined that the target vehicle has violated traffic rules, the traffic violation behavior of the target vehicle is obtained; Based on the surveillance image, the license plate number information of the target vehicle is extracted, and the owner information of the target vehicle is obtained based on the license plate number information. Traffic violation data is generated based on the traffic violation, the surveillance image, the license plate number, the vehicle owner information, the driver's identity and communication information, the identifier of the first road monitoring device, the location of the traffic violation, and the time of the traffic violation; wherein, the location of the traffic violation is the location of the first road monitoring device, and the time of the traffic violation is the time when the surveillance image was captured.

6. A traffic information display device, characterized in that, include: The image acquisition module is used to acquire monitoring images of the target vehicle captured by the first road monitoring device; An image extraction module is used to extract the driver's facial image from the monitoring image and send the facial image to the operator's big data system; wherein, the facial image is used by the operator's big data system for facial recognition; The data receiving module is used to receive the facial recognition results sent by the operator's big data system; wherein, the facial recognition results include the driver's identity information and communication information; The route determination module is used to identify the driving direction of the target vehicle based on the monitoring image, and determine the driving route of the target vehicle according to the driving direction and the position of the first road monitoring device; The traffic violation query module is used to identify multiple second road monitoring devices on the driving route; wherein, the multiple second road monitoring devices include a preset number of second road monitoring devices located on the driving route in front of the first road monitoring device, or second road monitoring devices located within a preset distance range in front of the first road monitoring device. For each second road monitoring device, query the driver's historical traffic violation data within the shooting range of the second road monitoring device within a preset time range based on the identity information; The prompt sending module is used to obtain the driver's mobile phone number based on the communication information during the driving of the target vehicle, and send the mobile phone number to the navigation service system so that the navigation service system can query whether there is a corresponding registered account based on the mobile phone number; If the navigation service system has a registered account corresponding to the mobile phone number, and the registered account is using the navigation service of the navigation service system, then the vehicle location of the target vehicle is obtained through the navigation information of the registered account; When the vehicle's location is a preset distance from the location of a traffic violation in the historical traffic violation data, a corresponding traffic alert is generated based on the traffic violation behavior in the historical traffic violation data. The traffic alert information is sent to the navigation service system so that the navigation service system can send the traffic alert information to the registered account.

7. An electronic device, characterized in that, Includes a processor and a memory communicatively connected to the processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1 to 5.

Images