Intelligent traffic management and monitoring system integrating vehicle and cloud computing
By constructing an intelligent traffic management and monitoring system that integrates vehicles and the cloud, and utilizing data processing and verification modules on both the vehicle and cloud sides, comprehensive, timely, and accurate supervision of intelligent traffic accidents has been achieved. This solves the problem of insufficient integrated management in existing monitoring systems and improves the level of intelligence in intelligent transportation.
Patent Information
- Application Number
- CN202310831380.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-06
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2043-07-06
AI Technical Summary
Existing technologies lack intelligent traffic management and monitoring systems that integrate vehicles and the cloud, making it impossible to achieve integrated control and management of vehicles, the cloud, and the execution platform. This results in incomplete, untimely, and inaccurate intelligent traffic accident supervision.
A vehicle-cloud integrated intelligent traffic management and monitoring system is constructed, including a vehicle-side monitoring terminal subsystem, a cloud-based monitoring subsystem, and an execution subsystem. The vehicle-side data processing module analyzes traffic image data, the cloud-based data verification module performs manual verification and generates control execution commands, and the execution subsystem executes the corresponding strategies.
It enables comprehensive, timely, and accurate monitoring of intelligent traffic accidents, enhances the intelligent transformation of intelligent transportation, reduces human intervention and safety risks, and improves the automation and compliance of data processing.
Smart Images

Figure CN117082088B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of traffic management technology, and in particular to an intelligent traffic management and monitoring system that integrates vehicle and cloud computing. Background Technology
[0002] The development of informatization, digitalization, and intelligentization is driving rapid transformation in the field of urban smart transportation towards green, safe, and comfortable features. Therefore, technologies such as new energy sources and autonomous driving are being used to make travel more environmentally friendly and safer; at the same time, the installation of urban monitoring and auxiliary equipment is also aimed at making traffic information more transparent and management more efficient.
[0003] However, among the existing related technologies, there is still no intelligent traffic management and monitoring system that integrates vehicle and cloud technologies, which can integrate and control the vehicle, cloud and execution platform, accelerate the intelligent transformation of smart transportation, and provide comprehensive, timely and accurate supervision and handling of smart traffic accidents. Summary of the Invention
[0004] This invention provides an intelligent traffic management and monitoring system that integrates vehicle and cloud computing, enabling integrated control and management of vehicle-side, cloud-side, and execution platforms, while also providing comprehensive, timely, and accurate monitoring and handling of intelligent traffic accidents.
[0005] Firstly, a vehicle-cloud integrated intelligent traffic management and monitoring system is provided, including:
[0006] The vehicle-side monitoring terminal subsystem is used to acquire traffic image data, acquire traffic rule information and traffic monitoring algorithms output by the execution subsystem, determine whether the traffic image data violates traffic rule requirements, and output the vehicle-side judgment result.
[0007] A cloud-based monitoring subsystem, communicatively connected to the vehicle-side monitoring terminal subsystem, is used to acquire the vehicle-side judgment result, acquire the verification result obtained manually based on the vehicle-side judgment result, and generate control execution instructions based on the verification result; and,
[0008] The execution subsystem is communicatively connected to the vehicle-side monitoring terminal subsystem and the cloud-based monitoring subsystem, and is used to obtain the control execution instructions and execute different traffic data processing strategies.
[0009] In some embodiments, the vehicle-side monitoring terminal subsystem includes a monitoring camera, a vehicle-side data storage module communicatively connected to the monitoring camera, a vehicle-side data processing module communicatively connected to the vehicle-side data storage module and the monitoring camera, and a wireless communication module communicatively connected to the vehicle-side data storage module, the vehicle-side data processing module, the cloud monitoring subsystem, and the execution subsystem.
[0010] The vehicle-side data processing module is used to acquire traffic image data output by the monitoring camera, execute traffic rule information and traffic monitoring algorithms output by the subsystem, determine whether the traffic image data violates traffic rule requirements, and output the vehicle-side judgment result to the vehicle-side data storage module.
[0011] The wireless communication module is used to send the vehicle-side judgment result in the vehicle-side data storage module to the cloud monitoring subsystem.
[0012] In some embodiments, the vehicle-side data processing module is used for,
[0013] Target detection and recognition are performed on the traffic image data based on the YOLO V5 algorithm and the mask2former algorithm.
[0014] The system determines whether a target violates traffic rules and outputs the vehicle-side judgment result.
[0015] In some embodiments, the cloud monitoring subsystem includes a cloud data storage module that is communicatively connected to the wireless communication module, a data verification module that is communicatively connected to the cloud data storage module, and a cloud data processing module that is communicatively connected to both the data verification module and the execution subsystem.
[0016] The cloud data storage module acquires the vehicle-side judgment result and outputs it to the data verification module;
[0017] The data verification module is used to obtain the vehicle-side judgment result and the verification result of manual verification based on the vehicle-side judgment result;
[0018] The cloud data processing module generates control execution instructions based on the verification results.
[0019] In some embodiments, the data verification module is used to,
[0020] Obtain the manual judgment results verified by humans based on the judgment results from the vehicle end;
[0021] When the manual judgment result is found to match the vehicle-side judgment result, a verification consistency result is output.
[0022] When a discrepancy is detected between the manual judgment result and the vehicle-side judgment result, a verification discrepancy result is output.
[0023] In some embodiments, the cloud data processing module includes:
[0024] The traffic violation penalty module is communicatively connected to the data verification module and the execution subsystem. When the output of the data verification module is detected to be a consistent verification result, the module outputs the correct traffic violation information to the execution subsystem.
[0025] The adjustment module is communicatively connected to the data verification module and the execution subsystem. When the output of the data verification module is detected to be inconsistent, the module outputs traffic violation misjudgment information and controls the execution subsystem to execute different traffic data processing strategies.
[0026] In some embodiments, the traffic violation misjudgment information includes information on problems with traffic rule standards and information on problems with traffic monitoring algorithms.
[0027] In some embodiments, the execution subsystem includes:
[0028] The traffic violation penalty platform is communicatively connected to the traffic violation penalty module and is used to obtain the correct traffic violation information and generate violation penalty information;
[0029] The rules management platform is communicatively connected to the adjustment module and the wireless communication module, and is used to acquire traffic rule standard problem information and update and adjust the traffic rule information.
[0030] The algorithm management platform is communicatively connected to the adjustment module and the wireless communication module, and is used to acquire traffic monitoring algorithm problem information and to train and adjust the traffic monitoring algorithm.
[0031] Compared with the prior art, the advantages of the present invention are as follows: by integrating the vehicle-end monitoring terminal subsystem, the cloud monitoring subsystem and the execution subsystem into one, a vehicle-cloud integrated intelligent traffic management and monitoring system is constructed, which can perform integrated control and management of the vehicle end, the cloud and the execution platform, accelerate the intelligent transformation of intelligent transportation, and provide comprehensive, timely and accurate supervision and handling of intelligent traffic accidents. Attached Figure Description
[0032] Figure 1 This is a schematic diagram of the structure of an embodiment of the intelligent traffic management and monitoring system integrating vehicle and cloud computing according to the present invention.
[0033] Figure 2 This is a schematic diagram of another embodiment of the intelligent traffic management and monitoring system integrating vehicle and cloud computing according to the present invention. Detailed Implementation
[0034] Referring now to specific embodiments of the invention, examples of which are illustrated in the accompanying drawings. Although the invention will be described in conjunction with specific embodiments, it will be understood that it is not intended to limit the invention to the described embodiments. Rather, it is intended to cover variations, modifications, and equivalents included within the spirit and scope of the invention as defined by the appended claims. It should be noted that the method steps described herein can be implemented by any functional block or functional arrangement, and any functional block or functional arrangement can be implemented as a physical entity or a logical entity, or a combination of both.
[0035] To enable those skilled in the art to better understand the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.
[0036] Note: The examples described below are merely specific examples and are not intended to limit the embodiments of the present invention to the specific steps, values, conditions, data, order, etc. Those skilled in the art can utilize the concept of the present invention to construct more embodiments not mentioned herein by reading this specification.
[0037] See Figure 1 As shown, this embodiment of the invention provides an intelligent traffic management and monitoring system integrating vehicle and cloud computing, comprising:
[0038] The vehicle-side monitoring terminal subsystem is used to acquire traffic image data, acquire traffic rule information and traffic monitoring algorithms output by the execution subsystem, determine whether the traffic image data violates traffic rule requirements, and output the vehicle-side judgment result.
[0039] A cloud-based monitoring subsystem, communicatively connected to the vehicle-side monitoring terminal subsystem, is used to acquire the vehicle-side judgment result, acquire the verification result obtained manually based on the vehicle-side judgment result, and generate control execution instructions based on the verification result; and,
[0040] The execution subsystem is communicatively connected to the vehicle-side monitoring terminal subsystem and the cloud-based monitoring subsystem, and is used to obtain the control execution instructions and execute different traffic data processing strategies.
[0041] Specifically, in this embodiment, the present invention integrates a vehicle-end monitoring terminal subsystem, a cloud-based monitoring subsystem, and an execution subsystem to construct an intelligent traffic management and monitoring system that integrates vehicle and cloud technologies. This system can perform integrated control and management of the vehicle, cloud, and execution platforms, accelerate the intelligent transformation of smart transportation, and provide comprehensive, timely, and accurate monitoring and handling of smart traffic accidents.
[0042] See also Figure 2As shown, the vehicle-side monitoring terminal subsystem includes a monitoring camera, a vehicle-side data storage module communicatively connected to the monitoring camera, a vehicle-side data processing module communicatively connected to the vehicle-side data storage module and the monitoring camera, and a wireless communication module communicatively connected to the vehicle-side data storage module, the vehicle-side data processing module, the cloud monitoring subsystem, and the execution subsystem.
[0043] The vehicle-side data processing module is used to acquire traffic image data output by the monitoring camera, execute traffic rule information and traffic monitoring algorithms output by the subsystem, determine whether the traffic image data violates traffic rule requirements, and output the vehicle-side judgment result to the vehicle-side data storage module.
[0044] The wireless communication module is used to send the vehicle-side judgment result in the vehicle-side data storage module to the cloud monitoring subsystem.
[0045] Specifically, in this embodiment,
[0046] Surveillance cameras are used to acquire raw images and location data – traffic image data.
[0047] The vehicle-mounted data storage module is used to cache raw images and positioning data (low frequency and small fragments are sufficient).
[0048] Traffic monitoring algorithms are used to identify images, such as lane lines and vehicle positions.
[0049] Traffic rule information mainly includes the definition of valuable data from surveillance cameras, such as the definition of 'illegally crossing a solid line'. On the one hand, a solid line is detected, and on the other hand, a car is detected to be positioned exactly on the solid line. When both detection results are met simultaneously, it is a definition of a rule. Traffic rule information stores multiple of the above rules.
[0050] Therefore, the vehicle-side data processing module determines whether the traffic rule information requirements are met, such as being triggered by cutting in front of a solid line, based on the traffic rule information and the recognition results of the traffic monitoring algorithm.
[0051] The vehicle-side data storage module obtains the vehicle-side judgment result, performs data anonymization processing on the vehicle-side judgment result, and then sends it to the cloud monitoring subsystem through the wireless communication module.
[0052] It should be noted that the vehicle-side data processing module can train AI models. The models are based on the content trained on the AI neural network. After a large number of 'violations of crossing solid lines' scenarios have been trained by AI, the model will automatically determine whether it meets the requirements when it encounters similar scenarios again.
[0053] Optionally, the vehicle-side data processing module is used for:
[0054] Target detection and recognition are performed on the traffic image data based on the YOLO V5 algorithm and the mask2former algorithm.
[0055] The system determines whether a target violates traffic rules and outputs the vehicle-side judgment result.
[0056] Specifically, in this embodiment, the main functions of the YOLO V5 algorithm are: (1) to detect the location of the target in the image, and there may be multiple targets in the same image; (2) to detect the size of the target, which is usually a rectangular box that just surrounds the target; (3) to identify and classify the detected targets; therefore, the YOLO V5 algorithm is used for target detection.
[0057] In terms of image semantic segmentation, the mask2former algorithm is used to identify lane lines and vehicle types and positions, transforming unstructured data into structured data.
[0058] Optionally, the cloud monitoring subsystem includes a cloud data storage module that is communicatively connected to the wireless communication module, a data verification module that is communicatively connected to the cloud data storage module, and a cloud data processing module that is communicatively connected to both the data verification module and the execution subsystem.
[0059] The cloud data storage module acquires the vehicle-side judgment result and outputs it to the data verification module;
[0060] The data verification module is used to obtain the vehicle-side judgment result and the verification result of manual verification based on the vehicle-side judgment result;
[0061] The cloud data processing module generates control execution instructions based on the verification results.
[0062] Specifically, in this embodiment, the cloud data storage module can directly display the vehicle-side judgment results on the traffic monitoring screen.
[0063] Optionally, the data verification module is used to,
[0064] Obtain the manual judgment results verified by humans based on the judgment results from the vehicle end;
[0065] When the manual judgment result is found to match the vehicle-side judgment result, a verification consistency result is output.
[0066] When a discrepancy is detected between the manual judgment result and the vehicle-side judgment result, a verification discrepancy result is output.
[0067] Optionally, the cloud data processing module includes:
[0068] The traffic violation penalty module is communicatively connected to the data verification module and the execution subsystem. When the output of the data verification module is detected to be a consistent verification result, the module outputs the correct traffic violation information to the execution subsystem.
[0069] The adjustment module is communicatively connected to the data verification module and the execution subsystem. When the output of the data verification module is detected to be inconsistent, the module outputs traffic violation misjudgment information and controls the execution subsystem to execute different traffic data processing strategies.
[0070] Optionally, the traffic violation misjudgment information includes information on problems with traffic rule standards and information on problems with traffic monitoring algorithms.
[0071] Optionally, the execution subsystem includes:
[0072] The traffic violation penalty platform is communicatively connected to the traffic violation penalty module and is used to obtain the correct traffic violation information and generate violation penalty information;
[0073] The rules management platform is communicatively connected to the adjustment module and the wireless communication module, and is used to acquire traffic rule standard problem information and update and adjust the traffic rule information.
[0074] The algorithm management platform is communicatively connected to the adjustment module and the wireless communication module, and is used to acquire traffic monitoring algorithm problem information and to train and adjust the traffic monitoring algorithm.
[0075] Specifically, in this embodiment, when the cloud data processing module detects that the output of the data verification module is a consistent verification result, it indicates that it has been determined to be a violation or accident, and the violation is entered into the violation penalty platform.
[0076] When the cloud data processing module detects that the output of the data verification module is an inconsistent result, there are two possible problems: either a problem with the traffic rule standard information or a problem with the traffic monitoring algorithm. If it's a problem with the traffic rule standard, the extracted "violation scenario" is not a real violation scenario, indicating a problem with the traffic rule information. In this case, the rule management platform updates and adjusts the traffic rule information. If it's a problem with the traffic monitoring algorithm, the algorithm misperceives the image when converting unstructured data into structured data. For example, it might incorrectly identify a dashed line as a solid line, and when a vehicle crosses the line, it's misjudged as a violation. In this case, the traffic rule information is correct, but the problem lies with the input of the original data. In this case, the algorithm management platform trains and adjusts the traffic monitoring algorithm.
[0077] The specific training and adjustment steps are as follows: the data annotation platform annotates the traffic image data, the AI training platform trains the traffic monitoring algorithm based on the dataset generated by the annotation, and after the algorithm training is completed, it is sent to the vehicle-side monitoring terminal subsystem through the wireless communication module.
[0078] Therefore, the present invention mainly has the following functions:
[0079] 1. By utilizing traffic monitoring algorithms, images of traffic violations and accidents can be automatically uploaded to the cloud platform without requiring excessive driver intervention. Traffic management departments can then link the platform with the violation penalty system to automatically issue traffic penalties; alternatively, it can be linked with traffic police terminal equipment to provide video evidence for accident determination.
[0080] 2. Under compliance requirements, operation and service companies build private clouds for the government and construct a closed-loop data cloud platform that integrates a data collection and management platform, a data processing and visualization platform, a data annotation platform, an AI training platform, and an OTA platform. On the one hand, this provides safe, compliant, and efficient platform support for traffic management; on the other hand, it improves the accuracy of algorithms and reduces manual processing costs through closed-loop iteration of AI algorithms.
[0081] 3. In addition to AI algorithms, the vehicle-mounted surveillance cameras upload data via 4G / 5G TBOX and receive cloud-based scene rules and algorithm upgrades. This not only achieves end-to-end automation but also enables continuous innovation in future scenarios.
[0082] 4. Rules can be comprehensively constructed using time, space, sequence number, and perception algorithms to meet the flexible allocation requirements of monitoring.
[0083] Therefore, the determination of most traffic violation scenarios in this invention comes from AI and rule-based automated judgment, extraction, and uploading, reducing human intervention and safety risks. Data flow utilizes a private cloud, with the pipeline operating under compliance and government intervention ensuring compliance requirements. The vehicle-side adopts a TOB model, such as buses and taxis, ensuring data supervision and high participation. The cloud-based automated data processing, AI annotation, and training capabilities support algorithm iteration and improvement. The algorithm can be deployed via OTA, providing fertile ground for the scalability and innovation of supervision.
[0084] In the description of this invention, it should be noted that the terms "upper," "lower," etc., indicating the orientation or positional relationship are based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Unless otherwise expressly specified and limited, the terms "installed," "connected," and "linked" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication between two elements. For those skilled in the art, the specific meaning of the above terms in this invention can be understood according to the specific circumstances.
[0085] It should be noted that in this invention, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0086] The above description is merely a specific embodiment of the present invention, enabling those skilled in the art to understand or implement the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features of the invention herein.
Claims
1. A vehicle-cloud integrated intelligent traffic management and monitoring system, characterized in that, include: The vehicle-side monitoring terminal subsystem is used to acquire traffic image data, acquire traffic rule information and traffic monitoring algorithms output by the execution subsystem, determine whether the traffic image data violates traffic rule requirements, and output the vehicle-side judgment result. The cloud-based monitoring subsystem is communicatively connected to the vehicle-side monitoring terminal subsystem. It is used to obtain the vehicle-side judgment result, obtain the verification result verified by the human based on the vehicle-side judgment result, and generate control execution instructions based on the verification result. as well as, The execution subsystem is communicatively connected to the vehicle-side monitoring terminal subsystem and the cloud-based monitoring subsystem, and is used to obtain the control execution instructions and execute different traffic data processing strategies. The vehicle-side monitoring terminal subsystem includes a monitoring camera, a vehicle-side data storage module communicatively connected to the monitoring camera, a vehicle-side data processing module communicatively connected to the vehicle-side data storage module and the monitoring camera, and a wireless communication module communicatively connected to the vehicle-side data storage module, the vehicle-side data processing module, the cloud-based monitoring subsystem, and the execution subsystem. The vehicle-side data processing module is used to acquire traffic image data output by the monitoring camera, execute traffic rule information and traffic monitoring algorithms output by the subsystem, determine whether the traffic image data violates traffic rule requirements, and output the vehicle-side judgment result to the vehicle-side data storage module. The wireless communication module is used to send the vehicle-side judgment result in the vehicle-side data storage module to the cloud monitoring subsystem; The cloud monitoring subsystem includes a cloud data storage module that is communicatively connected to the wireless communication module, a data verification module that is communicatively connected to the cloud data storage module, and a cloud data processing module that is communicatively connected to both the data verification module and the execution subsystem. The cloud data storage module acquires the vehicle-side judgment result and outputs it to the data verification module; The data verification module is used to obtain the vehicle-side judgment result and the verification result of manual verification based on the vehicle-side judgment result; The cloud data processing module generates control execution instructions based on the verification results.
2. The intelligent traffic management and monitoring system integrating vehicle and cloud computing as described in claim 1, characterized in that, The vehicle-side data processing module is used for, Target detection and recognition are performed on the traffic image data based on the YOLO V5 algorithm and the mask2former algorithm. The system determines whether a target violates traffic rules and outputs the vehicle-side judgment result.
3. The intelligent traffic management and monitoring system integrating vehicle and cloud computing as described in claim 1, characterized in that, The data verification module is used for, Obtain the manual judgment results verified by humans based on the judgment results from the vehicle end; When the manual judgment result is found to match the vehicle-side judgment result, a verification consistency result is output. When a discrepancy is detected between the manual judgment result and the vehicle-side judgment result, a verification discrepancy result is output.
4. The intelligent traffic management and monitoring system integrating vehicle and cloud computing as described in claim 1, characterized in that, The cloud data processing module includes: The traffic violation penalty module is communicatively connected to the data verification module and the execution subsystem. When the output of the data verification module is detected to be a consistent verification result, the module outputs the correct traffic violation information to the execution subsystem. The adjustment module is communicatively connected to the data verification module and the execution subsystem. When the output of the data verification module is detected to be inconsistent, the module outputs traffic violation misjudgment information and controls the execution subsystem to execute different traffic data processing strategies.
5. The intelligent traffic management and monitoring system integrating vehicle and cloud computing as described in claim 4, characterized in that, The information regarding misjudgments of traffic violations includes information on issues with traffic rule standards and information on issues with traffic monitoring algorithms.
6. The intelligent traffic management and monitoring system integrating vehicle and cloud computing as described in claim 4, characterized in that, The execution subsystem includes: The traffic violation penalty platform is communicatively connected to the traffic violation penalty module and is used to obtain the correct traffic violation information and generate violation penalty information; The rules management platform is communicatively connected to the adjustment module and the wireless communication module, and is used to acquire traffic rule standard problem information and update and adjust the traffic rule information. The algorithm management platform is communicatively connected to the adjustment module and the wireless communication module, and is used to acquire traffic monitoring algorithm problem information and to train and adjust the traffic monitoring algorithm.
Citation Information
Patent Citations
Vehicle-mounted violation real-time feedback system
CN109637150A
Traffic violation real-time flow monitoring method and system based on bus-mounted video
CN115880901A
