Traffic safety equipment centralized control middleware and application method thereof

Abstract

The invention discloses traffic safety equipment centralized control middleware and an application method. The method comprises the following steps: determining a road section and / or a congested intersection with vehicle congestion characteristics based on the traffic safety equipment centralized control middleware; identifying a blocked point, and determining the congestion type of the blocked point; obtaining road use conditions of communities around the related road sections and / or roads inside the social public places; the method comprises the following steps: acquiring traffic operation conditions of road sections associated with congested road sections and / or congested intersections, and formulating related dispersion strategies according to arrangement conditions of traffic safety equipment of each road section and / or each intersection and road use conditions of internal roads of communities and / or social public places around the related road sections; and executing the related grooming strategy. According to the invention, intelligence and automation of the traffic system are realized, and the traffic efficiency is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to intelligent traffic control technology, and in particular to a centralized control middleware for traffic safety equipment and an application method thereof. Background Art

[0002] Traffic safety equipment centralized control middleware is a processing node between the application system and the system application. It uses the basic services provided by the system application to connect the various parts of the application system or different applications on the network, thereby achieving the purpose of resource sharing and function sharing. Its essence is an independent system application service application, located on the operating system of the client server, managing computing resources and network communications.

[0003] At present, due to the large number of traffic safety equipment in urban traffic, such as traffic cameras, traffic signal controllers, lighting equipment and its control system, traffic signs, traffic information transmission equipment and display equipment such as LED variable information signs, all need to exchange information with the traffic center or traffic command center in each area. And because each traffic safety equipment is supplied by different manufacturers, it has different communication protocol interfaces and access methods. In this way, for the traffic center or traffic command center, if it wants to complete the control of traffic safety equipment, it needs to support multiple communication protocol interfaces, and it needs to convert back and forth between its own protocol interface and the protocol interface of each traffic safety equipment, resulting in low communication efficiency. In particular, when the response control of the corresponding traffic safety equipment needs to be urgently processed, the different conversion of the protocol interface and the transmission of large amounts of data packets will cause communication congestion, and the control response of the traffic safety equipment will be very seriously delayed.

[0004] How to coordinate the overall traffic flow and greatly improve the road traffic efficiency is still a technical problem that needs to be solved urgently. Summary of the invention

[0005] In view of this, an embodiment of the present application provides a centralized control middleware for traffic safety equipment, which can at least solve the aforementioned technical problems.

[0006] According to a first aspect of an embodiment of the present application, a traffic safety equipment centralized control middleware is provided, including: The device access subsystem is used to process the relevant messages of the traffic safety equipment, receive the control instructions of the accessed traffic safety equipment, receive the relevant information collected by the traffic safety equipment, and transmit it to the upper-layer application; perform device original protocol analysis, process the acquired original data and forward it to the corresponding port, perform protocol conversion on the instructions issued by the upper-layer application system and transmit them to the traffic safety equipment; The equipment management subsystem is used to input the registration information of traffic safety equipment, collect equipment protocol information and support the transfer and call between protocols, manage the access rights of connected traffic safety equipment, and update and regulate the working status of traffic safety equipment; The application layer interface subsystem is used to provide a unified standard application programming interface API according to the type of equipment, and realize information interaction with each application layer interface in a unified data encapsulation method; The protocol management subsystem is used to define the general abstract interface and the abstract interface for docking various devices. The interface specifies the general functions and extended functions that various devices can support, the specific implementation of the coordination of various abstract interfaces, and supports the automatic connection of multiple protocols, so that the core operating functions of the system and the protocols of various devices are connected with low coupling soft connection; The system management subsystem is used to provide configuration and management related to system operation, access and use, and at least provides functions such as device authorization mechanism, user management, permission management, and dictionary management; The control subsystem is electrically connected to the device access subsystem, the device management subsystem, the application layer interface subsystem, the protocol management subsystem and the system management subsystem respectively; it is used to obtain image information collected by the traffic safety equipment of the access middleware, identify specific objects in the traffic image information, and determine road sections and / or congested intersections with vehicle congestion characteristics based on the identification results; identify congestion points of congested sections and / or congested intersections, determine the congestion types of the congestion points, and analyze the congestion causes of congested sections and / or congested intersections; determine the location distribution information of congested sections and / or congested intersections and congestion points, and obtain the layout of traffic safety equipment on congested sections and / or congested intersections, the layout of traffic safety equipment on sections associated with congested sections and / or congested intersections, and obtain the surrounding communities and / or communities of the relevant sections. The method comprises the following steps: obtaining the road usage status of the internal roads of the congested road sections and / or congested intersections, and formulating relevant traffic diversion strategies according to the arrangement of the traffic safety devices of each road section and / or intersection, and the road usage status of the internal roads of the communities and / or social public places around the relevant road sections; determining the traffic safety devices involved in the diversion strategies and requiring the adjustment of their working status; generating a status adjustment instruction based on the diversion strategies, and sending the status adjustment instruction to the traffic safety devices to be adjusted through the device access subsystem, so that the traffic safety devices to be adjusted control their own status based on the received status adjustment instruction.

[0007] In some exemplary embodiments, the control subsystem is further used to simulate and execute the formulated traffic diversion strategy, determine whether there is a new congestion situation in traffic diversion, adjust the traffic diversion strategy according to the simulation results, and use the adjusted traffic diversion strategy as the final traffic diversion strategy; Based on the adjusted traffic diversion strategy, at least one of the following adjustment plans is implemented: control the traffic signal controllers at intersections and / or road sections to change the traffic instructions of lanes or intersections; control the tidal lane control equipment to adjust the usage ratio of tidal lanes in roads; control the closed road section isolation belt opening control equipment to open some of the closed road section isolation belt openings to enable vehicles to turn around or turn left; control the parking lot entrance and exit control equipment to change the control location of the parking lot entrance or exit, and open or close the entrance or exit of some parking lots; control the traffic signs to display the information that the internal roads of communities and / or public places are available for use, or notify the community and / or public places of the information that the internal roads are available for use through broadcasts set up around the roads.

[0008] In some exemplary embodiments, the formulating of relevant grooming strategies includes: Obtain navigation purposes and road planning information of vehicles on congested road sections, collect traffic volume and direction, and predict traffic volume and direction of road sections and / or intersections based on historical traffic information of the road section, and determine traffic information of each road section; According to the type of congestion point, the current congestion status of vehicles on the road, the traffic flow and speed of other sections related to the road section, the traffic flow direction and traffic volume of the parking lot related to the road section, determine whether there are lane resources and / or internal road resources that can be tidally adjusted, and determine the traffic intervention plan for each congested section; Make predictions for each traffic intervention plan to determine whether it will cause new congestion, and predict how two or more adjacent traffic intervention plans will affect each other. Adjust the plans based on two or more traffic intervention plans, and superimpose the intervention plans for each road section as the determined traffic diversion strategy.

[0009] In some exemplary embodiments, the device access subsystem is further configured to: Configure the communication working status monitoring port for the device, supporting at least TCP and UDP port monitoring; determine the monitoring port number and protocol type, bind the server port; feedback the port monitoring results to the device; receiving communication data actively sent by the device, determining a corresponding protocol for the device according to the system configuration, and parsing the received communication data into business data; and Receives self-dispatching from the upper-layer business system or service system, sends corresponding control or query instructions to the device, parses them into protocol instruction data supported by the device and sends them to the device.

[0010] In some exemplary embodiments, the device access subsystem is further configured to: Sending a query request for the operation status to the traffic signal controller and detecting the network status between the backend server and the traffic signal controller; Collect the running status of the device, and send a control instruction to the device based on the running status of the device. The control instruction carries the running strategy, so that the device runs according to the strategy; Send configuration information to the device, instructing the device to run basic configuration based on the configuration information.

[0011] In some exemplary embodiments, the device management subsystem is further configured to: Provides a device management interface for background management, supports adding and entering devices based on the management interface, and determines the communication protocol and working mode for the devices; Delete the device based on the management interface, or modify the communication protocol and working mode of the device; A query request for a device is received based on the management interface, and the queried matching devices are presented through the management interface.

[0012] In some exemplary embodiments, the application layer interface subsystem is further used to: Data requests are made based on HTTP POST, and UTF-8 encoding format support is provided for data; the message format of request and response is JSON; Receive query requests for relevant device data sent by the centralized control middleware, or send control instructions to the device, trigger the centralized control middleware to receive the control instructions and perform relevant operations according to the control instruction type, and receive the operation results; After receiving a business data upload request, it is broadcast externally through the message queue, and each application system automatically subscribes to the data that needs attention; when it is determined that the data to be broadcast is sensitive data or important data, the data to be broadcast is directly pushed to the set sensitive data or important data recipient.

[0013] In some exemplary embodiments, the system management subsystem is further configured to: Run the license authorization mechanism to implement single hardware restriction management and control on the system deployed to the server. Copying or moving the system will invalidate the license. Provides the creation of system administrators, supports the management of system users, and allocates fixed permissions between different users; Provide role management to ensure the security of system data while satisfying users' use of system resources.

[0014] In some exemplary embodiments, the protocol management subsystem is further configured to: In view of the different protocol types caused by differences in device types, device manufacturers, and models in access devices, the protocols of various types of devices are uniformly managed and registered by category.

[0015] According to a second aspect of an embodiment of the present application, there is provided an application method of a centralized control middleware for traffic safety equipment, comprising: Acquire traffic image information collected by traffic safety equipment, identify specific objects in the traffic image information, and determine road sections and / or congested intersections with vehicle congestion characteristics based on the identification results; Identify congested road sections and / or congested intersections, determine the congestion type of the congestion point, and analyze the cause of congestion in the congested road sections and / or congested intersections; Determine the location distribution information of congested road sections and / or congested intersections and congestion points, and obtain the layout of traffic safety equipment on congested road sections and / or congested intersections, the layout of traffic safety equipment on sections associated with congested road sections and / or congested intersections, and obtain the road use conditions of internal roads in communities and / or social public places surrounding the relevant road sections; the traffic safety equipment at least includes traffic signs, traffic signal controllers, tidal lane control equipment, closed road section isolation belt opening control equipment, and parking lot entrance and exit control equipment; Obtain the traffic operation status of the road sections associated with the congested road sections and / or congested intersections, and formulate relevant traffic diversion strategies based on the layout of the traffic safety equipment at each road section and / or intersection, as well as the road usage status of the internal roads of the communities and / or social public places surrounding the relevant road sections; Simulate and execute the formulated traffic diversion strategy to determine whether there is a new congestion in traffic diversion, adjust the traffic diversion strategy according to the simulation results, and use the adjusted traffic diversion strategy as the final traffic diversion strategy; Based on the adjusted traffic diversion strategy, at least one of the following adjustment plans is implemented: control the traffic signal controllers at intersections and / or road sections to change the traffic instructions of lanes or intersections; control the tidal lane control equipment to adjust the usage ratio of tidal lanes in roads; control the closed road section isolation belt opening control equipment to open some of the closed road section isolation belt openings to enable vehicles to turn around or turn left; control the parking lot entrance and exit control equipment to change the control location of the parking lot entrance or exit, and open or close the entrance or exit of some parking lots; control the traffic signs to display the information that the internal roads of communities and / or public places are available for use, or notify the community and / or public places of the information that the internal roads are available for use through broadcasts set up around the roads.

[0016] In some exemplary embodiments, the formulating of relevant grooming strategies includes: Obtain navigation purposes and road planning information of vehicles on congested road sections, collect traffic volume and direction, and predict traffic volume and direction of road sections and / or intersections based on historical traffic information of the road section, and determine traffic information of each road section; According to the type of congestion point, the current congestion status of vehicles on the road, the traffic flow and speed of other sections related to the road section, the traffic flow direction and traffic volume of the parking lot related to the road section, determine whether there are lane resources and / or internal road resources that can be tidally adjusted, and determine the traffic intervention plan for each congested section; Make predictions for each traffic intervention plan to determine whether it will cause new congestion, and predict how two or more adjacent traffic intervention plans will affect each other. Adjust the plans based on two or more traffic intervention plans, and superimpose the intervention plans for each road section as the determined traffic diversion strategy.

[0017] In some exemplary embodiments, the formulating of relevant grooming strategies includes: In response to the presence of an accident vehicle in the lane in the traffic image recognition result, obtaining position information of the accident vehicle; Searching for a hoisting device that is less than a set distance from the accident vehicle based on the location information; the hoisting device is arranged on a road protection belt or a road isolation belt; A driving instruction is sent to the lifting device to move the lifting device along the road protection belt or road isolation belt to the location of the accident vehicle, and the lifting arm of the lifting device is driven to lift the accident vehicle, so that the lane where the accident vehicle is located can resume its traffic capacity.

[0018] The centralized control middleware and its application method of the embodiment of the present application can identify the congested sections based on the relevant traffic image information collected by the traffic safety equipment, set the corresponding diversion strategy for the congested sections, and adjust the timing and priority of the traffic lights and the tidal lanes by controlling the traffic safety equipment, thereby reducing congestion and improving traffic efficiency. The embodiment of the present application realizes the intelligence and automation of the traffic system. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art description. Obviously, the drawings described below are some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 A schematic diagram showing the structural composition of the centralized control middleware for traffic safety equipment in an embodiment of the present application is shown; Figure 2 Another schematic diagram of the structure of the centralized control middleware for traffic safety equipment according to an embodiment of the present application is shown; Figure 3 A schematic diagram of implementing a grooming strategy based on control middleware in an embodiment of the present application is shown; Figure 4 A schematic diagram of the implementation structure of the programmable traffic safety equipment centralized control middleware according to an embodiment of the present application is shown; Figure 5 A schematic diagram of the application method flow of the centralized control middleware for traffic safety equipment according to an embodiment of the present application is shown; Figure 6 A schematic diagram of the structure of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0021] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0022] The essence of the technical solution of the embodiment of the present application is explained in detail below with reference to the accompanying drawings.

[0023] Figure 1 The schematic diagram of the structure of the centralized control middleware of the traffic safety equipment of the embodiment of the present application is shown as follows: Figure 1 As shown, the centralized control middleware of traffic safety equipment in the embodiment of the present application is a programmable centralized control middleware of traffic safety equipment, and the middleware includes: The device access subsystem is used to process messages, control instructions of accessed devices, and upload and download information collected by devices; parse the original protocol of the device, process and forward the acquired original data, perform protocol conversion on the instructions issued by the upper-level application system and transmit them to the device; the device access subsystem mainly provides access support for various types of traffic safety equipment and provides corresponding access interfaces for various types of traffic safety equipment.

[0024] The equipment management subsystem is used for equipment information entry, equipment protocol information flow, equipment access permission management, and equipment status management. The equipment management subsystem is mainly used for the management of traffic safety equipment. For newly added traffic safety equipment, its equipment function, equipment location information, communication protocol ports supported by the equipment and other information need to be entered through the equipment management subsystem, and the equipment management subsystem manages the access permission and equipment status of the traffic safety equipment.

[0025] The application layer interface subsystem is used to provide a unified standard application programming interface API according to the device type. The API can access the upper layer application and achieve docking with the upper layer application by receiving the call request of the upper layer application.

[0026] The protocol management subsystem is used to define the overall abstract interface and the abstract interface for docking various types of equipment. The interface specifies the common functions and extended functions that various types of equipment can support, the specific implementation of the coordination of various abstract interfaces, and supports automatic connection of multiple protocols, so that the core operating functions of the system and the protocols of various devices are connected with low coupling soft connection.

[0027] The system management subsystem is used to provide various system operation, access and use related configuration and management tasks, and at least provides the functions of device authorization mechanism, user management, permission management, and dictionary management.

[0028] The control subsystem is electrically connected to the device access subsystem, the device management subsystem, the application layer interface subsystem, the protocol management subsystem and the system management subsystem respectively; it is used to obtain image information collected by the traffic safety equipment of the access middleware, identify specific objects in the traffic image information, and determine road sections and / or congested intersections with vehicle congestion characteristics based on the identification results; identify congestion points of congested sections and / or congested intersections, determine the congestion types of the congestion points, and analyze the congestion causes of congested sections and / or congested intersections; determine the location distribution information of congested sections and / or congested intersections and congestion points, and obtain the layout of traffic safety equipment on congested sections and / or congested intersections, the layout of traffic safety equipment on sections associated with congested sections and / or congested intersections, and obtain the surrounding communities and / or communities of the relevant sections. The method comprises the following steps: obtaining the road usage status of the internal roads of the congested road sections and / or congested intersections, and formulating relevant traffic diversion strategies according to the arrangement of the traffic safety devices of each road section and / or intersection, and the road usage status of the internal roads of the communities and / or social public places around the relevant road sections; determining the traffic safety devices involved in the diversion strategies and requiring the adjustment of their working status; generating a status adjustment instruction based on the diversion strategies, and sending the status adjustment instruction to the traffic safety devices to be adjusted through the device access subsystem, so that the traffic safety devices to be adjusted control their own status based on the received status adjustment instruction.

[0029] Figure 2 Another schematic diagram of the structure of the centralized control middleware of the traffic safety equipment of the embodiment of the present application is shown. Figure 2As shown, the specific functions of each system in the centralized control middleware of the traffic safety equipment of the embodiment of the present application are shown. Specifically, the main function of the device access subsystem is message processing, processing the upload and download of device control instructions and device collection information; device original protocol parsing, obtaining the subsequent data forwarding processing of the original data user, and performing protocol conversion on the instructions issued by the upper-level application system and sending them to the device. As the communication server, the listening port is configured according to the communication working status of the system and the corresponding device, and TCP and UPD port listening can be supported. Different protocols (different device types) can use different communication ports.

[0030] The device access subsystem can provide the port number and protocol type to be monitored, and needs to bind the specified server port when necessary. The device access subsystem determines the success or failure of the monitoring based on the results of the port monitoring, and according to the requirements of different device communication protocols, it can actively send a connection instruction to the device after opening the port monitoring.

[0031] The device access subsystem passively receives the communication data sent by the device, parses the received information into business data according to the corresponding protocol of the system configuration device, and then distributes and performs other related processing according to the type of business data.

[0032] The device access subsystem receives control or query instructions sent to the device by the upper-layer business system or the system self-scheduling, parses them into protocol instruction data supported by the device and sends them to the device. It reads the return result of the instruction according to the protocol rules of the device and returns the result to the source of the instruction.

[0033] The device access subsystem also supports the unified communication and control protocol of traffic safety equipment. The traffic safety equipment mainly includes traffic signal controllers, which support the following related functions of the middleware.

[0034] Equipment status query: query the operating status of the traffic signal controller and synchronously detect the network status between the service and the equipment; Equipment operation data query: collect the operation status of equipment status, such as current display signal, policy rules, etc.; Device control: control device display signal; Policy delivery: Delivery of device operation policies to enable the device to execute the policies.

[0035] Device configuration information: Send basic configuration information about the device, such as device time calibration, device physical location configuration, etc.

[0036] It supports querying the current operating status of traffic signs, querying the current display content and playlist of traffic signs, and sending playlists and configuration information for configuring extended functions such as device time calibration.

[0037] The main functions of the device management subsystem are device information entry, device protocol information flow, device access rights management, and device status management. The key considerations in system design are: stability of information flow, timeliness of information flow, and high concurrent calls of device interfaces. The background management interface adopts a browser / server (BS) structure and supports user rights management.

[0038] In the device management interface of the background management, click Add Device, enter the device name, type, communication parameters, location parameters, select the corresponding protocol and working mode, and save the operation to the system.

[0039] In the device management interface, you can enter the main parameters of the device, including: name, number, device type, communication parameters, location parameters, corresponding protocol, and working mode.

[0040] In the device management interface of the background management, select the device to be modified and modify the device properties.

[0041] In the device management interface of the background management, select the device to be deleted and delete the device. During the deletion operation, the system will automatically pop up a second confirmation to prevent misoperation.

[0042] In the device management interface of the background management, quick query and advanced query are supported. Quick query can be performed on important attributes such as device name, location, type, etc.; advanced query can configure multiple query conditions to query the device under complex conditions.

[0043] The flow configuration is performed according to multiple conditions such as device type and location. For example, the collection results of a meteorological detector are fixedly sent to a designated business module.

[0044] The device status is collected according to the device's operating mode and updated to the device list.

[0045] Configure and manage device permissions, such as the instructions that can be executed by the device and the application system's access to certain (certain types of) device status and collected information.

[0046] The application layer interface subsystem can provide a unified standard application programming interface (API) to the upper layer according to the type of equipment. The data transmission provided by the application layer interface subsystem adopts the Hypertext Transfer Protocol Secure (HTTPS) protocol standard, and performs data requests based on the HTTP POST method. The encoding format is unified as UTF-8 (8-bit Universal Character Set / Unicode Transformation Format) encoding, and the request and response format is JSON.

[0047] The unified standard application programming interface will be gradually refined as the system development progresses, and the same type of equipment will be refined into a unified interface function. In the future, according to the requirements of data transmission and data application, it will support passive data query and active data sending; The application system uses HTTP POST to query the centralized control middleware for relevant device data or send control instructions to the device. The application system acts as the initiator of the operation, and the centralized control middleware passively receives the instructions and performs relevant operations according to the instruction type. Finally, the operation results are fed back to the application system.

[0048] The centralized control middleware passively receives the business data uploaded by the device, broadcasts it to the outside through the message queue, and each application system automatically subscribes to the data of interest. For sensitive and important data, it can be sent to the designated recipient by direct push.

[0049] The protocol management subsystem is designed and developed for access devices. Different manufacturers and models of the same type of devices can have different protocols. The protocol management system is used to uniformly manage and automatically register various types of device protocols by category. The embodiment of the present application adopts a dynamic plug-in and drive-based design of an abstract device interface to achieve automatic scanning and automatic registration of various protocols.

[0050] Specifically, the embodiment of the present application sets up a general abstract interface and an abstract interface for docking various types of devices. The interface specifies the general functions and extended functions that various types of devices can support. The coordination between various abstract interfaces can be realized on the basis of the interface, which is convenient for the automatic connection of multiple protocols during system operation, and makes the system core operation function and various types of device protocols low-coupled and soft-connected, so that the protocol can be designed and developed separately based on the interface, which greatly facilitates the system expansion. The protocol is specifically deregistered from the system by removal, deletion, invalidation, etc.

[0051] The system manages the configuration and management of the operation, access and use of the subsystem, mainly including authorization mechanism, user management, permission management, dictionary management and other functions.

[0052] The system runs a license authorization mechanism that imposes a single hardware restriction on the system deployed to the customer's server. Copying or moving the system will cause the license to become invalid.

[0053] It is used by system administrators to create and manage users who use the system and to assign fixed permissions between different users.

[0054] Role management is the premise for users to operate the system. Users can only perform operations related to permissions if they have roles. Through role management, the security of system data is guaranteed while satisfying users' use of system resources. The system sets up a permission management module to set permissions for users. After the system administrator logs in to the system, he or she can grant users corresponding permissions through the role management module. Role authorization is the process of assigning specific roles to users created by the system administrator. The system administrator can maintain the authorization function of the role.

[0055] Centrally manage system configuration dictionaries.

[0056] Dictionary category maintenance: such as surveillance camera data, binocular passenger flow camera data, variable information sign data, vehicle type, etc. Others can be dynamically defined and maintained.

[0057] The requirements for time characteristics are as follows: Response time: mainly refers to the total time it takes for a user to log in to the system and use the page from sending a request to receiving a response.

[0058] The response time for general query services is less than 1 second. Queries directly to devices are limited by the time it takes for the device to respond. The update processing time for complex business shall not exceed 2s; The static page response time is less than 500 milliseconds.

[0059] In the embodiment of the present application, the local full data backup is performed at least once a day, and the backup medium needs to be stored off-site. The backup period can be set according to actual needs, and can also be set to 2 or 3 times a day. As an example, a disaster recovery system for data storage can also be set to provide a remote data backup function, and use the communication network to regularly transfer key data in batches to a disaster recovery system at a remote backup site.

[0060] Dual-machine, dual-line redundant design is implemented for core switching equipment, external access links, and system servers to ensure that the needs of uninterrupted system operation are met in terms of network structure and hardware configuration.

[0061] The system interface adapts and converts the access data of the front-end device through the published standardized protocol, and provides a consistent communication protocol for the business application system based on Http (mainly POST) communication.

[0062] like Figure 1 As shown, the control subsystem of the embodiment of the present application can directly match images in the congestion and accident model image library based on the collected images to determine the similarity between two or more images, and determine whether the image content in the image to be identified is congestion or accident through the image similarity. Specifically, the collected image information is input into the congestion and accident model image library, and the same or similar feature points or feature point areas are identified between multiple images. The similarity between the images is finally determined by analyzing the similarity and consistency of the corresponding relationship between the specific content, features, structure, relationship, texture and grayscale of the images. Taking grayscale matching as an example, by dividing the image into two-dimensional signals, the similarity between the images is determined by similarity measurement functions such as covariance function, difference absolute value and the like. The embodiment of the present application adopts a normalized grayscale matching method to determine the matching degree between images, and the best matching image is found by comparing the grayscale matrix of the image window pixel by pixel, and the best matching image is used as the matching result. Based on the matching result, it is determined whether the image content of the current collected image is congestion or accident. On the basis of grayscale matching, the embodiment of the present application determines the similarity between multiple images by extracting feature points of multiple images, or feature lines and feature point regions formed by feature points, etc., and adopts the Scale Invariant Feature Transformation (SIFT) local feature detection algorithm. When the difference between the similarity determined by grayscale and the similarity determined by feature points is large, the similarity determined by feature points shall prevail.

[0063] As an example, a Normalized Cross-Correlation (NCC) matching algorithm may also be used to determine the similarity between images.

[0064] The control subsystem identifies the congested road section and / or the congested intersection's congested points, determines the congestion type of the congested points, and analyzes the congestion causes of the congested road section and / or the congested intersection.

[0065] In the embodiment of the present application, the control subsystem determines the congested road section, or congested intersection, or accident road section, or accident intersection, etc. through the above-mentioned image recognition results, and identifies the specific congestion point based on the congested road section or intersection. The congestion point can be a congestion point formed by a certain lane or certain lanes, or a congestion point can also be a congested intersection, etc. Congestion points are often the main cause of road congestion, such as lane narrowing or lane reduction caused by vehicle accidents, lane occupation caused by road construction, etc. By determining the congestion point, it is more conducive to formulating road unblocking strategies to solve road congestion in a more targeted manner. Taking the congested road section caused by intersection congestion as an example, when it is determined that the intersection congestion point causes congestion in a certain direction of the road section, the release time of the traffic signal controller corresponding to the congested road section can be extended, and the vehicles on the road section are prohibited from turning left, right, and turning around, so as to achieve the relief of road congestion caused by the intersection congestion point.

[0066] Determine the location distribution information of congested sections and / or congested intersections and congestion points, and obtain the layout of traffic safety equipment on congested sections and / or congested intersections, the layout of traffic safety equipment on sections associated with congested sections and / or congested intersections, and obtain the road use conditions of the inner roads of communities and / or social public places around the relevant sections. Traffic safety equipment includes at least traffic signs, traffic signal controllers, tidal lane control equipment, closed section isolation belt opening control equipment, and parking lot entrance and exit control equipment.

[0067] In the embodiment of the present application, after the congested road section and the congested intersection are determined by the electronic map, the correlation between the congested road section and the congested intersection is determined. For example, when the distance of some congested road sections is less than the preset distance, it is determined as a congested road section. When the road sections are parallel to the congested road section and the traffic direction is consistent, and the road sections are adjacent to each other, it is determined as a congestion-related road section. The congested road section is located on a longer road, the congested road sections are all located in the same vehicle flow direction, and the congested road sections are formed with the intersection as the congestion point. The current congestion situation is determined, and the congested intersection and the congested road section are congestion-related road sections, and the congested road sections between each interval are also congestion-related road sections. In the embodiment of the present application, after the congested road section and the congested intersection are determined, it is also necessary to determine the traffic situation of the road section related to the congested road section or the congested intersection, that is, determine the non-congested road section or non-congested intersection related to the congested road section, and the non-congested road section or non-congested intersection related to the congested intersection. After determining the congested road sections, congested intersections and their related road sections or intersections, the control subsystem needs to further determine the layout of the traffic safety equipment of these congested road sections, congested intersections, and the associated non-congested road sections or non-congested intersections. For example, the configuration of the signal lights at the lanes or intersections, and whether the road is equipped with relevant control equipment for tidal lanes or borrowed lanes that can change the driving direction of the lanes. In the embodiment of the present application, after obtaining the layout of the traffic safety equipment of the congested road sections, congested intersections, and the associated non-congested road sections or non-congested intersections, a diversion strategy can be formulated according to the layout of the traffic safety equipment. For example, when the intersection is congested, if the road is not equipped with a traffic signal controller for the lane, the red light at the congested intersection can be kept on to restrict the left turn and straight-ahead traffic of motor vehicles. For example, vehicles on the intersection road with more serious congestion can be allowed to pass, so that the congestion on the intersection road can be alleviated. If some roads are equipped with tidal lane regulating devices, when formulating the diversion strategy, it is possible to consider turning on the tidal function of some lanes by controlling the regulating devices to improve the operation of vehicles in the congested lanes. In the embodiment of the present application, it is necessary to obtain the conditions of the traffic safety equipment installed in the lanes or intersections in order to formulate the diversion strategy based on the traffic safety equipment to achieve the relief of the overall congestion of the congested section or intersection.

[0068] In the embodiments of the present application, it is necessary to fully consider the installation of traffic safety equipment to comprehensively determine the corresponding diversion strategy to improve and alleviate the traffic congestion in certain areas or certain key sections. According to the actual installation distribution of traffic safety equipment, the embodiments of the present application can formulate a more reasonable diversion strategy according to local conditions, so that the traffic congestion phenomenon is greatly improved.

[0069] As an example, the traffic safety equipment can also be a lifting device installed on a closed road or a road with a small number of lanes. The lifting device can be installed on the dividing line or dividing strip of a two-way tidal lane. It has the function of moving along the dividing line or dividing strip through a sliding support device, a lifting rope, etc., so that when a faulty vehicle is determined, the faulty vehicle can be lifted so that the faulty vehicle does not affect the passage of vehicles in the lane. All traffic safety equipment in the embodiments of the present application are provided with a control unit or a control machine, so that it can be connected to the control subsystem through the device access subsystem. The control subsystem can send corresponding control instructions to each corresponding traffic safety device through the device access subsystem, such as executing the light color change of the traffic light according to the control instruction, realizing the allocation of the lane signal light, the tidal lane allocation of the aforementioned tidal lane actuator, and the opening and closing control of the U-turn prohibition baffle on the lane dividing strip in the closed lane, so as to realize the formulation of the corresponding diversion strategy.

[0070] The control subsystem obtains the traffic operation conditions of the sections associated with the congested sections and / or congested intersections, and formulates relevant traffic diversion strategies based on the layout of the traffic safety equipment on each section and / or intersection, as well as the road usage conditions of the communities and / or social public roads on the relevant sections.

[0071] Figure 3 A schematic diagram of implementing a grooming strategy based on control middleware in an embodiment of the present application is shown. Figure 3 As shown, the road and its traffic conditions are shown, and the arrows in the figure indicate the direction of traffic flow. The control subsystem determines that sections A and H are congested based on image recognition and other means, while sections B and K are running normally. The traffic signal control machine F at the intersection can be controlled to keep the red light on in the straight direction, restricting vehicles on section A from going straight, so that the congestion on section H can be relieved. The traffic signal control machine F on section A can be operated normally after the congestion on section H is effectively relieved. At the same time, when formulating the diversion strategy, the embodiment of the present application can also be based on Figure 3 In the case shown, the traffic signal controller F at the intersection is controlled to keep the red light in the straight direction on, and only vehicles in section A are allowed to turn right, etc. The above is only an example of a congestion model. Those skilled in the art should understand that a corresponding congestion model can be constructed according to different road section distribution conditions and congestion conditions, and a corresponding diversion strategy can be formulated based on the congestion model as a reference for the formulation of the diversion strategy.

[0072] Figure 3The diversion strategies formulated based on congested sections are only examples. The embodiments of the present application can be based on neural network technology, by establishing a traffic congestion model by combining various congested sections and classic layout schemes of traffic safety equipment, and formulating reasonable diversion strategies for the corresponding congestion models, and associating the congestion model with the diversion strategies. In this way, based on traffic congestion image recognition, the congestion scene in the congestion image is matched with the congestion model, and the corresponding diversion strategy is determined according to the matching results.

[0073] As an example, a machine learning method using template matching such as support vector machine (SVM) and artificial neural network (ANN) can be used to match the congestion scene in the congestion image with the congestion model. Among them, SVM divides different categories of congestion data by finding the optimal hyperplane, while ANN learns and recognizes the congestion features in the image by simulating the connection method of human brain neurons. The machine learning method can handle more complex facial feature changes and improve the accuracy and robustness of recognition. Since SVM and ANN are both mature neural network technologies, the embodiments of this application are not intended to protect the specific algorithm logic in the neural network, so the matching details will not be repeated.

[0074] In the embodiment of the present application, the control subsystem also determines whether there is a new congestion in the traffic diversion based on the diversion strategy formulated by the simulation execution, adjusts the diversion strategy according to the simulation results, and uses the adjusted diversion strategy as the final diversion strategy. According to the diversion strategy, the control subsystem simulates the vehicle driving conditions of the relevant road section in the next 5 minutes or 10 minutes, and determines whether the diversion strategy will cause new serious congestion according to the vehicle driving conditions in the next 10 minutes, so as to determine the rationality of the diversion strategy. Since the traffic diversion strategy may be formulated only based on certain congested sections, and does not comprehensively consider the traffic operation conditions of the entire traffic control area, it is necessary to verify the traffic operation conditions according to the diversion strategy to determine the rationality of the diversion strategy. Of course, since the control subsystem of the embodiment of the present application formulates the diversion strategy in real time according to the image acquisition situation, the diversion strategy can also be formulated after determining the new congested section. Through the reasonable preview of the diversion strategy, the embodiment of the present application can timely readjust the diversion strategy according to the preview results, so that the final formulated diversion strategy is more reasonable.

[0075] As an example, the embodiment of the present application uses a neural network prediction model to preview the grooming strategy. The construction of the neural network prediction model includes an input layer, a hidden layer, and an output layer. It uses known sample data and n attributes to predict an unknown attribute. The implementation principle is that a neural network with one or more hidden layers and a non-polynomial activation function can uniformly approximate any continuous function on a compact set, where any open cover has a special set of points with finite subcovers. The training neural network prediction model requires the use of a training data set, and through repeated training, the neural network can gradually adapt to the features in the data set. During the training process, the weights and biases of the neural network will be continuously adjusted to minimize the error between the predicted results and the actual results. The training process can be optimized using optimization algorithms such as gradient descent and back propagation algorithms. After the training is completed, the neural network prediction model can receive new input data for prediction. The input data is processed adaptively by the model and the prediction result is output.

[0076] Based on the adjusted traffic diversion strategy, the control subsystem executes at least one of the following adjustment schemes: controlling the traffic signal controllers on the driving lanes at the intersections and / or road sections to change the traffic instructions of the lanes or intersections; driving the guardrails in the tidal lanes to adjust the usage ratio of the tidal lanes in the roads; controlling the opening control equipment of the isolation belts of the closed sections to open the openings of some isolation belts of the closed sections so that vehicles can turn around or turn left; controlling the entrance and exit control equipment of the parking lot to change the location of the entrance or exit of the parking lot, and opening or closing the entrance or exit of some parking lots; controlling the traffic signboards to display the information on the use of internal roads in the community and / or social public places, or notifying the community and / or social public places of the information on the use of internal roads through broadcasts set up around the roads.

[0077] Based on the diversion strategy, the traffic safety equipment to be regulated involved in the diversion strategy is controlled to determine the execution of the diversion strategy. The embodiment of the present application is not limited to the aforementioned execution, and can also be flexibly adjusted according to the addition and removal of traffic safety equipment. For non-regulatable traffic safety equipment, it is necessary to promptly know the current operating status of the traffic safety equipment in order to formulate a new diversion strategy.

[0078] In the embodiment of the present application, the control subsystem can also dynamically adjust the diversion strategy based on the specific vehicle driving conditions when formulating the relevant diversion strategy. Specifically, the navigation purpose and road planning information of the vehicles related to the congested road section are obtained, the traffic flow and direction are collected, and the traffic flow and direction of the road section and / or intersection are predicted based on the historical traffic information of the road section, and the traffic information of each road section is determined; according to the type of congestion point, the current congestion status of vehicles on the road, the traffic flow and speed of other sections related to the road section, the traffic flow direction and traffic flow of the parking lot related to the road section, it is determined whether there are lane resources and / or available internal road resources that can be tidally adjusted, and a traffic intervention plan is determined for each congested road section; each traffic intervention plan is predicted to determine whether it will cause new congestion, and the mutual influence between two or more adjacent traffic intervention plans is predicted, and the plan is adjusted based on two or more traffic intervention plans, and the intervention plan of each road section is superimposed as the determined diversion strategy.

[0079] In the embodiment of the present application, the mutual influence between traffic intervention plans can be predicted by the aforementioned neural network prediction model. Since the neural network prediction is not a protection technology point of the embodiment of the present application, but only a specific technical means adopted, the prediction details will not be repeated here.

[0080] Figure 4 The schematic diagram of the implementation structure of the programmable traffic safety equipment centralized control middleware of the embodiment of the present application is shown as follows: Figure 4 As shown, the programmable traffic safety equipment centralized control middleware of the embodiment of the present application includes a northbound interface, a business support layer, a southbound interface, a communication layer and an intelligent perception layer, and the connection relationship thereof is as follows Figure 2 As shown. It can be implemented through a unified API interface. The northbound interface is connected to various upper-level application systems. When the application system queries data through the API interface, it queries and obtains data through HTTP POST and HTTP GET. As an example, an RJ45 network interface can be set on the controller of the embodiment of the present application to implement the API interface in the present application. When querying data, for the corresponding data in different traffic safety devices, message management is performed through message queues to achieve corresponding data transmission.

[0081] The business support layer supports the functions of data storage, interface definition, authorization management, device configuration, message queue management and digital dictionary. It realizes the business support function through hardware such as CPU and memory, and through the business applications installed in the memory. It realizes the business support function by calling the business applications in the memory through the CPU and connecting the corresponding interface units.

[0082] The southbound interface supports the functions of port monitoring, data processing, instruction processing, device addressing, protocol registration and protocol deregistration. The southbound interface can be a virtual interface, which is mainly realized by the support of application software and electronic circuits in the chip.

[0083] The communication layer is mainly realized by installing communication protocols such as TCP, UDP and HTTP and physical electrical conduction between network communication interfaces. Specifically, by installing communication protocols such as TCP, UDP and HTTP on the processor, the programmable traffic safety equipment centralized control middleware of the embodiment of the present application is provided with corresponding optical fiber communication interfaces, wireless communication antenna systems such as 4G, 5G antennas or wired network interface RJ45 ports, etc. to realize the relevant functions of the communication layer. In the embodiment of the present application, the communication layer uses the network port, antenna system port, and calls the communication protocol through the processor, and executes the operation logic of the communication protocol through the etching circuit in the processor, etc. to realize the corresponding functions of the communication layer.

[0084] The intelligent perception layer is mainly connected to various devices in the centralized control middleware of the traffic safety equipment of the embodiment of the present application, such as traffic information controllers, LED variable information signs, traffic radars, traffic volume detection equipment, and intelligent boxes or intelligent cabinets for controlling traffic safety equipment, etc. It is connected to various types of traffic safety equipment through the connection ports provided by the device access subsystem of the embodiment of the present application. Of course, as an implementation method, these traffic safety equipment can also be physically connected through a remote network interface such as an antenna system.

[0085] The centralized control middleware of the traffic safety equipment in the embodiment of the present application has the ability to interact with other hardware and software. Different software can use the same exchange method to exchange data, and the same protocol can be used to achieve mutual connection between different software. The stability and fault tolerance of user misoperation are fully considered during the design to ensure that it can maintain long-term trouble-free operation under normal circumstances. For system failures caused by unforeseen reasons, various fault handling and recovery mechanisms are provided to ensure that the system resumes operation in the shortest possible time and ensure the security and stability of the data. The middleware in the embodiment of the present application can control the timing and priority of traffic lights, optimize traffic flow and reduce congestion, and realize the intelligence and automation of the transportation system.

[0086] Figure 5 The following is a flow chart showing the application method of the centralized control middleware for traffic safety equipment according to an embodiment of the present application. Figure 5 As shown, the application method of the centralized control middleware of traffic safety equipment in the embodiment of the present application includes: Step 501, obtain image information collected by the traffic safety equipment connected to the middleware, identify specific objects in the image information, and determine road sections and / or congested intersections with vehicle congestion characteristics based on the identification results.

[0087] In the embodiment of the present application, various traffic safety devices with image acquisition functions installed on the street are used to collect the traffic flow and real-time traffic images of each lane in the current road section. The corresponding traffic vehicles in the image are identified to determine the operation status of the vehicles in the current road section, such as the vehicle speed, whether it is congested, etc., to determine the road sections and / or intersections with congestion characteristics, so as to prepare for the subsequent congestion relief or decongestion.

[0088] Step 502, identifying the congested road section and / or congested intersection blocking point, determining the congestion type of the blocking point, and analyzing the congestion cause of the congested road section and / or congested intersection.

[0089] Based on the congested road sections and / or congested intersections identified in step 501, the cause of the congestion is determined, such as whether the congestion is caused by lane occupation or narrowness, or congestion caused by an accident point, or congestion caused by non-motor vehicles occupying the road, etc. By analyzing the cause of congestion, it is convenient to implement a congestion relief strategy.

[0090] Step 503, determine the location distribution information of congested sections and / or congested intersections and congestion points, and obtain the layout of traffic safety equipment on the congested sections and / or congested intersections, the layout of traffic safety equipment on sections associated with the congested sections and / or congested intersections, and obtain the road usage conditions of internal roads in communities and / or social public places surrounding the relevant sections.

[0091] In an embodiment of the present application, the traffic safety equipment includes at least traffic signs, traffic signal controllers, tidal lane control equipment, closed road section isolation zone opening control equipment, and parking lot entrance and exit control equipment.

[0092] In the embodiment of the present application, after determining the location distribution information of the congested road section and / or congested intersections and congestion points, it is necessary to formulate relevant diversion strategies according to the current congestion situation and the cause of the congestion. When formulating diversion strategies, it is necessary to call different traffic safety equipment to achieve the redeployment of traffic resources and directional services through the relevant control of traffic safety equipment, so as to alleviate the congestion to the greatest extent. For example, by configuring the duration of the lane traffic signal controller and changing the traffic signs, the congestion relief of the designated lane can be achieved in a targeted manner; by adjusting the tidal lanes in the road, the traffic lanes of the congested section can be increased, and the vehicle traffic volume of the congested section can be increased. Therefore, in the embodiment of the present application, it is necessary to know the relevant traffic safety equipment of the congested section in order to achieve the control of the safety equipment and realize the formulation of relevant diversion strategies.

[0093] Step 504, obtain the traffic operation status of the sections associated with the congested sections and / or congested intersections, and formulate relevant traffic diversion strategies based on the layout of the traffic safety equipment at each section and / or intersection, as well as the road usage status of the internal roads of the communities and / or social public places surrounding the relevant sections.

[0094] As an example, develop relevant diversion strategies including: Obtain navigation purposes and road planning information of vehicles on congested road sections, collect traffic volume and direction, and predict traffic volume and direction of road sections and / or intersections based on historical traffic information of the road section, and determine traffic information of each road section; According to the type of congestion point, the current congestion status of vehicles on the road, the traffic flow and speed of other sections related to the road section, the traffic flow direction and traffic volume of the parking lot related to the road section, determine whether there are lane resources and / or available internal road resources that can be tidally adjusted, and determine the traffic intervention plan for each congested section; Make predictions for each traffic intervention plan to determine whether it will cause new congestion, and predict how two or more adjacent traffic intervention plans will affect each other. Adjust the plans based on two or more traffic intervention plans, and superimpose the intervention plans for each road section as the determined traffic diversion strategy.

[0095] As an example, develop relevant diversion strategies including: In response to the presence of an accident vehicle in the lane in the traffic image recognition result, obtaining position information of the accident vehicle; Searching for a hoisting device that is less than a set distance from the accident vehicle based on the location information; the hoisting device is arranged on a road protection belt or a road isolation belt; A driving instruction is sent to the lifting device to move the lifting device along the road protection belt or road isolation belt to the location of the accident vehicle, and the lifting arm of the lifting device is driven to lift the accident vehicle, so that the lane where the accident vehicle is located can resume its traffic capacity.

[0096] The formulation of the guidance strategy has been elaborated in detail in the previous article, and its implementation details will not be repeated here.

[0097] Step 505, simulate and execute the formulated traffic diversion strategy to determine whether there is a new congestion situation in traffic diversion, adjust the traffic diversion strategy according to the simulation result, and use the adjusted traffic diversion strategy as the final traffic diversion strategy.

[0098] In the embodiment of the present application, after the diversion strategy is determined, it is necessary to simulate according to the diversion strategy. Since the correlation between roads is very high, when one section is congested, it is often transmitted to related sections, causing congestion in the entire related area. In view of this situation, it is necessary to simulate the congestion strategy of a specific section to see whether the strategy will cause more serious congestion in other sections. The embodiment of the present application can achieve more coordinated congestion coordination between sections and achieve more reasonable traffic congestion sorting through the detection of section congestion simulation.

[0099] Step 506: Execute relevant adjustment plans based on the adjusted guidance strategy.

[0100] Control the traffic signal controllers on the driving lanes at intersections and / or road sections to change the traffic instructions of lanes or intersections; control the tidal lane control equipment to adjust the usage ratio of tidal lanes on the road; control the closed section isolation belt opening control equipment to open some of the closed section isolation belt openings to allow vehicles to turn around or turn left; control the parking lot entrance and exit control equipment to change the parking lot entrance or exit location, open or close some parking lot entrances or exits; control traffic signs to display information about the use of internal roads in communities and / or public places, or notify communities and / or public places of the information about the use of internal roads through broadcasts set up around the roads.

[0101] The centralized control middleware and its application method of the embodiment of the present application can identify the congested road sections based on the relevant image information collected by the traffic safety equipment, set the corresponding diversion strategy for the congested road sections, and adjust the timing and priority of the traffic lights and the tidal lanes by controlling the traffic safety equipment, thereby reducing congestion and improving traffic efficiency. The embodiment of the present application realizes the intelligence and automation of the traffic system.

[0102] Figure 6 is a block diagram of an electronic device 800 according to an exemplary embodiment. Figure 6 As shown, the electronic device 800 supports multi-screen output, and the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0103] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0104] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, images, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0105] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0106] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0107] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0108] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0109] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0110] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0111] In an exemplary embodiment, the electronic device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components, and is used in the steps of the application method of the centralized control middleware for traffic safety equipment in the above-mentioned embodiments.

[0112] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the above instructions can be executed by the processor 820 of the electronic device 800 to complete the steps of the application method of the traffic safety equipment centralized control middleware of the above embodiment. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0113] The disclosed embodiment also records a non-temporary computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute the steps of the application method of the centralized control middleware of traffic safety equipment of the aforementioned embodiment.

[0114] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

Claims

1. A centralized control middleware for traffic safety equipment, characterized in that: The middleware includes: The device access subsystem is used to process the relevant messages of the traffic safety equipment, receive the control instructions of the accessed traffic safety equipment, receive the relevant information collected by the traffic safety equipment, and transmit it to the upper-layer application; perform device original protocol analysis, process the acquired original data and forward it to the corresponding port, perform protocol conversion on the instructions issued by the upper-layer application system and transmit them to the traffic safety equipment; The equipment management subsystem is used to input the registration information of traffic safety equipment, collect equipment protocol information and support the transfer and call between protocols, manage the access rights of connected traffic safety equipment, and update and regulate the working status of traffic safety equipment; The application layer interface subsystem is used to provide a unified standard application programming interface API according to the type of equipment, and realize information interaction with each application layer interface in a unified data encapsulation method; The protocol management subsystem is used to define the general abstract interface and the abstract interface for docking various devices. The interface specifies the general functions and extended functions that various devices can support, the specific implementation of the coordination of various abstract interfaces, and supports the automatic connection of multiple protocols, so that the core operating functions of the system and the protocols of various devices are connected with low coupling soft connection; The system management subsystem is used to provide configuration and management related to system operation, access and use, and at least provides functions such as device authorization mechanism, user management, permission management, and dictionary management; The control subsystem is electrically connected to the device access subsystem, the device management subsystem, the application layer interface subsystem, the protocol management subsystem and the system management subsystem respectively; it is used to obtain image information collected by the traffic safety equipment of the access middleware, identify specific objects in the traffic image information, and determine road sections and / or congested intersections with vehicle congestion characteristics based on the identification results; identify congestion points of congested sections and / or congested intersections, determine the congestion types of the congestion points, and analyze the congestion causes of congested sections and / or congested intersections; determine the location distribution information of congested sections and / or congested intersections and congestion points, and obtain the layout of traffic safety equipment on congested sections and / or congested intersections, the layout of traffic safety equipment on sections associated with congested sections and / or congested intersections, and obtain the surrounding communities and / or communities of the relevant sections. The method comprises the following steps: obtaining the road usage status of the internal roads of the congested road sections and / or congested intersections, and formulating relevant traffic diversion strategies according to the arrangement of the traffic safety devices of each road section and / or intersection, and the road usage status of the internal roads of the communities and / or social public places around the relevant road sections; determining the traffic safety devices involved in the diversion strategies and requiring the adjustment of their working status; generating a status adjustment instruction based on the diversion strategies, and sending the status adjustment instruction to the traffic safety devices to be adjusted through the device access subsystem, so that the traffic safety devices to be adjusted control their own status based on the received status adjustment instruction.

2. The centralized control middleware for traffic safety equipment according to claim 1, characterized in that: The control subsystem is also used to simulate and execute the formulated traffic diversion strategy, determine whether there is a new congestion situation in traffic diversion, adjust the traffic diversion strategy according to the simulation results, and use the adjusted traffic diversion strategy as the final traffic diversion strategy; Based on the adjusted traffic diversion strategy, at least one of the following adjustment schemes is executed: controlling the traffic signal controller at the intersection and / or road section to change the traffic instructions of the lane or intersection; controlling the tidal lane control device to adjust the usage ratio of the tidal lane on the road; Control the opening control equipment of the isolation belt of closed road sections, open the opening of some isolation belts of closed road sections to enable vehicles to turn around or turn left; control the entrance and exit control equipment of parking lots, change the entrance or exit location of parking lots, open or close the entrance or exit of some parking lots; control traffic signs, display the information that the internal roads of communities and / or public places are available for use, or notify the community and / or public places of the information that the internal roads are available for use through broadcasting set up around the roads.

3. The centralized control middleware for traffic safety equipment according to claim 2 is characterized in that: The formulation of relevant counseling strategies includes: Obtain navigation purposes and road planning information of vehicles on congested road sections, collect traffic volume and direction, and predict traffic volume and direction of road sections and / or intersections based on historical traffic information of the road section, and determine traffic information of each road section; According to the type of congestion point, the current congestion status of vehicles on the road, the traffic flow and speed of other sections related to the road section, the traffic flow direction and traffic volume of the parking lot related to the road section, determine whether there are lane resources and / or internal road resources that can be tidally adjusted, and determine the traffic intervention plan for each congested section; Make predictions for each traffic intervention plan to determine whether it will cause new congestion, and predict how two or more adjacent traffic intervention plans will affect each other. Adjust the plans based on two or more traffic intervention plans, and superimpose the intervention plans for each road section as the determined traffic diversion strategy.

4. The centralized control middleware for traffic safety equipment according to claim 1, characterized in that: The device access subsystem is also used for: Configure the communication working status monitoring port for the device, supporting at least TCP and UDP port monitoring; determine the monitoring port number and protocol type, and bind the server port; Feedback port monitoring results to the device; Receive the communication data actively sent by the device, determine the corresponding protocol for the device according to the system configuration, and parse the received communication data into business data; and receive the self-scheduling of the upper-level business system or service system, send the corresponding control or query instructions to the device, parse them into protocol instruction data supported by the device and send them to the device.

5. The centralized control middleware for traffic safety equipment according to claim 4, characterized in that: The device access subsystem is also used for: Sending a query request for the operation status to the traffic signal controller and detecting the network status between the backend server and the traffic signal controller; Collect the running status of the device, and send a control instruction to the device based on the running status of the device. The control instruction carries the running strategy, so that the device runs according to the strategy; Send configuration information to the device, instructing the device to run basic configuration based on the configuration information.

6. The centralized control middleware for traffic safety equipment according to claim 1, characterized in that: The device management subsystem is also used for: Provides a device management interface for backend management, supports adding and entering devices based on the management interface, and determines the communication protocol and working mode for the devices; Delete the device based on the management interface, or modify the communication protocol and working mode of the device; A query request for a device is received based on the management interface, and the queried matching devices are presented through the management interface.

7. The centralized control middleware for traffic safety equipment according to claim 1, characterized in that: The application layer interface subsystem is also used for: Data requests are made based on HTTP POST, and UTF-8 encoding format support is provided for data; the message format of request and response is JSON; Receive query requests for relevant device data sent by the centralized control middleware, or send control instructions to the device, trigger the centralized control middleware to receive the control instructions and perform relevant operations according to the control instruction type, and receive the operation results; After receiving a business data upload request, it is broadcast externally through the message queue, and each application system automatically subscribes to the data that needs attention; when it is determined that the data to be broadcast is sensitive data or important data, the data to be broadcast is directly pushed to the set sensitive data or important data recipient.

8. The centralized control middleware for traffic safety equipment according to claim 1, characterized in that: The system management subsystem is also used to: Run the license authorization mechanism to implement single hardware restriction management and control on the system deployed to the server. Copying or moving the system will invalidate the license. Provides the creation of system administrators, supports the management of system users, and allocates fixed permissions between different users; Provide role management to ensure the security of system data while satisfying users' use of system resources.

9. The centralized control middleware for traffic safety equipment according to claim 1, characterized in that: The protocol management subsystem is also used for: In view of the different protocol types caused by differences in device types, device manufacturers, and models in access devices, the protocols of various types of devices are uniformly managed and registered by category.

10. An application method of the traffic safety equipment centralized control middleware according to any one of claims 1 to 9, characterized in that: The method comprises: Obtain image information collected by traffic safety equipment connected to the middleware, identify specific objects in the traffic image information, and determine road sections and / or congested intersections with vehicle congestion characteristics based on the identification results; Identify congested road sections and / or congested intersections, determine the congestion type of the congestion point, and analyze the cause of congestion in the congested road sections and / or congested intersections; Determine the location distribution information of congested road sections and / or congested intersections and congestion points, and obtain the layout of traffic safety equipment on congested road sections and / or congested intersections, the layout of traffic safety equipment on sections associated with congested road sections and / or congested intersections, and obtain the road use conditions of internal roads in communities and / or social public places surrounding the relevant road sections; the traffic safety equipment at least includes traffic signs, traffic signal controllers, tidal lane control equipment, closed road section isolation belt opening control equipment, and parking lot entrance and exit control equipment; Obtain the traffic operation status of the road sections associated with the congested road sections and / or congested intersections, and formulate relevant traffic diversion strategies based on the layout of the traffic safety equipment at each road section and / or intersection, as well as the road usage status of the internal roads of the communities and / or social public places surrounding the relevant road sections; Simulate and execute the formulated traffic diversion strategy to determine whether there is a new congestion in traffic diversion, adjust the traffic diversion strategy according to the simulation results, and use the adjusted traffic diversion strategy as the final traffic diversion strategy; Based on the adjusted traffic diversion strategy, at least one of the following adjustment plans is implemented: control the traffic signal controllers on the driving lanes at intersections and / or road sections to change the traffic instructions of the lanes or intersections; control the tidal lane control equipment to adjust the usage ratio of the tidal lanes in the road; control the closed section isolation belt opening control equipment to open some of the closed section isolation belt openings to enable vehicles to turn around or turn left; control the parking lot entrance and exit control equipment to change the control location of the parking lot entrance or exit, and open or close the entrance or exit of some parking lots; control the traffic signs to display the information that the internal roads of the community and / or social public places are available for use, or notify the community and / or social public places of the information that the internal roads are available for use through broadcasts set up around the roads.

11. The application method of the centralized control middleware for traffic safety equipment according to claim 10, characterized in that: The formulation of relevant counseling strategies includes: In response to the presence of an accident vehicle in the lane in the traffic image recognition result, obtaining position information of the accident vehicle; Searching for a hoisting device that is less than a set distance from the accident vehicle based on the location information; the hoisting device is arranged on a road protection belt or a road isolation belt; A driving instruction is sent to the lifting device to move the lifting device along the road protection belt or road isolation belt to the location of the accident vehicle, and the lifting arm of the lifting device is driven to lift the accident vehicle, so that the lane where the accident vehicle is located can resume its traffic capacity.

Images