Monitoring system, monitoring method, intelligent driving device, computer equipment and medium

By deploying client plug-ins in the service nodes of the autonomous driving system, actively collecting and sending monitoring information, the problem of poor flexibility of the existing monitoring system is solved, the safety and universality of the autonomous driving system are improved, and the service nodes are realized. Flexible and timely monitoring.

CN112631297BActive Publication Date: 2024-11-29SHANGHAI SENSETIME LINGANG INTELLIGENT TECH CO LTD
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN202011505271.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-18
Publication Date
2024-11-29
Estimated Expiration
2040-12-18

AI Technical Summary

Technical Problem

The existing autonomous driving system has poor flexibility and is unable to actively collect service node status information, resulting in passive processing and limited system safety diagnosis, and insufficient versatility and external compatibility.

Method used

By deploying client plug-ins in the service node of the monitored system, actively collecting status information and generating monitoring information, and sending it to the monitoring unit, actively monitoring the autonomous driving system is realized, and system flexibility is improved through sorting and processing logic and communication plug-ins. and compatibility.

Benefits of technology

It improves the flexibility and versatility of the monitoring system, enhances the safety and real-timeness of the autonomous driving system, and ensures the timely processing and response of key monitoring information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112631297B_ABST
    Figure CN112631297B_ABST
Patent Text Reader

Abstract

The present disclosure provides a monitoring system, a monitoring method, an intelligent driving device, a computer device and a medium, wherein the system includes: a client plug-in and a monitoring unit; the client plug-in is deployed in a service node of the monitored system, and is used to collect status information of the service node; the monitoring information is determined based on the status information, and the monitoring information is sent to the monitoring unit; the monitoring unit is used to receive the monitoring information sent by the client plug-in; a first monitoring result is generated based on the monitoring information, and the first monitoring result is sent to a first response node corresponding to the first monitoring result; the first monitoring result is used for the first response node to respond according to the first monitoring result. The embodiments of the present disclosure can realize active monitoring of each service node in the autonomous driving system, and have greater flexibility.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer application technology, and in particular to a monitoring system, a monitoring method, an intelligent driving device, a computer device and a medium. Background Art

[0002] At present, the safety of the autonomous driving system mainly relies on the monitoring system. The monitoring system can continuously monitor the status of the autonomous driving system in real time during the vehicle's autonomous driving process, diagnose whether the autonomous driving system can safely execute the autonomous driving state, and complete real-time reporting. The current monitoring system can passively receive the monitoring information reported by each service node in the autonomous driving system, and monitor the autonomous driving system based on the monitoring information reported by the service node, but the flexibility is poor. Summary of the invention

[0003] The embodiments of the present disclosure at least provide a monitoring system, a monitoring method, an intelligent driving device, a computer device and a medium.

[0004] In a first aspect, an embodiment of the present disclosure provides a monitoring system, comprising: a client plug-in and a monitoring unit; the client plug-in is deployed in a service node of a monitored system, and is used to collect status information of the service node; monitoring information is determined based on the status information, and the monitoring information is sent to the monitoring unit; the monitoring unit is used to receive the monitoring information sent by the client plug-in; a first monitoring result is generated based on the monitoring information, and the first monitoring result is sent to a first response node corresponding to the first monitoring result; the first monitoring result is used for the first response node to respond according to the first monitoring result.

[0005] In this way, the status information of the service node can be actively collected through the client plug-in deployed in the service node of the monitored system, and the monitoring information can be determined based on the status information and sent to the monitoring unit, so that the monitoring unit can realize active monitoring of each service node in the autonomous driving system with greater flexibility.

[0006] In a possible implementation, the monitoring unit is also used to generate a second monitoring result corresponding to the scheduled monitoring task when the execution time corresponding to the scheduled monitoring task arrives, and send the second monitoring result to a second response node; the second monitoring result is used for the second response node to respond according to the second monitoring result.

[0007] In a possible implementation, the monitoring unit is also used to generate a third monitoring result after not receiving the monitoring information sent by the client plug-in within a preset time period, and send the third monitoring result to a third response node corresponding to the third monitoring result; the third monitoring result is used by the third response node to respond according to the third monitoring result.

[0008] In this way, the security of the monitored system is further guaranteed when the client plug-in fails to successfully collect the status information of the service node or fails to successfully send the heartbeat data packet to the monitoring unit.

[0009] In a possible implementation manner, the monitoring information includes at least one of the following: an error type, a service node identifier, an error priority, and error content information.

[0010] In this way, the error type example is used to characterize the various possible situations in which errors occur in the service node; the service node identifier is used to uniquely identify each service node in the monitored system; the error priority is used to characterize the degree to which the error will harm the security of the monitored system; the error content is used to indicate the specific status of the current service node, so that the working status of each service node can be monitored in more detail.

[0011] In a possible implementation, the client plug-in sends the monitoring information to the monitoring unit in the following manner: sending a heartbeat data packet generated based on the monitoring information to the monitoring unit in a heartbeat packet sending manner corresponding to an error priority level of the monitoring information.

[0012] In one possible implementation, in response to the situation where the error priority level of the monitoring information indicates that the monitoring information is urgent monitoring information, when the client plug-in sends a heartbeat data packet generated based on the monitoring information to the monitoring unit, it is used to: generate the heartbeat data packet based on the monitoring information, and immediately send the heartbeat data packet to the monitoring unit; in response to the situation where the priority indication information of the monitoring information indicates that the monitoring information is non-urgent monitoring information, when the client plug-in sends a heartbeat data packet generated based on the monitoring information to the monitoring unit, it is used to: generate the heartbeat data packet based on the monitoring information, and send the heartbeat data packet to the monitoring unit when the heartbeat cycle arrives.

[0013] In this way, to ensure the real-time and timely monitoring of the service node, the client plug-in will collect the status information of the service node more intensively, and determine the corresponding monitoring information based on the status information and the rules of the monitoring information customized and registered by the user at the service node. However, in order to balance the workload of the monitoring unit, not all monitoring information is sent to the monitoring unit immediately by the client plug-in after it is determined. This can not only reduce the workload of the monitoring unit, but also ensure that the monitoring information that poses a greater threat to the security of the monitored system is sent to the monitoring unit for processing in a timely manner, further ensuring the security of the monitored system.

[0014] In a possible implementation, the monitored system includes: an autonomous driving system; the service node includes at least one of the following: a perception service node, a planning service node, a decision service node, a control service node, and an alarm service node.

[0015] In a possible implementation manner, the response node includes: at least one service node in the monitored system, and / or a third-party service node.

[0016] In a possible implementation, the first response node responds according to the first monitoring result, including at least one of the following: warning, emergency braking, notifying the driver to take over the automatic driving equipment, and displaying the monitoring result on the human-computer interaction interface.

[0017] In a possible implementation, when sending the monitoring result to the first response node corresponding to the first monitoring result, the monitoring unit is configured to send the first monitoring result to the first response node according to a communication protocol with the first response node.

[0018] In a second aspect, an embodiment of the present disclosure also provides a monitoring method, applied to a client plug-in, wherein the client plug-in is deployed in a service node of a monitored system, comprising: collecting status information of the service node; determining monitoring information based on the status information, and sending the monitoring information to a monitoring unit.

[0019] In a possible implementation manner, the monitoring information includes at least one of the following: an error type, a service node identifier, an error priority, and error content information.

[0020] In a possible implementation, sending the monitoring information to the monitoring unit includes: sending a heartbeat data packet generated based on the monitoring information to the monitoring unit in a heartbeat packet sending mode corresponding to an error priority level of the monitoring information.

[0021] In one possible implementation, in response to the situation where the error priority level of the monitoring information indicates that the monitoring information is urgent monitoring information, the sending of a heartbeat data packet generated based on the monitoring information to the monitoring unit includes: generating the heartbeat data packet based on the monitoring information, and immediately sending the heartbeat data packet to the monitoring unit; in response to the situation where the priority indication information of the monitoring information indicates that the monitoring information is non-urgent monitoring information, the sending of a heartbeat data packet generated based on the monitoring information to the monitoring unit includes: generating the heartbeat data packet based on the monitoring information, and sending the heartbeat data packet to the monitoring unit when a heartbeat cycle arrives.

[0022] In a possible implementation, the monitored system includes: an autonomous driving system; the service node includes at least one of the following: a perception service node, a planning service node, a decision service node, a control service node, and an alarm service node.

[0023] In the third aspect, an embodiment of the present disclosure also provides a monitoring method, applied to a monitoring unit, including: receiving monitoring information sent by a client plug-in; generating a first monitoring result based on the monitoring information, and sending the first monitoring result to a first response node corresponding to the first monitoring result; the first monitoring result is used for the first response node to respond according to the first monitoring result.

[0024] In a possible implementation, it also includes: when the execution time corresponding to the scheduled monitoring task arrives, generating a second monitoring result corresponding to the scheduled monitoring task, and sending the second monitoring result to a second response node; the second monitoring result is used by the second response node to respond according to the second monitoring result.

[0025] In a possible implementation, it also includes: after not receiving the monitoring information sent by the client plug-in within a preset time period, generating a third monitoring result, and sending the third monitoring result to a third response node corresponding to the third monitoring result; the third monitoring result is used by the third response node to respond according to the third monitoring result.

[0026] In a possible implementation, sending the first monitoring result to a first response node corresponding to the first monitoring result includes: sending the first monitoring result to the first response node according to a communication protocol with the first response node.

[0027] In a possible implementation manner, the response node includes: at least one service node in the monitored system, and / or a third-party service node.

[0028] In a possible implementation manner, the first response node responds according to the first monitoring result, including at least one of the following:

[0029] Warning, emergency braking, notifying the driver to take over the autonomous driving equipment, and displaying the monitoring results on the human-computer interaction interface.

[0030] In the fourth aspect, the embodiment of the present disclosure also provides an intelligent driving device, comprising: a driving equipment body, an automatic driving system, and a monitoring system as described in the first aspect; wherein the automatic driving system and the monitoring system are both installed on the driving equipment body; the automatic driving system is used to drive based on controlling the driving equipment body.

[0031] In a fifth aspect, an optional implementation of the present disclosure further provides a computer device, a processor, and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory, and when the machine-readable instructions are executed by the processor, the machine-readable instructions perform the steps in any possible implementation of the second aspect or the third aspect mentioned above.

[0032] In a sixth aspect, an optional implementation of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in any possible implementation of the second aspect or the third aspect are executed.

[0033] For a description of the effects of the above-mentioned monitoring method, intelligent driving device, computer equipment, and computer-readable storage medium, please refer to the description of the above-mentioned monitoring system, which will not be repeated here.

[0034] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following is a brief introduction to the drawings required for use in the embodiments. The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used together with the specification to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can also be obtained based on these drawings without creative work.

[0036] Figure 1 A schematic diagram of a monitoring system provided by an embodiment of the present disclosure is shown;

[0037] Figure 2 A schematic diagram showing a possible monitoring system and its application environment provided by an embodiment of the present disclosure;

[0038] Figure 3 A flow chart of a monitoring method applied to a client plug-in provided by an embodiment of the present disclosure is shown;

[0039] Figure 4 A flow chart of a monitoring method applied to a monitoring unit provided by an embodiment of the present disclosure is shown;

[0040] Figure 5 A schematic diagram of an intelligent driving device provided by an embodiment of the present disclosure is shown;

[0041] Figure 6 A schematic diagram of a computer device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure is not intended to limit the scope of the present disclosure claimed for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.

[0043] Research has found that the current monitoring system for autonomous driving systems usually only acts as a passive recipient of messages in the autonomous driving system, resulting in error codes that can only be sent through service nodes, passively completing limited system safety diagnosis and other performance, and having poor flexibility.

[0044] In addition, the current monitoring system usually has a fixed logic for processing error codes. Different error codes need to be customized for different autonomous driving application scenarios, and the error code processing logic will also be different. Usually, the monitoring system needs to be customized for different application scenarios, resulting in poor versatility of the monitoring system.

[0045] In addition, the output of the monitoring system is usually limited to certain specific protocols and has poor compatibility with new communication protocols, which in turn limits the external compatibility of the monitoring system.

[0046] Based on the above research, the present disclosure provides a monitoring system, a monitoring method, an intelligent driving device, a computer device and a medium, which can actively collect the status information of the service node through a client plug-in deployed in the service node of the monitored system, and determine the monitoring information based on the status information and send it to the monitoring unit, so that the monitoring unit can realize active monitoring of each service node in the autonomous driving system, with greater flexibility.

[0047] In addition, the embodiment of the present disclosure organizes the processing logic of different monitoring information in the monitoring system into corresponding plug-ins, so that different plug-ins can be selectively loaded based on the different needs of the monitoring system in different application scenarios of autonomous driving, which can improve the versatility of the monitoring system and the flexibility of the use of the monitoring system.

[0048] In addition, the disclosed embodiment also organizes different input and output logics into different communication plug-ins to adapt to different communication protocols. Once the external communication protocol changes, it is only necessary to add a communication plug-in to adapt to the new protocol, thereby improving the external compatibility of the monitoring system.

[0049] The defects existing in the above solutions are the results obtained by the inventor after practice and careful research. Therefore, the discovery process of the above problems and the solutions proposed by the present disclosure for the above problems below should be the contributions made by the inventor to the present disclosure during the disclosure process.

[0050] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0051] In addition, the monitoring system provided by the embodiment of the present disclosure can be applied to the field of autonomous driving to monitor each service node in the autonomous driving system, and can also be used in other fields that require safety monitoring, which is not limited here. The embodiment of the present disclosure takes the application of the monitoring system in the field of autonomous driving as an example for detailed description.

[0052] See also Figure 1 , which is a schematic diagram of a monitoring system provided by an embodiment of the present disclosure, including: a client plug-in 10, and a monitoring unit 20;

[0053] The client plug-in 10 is deployed in the service node of the monitored system, and is used to collect the status information of the service node; determine the monitoring information based on the status information, and send the monitoring information to the monitoring unit;

[0054] The monitoring unit 20 is used to receive monitoring information sent by the client plug-in; generate a first monitoring result based on the monitoring information, and send the first monitoring result to a first response node corresponding to the first monitoring result; the first monitoring result is used for the first response node to respond according to the first monitoring result.

[0055] The disclosed embodiment collects status information of the service node through a client plug-in deployed in the service node of the monitored system, and the client plug-in determines monitoring information based on the status information and sends the monitoring information to a monitoring unit; the monitoring unit processes the monitoring information upon receipt, generates a first monitoring result, and sends the first monitoring result to a corresponding first response node, so that the first response node can respond to the first monitoring result, thereby actively collecting status information of the service node through the client plug-in deployed in the service node, and determining monitoring information based on the status information and sending it to the monitoring unit, so that the monitoring unit can realize active monitoring of each service node in the autonomous driving system, with greater flexibility.

[0056] The following is a detailed description of each component of the above monitoring system.

[0057] Regarding the client plug-in 10, the client plug-in 10 is deployed in a service node, can actively collect the status information of the service node, and determine the monitoring information based on the status information.

[0058] Among them, the service node may include any node in the monitored system. The monitored system may be, for example, an autonomous driving system. The service node may include, for example, at least one of the following: a perception service node, a planning service node, a decision service node, a control service node, and an alarm service node; the status information of the service node may include, for example: the status of the service node in its life cycle, the working status, etc.

[0059] In addition, the monitoring information is used to characterize the specific situation of the current service node, which is defined by the service node and registered in the monitoring unit 20 .

[0060] In specific implementation, users (such as maintenance personnel or programmers of the autonomous driving system) can customize monitoring information through the service node and register the rules of monitoring information to the monitoring unit 20 through the application programming interface (API) provided by the monitoring system. The form of monitoring information includes, for example, an error code, such as a digital code, a symbol code, etc. The client plug-in determines the monitoring information corresponding to the current state information based on the collected state information and the rules of the monitoring information of the service node registered by the user. The monitoring information includes, for example: at least one of the error type, service node identifier, error priority, and error content information.

[0061] Among them, the error type may include, for example: system response error, command request recognition error, operation failure, etc., which are used to characterize various possible different situations in which the service node may have an error; the service node identification may include, for example: the address of the service node, the identity document (ID) of the service node, etc., which are used to uniquely identify the service node in the monitored system; the error priority is used to characterize the degree to which the error will harm the security of the monitored system. The level of error priority can be set based on actual conditions, and the level of error priority that should correspond to different situations is defined; the error content may include, for example: what stage of the life cycle of the current service node is, how long it has been running, whether a certain function of the service node can be executed normally, etc., which are used to indicate the specific status of the current service node.

[0062] When registering monitoring information with the monitoring unit 20 , the service node may send monitoring information corresponding to different states of the service node to the monitoring unit 20 , and the monitoring unit establishes different processing logics for different monitoring information.

[0063] At the same time, the client plug-in 10 is configured to determine monitoring information based on the collected status information of the service node, and send the monitoring information to the monitoring unit 20. After receiving the monitoring information, the monitoring unit 20 can determine the processing logic based on the received monitoring information, and process the monitoring information based on the determined processing logic to generate a first monitoring result.

[0064] Exemplarily, the user-defined registration monitoring information is a seven-digit number. The first and second digits represent the error type. Different numbers correspond to different error types. 01 represents a system response error, 02 represents a command request recognition error... and so on. Different error types are numbered in a custom order; the third and fourth digits represent the service node identifier. The identifier of each service node can be a number. 01, 02, 03... and so on are the identifiers of different service nodes in the monitored system; the fifth digit represents the error priority. The error priority can be divided into five levels. The higher the level, the greater the impact of the error on the security of the monitored system. The higher the security threat, the first level corresponds to the number 1, the second level corresponds to the number 2... and so on, the fifth level corresponds to the number 5; the sixth and seventh digits represent the error content, and different numbers in order correspond to different error contents, for example, 01 represents that the life cycle of the current service node is normal, and 02 represents that the system operation is stuck or delayed; based on the above-mentioned user-defined registration monitoring information rules, 0105302 represents that the error type is an error of the system response error type, the service node where the error occurs is identified as 05, the error priority of the error is the third level, and the error content information is that the system is stuck when running. In specific implementation, the user can customize the registration monitoring information through the API of the service node 03, and upload the rule to the monitoring unit 20 for registration, so that the monitoring unit can parse the monitoring information after receiving it and determine the corresponding processing logic for the monitoring information.

[0065] When the client 10 sends monitoring information to the monitoring unit 20, for example, the following methods may be used:

[0066] The heartbeat data packet generated based on the monitoring information is sent to the monitoring unit 20 according to the heartbeat packet sending mode corresponding to the error priority level of the monitoring information.

[0067] In the specific implementation, in order to ensure effective monitoring of the service node, the client plug-in 10 will collect the status information of the service node more intensively, and determine the corresponding monitoring information based on the status information and the rules of the monitoring information registered by the user at the service node. However, for different monitoring information, the error priority is different, and the corresponding heartbeat packet sending method is different:

[0068] In the case where the error priority of the monitoring information indicates that the monitoring information is urgent monitoring information, when the client plug-in 10 sends a heartbeat data packet generated based on the monitoring information to the monitoring unit, it generates a heartbeat data packet based on the monitoring information and immediately sends the heartbeat data packet to the monitoring unit 20.

[0069] Among them, emergency monitoring information indicates that the monitoring information poses a greater threat to the security of the monitored system. For example, the third level of error priority and monitoring information indicated by levels above the third level can be pre-defined as emergency monitoring information. After determining that the monitoring information is emergency monitoring information, a corresponding heartbeat data packet is immediately generated and sent to the monitoring unit 20 immediately.

[0070] Here, such emergency monitoring information includes, for example, monitoring information that may cause great safety hazards to the autonomous driving process. For example, the monitoring information is that the perception node restarts. During the restart of the perception module, the autonomous driving system cannot determine the surrounding environment, and there may be great safety hazards. In this case, a corresponding heartbeat data packet must be sent immediately to the monitoring unit 20. After receiving the heartbeat data packet, the monitoring unit 20 generates a monitoring result of an emergency stop and sends the monitoring result to the corresponding response node (decision service node). After receiving the monitoring result, the response node controls the autonomous driving vehicle to make an emergency stop.

[0071] In the case where the priority indication information of the monitoring information indicates that the monitoring information is non-urgent monitoring information, the client plug-in 10 generates a heartbeat data packet based on the monitoring information when sending a heartbeat data packet generated based on the monitoring information to the monitoring unit 20, and sends the heartbeat data packet to the monitoring unit 20 when the heartbeat cycle arrives;

[0072] The heartbeat cycle can be predefined based on actual conditions. Here, the heartbeat data periodically sent to the monitoring unit 20 includes at least one monitoring information; illustratively, multiple pieces of monitoring information received in the current heartbeat cycle that need to be sent to the monitoring unit 20 when the heartbeat cycle arrives can be encapsulated in the same heartbeat data packet and sent to the monitoring unit 20.

[0073] The above method of sending heartbeat data packets to the monitoring unit 20 can not only reduce the workload of the monitoring unit 20, but also ensure that monitoring information that poses a greater threat to the security of the monitored system is sent to the monitoring unit 20 for processing in a timely manner, further ensuring the security of the monitored system.

[0074] After generating the first monitoring result, the monitoring unit 20 sends the first monitoring result to a first response node corresponding to the first monitoring result.

[0075] The monitoring results include, for example, at least one of warning, emergency braking, notifying the driver to take over the automatic driving equipment, and displaying the monitoring results on the human-computer interaction interface; the monitoring results are used by the corresponding response nodes to respond according to the monitoring results, and different monitoring results correspond to different response nodes. The response nodes include, for example: at least one service node in the monitored system, and / or a third-party service node; for example, if the government wants to know the operating status of the vehicle, the third-party service node can be a node with display function in the government's monitoring system, and the monitoring result is the current driving status of the vehicle.

[0076] Illustratively, an embodiment of the present disclosure provides a specific implementation example of a monitoring unit, in which the monitoring unit includes: at least one processing plug-in, at least one input plug-in, and at least one output plug-in.

[0077] Different processing plug-ins are used to process different monitoring information, and the processing plug-ins include, for example, event-driven processing plug-ins and time-driven processing plug-ins. The event processing plug-in is triggered based on events, for example, the corresponding monitoring results are immediately generated based on the error priority of the monitoring information; the event-driven plug-in is triggered based on time, for example, if the monitoring information sent by the client plug-in 10 of the predetermined service node is not received within a preset time, it will be started immediately and the corresponding alarm information will be generated.

[0078] The input plug-in is used to receive monitoring information sent by the client plug-in 10; different output plug-ins correspond to different transmission protocols, and based on the transmission protocol of the first response node corresponding to the first monitoring result, a corresponding output plug-in is selected from at least one output plug-in to send the first monitoring result to the first response node.

[0079] In addition, in order to ensure the diversity of the functions of the monitoring unit 20, multiple processing plug-ins with different functions can be deployed on the monitoring unit 20, and different autonomous driving scenarios will use different processing plug-ins; therefore, in another embodiment of the present disclosure, when the monitoring service 201 of the monitoring unit 20 is started, based on the pre-collected environmental information, it determines the processing plug-in to be loaded from the pre-generated multiple processing plug-ins, and loads the processing plug-in to be loaded.

[0080] Exemplarily, a processing plug-in for monitoring the vehicle's driving process is started while the vehicle is driving, and a processing plug-in for monitoring the vehicle's surroundings is started when the vehicle is not driving but in a parked state.

[0081] In this way, by organizing the processing logic of different monitoring information in the monitoring system into corresponding plug-ins, different plug-ins can be selectively loaded based on the different needs of the monitoring system in different application scenarios of autonomous driving, thereby improving the versatility of the monitoring system and the flexibility of the use of the monitoring system.

[0082] In another embodiment of the present disclosure, the monitoring unit 20 is also used to generate a second monitoring result corresponding to the scheduled monitoring task when the execution time corresponding to the scheduled monitoring task arrives, and send the second monitoring result to the second response node; the second monitoring result is used for the second response node to respond according to the second monitoring result.

[0083] In addition to the above-mentioned situation of monitoring the monitored system based on the monitoring information, in order to further ensure the security of the monitored system, in another embodiment of the present disclosure, the monitoring unit 20 is also used to generate a third monitoring result after not receiving the monitoring information sent by the client plug-in 10 within a preset time period, and send the third monitoring result to a third response node corresponding to the third monitoring result; the third monitoring result is used for the third response node to respond according to the third monitoring result.

[0084] In this way, when the client plug-in 10 fails to report monitoring information to the monitoring unit for a long time, the monitoring unit 20 can perform subsequent processing in a timely manner.

[0085] like Figure 2 As shown, it is a schematic diagram of a possible monitoring system and its application environment provided by an embodiment of the present disclosure, including: a client plug-in 10 deployed in a service node 21, a monitoring unit 20, and a response node 22;

[0086] Among them, the service node 21 is, for example, any service node in the autonomous driving system; the client plug-in 10 is deployed with a client service plug-in 101 and a first output plug-in 102; the monitoring unit 20 is deployed with a first input plug-in 201, a monitoring service plug-in 202, a first processing plug-in 203, a second processing plug-in 204, a third processing plug-in 205, and a second output plug-in 206; the response node 22 can be any service node in the autonomous driving system or a third-party service node, which is described in detail below.

[0087] The client service plug-in 101 collects status information of the service node 21, generates monitoring information based on the status information, and sends the monitoring information to the first output plug-in 102; the first output plug-in 102 receives the monitoring information sent by the client plug-in service 101, generates a heartbeat data packet based on the monitoring information, and sends the heartbeat data packet to the monitored unit 20.

[0088] After receiving the heartbeat data packet carrying monitoring information sent by the first output plug-in 102 , the first input plug-in 201 of the monitoring unit 20 parses the heartbeat data packet to obtain the monitoring information, and sends the monitoring information to the monitoring service plug-in 202 .

[0089] After the monitoring service plug-in 202 receives the monitoring information, it parses the monitoring information based on the rules of the monitoring information pre-registered by the user through the API in the service node 21 to obtain the corresponding error type, service node identifier, error priority, and error content information; based on the error type and / or error content, it determines the first processing plug-in 203 from at least one processing plug-in, and sends the monitoring information to the first processing plug-in 203.

[0090] After receiving the monitoring information, the first processing plug-in 203 generates a corresponding first monitoring result based on the monitoring information, and sends the first monitoring result to the second output plug-in 206 with a mapping relationship.

[0091] The second output plug-in 206 receives the monitoring result sent by the first processing plug-in 203 with the mapping relationship, and sends the monitoring result to the response node 22 with the mapping relationship.

[0092] In a specific implementation, the monitoring unit 20 may include multiple output plug-ins, each of which corresponds to a different transmission protocol. The monitoring unit 20 determines a response node 22 with a mapping relationship based on the monitoring result generated by the first processing plug-in 203, and determines a second output plug-in 206 from the multiple output plug-ins based on the transmission protocol corresponding to the response node 22.

[0093] In this way, by organizing different input and output logics into different communication plug-ins to adapt to different communication protocols, once the external communication protocol changes, only communication plug-ins need to be added to adapt to the new protocol, thereby improving the external compatibility of the monitoring system.

[0094] Among them, the response node 22 can be a node with control function in the automatic driving system. After receiving the monitoring result, the node can take timely measures on the automatic driving system. For example, if the monitoring result is "the vehicle is speeding, reduce the speed", the corresponding response node 22 is the node that controls the vehicle speed in the automatic driving system. After receiving the monitoring result, the node that controls the vehicle speed immediately slows down the vehicle; the response node 22 can also be a third-party service node. For example, if the government wants to know the operating status of the vehicle, the response node 22 can be a node with display function in the government's monitoring system, and the monitoring result is the current driving status of the vehicle.

[0095] In another embodiment of the present disclosure, the monitoring service plug-in 202 sends the scheduled monitoring task to the second processing plug-in 204 when the execution time corresponding to the scheduled monitoring task arrives; after receiving the scheduled monitoring task, the second processing plug-in 204 generates a second monitoring result corresponding to the scheduled monitoring task, and sends the second monitoring result to the corresponding response node 22.

[0096] In addition to the above-mentioned situation of monitoring the monitored system based on monitoring information, in order to further ensure the security of the monitored system when the client plug-in 10 fails to successfully collect the status information of the service node 21 or fails to successfully send a heartbeat data packet to the monitoring unit 20, in another embodiment of the present disclosure, the monitoring service 202 notifies the third processing plug-in 205 to generate a third monitoring result after failing to receive the monitoring information sent by the client plug-in 10 within a preset time period; after the third processing plug-in 205 generates the third processing result, it sends the third monitoring result to the response node 22 corresponding to the third monitoring result.

[0097] Based on the same inventive concept, a monitoring method corresponding to the monitoring system is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the method in the embodiment of the present disclosure is similar to the above-mentioned monitoring system in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0098] The execution subject of the monitoring method provided in the embodiment of the present disclosure is generally a computer device with certain computing capabilities, and the computer device includes, for example: a terminal device or a server or other processing device, and the terminal device can be a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementations, the monitoring method can be implemented by a processor calling a computer-readable instruction stored in a memory.

[0099] The monitoring method provided by the embodiment of the present disclosure is described below by taking the execution subject as a client plug-in as an example.

[0100] See also Figure 3 As shown, it is a flowchart of a monitoring method applied to a client plug-in provided by an embodiment of the present disclosure, and the method includes steps S301 to S302, wherein:

[0101] S301: Collecting status information of service nodes;

[0102] S302: Determine monitoring information based on the state information, and send the monitoring information to the monitoring unit.

[0103] In a possible implementation manner, the monitoring information includes at least one of the following: an error type, a service node identifier, an error priority, and error content information.

[0104] In a possible implementation, sending the monitoring information to the monitoring unit includes: sending a heartbeat data packet generated based on the monitoring information to the monitoring unit in a heartbeat packet sending mode corresponding to an error priority level of the monitoring information.

[0105] In one possible implementation, in response to the situation where the error priority level of the monitoring information indicates that the monitoring information is urgent monitoring information, the sending of a heartbeat data packet generated based on the monitoring information to the monitoring unit includes: generating the heartbeat data packet based on the monitoring information, and immediately sending the heartbeat data packet to the monitoring unit; in response to the situation where the priority indication information of the monitoring information indicates that the monitoring information is non-urgent monitoring information, the sending of a heartbeat data packet generated based on the monitoring information to the monitoring unit includes: generating the heartbeat data packet based on the monitoring information, and sending the heartbeat data packet to the monitoring unit when a heartbeat cycle arrives.

[0106] In a possible implementation, the monitored system includes: an autonomous driving system; the service node includes at least one of the following: a perception service node, a planning service node, a decision service node, a control service node, and an alarm service node.

[0107] The monitoring method provided in the embodiment of the present disclosure is described below by taking the execution subject as a monitoring unit as an example.

[0108] See also Figure 4 As shown, it is a flowchart of a monitoring method applied to a monitoring unit provided in an embodiment of the present disclosure, the method includes steps S401 to S402, wherein:

[0109] S401: receiving monitoring information sent by the client plug-in;

[0110] S402: Generate a first monitoring result based on the monitoring information, and send the first monitoring result to a first response node corresponding to the first monitoring result; the first monitoring result is used by the first response node to respond according to the first monitoring result.

[0111] In a possible implementation, it also includes: when the execution time corresponding to the scheduled monitoring task arrives, generating a second monitoring result corresponding to the scheduled monitoring task, and sending the second monitoring result to a second response node; the second monitoring result is used by the second response node to respond according to the second monitoring result.

[0112] In a possible implementation, it also includes: after not receiving the monitoring information sent by the client plug-in within a preset time period, generating a third monitoring result, and sending the third monitoring result to a third response node corresponding to the third monitoring result; the third monitoring result is used by the third response node to respond according to the third monitoring result.

[0113] In a possible implementation, sending the first monitoring result to a first response node corresponding to the first monitoring result includes: sending the first monitoring result to the first response node according to a communication protocol with the first response node.

[0114] In a possible implementation manner, the response node includes: at least one service node in the monitored system, and / or a third-party service node.

[0115] In a possible implementation manner, the first response node responds according to the first monitoring result, including at least one of the following:

[0116] Warning, emergency braking, notifying the driver to take over the autonomous driving equipment, and displaying the monitoring results on the human-computer interaction interface.

[0117] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0118] The present disclosure also provides an intelligent driving device, such as Figure 5 As shown, it is a schematic diagram of an intelligent driving device provided by an embodiment of the present disclosure, including: a driving device body 501, an automatic driving system 502, and a monitoring system 503 in an embodiment of the present disclosure; wherein the automatic driving system 502 and the monitoring system 503 are both installed on the driving device body 501; the automatic driving system 501 is used to control the driving device body to drive. The driving device may be a vehicle, a robot, etc.

[0119] The present disclosure also provides a computer device, such as Figure 6 FIG. 1 is a schematic diagram of a computer device structure provided in an embodiment of the present disclosure, including:

[0120] A processor 61 and a memory 62; the memory 62 stores machine-readable instructions executable by the processor 61, and the processor 61 is used to execute the machine-readable instructions stored in the memory 62. When the machine-readable instructions are executed by the processor 61, the processor 61 performs the following steps:

[0121] Collecting status information of the service node;

[0122] Monitoring information is determined based on the status information, and the monitoring information is sent to a monitoring unit.

[0123] Alternatively, when the machine-readable instruction is executed by the processor 61, the processor 61 performs the following steps:

[0124] Receiving monitoring information sent by the client plug-in;

[0125] A first monitoring result is generated based on the monitoring information, and the first monitoring result is sent to a first response node corresponding to the first monitoring result; the first monitoring result is used by the first response node to respond according to the first monitoring result.

[0126] The above-mentioned memory 62 includes internal memory 621 and external memory 622; the memory 621 here is also called internal memory, which is used to temporarily store the calculation data in the processor 61, as well as the data exchanged with the external memory 622 such as the hard disk. The processor 61 exchanges data with the external memory 622 through the internal memory 621.

[0127] The specific execution process of the above instructions can refer to the steps of the monitoring method described in the embodiment of the present disclosure, which will not be repeated here.

[0128] The present disclosure also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the monitoring method described in the above method embodiment are executed. The storage medium may be a volatile or non-volatile computer-readable storage medium.

[0129] The present disclosure also provides a computer program product that carries a program code. The program code includes instructions that can be used to execute the steps of the monitoring method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.

[0130] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0131] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0132] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0133] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0134] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0135] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A monitoring system, characterized in that: include: A client plug-in and a monitoring unit; the monitoring unit is deployed with a plurality of processing plug-ins with different functions, the processing plug-ins with different functions are used to process different monitoring information, different monitoring information corresponds to different processing logics, and different autonomous driving scenarios use different processing plug-ins; The monitoring unit further comprises: a plurality of output plug-ins; different output plug-ins correspond to different transmission protocols; The client plug-in is deployed in a service node of a monitored system, and is used to collect status information of the service node; determine monitoring information based on the status information, and send the monitoring information to the monitoring unit; The monitoring unit is used to determine a target processing plug-in from the plurality of processing plug-ins with different functions and load the target processing plug-in based on the pre-collected environment information when the monitoring service of the monitoring unit is started; and to receive monitoring information sent by the client plug-in; using the target processing plug-in to generate a first monitoring result based on the monitoring information, and based on the transmission protocol of the first response node corresponding to the first monitoring result, select a corresponding output plug-in from at least one output plug-in, and use the selected output plug-in to send the first monitoring result to the first response node; the first monitoring result is used for the first response node to respond according to the first monitoring result; The monitored system includes: an autonomous driving system; the service node includes at least one of the following: a perception service node, a planning service node, a decision service node, a control service node, and an alarm service node.

2. The monitoring system according to claim 1, characterized in that: The monitoring unit is further configured to generate a second monitoring result corresponding to the scheduled monitoring task when the execution time corresponding to the scheduled monitoring task arrives, and send the second monitoring result to the second response node; The second monitoring result is used by the second response node to respond according to the second monitoring result.

3. The monitoring system according to claim 1 or 2, characterized in that: The monitoring unit is further configured to generate a third monitoring result after failing to receive the monitoring information sent by the client plug-in within a preset time period, and send the third monitoring result to a third response node corresponding to the third monitoring result; The third monitoring result is used by the third response node to respond according to the third monitoring result.

4. The monitoring system according to any one of claims 1 to 3, characterized in that: The monitoring information includes at least one of the following: Error type, service node identifier, error priority, and error content information.

5. The monitoring system according to any one of claims 1 to 4, characterized in that: The client plug-in sends the monitoring information to the monitoring unit in the following manner: A heartbeat data packet generated based on the monitoring information is sent to the monitoring unit in accordance with the heartbeat packet sending mode corresponding to the error priority level of the monitoring information.

6. The monitoring system according to claim 5, characterized in that: In response to the error priority of the monitoring information indicating that the monitoring information is urgent monitoring information, the client plug-in, when sending a heartbeat data packet generated based on the monitoring information to the monitoring unit, is used to: generate the heartbeat data packet based on the monitoring information, and immediately send the heartbeat data packet to the monitoring unit; In the case where the priority indication information of the monitoring information indicates that the monitoring information is non-urgent monitoring information, the client plug-in, when sending a heartbeat data packet generated based on the monitoring information to the monitoring unit, is used to: The monitoring information generates the heartbeat data packet, and sends the heartbeat data packet to the monitoring unit when a heartbeat cycle arrives.

7. The monitoring system according to any one of claims 1 to 6, characterized in that: The response nodes include: At least one service node in the monitored system, and / or a third-party service node.

8. The monitoring system according to any one of claims 1 to 7, characterized in that: The first response node responds according to the first monitoring result, including at least one of the following: Warning, emergency braking, notifying the driver to take over the autonomous driving equipment, and displaying the monitoring results on the human-computer interaction interface.

9. A monitoring method, characterized in that: A client plug-in applied to the monitoring system according to any one of claims 1 to 8, wherein the client plug-in is deployed in a service node of the monitored system, comprising: Collecting status information of the service node; Monitoring information is determined based on the status information, and the monitoring information is sent to a monitoring unit.

10. The monitoring method according to claim 9, characterized in that: The monitoring information includes at least one of the following: Error type, service node identifier, error priority, and error content information.

11. The monitoring method according to claim 9 or 10, characterized in that: The sending the monitoring information to the monitoring unit includes: A heartbeat data packet generated based on the monitoring information is sent to the monitoring unit in accordance with the heartbeat packet sending mode corresponding to the error priority level of the monitoring information.

12. The monitoring method according to claim 11, characterized in that: In response to the error priority level of the monitoring information indicating that the monitoring information is urgent monitoring information, sending a heartbeat data packet generated based on the monitoring information to the monitoring unit includes: Generate the heartbeat data packet based on the monitoring information, and immediately send the heartbeat data packet to the monitoring unit; In response to the situation where the priority indication information of the monitoring information indicates that the monitoring information is non-urgent monitoring information, sending a heartbeat data packet generated based on the monitoring information to the monitoring unit includes: The heartbeat data packet is generated based on the monitoring information, and the heartbeat data packet is sent to the monitoring unit when a heartbeat cycle arrives.

13. A monitoring method, characterized in that: Applied to a monitoring unit, the monitoring unit is located in a monitoring system, and a plurality of processing plug-ins with different functions are deployed on the monitoring unit. The processing plug-ins with different functions are used to process different monitoring information. Different monitoring information corresponds to different processing logics, and different autonomous driving scenarios use different processing plug-ins; The monitoring unit further includes: a plurality of output plug-ins; different output plug-ins correspond to different transmission protocols; including: Receiving monitoring information sent by a client plug-in; wherein the client plug-in is deployed in a service node of a monitored system; Based on the pre-collected environmental information, a target processing plug-in is determined from the plurality of processing plug-ins with different functions, and a first monitoring result is generated based on the monitoring information by using the target processing plug-in, and a corresponding output plug-in is selected from at least one output plug-in based on a transmission protocol of a first response node corresponding to the first monitoring result, and the first monitoring result is sent to the first response node by using the selected output plug-in; the first monitoring result is used for the first response node to respond according to the first monitoring result; The monitored system includes: an autonomous driving system; the service node includes at least one of the following: a perception service node, a planning service node, a decision service node, a control service node, and an alarm service node.

14. The monitoring method according to claim 13, characterized in that: Also includes: When the execution time corresponding to the scheduled monitoring task arrives, generating a second monitoring result corresponding to the scheduled monitoring task, and sending the second monitoring result to the second response node; The second monitoring result is used by the second response node to respond according to the second monitoring result.

15. The monitoring method according to claim 13 or 14, characterized in that: The first response node responds according to the first monitoring result, including at least one of the following: Warning, emergency braking, notifying the driver to take over the autonomous driving equipment, and displaying the monitoring results on the human-computer interaction interface.

16. An intelligent driving device, characterized in that: include: A driving device body, an automatic driving system, and a monitoring system as described in any one of claims 1 to 8; wherein the automatic driving system and the monitoring system are both installed on the driving device body; and the automatic driving system is used to control the driving of the driving device body.

17. A computer device, characterized in that: include: A processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the processor executes the steps of the monitoring method as described in any one of claims 9 to 15.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program. When the computer program is executed by a computer device, the computer device executes the steps of the monitoring method according to any one of claims 9 to 15.

Citation Information

Patent Citations

  • Car monitoring and diagnosing system

    CN102445940A

  • Cloud-based dynamic application monitoring method and system

    CN106850332A

  • Virtual machine monitoring plug-in control method and device

    CN108363610A

  • Autopilot system, fault alarm method and device

    CN109204189A

  • Monitoring system of distributed database cluster

    CN109614283A