Abnormal display method and device, electronic equipment and storage medium

Abstract

The invention discloses an exception display method and device, electronic equipment and a storage medium, and the method comprises the steps: receiving exception data reported by a monitoring target in a working area, each exception data corresponding to an exception event, analyzing the exception data, obtaining an exception problem and exception location corresponding to the identification information of the monitoring target, and displaying the exception problem and the exception location according to the exception problem and the exception location. And semantically displaying the identification information corresponding to the abnormal event, the abnormal problem and the abnormal location in a monitoring map. When the monitoring target goes wrong, abnormal data can be reported autonomously, and the system performs analysis based on the reported abnormal data, so that the efficiency of abnormal problem analysis is improved to a certain extent; the abnormal data is analyzed, the abnormal problems and the abnormal localization can be determined without manual one-by-one analysis, the determination of the abnormal problems and the abnormal localization is more convenient and efficient, the abnormal events of the abnormal problems and the abnormal localization are displayed in the monitoring map, and the monitoring efficiency is improved. And on-site workers can quickly position abnormal or fault points according to the display of the monitoring map.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to an abnormal display method and device, an electronic device and a storage medium. Background Art

[0002] In the monitoring display interface of the Robot Management System (RMS system), the operating status of various types of robots, cargo shelves, equipment, etc. in the warehouse are displayed in real time, and some simplified operation capabilities of human-machine interaction are provided.

[0003] When an abnormality or failure occurs at the warehouse site, users or maintenance personnel need to retrieve the operating data from the background, analyze the operating data, and obtain the abnormal data or fault data; after obtaining the abnormal data or fault data, the abnormal data or fault data is analyzed and checked to determine the cause of the abnormality or fault, and it is also necessary to locate where the problem occurred. This method of problem troubleshooting and locating requires a lot of time to find abnormal data or fault data from the operating data due to the large amount of operating data. After obtaining the abnormal data or fault data, it is necessary to manually analyze the cause and location of the abnormality or fault one by one, which will result in a long time to determine the cause of the problem and low efficiency. Summary of the invention

[0004] The present application provides an abnormal display method, device, electronic device and storage medium. Its main purpose is to enable the system to analyze the abnormal data reported autonomously by the monitoring target, so that the abnormal problem and abnormal location of the abnormality can be determined without manual analysis one by one, making the determination of the abnormal problem and abnormal location more convenient and efficient; and the abnormal events of the abnormal problem and abnormal location are displayed in the monitoring map, so that the on-site staff can quickly locate the abnormality or fault point according to the monitoring map display.

[0005] According to a first aspect of the present application, there is provided an abnormal display method, which comprises:

[0006] Receive abnormal data reported by monitoring targets in the working area, each abnormal data corresponds to an abnormal event, and the abnormal event includes identification information of the abnormal event;

[0007] Analyze the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information;

[0008] The identification information, the abnormal problem and the abnormal location corresponding to the abnormal event are semantically displayed in a monitoring map.

[0009] In some embodiments, the semantically displaying the identification information, the abnormal problem, and the abnormal location corresponding to the abnormal event in a monitoring map includes:

[0010] The identification information, the corresponding abnormal problems, and the abnormal location are displayed at least through a display bar, or a display bar and a map display interface; wherein the display bar is independent of the map display interface corresponding to the working area, and the map display interface is an interface in the monitoring map for visually displaying the working area.

[0011] In some embodiments,

[0012] The step of displaying the identification information, the abnormal problems corresponding to each other, and the abnormal location through a display column includes: displaying the identification information, the abnormal problems corresponding to each other, and the abnormal location in at least a first display area of ​​the display column;

[0013] The identification information, the corresponding abnormal problems, and the abnormal location are displayed through a display bar and a map display interface, including: displaying the identification information, the corresponding abnormal problems, and the abnormal location in at least the first display area of ​​the display bar, and displaying the abnormal problems and the abnormal location in a graphical manner in the map display interface.

[0014] In some embodiments, displaying the identification information, the abnormal problems corresponding to each other, and the abnormal location in at least the first display area of ​​the display column includes:

[0015] The abnormal problems and the abnormal locations corresponding to the identification information are displayed in the first display area according to the results of sorting the abnormalities in descending order of priority to be processed;

[0016] or

[0017] In the first display area, the abnormal problems and the abnormal locations corresponding to the identification information are displayed according to the results of descending order of the exceptions to be processed; and in the second display area of ​​the display column, the abnormal events are summarized and displayed according to the abnormal types, wherein the abnormal types include at least any one of robot abnormality, task abnormality and equipment abnormality.

[0018] In some embodiments, the abnormal problem and abnormal location are displayed graphically in the map display interface, including:

[0019] The abnormal problem and abnormal location are displayed using different shapes at the position corresponding to the abnormal location, and using different colors based on the abnormality degree of the abnormal problem.

[0020] In some embodiments, after semantically displaying the identification information, the abnormal problem, and the abnormal location corresponding to the abnormal event in the monitoring map, the method further includes:

[0021] In response to a selection instruction for a positioning link icon corresponding to the abnormal positioning, determining a target abnormal positioning corresponding to the selection instruction and target identification information corresponding to the target abnormal positioning;

[0022] In the map display interface, the minimum display unit where the monitoring target corresponding to the target identification information is located is framed and displayed, wherein the minimum display unit is the smallest unit in which the monitoring target is displayed in the map display interface.

[0023] In some embodiments, in the map display interface, when the minimum display unit where the monitoring target corresponding to the target identification information is located is framed and displayed, it also includes:

[0024] The abnormal problem and detailed information of the monitoring target corresponding to the target identification information are displayed in the detailed information column, and the detailed information at least includes: the type, location and cause of the abnormal problem of the monitoring target.

[0025] In some embodiments, displaying the abnormal problem and detailed information of the monitoring target corresponding to the target identification information in the detailed information column includes:

[0026] Determining whether the monitoring target is consistent with the monitoring target type displayed by the smallest display unit in the map display interface;

[0027] If they are consistent, the abnormal problem and detailed information corresponding to the monitoring target will be displayed synchronously in the detailed information column.

[0028] If there is inconsistency, a first-level display panel and a second-level display panel are displayed, in which the monitoring target is displayed graphically in the second-level display panel, and the abnormal problems and detailed information corresponding to the monitoring target are simultaneously displayed in the detailed information column; wherein, the first-level display panel is used to display the coding information of the monitoring target displayed by the minimum display unit.

[0029] In some embodiments, after determining that the monitoring target is inconsistent with the monitoring target type displayed by the smallest display unit in the map display interface, the method further includes:

[0030] Determine whether the hidden switch is turned on;

[0031] If the hidden switch is in the on state, the display of the primary display panel and the secondary display panel is performed;

[0032] If the hidden switch is in a non-on state, the hidden switch in the monitoring map is controlled to be switched to an on state, and the display of the first-level display panel and the second-level display panel is executed.

[0033] In some embodiments, after displaying the identification information, the abnormal problems corresponding to each other, and the abnormal location through the display bar and the map display interface, the method further includes:

[0034] In response to a click instruction triggered on one or more minimum display units in the map display interface, determining a target abnormality location corresponding to the click instruction and target identification information corresponding to the target abnormality location;

[0035] The abnormal problem and detailed information corresponding to the target identification information are displayed in the detailed information column.

[0036] In some embodiments, parsing the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information includes:

[0037] Determine whether the abnormal data carries abnormal location information and abnormal code corresponding to the monitoring target where the abnormality occurs;

[0038] If so, the abnormal location information and the abnormal code are parsed from the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information; wherein there is a preset corresponding relationship between the abnormal code and the abnormal problem;

[0039] If it does not exist, directly perform data analysis on the abnormal data to determine the abnormal problem and locate the abnormality.

[0040] According to a second aspect of the present application, there is provided an abnormal display device, comprising:

[0041] A receiving unit is configured to receive abnormal data reported by a monitoring target in a working area, wherein the abnormal data includes identification information corresponding to the monitoring target, and each abnormal data corresponds to an abnormal event;

[0042] A parsing unit, configured to parse the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information;

[0043] The first display unit is configured to semantically display the identification information, the abnormal problem and the abnormal location corresponding to the abnormal event in a monitoring map.

[0044] In some embodiments, the first display unit includes:

[0045] The identification information, the corresponding abnormal problems, and the abnormal location are displayed at least through a display bar, or a display bar and a map display interface; wherein the display bar is independent of the map display interface corresponding to the working area, and the map display interface is an interface in the monitoring map for visually displaying the working area.

[0046] In some embodiments, the first display unit comprises:

[0047] A first display module is configured to display the identification information, the abnormal problems and abnormal locations corresponding to the identification information in at least a first display area of ​​the display column;

[0048] The second display module is configured to display the identification information, the corresponding abnormal problems, and the abnormal location in at least the first display area of ​​the display column, and to display the abnormal problems and the abnormal location in a graphical manner in the map display interface.

[0049] In some embodiments, the first display module is further configured to:

[0050] The abnormal problems and the abnormal locations corresponding to the identification information are displayed in the first display area according to the results of sorting the abnormalities in descending order of priority to be processed;

[0051] or

[0052] In the first display area, the abnormal problems and the abnormal locations corresponding to the identification information are displayed according to the results of descending order of the exceptions to be processed; and in the second display area of ​​the display column, the abnormal events are summarized and displayed according to the abnormal types, wherein the abnormal types include at least any one of robot abnormality, task abnormality and equipment abnormality.

[0053] In some embodiments, the second display module is further configured to:

[0054] The abnormal problem and abnormal location are displayed using different shapes at the position corresponding to the abnormal location, and using different colors based on the abnormality degree of the abnormal problem.

[0055] In some embodiments, the apparatus further comprises:

[0056] A first determination unit is configured to determine, in response to a selection instruction for a location link icon corresponding to the abnormal location, a target abnormal location corresponding to the selection instruction and target identification information corresponding to the target abnormal location after the first display unit semantically displays the identification information, the abnormal problem, and the abnormal location corresponding to the abnormal event in a monitoring map;

[0057] The second display unit is configured to frame and display the minimum display unit where the monitoring target corresponding to the target identification information is located in the map display interface, wherein the minimum display unit is the smallest unit in which the monitoring target is displayed in the map display interface.

[0058] In some embodiments, the apparatus further comprises:

[0059] The third display unit is configured to display the abnormal problem and detailed information of the monitoring target corresponding to the target identification information in the detailed information column, and the detailed information at least includes: the type, location and cause of the abnormal problem of the monitoring target.

[0060] In some embodiments, the third display unit is further configured as:

[0061] Determining whether the monitoring target is consistent with the monitoring target type displayed by the smallest display unit in the map display interface;

[0062] If they are consistent, the abnormal problem and detailed information corresponding to the monitoring target will be displayed synchronously in the detailed information column.

[0063] If there is inconsistency, a first-level display panel and a second-level display panel are displayed, in which the monitoring target is displayed graphically in the second-level display panel, and the abnormal problems and detailed information corresponding to the monitoring target are simultaneously displayed in the detailed information column; wherein, the first-level display panel is used to display the coding information of the monitoring target displayed by the minimum display unit.

[0064] In some embodiments, it also includes:

[0065] A judgment unit configured to judge whether the hidden switch is in an on state after determining that the monitoring target is inconsistent with the monitoring target type displayed by the smallest display unit in the map display interface;

[0066] an execution unit, configured to execute the display of the primary display panel and the secondary display panel if the hidden switch is in an on state;

[0067] The processing unit is configured to control the hidden switch in the monitoring map to switch to the on state if the hidden switch is in the off state, and to execute the display of the first-level display panel and the second-level display panel.

[0068] In some embodiments, the apparatus further comprises:

[0069] The second determination unit is configured to determine the target abnormal location corresponding to the click instruction and the target identification information corresponding to the target abnormal location in response to a click instruction triggered by one or more minimum display units in the map display interface after the first display unit displays the identification information, the corresponding abnormal problems, and the abnormal location through the display bar and the map display interface;

[0070] The third display unit is further configured to display the abnormal problem and detailed information corresponding to the target identification information in the detailed information column.

[0071] In some embodiments, the parsing unit is further configured to:

[0072] Determine whether the abnormal data carries abnormal location information and abnormal code corresponding to the monitoring target where the abnormality occurs;

[0073] If so, the abnormal location information and the abnormal code are parsed from the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information; wherein there is a preset corresponding relationship between the abnormal code and the abnormal problem;

[0074] If it does not exist, directly perform data analysis on the abnormal data to determine the abnormal problem and locate the abnormality.

[0075] According to a third aspect of the present application, an electronic device is provided, including:

[0076] at least one processor; and

[0077] a memory communicatively connected to the at least one processor; wherein,

[0078] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect.

[0079] According to a fourth aspect of the present application, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the first aspect above.

[0080] According to a fifth aspect of the present application, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the method according to the first aspect is implemented.

[0081] The abnormal display method, device, electronic device and storage medium provided by the present application receive abnormal data reported by the monitoring target in the working area, the abnormal data include identification information corresponding to the monitoring target, each abnormal data corresponds to an abnormal event, the abnormal data is parsed, the abnormal problem and abnormal location corresponding to the identification information are obtained, and the identification information, the abnormal problem and the abnormal location corresponding to the abnormal event are semantically displayed in the monitoring map. In the embodiment of the present application, when a problem occurs in the monitoring target, the abnormal data will be reported autonomously, and the system will analyze based on the reported abnormal data. It is not necessary to analyze and obtain abnormal data from a large amount of operating data like the prior art, and then analyze the abnormal data, which improves the efficiency of abnormal problem analysis to a certain extent; the system can autonomously analyze the abnormal data based on the reported abnormal data, and can determine the abnormal problem and abnormal location without manual analysis one by one, making the determination of abnormal problems and abnormal locations more convenient and efficient; and the abnormal events of abnormal problems and abnormal locations are displayed in the monitoring map, so that the on-site staff can quickly locate the abnormal or fault point according to the display of the monitoring map.

[0082] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0083] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present application.

[0084] Figure 1 A flowchart of an abnormal display method provided in an embodiment of the present application;

[0085] Figure 2 A schematic diagram of a map display interface provided in an embodiment of the present application;

[0086] Figure 3 This is a schematic diagram of another map display interface mentioned in an embodiment of the present application;

[0087] Figure 4 A flowchart of another abnormal display method provided in an embodiment of the present application;

[0088] Figure 5 This is a schematic diagram of another map display interface mentioned in an embodiment of the present application;

[0089] Figure 6 A schematic diagram of the structure of an abnormal display device provided in an embodiment of the present application;

[0090] Figure 7A schematic diagram of the structure of another abnormal display device provided in an embodiment of the present application;

[0091] Figure 8 A schematic block diagram of an example electronic device provided for an embodiment of the present application. DETAILED DESCRIPTION

[0092] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0093] The terms used in one or more embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of the present application. The singular forms of "a", "" and "the" used in one or more embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in one or more embodiments of the present application refers to and includes any or all possible combinations of one or more associated listed items.

[0094] It should be understood that, although the terms first, second, etc. may be used to describe various information in one or more embodiments of the present application, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0095] In the monitoring display interface of the Robot Management System (RMS system), the operating status of various types of robots, cargo shelves, equipment, etc. in the warehouse are displayed in real time, and some simplified operation capabilities of human-machine interaction are provided.

[0096] When an abnormality or failure occurs at the warehouse site, users or maintenance personnel need to retrieve the operating data from the background, analyze the operating data, and obtain the abnormal data or fault data; after obtaining the abnormal data or fault data, the abnormal data or fault data is analyzed and checked to determine the cause of the abnormality or fault, and it is also necessary to locate where the problem occurred. This method of problem troubleshooting and locating requires a lot of time to find abnormal data or fault data from the operating data due to the large amount of operating data. After obtaining the abnormal data or fault data, it is necessary to manually analyze the cause and location of the abnormality or fault one by one, which will result in a long time to determine the cause of the problem and low efficiency.

[0097] In order to solve the above problems, the embodiments of the present application provide an abnormal display method, device, electronic device and storage medium, which are described in detail one by one in the following embodiments.

[0098] Figure 1 A flowchart of an abnormal display method provided in an embodiment of the present application.

[0099] like Figure 1 As shown, the method of the embodiment of the present application is applied to the monitoring map of the RMS system, and the method comprises the following steps:

[0100] Step 101: Receive abnormal data reported by a monitoring target in a working area. The abnormal data includes identification information of the corresponding monitoring target. Each abnormal data corresponds to an abnormal event.

[0101] The monitoring targets of the embodiment of the present application are targets displayed in the monitoring map of the RMS system, including but not limited to robots, tasks, equipment, shelves, cargo spaces, cargo boxes, workstations, charging stations, etc. within the working area, wherein tasks include but are not limited to tasks performed by robots, task paths, task pauses, etc., and equipment includes but is not limited to transmission lines, stacking machines, elevators, etc. within the working area; specifically, the embodiment of the present application does not limit the specific categories of monitoring targets.

[0102] When the monitoring target determines that it has an abnormality or fault (abnormality or fault is collectively referred to as abnormality), it reports abnormal data to the RMS system, and the RMS system receives abnormal data sent by all monitoring targets. The abnormal data includes the identification information of the corresponding monitoring target, which can be the unique ID information of the monitoring target or any other form of information with unique identification. The identification information includes but is not limited to the shelf number, cargo location number, robot code, etc.

[0103] Step 102: parse the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information.

[0104] It should be noted here that the abnormal data uploaded by the monitoring target may carry at least the current position information, identification information, abnormal code and other information when the abnormality occurs. Among them, the abnormal code is a coding serial number, and one abnormal code corresponds to an abnormal problem. When the system is running, the abnormal problem is recorded by the abnormal code. Before executing the embodiment of the present application, the correspondence between the abnormal code and the abnormal problem is set. For example, the preset abnormal code: 30134, the corresponding abnormal problem is: the suction cup drops the box during the box retrieval process, the preset abnormal code: 31110, the corresponding abnormal problem is: the robot positioning fails, etc.

[0105] When specifically analyzing, it can be implemented in the following ways but not limited to: first determine whether the abnormal data carries the identification information, current location information, abnormal code and other information of the abnormal monitoring target; if so, parse the abnormal location information and abnormal code from the abnormal data to obtain the abnormal problem and abnormal location corresponding to the abnormal event. If not, directly perform data analysis on the abnormal data to determine the abnormal problem and the abnormal location where the abnormal problem occurs. Specifically, the embodiments of the present application are not limited to this, and other methods can also be used to obtain the abnormal problem and abnormal location corresponding to the identification information.

[0106] According to the correspondence between the preset abnormal code and the abnormal problem, the abnormal problem corresponding to the abnormal code in the abnormal data is determined, the abnormal position information in the abnormal data is analyzed, and the abnormal location is determined according to the abnormal position information.

[0107] As another implementation method of the embodiment of the present application, when the correspondence between the exception code and the exception problem is pre-set, a solution to the exception problem can also be set, so that when the exception problem is displayed on the map display interface, the corresponding solution is also displayed in the map display interface, thereby improving the efficiency of solving the exception problem.

[0108] For example, when the abnormal problem is that the suction cup drops the box during the box retrieval process, the solution is to check the suction cup and confirm the current box position. When the abnormal problem is that the robot fails to locate, the solution is to check whether the robot is on the QR code on the ground. The corresponding relationship between the above abnormal code, abnormal problem and solution is preset in advance, and the embodiment of this application does not limit the specific preset content.

[0109] Step 103: semantically display the identification information, abnormal problem and abnormal location corresponding to the abnormal event in the monitoring map.

[0110] The semantic display of the embodiment of the present application is to display in different forms in the human-computer interaction interface in the monitoring map. The human-computer interaction interface can be a separate pop-up dialog box, which is a display bar; it can also be a map display interface in the monitoring map, or it can be other forms of human-computer interaction interface. Specifically, this embodiment does not limit this. Among them, it should be noted that the display bar of the dialog box is independent of the map display interface and belongs to a different layer from the map display interface. The map display interface is an interface for visually displaying the working area in the monitoring map. By displaying the abnormal problems and abnormal locations semantically, the abnormal data of the monitoring target can be displayed more intuitively, so that users can more intuitively determine the abnormal causes and abnormal locations of the abnormalities, thereby speeding up the efficiency of abnormal repair.

[0111] The abnormal display method provided by the present application receives abnormal data reported by the monitoring target in the working area, each abnormal data corresponds to an abnormal event, and the abnormal event includes the identification information of the abnormal event, analyzes the abnormal data, obtains the abnormal problem and abnormal location corresponding to the identification information, and semantically displays the identification information, abnormal problem and abnormal location corresponding to the abnormal event in the monitoring map. In the embodiment of the present application, when a problem occurs in the monitoring target, the abnormal data will be reported autonomously, and the system will analyze based on the reported abnormal data. It is not necessary to analyze and obtain abnormal data from a large amount of operating data like the prior art, and then analyze the abnormal data, which improves the efficiency of abnormal problem analysis to a certain extent; the system can autonomously analyze the abnormal data based on the reported abnormal data, and can determine the abnormal problem and abnormal location without manual analysis one by one, making the determination of abnormal problems and abnormal locations more convenient and efficient; and the abnormal events of abnormal problems and abnormal locations are displayed in the monitoring map, so that the on-site staff can quickly locate the abnormality or fault point according to the display of the monitoring map.

[0112] In order to more intuitively display the abnormal data of each monitoring target in the monitoring map, the identification information, abnormal problems and abnormal locations corresponding to the abnormal events are semantically displayed in the monitoring map, which can be done in the following ways, specifically: at least display the identification information and the corresponding abnormal problems and abnormal locations through the display bar, or the display bar and the map display interface;

[0113] Among them, when the identification information and the corresponding abnormal problems and abnormal locations are displayed through the display column, the identification information, the corresponding abnormal problems, and the abnormal locations can be displayed through at least one display area, or when the number of abnormal problems is large, the identification information and the corresponding abnormal problems and abnormal locations can be displayed in different forms through multiple display areas (such as the first display area, the second display area, the map display interface, etc.). The specific embodiments of the present application are not limited to this.

[0114] In some embodiments, a display area may be set as a first display area in the display column, and the abnormal problems and abnormal locations corresponding to the identification information are displayed in the first display area according to the results of descending order of the priority of the abnormalities to be processed.

[0115] In other embodiments, two display areas may be set in the display column, namely a first display area and a second display area. In the first display area, the abnormal problems and abnormal locations corresponding to the identification information are displayed according to the results of descending sorting of the exceptions to be processed; and in the second display area of ​​the display column, the abnormal events are summarized and displayed according to the abnormal types; or the second display area may be the summary information, and the first display area may be the detailed information of each abnormal event (in list form). When the total number of abnormalities in the second display area is triggered, the page may jump to the detailed information list of the abnormal events in the first display area.

[0116] When the identification information and the corresponding abnormal problems and abnormal location are displayed in the first display area and the second display area of ​​the display bar, for easy understanding, please refer to Figure 2 , Figure 2 A schematic diagram of a map display interface of a monitoring map provided in an embodiment of the present application, Figure 2 The display bar is used to display the abnormal data and abnormal location reported by each monitoring target. The display bar is divided into a first display area and a second display area. The first display area is used to display abnormal events reported by all monitoring targets, including: identification information, abnormal details (abnormal problems) and abnormal location. For example, corresponding to Figure 2 One of the abnormal events in the first display area: identification information: 10405538, abnormal details: shelf abnormality, positioning link icon (this may also be specific location information), another abnormal event: identification information: RO65050, abnormal details: shelf abnormality, positioning link icon, wherein, when the abnormal location is a positioning connection icon, when the positioning link icon is clicked, it can be linked to the corresponding location in the map display interface. Specifically, the embodiment of the present application does not limit the number and abnormality types of abnormal events in the first display area.

[0117] In the second display area of ​​the display column, please continue to see Figure 2 , summarize and display according to the abnormal type of abnormal events. The abnormal type includes at least one of robot abnormality, task abnormality and equipment abnormality. The summary display includes but is not limited to the total amount of monitored targets and the total amount of abnormalities. For example, Figure 2The total number of robots in the task is 316, the number of exceptions is 79, the total number of tasks is 288, the total number of exceptions is 56, and so on. It should be noted that the task exceptions in the embodiment of the present application can be associated with the exceptions of each node related to the task. When a node involved in the task (such as a robot, picking up a box, returning a box, etc.) fails, it is determined that the task is abnormal. For example, when there is an abnormality in placing a box in a task, the task is determined to be abnormal; for another example, when the robot performing the task cannot locate the end point, the task is determined to be abnormal, etc. Such abnormalities are all recorded as task exceptions and recorded in the total number of task exceptions.

[0118] In some embodiments, for the abnormal data reported by each monitoring target, there are abnormal priorities. For those with higher priorities, they need to be processed first, and for those with lower priorities, they can be processed after the higher priority abnormal events are processed. Therefore, in order to more intuitively display the priority of abnormal events, when displaying the identification information and the corresponding abnormal problems and abnormal locations in the first display area of ​​the display column, it can be implemented in the following ways but not limited to:

[0119] Sort all abnormal events according to the priority of the abnormalities to be processed, and obtain the descending sorting result;

[0120] In the first display area, the abnormal problems and abnormal locations corresponding to the identification information are displayed according to the results of descending order of the abnormalities to be processed.

[0121] After the RMS system receives the exception data, after parsing the exception problem and exception location corresponding to the exception event, it re-sorts it and all the exception events in the first display area according to the exception pending priority, obtains the descending sorting result, and displays it in the first display area according to the descending sorting result of the priority. In this way, users give priority to viewing the exception events with relatively high priority.

[0122] From the description of the above embodiment, it can be seen that a dialog box pops up separately in the map display interface. The dialog box is a display bar, which is independent of the map display interface, that is, the display bar and the map display interface belong to different layers. In order to realize the synchronous display of the monitoring target in the display bar and the map display interface and make the positioning result of abnormal monitoring more accurate, in the embodiment of the present application, the identification information, abnormal problem and abnormal location corresponding to the abnormal event are semantically displayed in the monitoring map. It can be achieved in the following way, specifically: the identification information and the corresponding abnormal problems and abnormal locations are displayed in at least the first display area of ​​the display bar, and the abnormal problems and abnormal locations are displayed in different shapes at the position corresponding to the abnormal location, and different colors are used based on the abnormality degree of the abnormal problem.

[0123] For a description of displaying the identification information and the abnormal problems and abnormal locations corresponding to each other in at least the first display area of ​​the display column, please refer to Figure 2 The corresponding description will not be repeated in this embodiment. The following will specifically describe how to display the abnormal problem and abnormal location in a graphical manner in the map display interface.

[0124] In the embodiment of the present application, when displaying abnormal problems and abnormal locations in a graphical manner in the map display interface, different shapes can be used, such as circular, triangular, square logos, or different symbols, such as question marks, exclamation marks, etc.; in addition, different colors can be used to indicate the abnormality degree of abnormal events, such as red for the highest abnormality degree, yellow for a medium abnormality degree, and gray for a low priority abnormality degree. Different abnormalities are displayed at the corresponding positions (abnormal location positions) of the monitoring map, and there is no specific limitation.

[0125] In the above embodiment, when executing the semantic display of the monitoring map, the abnormal location of the abnormal event can be displayed on the map display interface on the front end (map display interface) through different color values, shapes and other graphical display methods, showing different abnormal locations and abnormal problems of different abnormal events to operators, providing convenient positioning and abnormal analysis.

[0126] To facilitate the understanding of the semantic display of monitoring maps, please refer to Figure 3 , Figure 3 This is a schematic diagram of another display interface mentioned in an embodiment of the present application. Figure 3 As shown, when the location link icon is clicked, a triangle and an exclamation mark are used to display the abnormality at the location corresponding to the abnormal location in the map display interface, and the triangle is gray to indicate that the abnormality level of the abnormal event is low. Alternatively, a triangle and an exclamation mark are used to display the abnormality at the location corresponding to the abnormal location in the map display interface, and the triangle is red ( Figure 3 (not shown) indicates that the abnormality level of the abnormal event is the highest level; it should be noted that Figure 3 This is only an exemplary description, and not a specific limitation on the position corresponding to the abnormal location displayed graphically in the map display interface.

[0127] In the embodiment of the present application, in addition to providing a semantic display effect, the monitoring map also provides certain human-computer interaction capabilities. The interaction scheme is as follows: after the identification information, abnormal problems and abnormal locations corresponding to the abnormal events are semantically displayed in the monitoring map, in response to the selection instruction of the location link icon corresponding to the abnormal location, the target abnormal location corresponding to the selection instruction and the target identification information corresponding to the target abnormal location are determined, and the minimum display unit where the abnormal monitoring target corresponding to the target identification information is located is framed and displayed in the map display interface.

[0128] Among them, it should be noted that since there are too many monitoring targets in the monitoring map, it is impossible to display all the monitoring targets in the map display interface. In the embodiment of the present application, a minimum display unit of the monitoring map is set. The minimum display unit is not the minimum monitoring target, and the minimum display unit can include multiple minimum monitoring targets.

[0129] Exemplarily, taking the minimum display unit as a shelf as an example, a shelf contains multiple cargo locations, and a shelf is a minimum display unit, and a shelf includes multiple monitored cargo location monitoring targets.

[0130] When the user clicks any positioning link icon in the first display area When the RMS system responds to the selection instruction for the target abnormal location, it determines the target identification information corresponding to the target abnormal location, and selects and displays the monitoring target corresponding to the target identification information in the map display interface. Its purpose is to achieve the synchronous (joint) display of the abnormalities in the display bar and the map display interface, so that the user can more intuitively view the specific location of the abnormal monitoring target in the map display interface, and further improve the efficiency of abnormal repair.

[0131] Please continue reading Figure 3 When the user clicks the location link icon numbered RO65050 When the abnormal position corresponding to the number RO65050 is displayed in the map display interface in the form of a box selection, the abnormal position corresponding to the number RO65050 is displayed in the map display interface. Specifically, the embodiment of the present application does not limit the selection instruction and the abnormality triggered by the user.

[0132] In some embodiments, in addition to displaying the abnormal location in the form of a box selection in the map display interface, it can also be displayed through flashing, highlighting, voice prompts, etc. The embodiment of the present application does not limit the display form of the abnormal monitoring target in the map display interface.

[0133] In another embodiment of the present application, when the user clicks Figure 3 The anchor link icon shown In addition to selecting and displaying the minimum display unit where the monitoring target corresponding to the target identification information is located, the abnormal problem and detailed information of the monitoring target corresponding to the target identification information are also displayed in the detailed information column. The detailed information at least includes: the type, location, and cause of the abnormal problem of the monitoring target. The location of the abnormal monitoring target is displayed on the map display interface, and the detailed information of the abnormal monitoring target is displayed in the detailed information column of the map display interface, so that maintenance personnel can obtain more detailed abnormal information of the abnormal monitoring target, further improving the efficiency of locating and repairing abnormalities or fault points.

[0134] In the examples of this application, Figure 4 As shown, when the target identification information corresponds to the abnormal problem of the monitoring target and the detailed information are displayed in the detailed information column, the method further includes:

[0135] Step 201, determining whether the monitoring target is consistent with the type of the monitoring target displayed by the smallest display unit in the map display interface.

[0136] The embodiment of the present application takes the minimum display unit as a shelf as an example, but in specific applications, the minimum display unit is not limited to being a shelf. Under the condition of sufficient processing resources, the minimum display unit can also be set as a cargo position, a cargo box, etc. Specifically, the embodiment of the present application does not limit the minimum display unit.

[0137] by Figure 3 Taking the selected shelf as an example, the smallest display unit where the shelf is located is framed and displayed in the map display interface by locating the link icon. The monitoring target type corresponding to the target identification information is the shelf, which is consistent with the monitoring target type displayed in the smallest display unit in the map display interface, then execute step 202.

[0138] by Figure 5 Taking the selected cargo location (numbered 10405538) as an example, the shelf where the cargo location is located (corresponding to the cargo box shelf code R104055 in the first-level display panel) is framed and displayed in the map display interface through the positioning link icon. However, the type of the monitoring target displayed by this positioning is not the monitoring target type displayed by the minimum display unit, but is contained in the minimum display unit, that is, the monitoring target type corresponding to the target identification information is the cargo location, which is inconsistent with the monitoring target type displayed by the minimum display unit in the map display interface, then execute step 203.

[0139] Step 202, the abnormal problem and detailed information corresponding to the monitoring target are synchronously displayed in the detailed information column.

[0140] Please continue reading Figure 3When it is identified that the monitoring target corresponding to the target identification information is consistent with the monitoring target type displayed by the smallest display unit in the map display interface, the detailed information and abnormal problems corresponding to the monitoring target will be synchronously displayed in the detailed information column of the map display interface, so that the displayed abnormal monitoring target is more detailed and comprehensive, which is convenient for users to view.

[0141] Step 203, displaying the primary display panel and the secondary display panel, displaying the monitoring target in a graphical manner in the secondary display panel, and synchronously displaying the abnormal problem and detailed information corresponding to the monitoring target in the detailed information column; wherein the primary display panel is used to display the coding information of the monitoring target displayed by the minimum display unit;

[0142] Please continue reading Figure 5 When it is identified that the monitoring target corresponding to the target identification information is inconsistent with the monitoring target type displayed by the smallest display unit in the map display interface, in order to display the abnormal monitoring corresponding to the target identification information, the first display panel and the second display panel will be displayed. Figure 5 The code R104055 of the cargo box rack displayed on the middle-level display panel is displayed, and the identification information corresponds one-to-one with the smallest display unit in the map.

[0143] At the same time, the monitoring target is displayed graphically in the secondary display panel, such as Figure 5 In the secondary display panel, the cargo position (10405538) corresponding to the cargo position number: 10405538 is graphically displayed using a combination of a triangle and an exclamation mark, and the triangle is gray to indicate the abnormality of the abnormal event. Specifically, the specific method of the graphical display in the secondary display panel is not limited in the present embodiment.

[0144] In an embodiment of the present application, in addition to graphically displaying the monitoring target in the secondary display panel, the abnormal problems and detailed information corresponding to the monitoring target are also synchronously displayed in the detailed information column of the map display interface. In this way, the user can directly view the abnormal problems.

[0145] For example Figure 5 The content displayed in the detailed information column includes detailed information and locking reasons (abnormal reasons), and the detailed information includes the cargo location code, cargo location type, cargo location status, shelf location, and pickup direction. Specifically, the specific content and display format of the detailed information are not limited in the embodiments of the present application.

[0146] In some embodiments, please refer to Figure 5By clicking on the shelf, cargo location and cargo box in the detailed information column, you can display the detailed information of the shelf and cargo box respectively, and the detailed information and abnormal problems of the cargo location, reflecting the display flexibility for each monitoring target.

[0147] In some embodiments, displaying the primary display panel and the secondary display panel is conditional, such as setting a hidden switch for panel expansion, which is generally closed and will be turned on under certain triggering conditions. After determining that the monitoring target is consistent with the monitoring target type displayed by the smallest display unit in the map display interface, the embodiment of the present invention further includes the following steps:

[0148] Determine whether the hidden switch is turned on;

[0149] If the hidden switch is turned on, step 203 is executed, that is, the primary display panel and the secondary display panel are displayed;

[0150] If the hidden switch is not turned on, the hidden switch in the monitoring map is turned on, and the first and second display panels are displayed.

[0151] It should be noted that the hidden switch is used to control whether to display the secondary display panel, and the primary display panel and the secondary display panel are displayed based on the hidden switch being in the turned-on state.

[0152] When the hidden switch is on, the first-level display panel and the second-level display panel are displayed. When the hidden switch is off (or not on), the first-level display panel and the second-level display panel cannot be displayed. Therefore, the system needs to control the hidden switch in the monitoring map to be switched on, and display the first-level display panel and the second-level display panel.

[0153] It should be noted that the on / off state switching of the hidden switch can be automatically controlled based on the recognition result of the target identification information. For example, when the target identification information is recognized as a cargo location, the hidden switch is automatically switched to the on state.

[0154] In another implementation, see Figure 5 , Figure 5A schematic diagram of a hidden switch is provided. The user can manually control the on / off state of the hidden switch by clicking on the hidden switch. When the user manually clicks on the hidden switch to turn it on (the corresponding icon of the hidden switch is highlighted), the primary display panel and the secondary display panel are displayed. When the user manually clicks on the hidden switch to turn it off (the corresponding icon of the hidden switch is not highlighted), the primary display panel and the secondary display panel are hidden, that is, the primary display panel and the secondary display panel are not displayed in the map display interface. The on / off state of the hidden switch can be controlled according to actual viewing needs in the above manner. Specifically, the embodiments of the present application are not limited.

[0155] The embodiment of the present invention does not limit whether the opening mode of the hidden switch is manual or automatic. During the specific implementation, it is specifically set according to specific needs.

[0156] The above embodiment illustrates that the display of abnormal monitoring targets in the map display interface and the detailed information column is realized through human-computer interaction with the display column. In addition, the embodiment of the present application also provides an interactive method, that is, through interaction with the map display interface, the display of abnormal monitoring targets in the detailed information column is realized. Specifically, it includes:

[0157] In response to a click instruction triggered on one or more minimum display units in the map display interface, determining a target abnormality location corresponding to the click instruction and target identification information corresponding to the target abnormality location;

[0158] The abnormal problems and detailed information corresponding to the target identification information are displayed in the detailed information column.

[0159] Users directly in Figure 3 or Figure 5 In the map display interface shown, human-computer interaction can be achieved by clicking operations. From the machine level, after the user clicks one or more minimum display units in the map display interface, the RMS system receives the click instruction triggered by the map display interface, determines the target abnormality location corresponding to the click instruction and the target identification information corresponding to the target abnormality location, and displays the abnormal problem and detailed information corresponding to the target identification information in the detailed information column.

[0160] Similarly, during the human-computer interaction process with the map display interface, if the monitoring target corresponding to the target identification information is inconsistent with the monitoring target type displayed by the smallest display unit in the map display interface, the first-level display panel and the second-level display panel are also displayed. The monitoring target is displayed graphically in the second-level display panel, and the abnormal problems and detailed information corresponding to the monitoring target are displayed simultaneously in the detailed information column.

[0161] The difference between the human-computer interaction based on display bar triggering in the embodiment of the present application and the human-computer interaction method based on click instructions triggered by the map display interface lies in the different triggering methods. However, after the interactive operation is triggered, the corresponding display methods and display principles of the first-level display panel and the second-level display panel are the same. For the description of displaying the first-level display panel and the second-level display panel, please refer to the detailed description of the above embodiment, so it will not be repeated here.

[0162] Corresponding to the above-mentioned abnormal display method, the present invention also provides an abnormal display device. Since the device embodiment of the present invention corresponds to the above-mentioned method embodiment, the details not disclosed in the device embodiment can be referred to the above-mentioned method embodiment, and will not be repeated in the present invention.

[0163] Figure 6 A schematic diagram of the structure of an abnormal display device provided in an embodiment of the present application, such as Figure 6 As shown, including:

[0164] The receiving unit 61 is configured to receive abnormal data reported by the monitoring target in the working area, wherein the abnormal data includes identification information of the corresponding monitoring target, and each abnormal data corresponds to an abnormal event;

[0165] The parsing unit 62 is configured to parse the abnormal data and obtain the abnormal problem and abnormal location corresponding to the identification information;

[0166] The first display unit 63 is configured to semantically display identification information, abnormal problems and abnormal locations corresponding to abnormal events in the monitoring map.

[0167] The abnormal display device provided by the present application receives abnormal data reported by the monitoring target in the working area, the abnormal data includes identification information corresponding to the monitoring target, each abnormal data corresponds to an abnormal event, analyzes the abnormal data, obtains the abnormal problem and abnormal location corresponding to the identification information, and semantically displays the identification information, abnormal problem and abnormal location corresponding to the abnormal event in the monitoring map. In the embodiment of the present application, when a problem occurs in the monitoring target, the abnormal data will be reported autonomously, and the system will analyze based on the reported abnormal data. It is not necessary to analyze and obtain abnormal data from a large amount of operating data like the prior art, and then analyze the abnormal data, which improves the efficiency of abnormal problem analysis to a certain extent; the system can autonomously analyze the abnormal data based on the reported abnormal data, and can determine the abnormal problem and abnormal location without manual analysis one by one, making the determination of abnormal problems and abnormal locations more convenient and efficient; and the abnormal events of abnormal problems and abnormal locations are displayed in the monitoring map, so that the on-site staff can quickly locate the abnormality or fault point according to the display of the monitoring map.

[0168] In some embodiments, the first display unit 63 includes:

[0169] At least the identification information and the corresponding abnormal problems and abnormal locations are displayed through the display bar, or the display bar and the map display interface; wherein the display bar is independent of the map display interface corresponding to the working area, and the map display interface is an interface used to visually display the working area in the monitoring map.

[0170] In some embodiments, the first display unit 63 includes:

[0171] The first display module 631 is configured to display the identification information, the corresponding abnormal problems and the abnormal location in at least the first display area of ​​the display column;

[0172] The second display module 632 is configured to display the identification information, the corresponding abnormal problems, and the abnormal location in at least the first display area of ​​the display column, and to display the abnormal problems and the abnormal location in a graphical manner in the map display interface.

[0173] Furthermore, in a possible implementation of the embodiment of the present application, as Figure 7 As shown, the first display module 631 is further configured as follows:

[0174] In the first display area, the abnormal problems and abnormal locations corresponding to the identification information are displayed according to the results of descending order of the abnormalities to be processed;

[0175] or

[0176] In the first display area, the abnormal problems and abnormal locations corresponding to the identification information are displayed according to the results of descending order of the exceptions to be processed; and in the second display area of ​​the display column, the abnormal events are summarized and displayed according to the abnormal types, wherein the abnormal types include at least any one of robot abnormalities, task abnormalities and equipment abnormalities.

[0177] Furthermore, in a possible implementation of the embodiment of the present application, as Figure 7 As shown, the second display module 632 is further configured as follows:

[0178] The abnormal problem and abnormal location are displayed using different shapes at the position corresponding to the abnormal location, and different colors based on the abnormal degree of the abnormal problem.

[0179] Furthermore, in a possible implementation of the embodiment of the present application, as Figure 7 As shown, the device also includes:

[0180] The first determination unit 64 is configured to determine the target abnormal location corresponding to the selection instruction and the target identification information corresponding to the target abnormal location in response to the selection instruction of the location link icon corresponding to the abnormal location after the first display unit semantically displays the identification information, abnormal problem and abnormal location corresponding to the abnormal event in the monitoring map;

[0181] The second display unit 65 is configured to frame and display the minimum display unit where the monitoring target corresponding to the target identification information is located in the map display interface, wherein the minimum display unit is the smallest unit for displaying the monitoring target in the map display interface.

[0182] Furthermore, in a possible implementation of the embodiment of the present application, as Figure 7 As shown, the device also includes:

[0183] The third display unit 66 is configured to display the abnormal problem of the monitoring target corresponding to the target identification information and detailed information in the detailed information column, and the detailed information at least includes: the type, location and cause of the abnormal problem of the monitoring target.

[0184] Furthermore, in a possible implementation of the embodiment of the present application, as Figure 7 As shown, the third display unit 66 is further configured as:

[0185] Determine whether the monitoring target is consistent with the monitoring target type displayed by the smallest display unit in the map display interface;

[0186] If they are consistent, the abnormal problems and detailed information corresponding to the monitoring target will be displayed synchronously in the detailed information column.

[0187] If there is inconsistency, the first-level display panel and the second-level display panel will be displayed. The monitoring target will be displayed graphically in the second-level display panel, and the abnormal problems and detailed information corresponding to the monitoring target will be displayed simultaneously in the detailed information column; among them, the first-level display panel is used to display the coding information of the monitoring target displayed by the smallest display unit.

[0188] Furthermore, in a possible implementation of the embodiment of the present application, as Figure 7 As shown, the device also includes:

[0189] The judging unit 67 is configured to judge whether the hidden switch is in the on state after determining that the monitoring target is consistent with the monitoring target type displayed by the smallest display unit in the map display interface;

[0190] The execution unit 68 is configured to display the primary display panel and the secondary display panel if the hidden switch is turned on;

[0191] The processing unit 69 is configured to control the hidden switch in the monitoring map to switch to the on state if the hidden switch is in the off state, and to display the primary display panel and the secondary display panel.

[0192] Furthermore, in a possible implementation of the embodiment of the present application, as Figure 7 As shown, the device also includes:

[0193] The second determination unit 610 is configured to determine the target abnormality location corresponding to the click instruction and the target identification information corresponding to the target abnormality location in response to the click instruction triggered by one or more minimum display units in the map display interface after the identification information and the corresponding abnormal problems and abnormal locations are displayed by the first display unit through the display bar and the map display interface;

[0194] The third display unit 63 is further configured to display the abnormal problem and detailed information corresponding to the target identification information in the detailed information column.

[0195] Furthermore, in a possible implementation of the embodiment of the present application, as Figure 7 As shown, the parsing unit 62 is further configured to:

[0196] Determine whether the abnormal data carries abnormal location information and abnormal code corresponding to the monitoring target where the abnormality occurs;

[0197] If so, the abnormal location information and the abnormal code are parsed from the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information; wherein there is a preset corresponding relationship between the abnormal code and the abnormal problem;

[0198] If it does not exist, directly perform data analysis on the abnormal data to determine the abnormal problem and locate the abnormality.

[0199] It should be noted that the above explanation of the method embodiment is also applicable to the device of the embodiment of the present application, the principle is the same, and it is no longer limited in the embodiment of the present application.

[0200] According to an embodiment of the present application, the present application also provides an electronic device, a readable storage medium and a computer program product.

[0201] Figure 8A schematic block diagram of an example electronic device 800 that can be used to implement an embodiment of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0202] like Figure 8 As shown, the device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a ROM (Read-Only Memory) 802 or a computer program loaded from a storage unit 808 to a RAM (Random Access Memory) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An I / O (Input / Output) interface 805 is also connected to the bus 804.

[0203] A number of components in the device 800 are connected to the I / O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0204] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, CPU (Central Processing Unit), GPU (Graphic Processing Units), various dedicated AI (Artificial Intelligence) computing chips, various computing units running machine learning model algorithms, DSP (Digital Signal Processor), and any appropriate processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as the abnormal display method. For example, in some embodiments, the abnormal display method may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 800 via ROM 802 and / or communication unit 809. When the computer program is loaded into RAM 803 and executed by the computing unit 801, one or more steps of the method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to execute the aforementioned abnormal display method in any other appropriate manner (for example, by means of firmware).

[0205] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application Specific Standard Products), SOCs (System On Chips), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that may be executed and / or interpreted on a programmable system including at least one programmable processor that may be a dedicated or general-purpose programmable processor that may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0206] The program code for implementing the method of the present application can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, implements the functions / operations specified in the flow chart and / or block diagram. The program code can be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0207] In the context of the present application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include electrical connections based on one or more lines, portable computer disks, hard disks, RAM, ROM, EPROM (Electrically Programmable Read-Only-Memory) or flash memory, optical fiber, CD-ROM (Compact Dis sc Read-Only Memory), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0208] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0209] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (Local Area Network), WAN (Wide Area Network), the Internet, and blockchain networks.

[0210] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0211] It should be noted that artificial intelligence is a discipline that studies how computers can simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), and includes both hardware-level and software-level technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, as well as machine learning / deep learning, big data processing technology, knowledge graph technology, and other major directions.

[0212] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution disclosed in this application can be achieved, and this document is not limited here.

[0213] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. An abnormal display method, characterized in that, include: Receive abnormal data reported by a monitoring target in a working area, wherein the abnormal data includes identification information of the corresponding monitoring target, and each abnormal data corresponds to an abnormal event; Analyze the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information; The identification information, the abnormal problem and the abnormal location corresponding to the abnormal event are semantically displayed in a monitoring map.

2. The method according to claim 1, characterized in that The semantically displaying the identification information, the abnormal problem and the abnormal location corresponding to the abnormal event in the monitoring map includes: The identification information, the corresponding abnormal problems, and the abnormal location are displayed at least through a display bar, or a display bar and a map display interface; wherein the display bar is independent of the map display interface corresponding to the working area, and the map display interface is an interface in the monitoring map for visually displaying the working area.

3. The method according to claim 2, characterized in that The displaying of the identification information, the abnormal problems corresponding to each other, and the abnormal location through a display column includes: displaying the identification information, the abnormal problems corresponding to each other, and the abnormal location in at least a first display area of ​​the display column; The display of the identification information, the corresponding abnormal problems, and the abnormal location through a display bar and a map display interface includes: displaying the identification information, the corresponding abnormal problems, and the abnormal location in at least the first display area of ​​the display bar, and displaying the abnormal problems and the abnormal location in a graphical manner in the map display interface.

4. The method according to claim 3, characterized in that The step of displaying the identification information, the abnormal problems corresponding to each other, and the abnormal location in at least the first display area of ​​the display column includes: The abnormal problems and the abnormal locations corresponding to the identification information are displayed in the first display area according to the results of sorting the abnormalities in descending order of priority to be processed; or In the first display area, the abnormal problems and the abnormal locations corresponding to the identification information are displayed according to the results of descending order of the exceptions to be processed; and in the second display area of ​​the display column, the abnormal events are summarized and displayed according to the abnormal types, wherein the abnormal types include at least any one of robot abnormality, task abnormality and equipment abnormality.

5. The method according to claim 3, characterized in that: The abnormal problem and the abnormal location are displayed graphically in the map display interface, including: The abnormal problem and the abnormal location are displayed using different shapes at the position corresponding to the abnormal location, and using different colors based on the abnormality degree of the abnormal problem.

6. The method according to any one of claims 2 to 5, characterized in that: After semantically displaying the identification information, the abnormal problem, and the abnormal location corresponding to the abnormal event in a monitoring map, the method further includes: In response to a selection instruction for a positioning link icon corresponding to the abnormal positioning, determining a target abnormal positioning corresponding to the selection instruction and target identification information corresponding to the target abnormal positioning; In the map display interface, the minimum display unit where the monitoring target corresponding to the target identification information is located is framed and displayed, wherein the minimum display unit is the smallest unit in which the monitoring target is displayed in the map display interface.

7. The method according to claim 6, characterized in that In the map display interface, when the minimum display unit where the monitoring target corresponding to the target identification information is located is framed and displayed, it also includes: The abnormal problem and detailed information of the monitoring target corresponding to the target identification information are displayed in the detailed information column, and the detailed information at least includes: the type, location and cause of the abnormal problem of the monitoring target.

8. The method according to claim 7, characterized in that The abnormal problem and detailed information of the monitoring target corresponding to the target identification information are displayed in the detailed information column, including: Determining whether the monitoring target is consistent with the monitoring target type displayed by the smallest display unit in the map display interface; If they are consistent, the abnormal problem and detailed information corresponding to the monitoring target will be displayed synchronously in the detailed information column. If there is inconsistency, a first-level display panel and a second-level display panel are displayed, in which the monitoring target is displayed graphically in the second-level display panel, and the abnormal problems and detailed information corresponding to the monitoring target are simultaneously displayed in the detailed information column; wherein, the first-level display panel is used to display the coding information of the monitoring target displayed by the minimum display unit.

9. The method according to claim 8, characterized in that After determining that the monitoring target is inconsistent with the monitoring target type displayed by the smallest display unit in the map display interface, the method further includes: Determine whether the hidden switch is turned on; If the hidden switch is in the on state, the display of the primary display panel and the secondary display panel is performed; If the hidden switch is in a non-on state, the hidden switch in the monitoring map is controlled to be switched to an on state, and the display of the first-level display panel and the second-level display panel is executed.

10. The method according to claim 3, characterized in that After displaying the identification information, the abnormal problems corresponding to each other, and the abnormal location through the display bar and the map display interface, the method further includes: In response to a click instruction triggered on one or more minimum display units in the map display interface, determining a target abnormality location corresponding to the click instruction and target identification information corresponding to the target abnormality location; The abnormal problem and detailed information corresponding to the target identification information are displayed in the detailed information column.

11. The method according to claim 1, characterized in that: The parsing of the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information includes: Determine whether the abnormal data carries abnormal location information and abnormal code corresponding to the monitoring target where the abnormality occurs; If so, the abnormal location information and the abnormal code are parsed from the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information; wherein there is a preset corresponding relationship between the abnormal code and the abnormal problem; If it does not exist, directly perform data analysis on the abnormal data to determine the abnormal problem and locate the abnormality.

12. An unusual display device, characterized in that: include: A receiving unit is configured to receive abnormal data reported by a monitoring target in a working area, wherein the abnormal data includes identification information corresponding to the monitoring target, and each abnormal data corresponds to an abnormal event; A parsing unit, configured to parse the abnormal data to obtain the abnormal problem and abnormal location corresponding to the identification information; The first display unit is configured to semantically display the identification information, the abnormal problem and the abnormal location corresponding to the abnormal event in a monitoring map.

13. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 11.

14. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-11.

15. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 11.

Images