Information body display method and electronic equipment

Abstract

The invention discloses an information body display method and electronic equipment. The method comprises the steps that in response to a first display instruction, a map corresponding to an operation area and display information corresponding to at least one information body set are displayed, and the at least one information body set is a result obtained by clustering multiple information bodies based on space position information and size information of the multiple information bodies in the operation area; and in response to the change of the position of the at least one information body, displaying the display information corresponding to the updated at least one information body set. The technical problem that more resources are consumed when the information body is displayed in the prior art is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of automatic driving, in particular to an information body display method and an electronic device. BACKGROUND

[0002] With the continuous improvement of mine intelligence and informatization construction, the visualization technology of mine scene becomes increasingly critical. In the visualization scene of the mine scene, there are many information bodies, such as excavators, mine cards and other equipment, which are not only numerous but also widely distributed, especially in large mines, the total number of which can reach thousands or even tens of thousands.

[0003] The existing information body display method usually directly renders all information bodies, but when displaying a large-scale information body operation area, it needs to consume a lot of system resources, especially in the case of dynamic changes of information bodies, the display of information bodies needs to be re-rendered many times, which further aggravates the problem of resource consumption.

[0004] At present, there is no effective solution to the above problems. SUMMARY

[0005] The embodiments of the present application provide an information body display method and an electronic device to at least solve the technical problem of consuming more resources when displaying information bodies in the related art.

[0006] According to an aspect of the embodiments of the present application, an information body display method is provided, including: in response to a first display instruction, displaying a map corresponding to a work area and display information corresponding to at least one information body set, wherein the at least one information body set is a result of clustering a plurality of information bodies based on spatial position information and size information of the plurality of information bodies in the work area; and in response to a change in the position of at least one information body, displaying updated display information corresponding to the at least one information body set.

[0007] According to an aspect of the embodiments of the present application, an information body display device is provided, including: a first display module configured to, in response to a first display instruction, display a map corresponding to a work area and display information corresponding to at least one first information body set, wherein the at least one first information body set is a result of clustering a plurality of information bodies based on spatial position information and size information of the plurality of information bodies in the work area; and a second display module configured to, in response to a change in the position of at least one information body, display updated display information corresponding to the at least one information body set.

[0008] According to another aspect of the embodiments of the present application, an electronic device is also provided, including: a memory storing an executable program; and a processor configured to run the program, wherein the program performs the method in the embodiments of the present application when running.

[0009] According to another aspect of the embodiments of the present application, a computer readable storage medium is also provided, which includes a stored executable program, wherein the executable program controls the device where the computer readable storage medium is located to perform the method in the embodiments of the present application when the executable program is executed.

[0010] According to another aspect of the embodiments of the present application, a computer program product is also provided, which includes a computer program, wherein the computer program implements the method in the embodiments of the present application when executed by a processor.

[0011] According to another aspect of the embodiments of the present application, a computer program product is also provided, which includes a non-volatile computer readable storage medium, wherein the non-volatile computer readable storage medium stores a computer program, and the computer program implements the method in the embodiments of the present application when executed by a processor.

[0012] According to another aspect of the embodiments of the present application, a computer program is also provided, wherein the computer program implements the method in the embodiments of the present application when executed by a processor.

[0013] In the embodiments of the present application, in response to the first display instruction, the map corresponding to the work area and the display information corresponding to the at least one information body set are displayed, and in response to the change of the position of the at least one information body, the display information corresponding to the updated at least one information body set is displayed. It is easy to note that, by using the dynamic clustering and instant updating mode, the spatial position information and the size information of the information bodies are used to perform the clustering analysis on the plurality of information bodies, the information bodies in the work area are displayed in the form of the information body set, unnecessary rendering is reduced, and the system load is reduced. Moreover, when the position of the information body changes, the re-clustering and updating of the information body set are triggered immediately, the display content is ensured to always match the latest information body position, the purpose of saving the display resource is achieved, the technical effect of reducing unnecessary resource consumption is achieved, and the technical problem that the resource consumption is large when the information body is displayed in the related art is solved. BRIEF DESCRIPTION OF DRAWINGS

[0014] The accompanying drawings, which are included to provide a further understanding of the present application and are incorporated in and constitute a part of this application, illustrate embodiments of the present application and serve to explain the present application. In the drawings:

[0015] Figure 1 is a schematic diagram of an information body display method according to an embodiment of the present application;

[0016] Figure 2 is a schematic diagram of an optional information body processing method according to an embodiment of the present application;

[0017] Figure 3 is a schematic view of an information body display device according to an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to make the persons skilled in the art better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative efforts should fall within the protection scope of the present application.

[0019] It should be noted that the terms "first", "second", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to include only those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to the process, method, product or device.

[0020] According to an embodiment of the present application, a method embodiment of an information body display method is provided. It should be noted that the steps shown in the flowchart of the drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described herein can be executed in an order different from that shown herein.

[0021] Figure 1 is a flowchart of an information body display method according to an embodiment of the present application, as shown in Figure 1 , the method comprises the following steps:

[0022] Step S102, in response to the first display instruction, displaying a map corresponding to the work area, and display information corresponding to at least one information body set.

[0023] Among them, at least one information body set is the result of clustering a plurality of information bodies based on the spatial position information and size information of the plurality of information bodies in the work area.

[0024] The first display instruction mentioned above can be a command issued by a user or a system. The first display instruction can be used to request the visualization system to display the layout and status of a specific work area and information bodies located in the area. The first display instruction can be a signal triggering the display of a map or information display. The first display instruction can not only help the user or system quickly locate the position of interest, but also present the real-time status of the work area, including equipment distribution, running status, etc., through visualization, thereby assisting decision-making and scheduling. The first display instruction can include, but is not limited to, the following: identification of the work area, display mode or parameters, etc. The content of the first display instruction is not limited here and can be determined as needed. The identification of the work area can be the name, number, or spatial coordinates, size, etc. of the work area, which is used to clearly indicate the work area to be displayed. The display mode or parameters can be used to indicate how the system displays the work area and information bodies. For example, whether to zoom in to display details, whether to display equipment status, whether to display statistical information, etc.

[0025] The first display instruction can be obtained in the following ways: For example, the user can click, drag, zoom, or select the work area, etc. The system recognizes these operations and converts them into the first display instruction. Alternatively, the first display instruction can be automatically sent based on predetermined events or conditions, such as when the equipment status changes, the equipment enters or leaves a specific area, or when the system detects a situation that needs to update the display. Alternatively, it can also accept instructions from other external systems, such as real-time update data from a scheduling system, thereby automatically adjusting the display content. For example, by calling the application programming interface of the visualization system, the first display instruction with specific parameters can be sent to control the display output in a customized manner.

[0026] The work area mentioned above can be a geographical range in a specific application scenario, which is defined or divided on a map and used to control the space for specific tasks or activities. The work area can be rectangular, irregular polygon, etc. The shape of the work area is not limited and can be determined as needed. This depends on the type of work and the terrain. The work area can be represented by geographical coordinates, polygons on a map, or other spatial positioning. When visualizing, the information body position and activities are located within the work area, which helps to understand and analyze the actual situation of the mine operation. In the mine scene, the work area can be a complete mine area including loading area, unloading area, intersection, road, etc. The work area can also be a mining area, a mining face, a transportation channel, a warehouse area, a mechanical equipment workstation, etc. For example, the work area can refer to the loading area where loading operations are performed. The work area can be in an open-pit mine or in a tunnel. The location of the work area is not limited here and can be determined as needed.

[0027] Through the corresponding map of the work area, not only can the work be controlled and managed in real time, but also visual basis is provided, thereby improving work safety and work efficiency. The map provides detailed location information of the work area, helping equipment and personnel accurately find the destination or work site. The map can integrate data from different sources, such as equipment location, work progress, geological data, etc., and present it to the user in a visual way, making it easier to understand and make decisions. Based on the distribution of equipment and resources on the map, plans such as equipment scheduling and material transportation can be made to achieve efficient management. In emergency situations, the map can quickly provide an overview of the scene, helping rescue teams understand dangerous areas and develop evacuation or response measures.

[0028] The map corresponding to the work area can include but is not limited to: geographical boundaries and terrain, to clearly mark the boundaries of the work area and the terrain features within the area, such as elevation, topography, water bodies, etc.; equipment and resource locations, to display the location information of various mechanical equipment, vehicles, warehouses, work sites, etc. within the work area; routes and networks, to depict transportation routes, communication networks, power lines, and other infrastructure, in order to plan paths and check network conditions; status signs, to represent the status of the area or equipment with colors, icons or other visual elements, such as normal operation, maintenance, failure, etc. Data analysis layer, to superimpose various data analysis results, such as heat maps, density maps, to display equipment work intensity, personnel distribution density, etc. information; time series information, to record historical data, allowing users or systems to review work conditions at a certain time in the past.

[0029] The information body described above can refer to an entity object that can be perceived, tracked, and displayed by the system. That is, the information body can refer to a physical or logical entity. The information body has a motion attribute, that is, the position and size at different times can be different. The information body can involve multi-dimensional data such as spatial position information, size information, time series information, state changes, interaction with the environment, etc. In different scenarios, the specific forms and functions of the information body will be different, but in the mine scene, the information body can refer to the following entities: mechanical equipment such as excavators, loaders, mine trucks, etc. Tools; staff such as operators, maintenance personnel, safety supervisors, etc.; natural resources such as ores, fuels, water, etc.; infrastructure such as roads, warehouses, power facilities, communication networks, etc. Here, the content of the information body is not limited, and can be determined as needed. The content of the information body can include but is not limited to: spatial position, size information, state information, type identification, time series data, interaction information, etc. Here, the content of the information body is not limited, and can be determined as needed. The state information can refer to the running state of the information body (such as working, idle, maintenance), health status (such as failure, low efficiency), loading condition (such as full load, empty load), etc. Type identification can refer to the type of information body, such as excavators, mine trucks, warehouses, etc., for easy classification management and identification. Time series data can refer to the historical position and state change of the information body, which is helpful for analyzing trends and behavior patterns. Interaction information can refer to the dynamic interaction record of the information body with other entities or the environment, such as cooperation between devices, collision detection with obstacles, etc. By collecting and analyzing the data of the information body, its position, state and behavior can be monitored in real time. Understanding the distribution and state of the information body can improve resource allocation efficiency, such as scheduling appropriate equipment to the right place and reducing resource waste. The data of the information body can be used to control the automatic operation of the equipment, achieving more efficient and safe operation. The data of the information body can also be used for statistical analysis, performance testing, fault prediction, etc.

[0030] The spatial position information described above can refer to the data of the specific position of the information body in the geographical space. The spatial position information can refer to geographic coordinates such as longitude and latitude, projection coordinates, altitude, etc. It can also include more detailed position descriptions, such as position relationship information between different information bodies. Alternatively, the spatial position information can also include direction and orientation, speed and moving direction, etc., which are more important for information bodies in motion. By tracking the spatial position information of the information body in real time, it is convenient to track and schedule equipment in real time, ensure that the equipment moves efficiently between different work points, avoid collisions between equipment, and improve production efficiency. Spatial position information helps monitor the position of personnel and equipment, and timely discovers unsafe behavior or potential danger, such as equipment entering prohibited areas, personnel approaching mine danger points, etc., thereby improving the safety of the mine. Spatial position information can also be used to better plan the work area, design efficient material transportation paths, and reasonably arrange the layout of equipment and personnel.

[0031] The size information described above describes the size of the information body in space, which can be the actual physical size, such as length, width, height, or the size of the image or icon representing the information body in the visualization system. These data are used to determine the visual representation of the information body on the map, and whether they intersect with other information bodies or the screen edge, thereby determining the clustering and display of the information body. In the mine scene, these information is crucial for understanding and improving the layout of the equipment, scheduling.

[0032] The information body set described above can be the result of clustering a plurality of information bodies in the work area based on the spatial position information and size information of the plurality of information bodies. That is, the information body set can be a group of entities formed by clustering a plurality of information bodies with similar spatial positions in the work area. Each information body set can represent a group of entities adjacent or overlapping in geographical space, which share certain characteristics or states. In the mine scene, the information body can be a excavator, a mine truck, a detection device, etc. By clustering, information bodies that are visually similar or overlapping can be combined into a set to reduce system resource consumption and improve visualization efficiency. The information body set can have one or more, and the number of information body sets is not limited here and can be determined as needed.

[0033] The display information described above can be used to represent the visualization elements and data of the information body and its set. The display information can include, but is not limited to, the position, state (such as whether it is running, running mode), number, type, etc. of the information body set, as well as the aggregated information of each information body set, such as the total number of information bodies in the information body set, type distribution, average state, etc. The display information can be an icon, a label, color coding, dynamic effects, etc. The display form of the display information is not limited here and can be determined as needed. The display information can be used to intuitively convey the real-time status and important attributes of each information body or set to the user.

[0034] In an optional embodiment, the map corresponding to the work area and the display information corresponding to at least one information body set can be displayed through a user interaction interface. The user interaction interface provides a channel for the user to perform clicking, dragging, zooming, or selecting operations, etc. After the backend listens to these operations, it is converted into a first display instruction to automatically obtain and display the map corresponding to the work area and the display information corresponding to at least one information body set.

[0035] In yet another optional embodiment, when the user issues the first display instruction through the mobile device to request to view the work area or the information body, the responsive design framework is adopted to ensure that the map is well displayed on different devices and screen sizes, and the backend adjusts the data format and information complexity of the data sent according to the data carried by the first display instruction, thereby improving the display effect across devices. At the same time, the display information of the information body set is adjusted according to the screen size and device performance, such as simplifying the visual expression of the information body on a small screen device, and providing more detailed information on a large screen device.

[0036] In yet another optional embodiment, when the first display instruction is received, the snapshot in the cache can be directly loaded and then displayed. That is, the snapshot of the display information corresponding to the work area map and the information body set can be pre-rendered and stored in the local or cloud cache. For frequently accessed work areas, the backend can periodically generate pre-rendered snapshots according to the display information corresponding to the information body set, and the frontend can query the snapshot in the cache according to the first display instruction. If the snapshot exists, it is immediately displayed. If the snapshot does not exist, it is rendered in real time as needed and the cache is updated.

[0037] In another optional embodiment, the display information corresponding to the map and the at least one information body set can be displayed after being rendered based on different levels of the map (for example, a terrain layer, a device layer, a state layer, etc.), so that the map and the information body set have different display priorities and detailed levels at different levels. The parameters in the first display instruction can be parsed to dynamically adjust the visibility and transparency of each layer.

[0038] Step S104, in response to the change of the position of the at least one information body, display the updated display information corresponding to the at least one information body set.

[0039] In a work site, such as a mine work site, a large number of dynamic information bodies are involved. Continuous updating of the position of the information body is crucial to ensuring work safety, improving production efficiency, and allocating resources. Dynamic positioning of the information body helps to detect the movement of devices and personnel in real time, and timely discover potential safety hazards, such as devices entering restricted areas, personnel approaching dangerous sources, etc., so as to take preventive measures. Accurate updating of the position of the information body can help the scheduling system to dynamically adjust the work plan, real-time allocate resources, avoid idle or excessive concentration of devices, and ensure smooth and efficient work flow. By tracking the change of the position of the information body, the utilization rate of the device, the material flow path, etc. can be analyzed to provide data support for resource management, and the rational allocation and utilization of resources can be achieved. The dynamically updated display information enables the user to intuitively understand the overall status of the work, thereby improving the work efficiency.

[0040] The change of the information body position can be determined by, but not limited to, the following ways: through the sensor equipment such as laser radar, camera, etc. installed on the information body, the position data of the information body is continuously collected. In the mine environment, the position of the information body can also be determined by combining base station positioning, inertial measurement unit, etc. The position change threshold can be set to determine whether the position of the information body has changed. For example, when the information body moves more than 1 meter, it is considered that the position has changed, and the value here is only an example. This can be realized by comparing the coordinate data difference between the two time points before and after.

[0041] After confirming the change of the information body position, the system will re-calculate the representation of the information body on the map according to the new position data, such as icon position, label update, etc., and push these updated information to all related clients, including the monitors in the control room, mobile devices.

[0042] In an optional embodiment, an event-driven mechanism can be used to define event trigger conditions, such as when the device moves more than a certain threshold or enters a critical work area, triggering a position update instruction to re-cluster the information body set to which the information body belongs, to confirm the information body set after the position update of the information body. After confirming the update of the information body set, the display information corresponding to at least one updated information body set can be displayed.

[0043] In yet another optional embodiment, edge computing nodes can be deployed near the information body or in the work area. These nodes can quickly process sensor data to identify changes in the position of the information body. The edge nodes upload the preliminary processing results to the cloud server, which can update the display information corresponding to the information body set according to the aggregated data from all edge nodes, and then issue update instructions to all related clients to display the updated information on the display interface.

[0044] In another optional embodiment, real-time communication channels can be established using server-sent events protocol, web socket protocol, etc. When the position of the information body changes, the latest position data is immediately pushed to all clients that subscribe to the information body update. After receiving the event of the change of the position of the information body, the client updates the position of the corresponding information body on the map. Only the affected information body and its surrounding work area need to be rendered, without the need to redraw the entire map, which can significantly reduce the computational load and time delay of map update.

[0045] By introducing information bodies to represent the digital representations of entities such as vehicles, equipment, and other entities in a mine, efficient management and visualization of a large number of entities in a mine scene are achieved. Specifically, by responding to a first display instruction, the system can intuitively display a set of information bodies on a map, each set consisting of information bodies with similar sizes and close geographical locations, which greatly simplifies the visual information and avoids visual confusion caused by too many single information bodies. At the same time, when the positions of the information bodies change, the system can update the clustering state of these information bodies in real time to ensure the accuracy of the displayed information. This method not only improves the efficiency of mine management, but also reduces the pressure of data processing, especially when dealing with large-scale data sets, its advantages are more obvious.

[0046] In the embodiments of the present application, in response to a first display instruction, a map corresponding to the work area and display information corresponding to at least one information body set are displayed, and in response to a change in the position of at least one information body, display information corresponding to the updated at least one information body set is displayed. It is easy to note that dynamic clustering and real-time updating are used, and through the spatial position information and size information of the information bodies, clustering analysis is performed on multiple information bodies, and the information bodies in the work area are displayed through information body sets, reducing unnecessary rendering and reducing system load. And when the position of the information body changes, the re-clustering and updating of the information body set are triggered immediately, ensuring that the display content always matches the latest information body position, achieving the purpose of saving display resources, thereby realizing the technical effect of reducing unnecessary resource consumption, and further solving the technical problem of consuming more resources when displaying information bodies in the related art.

[0047] Optionally, the display information includes a set type icon and / or an information body type icon, and the set type is determined based on the type of at least one information body included in the information body set.

[0048] In a visualization system that handles a large number of information bodies, in order to improve the readability of the information and the aesthetics of the interface, icons can be used to represent different types of information body sets. By adding set type icons and information body type icons to the display information, different information body sets can be more intuitively distinguished, for example, a truck set can be represented by a truck icon, and a excavator set can be represented by a excavator icon. This design not only improves the friendliness of the user interface, but also enables users to quickly identify specific types of sets. Set type icons and information body type icons can help users quickly understand the types, states, and distributions of information bodies in the system through graphical means, which is an important means to improve the information transmission efficiency and user experience of the visualization system. When dealing with a large number of information bodies in a mine scene, reasonable use of these icons can effectively reduce visual interference, provide clearer and more intuitive information display, and improve the interactivity and response speed of the system.

[0049] The set type icon can refer to an icon used to represent a group of information bodies with common characteristics or attributes. The set type icon can also be a general icon used to represent a set of information bodies composed of different types of information bodies performing different tasks. The information bodies in an information body set can belong to the same category, perform similar tasks, or appear in the same work area. The design and use of the set type icon can be based on the analysis of the information body set. For example, when multiple information bodies belong to the same type, the system can display a set type icon to represent multiple information bodies belonging to this type, for example, in a mine scene, multiple mine trucks can be aggregated as a "mine truck set icon" representation. The set type icon can also reflect the functional state of the information body set, such as the working state of the device, the task execution state, etc. For example, the "excavation device set icon" can be displayed in green when all devices are in working state, and in red when there are devices in maintenance or fault state. The same set type icon can also be used on information bodies with similar geographical locations, which can reduce visual clutter on the map and improve the clarity of information body locations. For example, when the representations of multiple devices on the map are too dense, a set icon can be used instead, while displaying the number or type of information bodies in the set.

[0050] The set type icon can be represented by shape, color, etc. The set type icon can also be represented by a static icon. A dynamic icon can also be used. For example, the set icon can have dynamic effects such as flashing, rotating or size changing, etc. to indicate the activity state or importance of the information body set. For example, a high-speed rotating icon represents a high-activity device set. The representation of the set type icon is not limited here and can be determined as needed.

[0051] The determination of the set type can be based on the type of at least one information body contained in the information body set. The type of the information body can be the physical attribute, functional attribute, state attribute of the information body, and the type of the information body is not limited here and can be determined as needed. It should be noted that the type of the information body can change over time, state and location, so it is necessary to monitor these changes and adjust the type of the information body in time to update the display information. For example, a mine truck can be identified as "empty" when it is not loaded, and as "loading" when it starts to load.

[0052] For example, for mine managers, by looking at the icons on the map, they can quickly understand the type distribution of the main work devices in a certain area, and then adjust the work plan. The set type icon is not randomly generated, but is determined according to the properties (such as function, category, state) of the information bodies in the information body set, and the purpose is to represent a group of information bodies in a more concise and intuitive way on the map or interface.

[0053] For example, in a mine visualization system, assume that the system identifies 20 excavators that are loading raw materials in the same area. These excavators have a common operational mode, function, and working status, i.e., they are all performing loading operations. The system will group these pieces of information into a set based on their common "loading excavator" type, and represent this "loading excavator set" on the map with a set type icon, e.g., a large, yellow excavator icon. This icon not only represents the presence of the excavators, but also reflects their common activity, i.e., loading operation.

[0054] However, when this loading operation is completed, these 20 excavators can no longer belong to the same set of information pieces, e.g., 5 of them need to be dispatched with a slurry conveyor to another operation area for slurry conveying operation. At this time, the original "loading excavator set" icon is no longer applicable, because the task attributes and spatial locations of these excavators have changed. By monitoring the status and location changes of the information pieces in real time, the common operation purpose and area of this group of excavators and slurry conveyor can be identified. Thus, a new set of information pieces, named "slurry conveying operation set", is obtained, and a brand new set type icon is designed to represent this combination. This icon can be a combination of an excavator icon and a slurry conveyor icon, surrounded by a dynamic green light ring to emphasize that this group of equipment is performing a new, high-priority slurry conveying operation. This icon is also displayed on the map with appropriate size and position to ensure that the user can quickly identify this operation set.

[0055] The dynamic generation and update of the set type icon in the mine visualization system is achieved by real-time analysis of the type, status, and spatial location of the information pieces. This mechanism greatly enhances the adaptability and flexibility of the system to complex operation scenarios, ensures the real-time and accuracy of the information, provides a powerful decision support tool for mine operation, and also improves the user's visual experience and operational efficiency.

[0056] The above information piece type icon can represent the type of a single information piece, i.e., the information piece type is usually used to visualize the purpose of each information piece in the system. The information piece type icon can be determined by the function, status, or configuration attribute of the information piece. Information pieces with different implementation functions have their specific icon representations, so that the user can quickly identify and understand the function of each information piece. The information piece type icon can also be generated by superimposing the current status of the information piece, such as working, standby, fault, etc., so that the user can quickly grasp the working condition of the equipment information piece.

[0057] The information body type icon can adopt a standardized icon, using a widely recognized icon to represent a specific device or object, such as a car icon representing a mine truck, a hammer icon representing a shovel, and a camera icon representing a detection device. Alternatively, a specially designed icon can be used to reflect the uniqueness or functional characteristics of the information body. For example, a unique icon is designed for a special heavy machinery in the mine, which is distinguished from other vehicles or equipment on the map.

[0058] The information body type icon can reflect the state of the information body, such as working, resting, and maintenance, through changes in the appearance of the icon, such as color, brightness, and outline. For example, a shovel icon in working condition can be displayed in gold, and a stopped one in gray. Changes in the size and transparency of the information body type icon can represent the relative importance of the information body or its density on the map. In areas with high density of information bodies, the icon size can be appropriately reduced or the transparency can be increased to avoid overlapping between icons and improve visibility.

[0059] For example, in a mine scene, the collection type icon can be a large circle containing small icons of "shovel", "mine truck", and "loader", representing a cluster of devices performing joint mining operations, and the color of the circle changes according to the average working state of the cluster. The information body type icon, such as a mine truck icon, can have a small battery icon below it, showing the power status of the device; if the mine truck is in transport, the icon can be displayed in green with an arrow pointing forward; if it is in maintenance state, the icon turns yellow with a hammer pattern covering it.

[0060] Optionally, if the number of information bodies contained in any one information body collection is greater than a preset number, the information display includes a numerical text corresponding to the number of information bodies.

[0061] The above-mentioned preset number is a threshold value defined by the system or the user, which is used to determine whether an information body collection is too large to require additional display measures to avoid information overload or interface confusion. For example, the preset number can be 10, 20, 50, etc., and the preset number can also be 100, 500, etc. The specific value depends on the performance of the system, the size of the display area, and the friendliness requirements of the user interface. The values here are only examples.

[0062] When detecting that any one information body set contains a number of information bodies exceeding the preset number, the visualization system will adopt an additional display strategy. The most direct way is to use numerical text, that is, to display a number next to or on the icon of the set type, indicating how many information bodies are contained in the set. The design of this function is mainly to avoid the disturbance of displaying a large number of information bodies to the user, so that displaying the information body set combined with the number can help users intuitively understand the size of the information body. It not only simplifies the interface, improves the user's understanding and operation efficiency, and ensures the stability of the system and user experience under large-scale data visualization. For example, if a "loader set" contains 25 loaders, the number "25" may be displayed next to the set icon to help users quickly understand the size of the information body set.

[0063] In the display system of mine operations, this display strategy is particularly important. Because there may be a large number of equipment and entities in the mine area at the same time, a single set icon may not display the specific number, which may make it difficult for users to judge the size of the set, thereby affecting decision-making efficiency. By adding numerical text, the system can ensure that users can intuitively obtain key data even in information-intensive environments, avoiding ambiguity and possible misinterpretation of information. In addition, this method also helps to allocate system resources. In a set with a large number of information bodies, directly rendering the icon and information of each information body may greatly consume system resources, leading to performance degradation. By using the display method of set icon combined with numerical text, the system can significantly reduce resource consumption, maintain the response speed and fluency of the interface, and ensure the accuracy and integrity of the information.

[0064] For example, in a busy operation area of a mine, there may be a large number of mine cars and equipment running at the same time. At this time, directly displaying the icons of all information bodies will cause visual confusion. By displaying numerical text, users can immediately understand the density of information bodies in the area, which helps to take appropriate management measures. This method can be used but not limited to in any scenario that needs to handle high-density information body display, such as urban traffic, logistics management, etc., to improve the clarity and efficiency of information display.

[0065] Optionally, the above method further includes: in response to the second display instruction, displaying information of the information bodies contained in the information body set corresponding to the second display instruction.

[0066] The present disclosure also supports flexible adjustment of the display details of the information body set according to different display requirements. For example, when the user needs more detailed information, the second display instruction can be used to request display, and the system can display the specific information of each information body in the information body set, such as the model, state, and the like. This method not only improves the user experience, but also avoids unnecessary calculation and network transmission overhead. It can be used in, but not limited to, any application scenario that requires dynamic adjustment of information display granularity, such as remote detection and data analysis, to adapt to the needs of different users and device performance.

[0067] The second display instruction described above can be a command triggered by the user through interface operation. For example, the second display instruction can be an instruction triggered based on the user selecting an information body set from a plurality of information body sets. The second display instruction can be used to request the system to display detailed information of a specific information body set with higher display quality. The second display instruction can include, but is not limited to, information body set identification, information body attribute, display parameter, information granularity, data integrity, and the like. The content of the second display instruction is not limited here and can be determined as needed. The second display instruction allows the user to view detailed information of each information body in the information body set, such as the model, working state, operator, and current work progress of each excavator. This is crucial for fine scheduling and troubleshooting. The second display instruction provides a quick access and display channel, allowing direct access to fine-level data such as real-time location and performance state of the device, thereby making more accurate scheduling arrangements. Moreover, by responding to the user's second display instruction, the system also enhances interaction with the user, provides multi-level information access, and meets the user's query needs in different scenarios. The second display instruction can indicate the level of detail and clarity of the information body information displayed in the information body set. After receiving the second display instruction, the display of the information body can include more detailed parameters, real-time data streams, operator information, device state history, and the like to provide the user with a comprehensive information view of the information body.

[0068] In an optional embodiment, when the second display instruction is received, the snapshot in the cache can be directly loaded and displayed. That is, the snapshot of the information body information contained in the information body set can be pre-rendered and stored in the local or cloud cache. For frequently displayed information body sets, the backend can periodically generate pre-rendered snapshots based on the information body information contained in the information body set, and the frontend can query the snapshot in the cache according to the second display instruction. If the snapshot exists, it is displayed immediately. If the snapshot does not exist, it is rendered in real time as needed and the cache is updated.

[0069] In another alternative embodiment, an event-driven mechanism can be utilized to define event trigger conditions, such as listening to a double-click operation by the user to trigger the second display instruction, and after the second display instruction is parsed, the information of the information body contained in the information body set corresponding to the second display instruction is displayed. Specifically, the information of the information body contained in the information body set corresponding to the second display instruction can be displayed in the form of a pop-up panel, a detail card, or an interactive icon.

[0070] In yet another alternative embodiment, a hierarchical detail technique can be utilized to create a model of multiple display levels for the information body set. In the initial state, a rough model is displayed, and when the second display instruction is received, the system quickly switches to a more detailed model to display the information of the information body contained in the information body set corresponding to the second display instruction, thereby improving the clarity and richness of information display.

[0071] For example, in a mine visualization system, suppose there is an icon on the map representing a "loading excavator set", which displays the total number of excavators in the set and the current operating status. When a dispatcher needs to know the specific working conditions of each excavator in the set, he can issue a second display instruction (such as double-clicking the set icon), and after the system receives the instruction, it will display detailed information of the set. The original set icon on the map may expand into an information panel listing the model, working status, operator name, current location, and operation timeline of each excavator. In addition, the panel may also provide dynamic tables, charts, and other visualization tools to help the dispatcher quickly assess the efficiency and maintenance needs of each excavator, providing a basis for subsequent decision-making and scheduling. Through this multi-level display mechanism, the mine visualization system not only quickly responds to the user's overview needs, but also provides in-depth information queries when needed, significantly improving the system's information processing capabilities and user experience.

[0072] Optionally, the above method further includes one of the following: in response to a local zoom-in instruction, displaying the display information corresponding to the information body set updated based on the zoomed-in pixels in the zoomed-in local area; and in response to a zoom-out instruction, displaying the display information corresponding to the information body set updated based on the zoomed-out pixels.

[0073] By supporting local zoom in and zoom out functions, users can focus on specific operating areas as needed, or observe the entire operating area from a macro perspective. For example, in local zoom out mode, users can view the equipment distribution and working status of a small mining area in detail, which is crucial for refined management; while in zoom out mode, users can quickly browse the operating status of the entire mine, which helps with overall planning and scheduling. The implementation of these two functions not only improves the availability of information, but also enhances the flexibility of the system. This can be used in, but not limited to, any application scenario that requires multi-scale views, such as geographic information systems and architectural design, to meet users' information needs in different situations.

[0074] The above-mentioned local zoom instruction may refer to a command issued by a user or a system. The local zoom instruction may be used to request a zoomed display of a specific area on a map. The details of the area may be magnified by increasing the display scale. This local zoom instruction may usually be triggered by mouse operations (such as scrolling along the table, dragging a selection box), gestures (such as pinch-to-zoom on a touch-screen device) or specific keyboard shortcuts. The triggering method of the local zoom instruction is not limited here and may be determined as needed. The local zoom instruction may include but is not limited to: display parameters, information body collection identifiers, etc. The content of the local zoom instruction is not limited here and may be determined as needed. Zooming in on a local area enables users to view more detailed display information of a collection of information bodies. Zoomed display helps users accurately locate the location of the information body, which is crucial for emergency response, equipment maintenance or detailed planning of specific work areas. When the user zooms in on a part, the display of the information body will be recalculated based on the magnified pixel information, and the information body will be regrouped and sorted to adapt to the new display scale to ensure the accuracy of the information and the improvement of the visualization effect.

[0075] The above-mentioned zoom-out instruction may refer to a command issued by a user or a system, and the zoom-out instruction may be used to request that the display ratio be reduced so as to see a wider range of overview information. The zoom-out instruction may include but is not limited to: display parameters, information body collection identifiers, etc. The content of the zoom-out instruction is not limited here and can be determined as needed. Zooming out helps users view the overview of the entire system or mining area at the same time, and understand the overall layout and equipment distribution. When zooming out, dense information body collections may be aggregated and displayed to reduce information overload on the screen, and the number and category of information body collections may be displayed through icons or digital text to maintain the clarity and visual beauty of the interface. Reducing the display ratio can reduce the number of information bodies that need to be rendered, reduce the burden on system resources, improve the loading speed and response efficiency of the map, and enable the system to remain smooth under large-scale data sets.

[0076] In an alternative embodiment, when the user selects a local zoom-in or zoom-out operation, the pixel coordinates and size of the information body at the new scale can be calculated in real time, so that in the zoomed-in local area, the display information corresponding to the information body set updated based on the zoomed-in pixels is displayed; or, in the zoomed-out local area, the display information corresponding to the information body set updated based on the zoomed-out pixels is displayed.

[0077] Alternatively, an event-driven mechanism can be used to define event trigger conditions, such as local zoom-in, to trigger the generation of a local zoom-in instruction, and in the zoomed-in local area, the display information corresponding to the information body set updated based on the zoomed-in pixels is displayed. For example, a zoom-out event can be defined to trigger the generation of a zoom-out instruction, and the display information corresponding to the information body set updated based on the zoomed-out pixels is displayed.

[0078] In another alternative embodiment, a hierarchical detail model can be designed for each information body, including multiple levels of appearance and attribute details. When a local zoom-in instruction is received, the system switches to a higher detail level model to display more information; when a zoom-out instruction is received, it switches to a lower detail level model to display the display information corresponding to the information body set updated based on the zoomed-out pixels. Different levels of information body models can be generated and stored in advance, and a fast switching mechanism can be designed to ensure the smoothness and accuracy of the information body display during local zoom-in or zoom-out.

[0079] Optionally, the above method further comprises: for any one of the plurality of information bodies, based on the spatial position information and the size information of the information body, abstract processing is performed on the information body to obtain display area information of the information body; based on the display area information of the plurality of information bodies, clustering is performed on the plurality of information bodies to obtain at least one information body set; for any one of the at least one information body set, based on the display area information of the at least one information body contained in the information body set, the display range of the display information corresponding to the information body set is determined.

[0080] The display area information of the information body can be a description and definition of the visual display area of the information body on the screen. The display area information can reflect the spatial position and size information of the information body, as well as shape information and the like. Through the display area information, the display manner and range of each information body in the visualization interface can be controlled. Through the display area information, the information body can be accurately placed at a specific position on the screen, and the size can be adjusted according to the spatial position information and size information of the information body, so as to ensure that the visual display of each information body not only conforms to the real position of the geographic space, but also can adapt to the screen display under different scales, and provide accurate information display for the user. The display area information can be the basis for clustering of the information body. The system can automatically group multiple information bodies into an information body set based on the overlap or proximity of the information body display area information, reduce the information overload on the screen, and when the information bodies are dense, the summary information of the set can be used instead of the detailed information of the single information body, so as to improve the readability and visual clarity of the map.

[0081] After obtaining the display area information of each information body, the display range of the display information corresponding to the information set can be determined, that is, for the information body set, the determination of the display range is based on the display area information of the information body in the set. This display range covers the boundary of the display area of all information bodies in the information body set, and this boundary defines the visual display range of the information body set, so as to ensure that the user can view the display information corresponding to the information body set without missing any details.

[0082] In an optional embodiment, the shape of the information body can be simplified to a basic geometric shape such as a rectangle or a circle, and the minimum circumscribed shape of the information body can be calculated based on the spatial position information and size information of the information body to determine the display area information of the information body. For example, the parameters of the minimum circumscribed shape of the information body can be predicted by a neural network model using the spatial position information and size information of the information body, so as to obtain the display area information of the information body. Alternatively, a mathematical relationship between the spatial position and size information of the information body and the parameters of the minimum circumscribed shape of the information body can be established by a regression analysis model, so as to obtain the display area information of the information body.

[0083] Then, the display area information of the information body can be indexed by using a spatial index structure such as a quadtree, a space-filling curve, or the like. Through spatial query, information bodies with similar geographic positions can be quickly located, so as to obtain at least one information body set. Alternatively, the information body set can also be obtained by clustering according to the center point coordinates of the display area information of the information body.

[0084] Finally, for any one of the at least one information body set, the display range of the display information corresponding to the information body set can be determined based on the display area information of at least one information body contained in the information body set. Specifically, the minimum enclosing rectangle, minimum enclosing polygon, or minimum enclosing circle of the display area information of all the information bodies in the information body set can be calculated as the display range of the set.

[0085] In another optional embodiment, mathematical transformations such as affine transformations and rotational transformations can be used to dynamically adjust the size and position of a preset shape template based on the spatial position and size information of the information body to determine the display area information of the information body. The display area information of multiple information bodies can then be input into a density-based clustering algorithm, a deep learning-based clustering model, or other models to cluster the multiple information bodies and obtain at least one information body set. Thus, the coordinates of the center point of the information body set can be first determined, for example, by calculating the average coordinates of the center points of the display area information of all information bodies. Then, based on the distance from these center points to the farthest point of the display area information of the information body in the set, the radius of a circular display range can be determined, thereby obtaining the display range of the display information corresponding to the information body set.

[0086] By converting the spatial location and size information of an information volume into display area information, information volumes can be effectively abstracted, a key step in achieving information volume clustering. For example, the 3D coordinates and size of a minecart can be converted into rectangular areas on a map, and then information volumes can be clustered based on these rectangular areas. This approach not only simplifies the representation of information volumes but also improves clustering efficiency and accuracy. The display range is determined to ensure that the displayed information does not exceed the actual coverage area of ​​the information volume to avoid misleading users. This can be used in, but is not limited to, any application scenario that requires mapping 3D spatial information onto a 2D plane, such as virtual reality and augmented reality, to achieve effective information display and management.

[0087] Optionally, based on the spatial position information and size information of the information body, the information body is abstracted to obtain the display area information of the information body, including: converting the spatial position information of the information body from three-dimensional space to the pixel space corresponding to the display interface to obtain pixel position information; based on the size information of the information body, the information body is abstracted to obtain the occupied area information of the information body, wherein the graphic formed by the occupied area information is a rectangle; based on the pixel position information and the occupied area information, the display area information of the information body is determined; optionally, based on the size information of the information body, the information body is abstracted to obtain the occupied area information of the information body, including: based on the current zoom ratio of the map, determining the zoom factor of the information body; based on the zoom factor and size information of the information body, obtaining the occupied area information of the information body.

[0088] The pixel position information mentioned above can refer to two-dimensional pixel information of the information body under the display interface. The pixel position information can be represented by the number of pixels. In three-dimensional space, the position of the information body is represented by three-dimensional coordinates (such as latitude, longitude, and height). When these information bodies need to be visualized on the display interface, the system can convert the three-dimensional position information into pixel coordinates on the screen. This process can be achieved by projection transformation, which maps three-dimensional coordinates to a two-dimensional coordinate system to accurately present the position of the information body on the display interface. The pixel position information ensures that the accurate positions of the information bodies on the display interface correspond, allowing users to intuitively understand the positions of the information bodies in the real world. Through the pixel position information, users can interact with the information bodies on the display interface, such as clicking, selecting, zooming, and other operations, which depend on accurate identification of the pixel position information of the information bodies.

[0089] The occupation area information mentioned above can refer to the spatial range occupied by the information body on the display interface. The graph formed by the occupation area information can be a rectangle, a square, a circle, etc., and the graph formed by the occupation area information is not limited here and can be determined as needed. The size information (such as length, width, and height) of the information body in three-dimensional space is a manifestation of its physical size, but when displayed on the screen, these dimensions need to be converted to pixel dimensions according to the projection and display scale to form the occupation area information. The occupation area information not only reflects the visual size of the information body on the screen, but also takes into account factors such as projection transformation, screen resolution, and scaling ratio. The occupation area information can be used to visualize the size and shape of the information body, helping users understand the relative size and positional relationship of each information body. By determining the occupation area information of each information body, collision detection can be performed to avoid overlapping and occlusion of information body icons on the display interface, ensuring that all information bodies can be clearly identified and displayed. Knowing the size of the occupied area of each information body can facilitate the allocation of system resources, for example, larger information bodies may require more rendering resources, while small information bodies can be simplified to improve the overall rendering speed and efficiency of the system.

[0090] The combination of pixel position information and occupation area information is an important foundation for efficient, accurate, and aesthetically pleasing visualization of three-dimensional space information bodies on a two-dimensional display interface. Through these information, the layout and rendering of information bodies are improved, and user interaction with information bodies is supported, providing a better user experience. In application scenarios such as mine display systems, accurate calculation and application of these information not only improve the visualization performance of the system, but also enhance the practicality and user-friendliness of the system.

[0091] In an optional embodiment, the spatial position information of the information body can be converted from the three-dimensional space to the pixel space corresponding to the display interface by orthographic projection or perspective projection to obtain pixel position information. Alternatively, the spatial position information of the input information body can be converted by a machine learning model to obtain the pixel position information. The machine learning model can be a random forest, a support vector machine, or a convolutional neural network model, and the type of the machine learning model is not limited herein and can be determined as needed.

[0092] Moreover, the minimum circumscribed rectangle can be calculated according to the size information of the information body by using an algorithm such as a scan line algorithm or a quadtree, so as to obtain the occupied area information of the information body. Alternatively, the size information of the input information body can be processed by a machine learning model to obtain the occupied area information of the information body. The machine learning model can be a random forest, a support vector machine, or a convolutional neural network model, and the type of the machine learning model is not limited herein and can be determined as needed.

[0093] After obtaining the pixel position information and the occupied area information of the information body, the possible overlap can be detected based on the pixel position information and the occupied area information of the information body by using an algorithm such as an axis-aligned bounding box or a directional bounding box, so as to determine the display area information of the information body, ensure that each information body has sufficient display space, and avoid visual confusion. Alternatively, the display area information of the information body can be predicted and determined by using historical data and a machine learning method such as a convolutional neural network or a long short-term memory network.

[0094] The present disclosure realizes accurate representation of the information body on the map by converting the information body position information in the three-dimensional space into pixel position information on the display interface and determining the occupied area information based on the size of the information body and the map zoom ratio. For example, the coordinates and size of a mine car in the three-dimensional space can be represented by an accurate rectangular area on the map after conversion, and the size of the area is affected by the map zoom ratio, so that the representation of the information body is accurate and accurate at different display levels. This method not only improves the accuracy of information display, but also enhances the adaptability of the system, which can meet the display requirements of different resolutions and screen sizes.

[0095] In an optional embodiment, the information body is abstracted based on the size information of the information body to obtain the occupied area information of the information body. Specifically, the zoom factor of the information body can be determined based on the current zoom ratio of the map, and the occupied area information of the information body can be obtained based on the zoom factor and the size information of the information body. That is, the occupied size information of the information body is adjusted based on the current zoom ratio of the map to ensure that the aggregation process of the information body matches the current zoom ratio of the map.

[0096] The zoom factor of the information body can be determined by a deep neural network. Alternatively, a plurality of zoom ratio thresholds of the map can be preset, each threshold corresponding to a different zoom factor of the information body. After determining the current zoom ratio of the map, the corresponding zoom factor can be queried as the zoom factor of the information body. Further, the machine learning model can be used to predict the occupied area information of the information body according to the input zoom factor and size information of the information body. The machine learning model can be a random forest, a support vector machine or a convolutional neural network model, and the type of the machine learning model is not limited herein and can be determined as needed. Alternatively, the size of the information body at the current zoom ratio can be calculated using a geometric algorithm based on the size information and the zoom factor of the information body, and then the occupied area information of the information body can be obtained.

[0097] Optionally, the plurality of information bodies are clustered based on the display area information of the plurality of information bodies to obtain at least one information body set, including: sorting the plurality of information bodies according to a preset clustering strategy to obtain a first sequence; taking the first information body in the first sequence as a clustering center, and sequentially comparing the display area information of other information bodies in the first sequence with the display area information of the first information body, wherein the other information bodies are information bodies in the first sequence except the first information body; in response to the display area information of the other information bodies intersecting with the display area information of the first information body, or the display area information of the other information bodies being located within the display area information of the first information body, the other information bodies and the first information body are aggregated into an information body set; the information bodies in the information body set are removed from the first sequence, and the steps of taking the first information body in the first sequence as a clustering center, and sequentially comparing the display area information of other information bodies in the first sequence with the display area information of the first information body, and aggregating the other information bodies and the first information body into an information body set are repeatedly executed until there is no information body in the first sequence; optionally, the plurality of information bodies are clustered based on the display area information of the plurality of information bodies to obtain at least one information body set, including one of: classifying the plurality of information bodies based on the types of the plurality of information bodies to obtain at least one classification result, and clustering the information bodies in the same classification result based on the display area information of the information bodies in the same classification result to obtain at least one information body set; determining a display range based on the current pixel, comparing the display area information of the plurality of information bodies with the display range, determining at least one target information body in the plurality of information bodies, and aggregating the at least one target information body based on the display area information of the at least one target information body to obtain at least one information body set, wherein the display area information of the target information body intersects with the display range, or the display area information of the target information body is located within the display range.

[0098] In an alternative embodiment, the first sequence can be generated using the area size of the display region of the information body as the basis for sorting. That is, the information bodies are sorted in descending order of the area size of the display region of the information body. Then, the information body with the largest area size is selected as the first cluster center from the first sequence, and then compared with the display region information of the next information body in the sequence. If the display region of the subsequent information body intersects or is located inside the cluster center, they are added to the same information body set. In this way, overlapping or small information bodies within the range of a large information body can be aggregated. Then, the information bodies that have been added to the information body set are removed from the first sequence, and the above process is repeated until the sequence is empty, and each cluster center will form a respective information body set.

[0099] In another alternative embodiment, the first sequence can be generated by sorting the information bodies in order of spatial density through a nearest neighbor search of a quadtree. The first information body in the first sequence is regarded as the initial cluster center, and other information bodies that intersect or contain it are quickly queried using a quadtree. The use of a quadtree significantly speeds up the search and comparison process. After all information bodies that intersect or contain the cluster center are added to the same information body set, the information bodies that have been added to the information body set are removed, and the remaining information bodies are iteratively clustered using the quadtree until all information bodies have been processed.

[0100] In addition, clustering the plurality of information bodies based on the display region information of the plurality of information bodies to obtain at least one information body set can include one of the following: the plurality of information bodies can be classified and then the information bodies of the same class are clustered. Specifically, the plurality of information bodies can be classified according to a predetermined classification rule using a rule engine to obtain at least one classification result. Alternatively, the plurality of information bodies can also be classified using a classification algorithm to obtain at least one classification result. Then, the information bodies in each classification result are indexed using a spatial indexing technique to quickly find geographically adjacent information bodies. A density-based clustering algorithm is used to spatially cluster the information bodies in the same classification result to obtain at least one information body set. A suitable distance threshold can be set to ensure the reasonableness and efficiency of clustering. Alternatively, a deep clustering network (such as a clustering network based on contrastive learning) can also be trained, with the input being the display region information of each information body in the classification result and the output being the clustering relationship of the information bodies, thereby obtaining at least one information body set.

[0101] By aggregating information bodies within the display range, the amount of data for information body aggregation is reduced, and the efficiency of information body display is improved. Specifically, the pixel range of the current view of the user can be captured in real time using a graphics network library technology to determine the display range. Then, the display area information of each information body is pixelated and compared with the display range to find the target information body (i.e., the information body whose display area information intersects with or is located within the display range). Moreover, a K-dimensional tree algorithm is used to spatially cluster the target information bodies, which can quickly find geographically adjacent information bodies to form an information body set. Thus, only the information body set, rather than all individual information bodies, can be displayed, thereby reducing the rendering burden and improving the map loading speed and user experience. Alternatively, a streaming server is established to dynamically track the pixel view and transmit the corresponding map display range information in real time.

[0102] Moreover, a deep learning model is trained with the display area information of the information bodies and the display range as input and the target information bodies as output. The model identifies the information bodies that intersect with or are located within the display range based on the display area information of the target information bodies. The deep learning model can be constructed based on a convolutional neural network or an object detection network. Then, a density clustering algorithm is used to intelligently cluster the target information bodies to form an information body set.

[0103] By implementing an efficient clustering strategy, the present disclosure can quickly classify a large number of information bodies, reduce information redundancy on the map, and improve the visualization effect. For example, a greedy algorithm can be used to sort and cluster the information bodies to ensure that each clustering contains as many information bodies as possible, thereby reducing the number of clusters and improving the efficiency of information display. In addition, classification based on information body type and then clustering, or information body screening based on the current display range and then clustering, are both designed to better adapt to user needs and system performance. This method not only improves the display of information bodies, but also enhances the intelligence and response speed of the system.

[0104] Optionally, based on the display area information of at least one information body included in the information body set, the display range of the display information corresponding to the information body set is determined, including: removing information bodies that satisfy a preset condition from the at least one information body to obtain remaining information bodies, wherein the display area information of the information bodies that satisfy the preset condition is located within the display area information of the remaining information bodies; and determining the display range of the display information corresponding to the information body set based on the display area information of the remaining information bodies.

[0105] In an alternative embodiment, the display area information of all information bodies can be loaded, and then a collision detection algorithm is applied to traverse all information bodies to find out those whose display areas are completely covered by other information bodies. Those information bodies that meet the preset condition (i.e., whose display areas are completely covered) are deleted from the information body set, and the remaining information bodies are the set of information bodies that are visible at the current zoom level. Then, based on the display area information of the remaining information bodies, a spatial index data structure such as a quadtree or a K-dimensional tree is used to determine the effective display range of the information body set on the display interface. Thus, the pixel bounding box of the remaining information bodies is calculated, i.e., the smallest rectangle that contains the display areas of all remaining information bodies, to define the display range of the display information.

[0106] In another alternative embodiment, each information body can be assigned a priority score, which can be determined based on its type, user interest, and other dynamic factors. After traversing all information bodies and identifying those that meet the preset condition, e.g., information bodies with low priority scores and whose display areas are obscured by other information bodies, these identified information bodies are deleted to ensure that the information bodies are always visible. The remaining information bodies are sorted, and high-priority information bodies are displayed first, and then the display range is expanded to ensure that other important information bodies can also be seen. When the number of information bodies is large and cannot all be displayed, the display range of the display information is dynamically adjusted according to the priority to display the most relevant and important information.

[0107] The present disclosure determines the display range of the information body set by removing information bodies that are obscured by other information bodies, avoids overlapping between information body icons, ensures the clarity of information display, and ensures that the final display range can cover the display area information of all information bodies in the same information body set. For example, in a mine scene, if two mine cars are very close to each other, their display areas may overlap, at which time the system automatically hides the smaller information body icon and only displays the larger or higher-priority icon, thereby avoiding visual interference. This method not only improves the quality of information display but also improves the layout effect of the user interface.

[0108] The technical scheme provided in the present application is described below in combination with an optional embodiment. The present application provides an optional information body display method. Based on the characteristics of a visualization system, in combination with the spatial position information of information entities and the pixel size of the entities in the visualization system, and based on the key information, the information bodies important to the system are sorted and grouped. For the information bodies, the spatial position information is converted to pixel position information in the display interface. If the converted pixel points are within the pixel range of a certain information body, they are classified into a category. If the pixel points are not within the pixel range of the information body, a new set of information body groups is formed. If it is detected that the pixel points exceed the display range, they are removed. Finally, multiple sets of information body groups are formed. At the same time, the zoom levels of different maps in the visualization system are re-sorted and grouped to adapt to the different zoom levels.

[0109] Since the information bodies existing in the visualization scene are not only represented by a pixel point, but also occupy a certain space and size, the size of the actual information body is considered in the process of information body aggregation and classification. The specific steps are as follows: the display information of the information body is calculated for size to obtain the size of the information body range, which is abstracted into a rectangular frame; the abstracted rectangular frame is classified and searched in combination with a certain range to classify the information bodies; the topological relationship between the information body and the search range is considered in the classification process, that is, whether there is intersection, inclusion, etc. If there is intersection and inclusion, the information bodies are classified into a set of information bodies. Otherwise, they are classified into another set of information bodies. Since the information bodies have motion attributes such as spatial position and display size, dynamic classification can be used, that is, an information body in class A at a previous moment may be in class B at a next moment, or may exist alone.

[0110] According to the final sorting and grouping results, the information entities are displayed. The information bodies in a group are displayed in the form of an information body set. The information bodies not in the information body set are displayed alone. In this way, the resources in the system are greatly reduced, achieving the purpose of saving system resources and improving operation efficiency.

[0111] As shown in Figure 2 , a method of information body processing is shown. After determining the information body, the position and pixel information are extracted, or the position and pixel information are extracted when the position and pixel information change. Then, grouping information storage is performed based on the position and pixel information to sort and group the information bodies, and form a grouping result.

[0112] According to an embodiment of the present application, a device embodiment of an information body display device is provided. It should be noted that the device can be used to execute the above-mentioned information body display method.

[0113] Figure 3is a schematic diagram of an information body display device according to an embodiment of the present application, as shown, the device comprises: Figure 3

[0114] A first display module 32 is configured to display a map corresponding to a work area and display information corresponding to at least one first information body set in response to a first display instruction, wherein the at least one first information body set is obtained by clustering a plurality of information bodies based on spatial position information and size information of the plurality of information bodies in the work area.

[0115] A second display module 34 is configured to display updated display information corresponding to the at least one information body set in response to a change in the position of at least one information body.

[0116] Optionally, the display information comprises a set type icon and / or an information body type icon, and the set type is determined based on the type of at least one information body included in the information body set.

[0117] Optionally, in a case where the number of information bodies included in any one information body set is greater than a preset number, the display information comprises a numerical text corresponding to the number of information bodies.

[0118] Optionally, the device further comprises a third display module configured to display information of information bodies included in an information body set corresponding to a second display instruction in response to the second display instruction.

[0119] Optionally, the device further comprises a control module configured to perform one of the following: in response to a local zoom-in instruction, display display information corresponding to an information body set updated based on zoomed-in pixels in a zoomed-in local area; and in response to a zoom-out instruction, display display information corresponding to an information body set updated based on zoomed-out pixels.

[0120] Optionally, the device further comprises a determination module configured to: for any one information body of a plurality of information bodies, perform abstract processing on the information body based on spatial position information and size information of the information body to obtain display area information of the information body; cluster the plurality of information bodies based on the display area information of the plurality of information bodies to obtain at least one information body set; and for any one information body set of the at least one information body set, determine a display range of display information corresponding to the information body set based on display area information of at least one information body included in the information body set.

[0121] ​Optionally, the determining module is further configured to convert the spatial position information of the information body from a three-dimensional space to a pixel space corresponding to the display interface to obtain pixel position information; perform abstract processing on the information body based on the size information of the information body to obtain occupation area information of the information body, wherein a graph formed by the occupation area information is a rectangle; and determine the display area information of the information body based on the pixel position information and the occupation area information. Optionally, the determining module is further configured to determine a scaling factor of the information body based on a current zoom ratio of the map; and obtain the occupation area information of the information body based on the scaling factor and the size information of the information body.

[0122] Optionally, the determining module is further configured to sort the plurality of information bodies according to a preset clustering strategy to obtain a first sequence; take a first information body in the first sequence as a clustering center, and compare display area information of other information bodies in the first sequence with the display area information of the first information body in sequence, wherein the other information bodies are information bodies in the first sequence except the first information body; in response to the display area information of the other information bodies intersecting with the display area information of the first information body, or the display area information of the other information bodies being located within the display area information of the first information body, aggregate the other information bodies and the first information body into an information body set; remove the information bodies in the information body set from the first sequence, and repeatedly execute the steps of taking the first information body in the first sequence as the clustering center, comparing the display area information of the other information bodies in the first sequence with the display area information of the first information body in sequence, and aggregating the other information bodies and the first information body into the information body set until there is no information body in the first sequence; optionally, the determining module is further configured to classify the plurality of information bodies based on types of the plurality of information bodies to obtain at least one classification result, and cluster information bodies in a same classification result based on the display area information of the information bodies in the same classification result to obtain at least one information body set; determine a display range based on a current pixel, compare the display area information of the plurality of information bodies with the display range, determine at least one target information body in the plurality of information bodies, and aggregate the at least one target information body based on the display area information of the at least one target information body to obtain at least one information body set, wherein the display area information of the target information body intersects with the display range, or the display area information of the target information body is located within the display range.

[0123] Optionally, the determining module is further configured to remove an information body satisfying a preset condition from the at least one information body to obtain a remaining information body, wherein the display area information of the information body satisfying the preset condition is located within the display area information of the remaining information body; and determine a display range of display information corresponding to the information body set based on the display area information of the remaining information body.

[0124] The embodiment of the present application further provides an electronic device, comprising a memory storing an executable program; and a processor configured to execute the program, wherein the program is configured to execute the method in the various embodiments of the present application when executed.

[0125] The embodiment of the present application further provides a computer readable storage medium, comprising a stored executable program, wherein the computer readable storage medium is configured to execute the method in the various embodiments of the present application when the executable program is executed.

[0126] The embodiment of the present application further provides a computer program product, comprising a computer program configured to implement the method in the various embodiments of the present application when executed by a processor.

[0127] The embodiment of the present application further provides a computer program product, comprising a non-volatile computer readable storage medium configured to store a computer program, wherein the computer program is configured to implement the method in the various embodiments of the present application when executed by a processor.

[0128] The embodiment of the present application further provides a computer program configured to implement the method in the various embodiments of the present application when executed by a processor.

[0129] In the above-described embodiments of the present application, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0130] In several embodiments provided in the present application, it should be understood that the disclosed technical contents can be implemented by other manners. Among them, the apparatus embodiment described above is only schematic, for example, the division of the units can be a logical function division, and in actual implementation, there can be another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units or modules shown or discussed can be indirect coupling or communication connection through some interfaces, units or modules, which can be electrical or other forms.

[0131] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of units. According to actual needs, part or all of the units can be selected to achieve the purpose of the embodiment.

[0132] In addition, each function unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software function unit.

[0133] When the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application, essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present application. The foregoing storage medium includes: a U disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a mobile hard disk, a magnetic disk or an optical disk, and various program code storage media.

[0134] The above is only the preferred embodiment of the present application, and it should be pointed out that for those skilled in the art, without departing from the principles of the present application, a number of improvements and refinements can be made, and these improvements and refinements should be considered as the protection scope of the present application.

Claims

1. A method for displaying an information body, characterized in that: include: In response to the first display instruction, display a map corresponding to the work area and display information corresponding to at least one information body set, wherein the at least one information body set is a result of clustering multiple information bodies within the work area based on spatial position information and size information of the multiple information bodies; In response to a change in the position of at least one information body, displaying updated presentation information corresponding to the at least one information body set.

2. The method according to claim 1, characterized in that The display information includes a collection type icon and / or an information body type icon, and the collection type is determined based on the type of at least one information body included in the information body collection.

3. The method according to claim 1, characterized in that In the case that the number of information bodies included in any information body set is greater than a preset number, the display information includes digital text corresponding to the number of information bodies.

4. The method according to claim 3, characterized in that The method further comprises: In response to the second display instruction, information of the information body included in the information body set corresponding to the second display instruction is displayed.

5. The method according to claim 1, wherein The method further includes one of the following: In response to the local zoom-in instruction, displaying, in the zoomed-in local area, presentation information corresponding to the updated information set based on the zoomed-in pixels; In response to the zoom-out instruction, presentation information corresponding to the updated information body set based on the zoomed-out pixels is displayed.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: For any one of the multiple information bodies, abstract processing is performed on the information body based on the spatial position information and size information of the information body to obtain display area information of the information body; clustering the multiple information bodies based on the display area information of the multiple information bodies to obtain the at least one information body set; For any one of the at least one information body set, a display range of display information corresponding to the information body set is determined based on display area information of at least one information body included in the information body set.

7. The method according to claim 6, characterized in that Based on the spatial position information and size information of the information body, the information body is abstracted to obtain the display area information of the information body, including: Converting the spatial position information of the information body from the three-dimensional space to the pixel space corresponding to the display interface to obtain pixel position information; Based on the size information of the information body, abstract processing is performed on the information body to obtain occupied area information of the information body, wherein the graphic formed by the occupied area information is a rectangle; Determining display area information of the information body based on the pixel position information and the occupied area information; Optionally, performing abstract processing on the information body based on the size information of the information body to obtain occupied area information of the information body includes: determining a zoom factor for the information body based on a current zoom ratio of the map; Based on the scaling factor and size information of the information body, occupied area information of the information body is obtained.

8. The method according to claim 6, characterized in that Clustering the multiple information bodies based on the display area information of the multiple information bodies to obtain the at least one information body set includes: Sorting the multiple information bodies according to a preset clustering strategy to obtain a first sequence; Taking the first information body in the first sequence as the cluster center, and sequentially comparing the display area information of other information bodies in the first sequence with the display area information of the first information body, wherein the other information bodies are information bodies in the first sequence other than the first information body; In response to the display area information of the other information body intersecting with the display area information of the first information body, or the display area information of the other information body being located within the display area information of the first information body, aggregating the other information body and the first information body into an information body set; removing information bodies from the information body set from the first sequence, and repeatedly performing the steps of using the first information body in the first sequence as a cluster center, sequentially comparing the display area information of other information bodies in the first sequence with the display area information of the first information body, and aggregating the other information bodies and the first information body into an information body set, until no information body exists in the first sequence; Optionally, clustering the multiple information bodies based on the display area information of the multiple information bodies to obtain the at least one information body set includes one of the following: classifying the multiple information bodies based on types of the multiple information bodies to obtain at least one classification result, and clustering the information bodies in the same classification result based on display area information of the information bodies in the same classification result to obtain the at least one information body set; Based on the current pixel, the display range is determined, the display area information of the multiple information bodies is compared with the display range, at least one target information body among the multiple information bodies is determined, and based on the display area information of the at least one target information body, the at least one target information body is aggregated to obtain the at least one information body set, wherein the display area information of the target information body intersects with the display range, or the display area information of the target information body is located within the display range.

9. The method according to claim 6, characterized in that Determining, based on display area information of at least one information body included in the information body set, a display range of display information corresponding to the information body set, including: Eliminating an information body that meets a preset condition from the at least one information body to obtain a remaining information body, wherein the display area information of the information body that meets the preset condition is located within the display area information of the remaining information body; Based on the display area information of the remaining information bodies, a display range of the display information corresponding to the information body set is determined.

10. An electronic device, characterized in that: include: a memory storing an executable program; A processor, configured to run the program, wherein the program executes the method according to any one of claims 1 to 9 when running.

Images