Industrial knowledge graph display method and device, medium and product
Patent Information
- Application Number
- CN202280096992.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-18
- Publication Date
- 2025-01-21
AI Technical Summary
The traditional presentation method of industrial knowledge graphs suffers from excessive information density, overlapping visual elements, and rigid overall layout, resulting in poor user experience.
Hexagonal grid layout is used to assist in displaying the industrial knowledge graph, by displaying nodes in the center of the hexagonal grid layout, and using optional multiple connection methods to display the edges between nodes, combined with pseudo-three-dimensional or three-dimensional forms and progressive multi-view switching , improve user experience.
It achieves a clear and complete display of the industrial knowledge graph, avoids dense information and overlapping visual elements, and improves user experience and view switching efficiency.
Smart Images

Figure CN119343672A_ABST
Abstract
Description
Industrial knowledge graph display method, equipment, medium and product Technical Field
[0001] Embodiments of the present disclosure generally relate to the field of computers, and more specifically to methods, devices, media, and products for displaying industrial knowledge graphs. Background Art
[0002] A knowledge graph (KG) is a structured semantic knowledge base that is used to visually describe concepts and their relationships in the physical world. A knowledge graph is essentially a semantic network that reveals the relationships between entities. Typically, a knowledge graph consists of multiple nodes, each representing an entity. Some nodes are connected by directed or undirected edges, which represent the relationships between nodes. Technologies related to knowledge graph implementation include knowledge extraction (such as entity extraction, relationship extraction, and attribute extraction), knowledge fusion, and knowledge processing.
[0003] Industrial knowledge graphs are constructed by classifying various types of industrial data using knowledge graphs, natural language processing, and / or artificial intelligence (AI) technologies, thereby empowering industrial decision-making or production. Knowledge graphs have become a hot topic in industrial discussions about AI, demonstrating significant potential and capabilities in systematically organizing diverse types of knowledge collected from all aspects of the production process. By properly analyzing well-organized industrial knowledge, more efficient, better management, and innovative ideas can be realized. Currently, the construction and application of industrial knowledge graphs have been extensively researched and have achieved considerable progress.
[0004] Summary of the Invention
[0005] As mentioned above, although knowledge graphs have some applications in industry, the inventors of this application have noticed that the traditional presentation method of industrial knowledge graphs has a series of problems such as excessive information density, overlapping visual elements, and rigid overall layout. Therefore, the user experience of traditional industrial knowledge graphs is not good.
[0006] To this end, embodiments of the present disclosure provide methods, devices, media, and products for displaying industrial knowledge graphs. According to embodiments of the present disclosure, a hexagonal grid layout is used to assist in the display of the industrial knowledge graph, with each node displayed at the center of each grid and multiple optional wiring methods used to display the edges between nodes. This allows the content of the industrial knowledge graph to be presented in a complete and clear manner, greatly improving the user experience when browsing the knowledge graph.
[0007] In the first aspect of the present disclosure, a method for displaying an industrial knowledge graph is provided. The method includes: determining a hexagonal grid layout for the industrial knowledge graph, wherein in the hexagonal grid layout, a non-edge grid is surrounded by six grids, and the centers of the six grids constitute a hexagon; displaying multiple nodes in the industrial knowledge graph at the center of each of the multiple grids in the hexagonal grid layout; and based on the semantic relationship between the multiple nodes, using at least one of the following lines to display multiple edges between the multiple nodes: a straight line, a broken line, and a curve. In this way, the hexagonal grid layout is used to assist in the display of the industrial knowledge graph, each node is displayed at the center of each grid, and a variety of optional lines are used to display the edges between the nodes. This can present the content of the industrial knowledge graph in a complete and clear manner, greatly improving the user experience when displaying the knowledge graph.
[0008] In some embodiments, the non-edge cells and the six cells are all hexagons, and the hexagon formed by the centers of the six cells is an equilateral hexagon. By using hexagons to form a hexagonal honeycomb, it is possible to ensure that the hexagons formed by the centers of adjacent cells are equilateral hexagons, effectively ensuring user experience.
[0009] In some embodiments, the non-edge grids and the six grids are all quadrilaterals, and the hexagon formed by the centers of the six grids is a non-equilateral hexagon. Although the grid is arranged using quadrilaterals, the staggered arrangement can also achieve a hexagonal shape where the center lines connecting the six adjacent grids of each grid are connected, thereby improving the applicability of the solution.
[0010] In some embodiments, displaying multiple nodes in the industrial knowledge graph at the center of each of multiple grids in a hexagonal grid layout includes: placing a first node in a first grid among the multiple grids; placing a second node in a second grid among the multiple grids, wherein the second grid is adjacent to the first grid; and placing a third node in a third grid among the multiple grids, wherein the third grid is not adjacent to the first grid or the second grid. In this manner, nodes can be located in any grid on the board, and any two nodes can be located in adjacent or non-adjacent grids, so that the nodes are not too dense or crowded.
[0011] In some embodiments, the method further includes: displaying the industrial knowledge graph in a pseudo-3D or 3D form by deflecting and rotating the hexagonal grid layout. Providing a pseudo-3D or 3D form can further enhance the user experience of the industrial knowledge graph.
[0012] In some embodiments, the method further includes: displaying the industrial knowledge graph in a global view, wherein in the global view, the text in multiple nodes and multiple edges is hidden; in response to receiving a first user input for a first node among the multiple nodes in the global view, displaying the industrial knowledge graph in a local view, wherein in the local view, the text of at least one of the nodes and edges associated with the first node is displayed; and in response to receiving a second user input for the first node in the local view, displaying the industrial knowledge graph in a focused view, wherein in the focused view, the description information of the first node is displayed through a window. By setting three progressive views, the content of the knowledge graph can be viewed from different perspectives, which not only improves the overall experience of the knowledge graph, but also enables the graph information to be viewed in more detail and with greater focus.
[0013] In some embodiments, the method further includes: in response to receiving a third user input in the focused view, displaying the industrial knowledge graph in a local view; and in response to receiving a fourth user input in the local view, displaying the industrial knowledge graph in a global view. By setting a switching method between different views, flexible switching can be achieved.
[0014] In some embodiments, the method further includes: in response to receiving a fifth user input for the first node in the global view, displaying the industrial knowledge graph in the focused view; and in response to receiving a sixth user input for the first node in the focused view, displaying the industrial knowledge graph in the global view. This allows switching between the global view and the focused view to be performed directly, bypassing the local views in the intermediate layer, thereby improving view switching efficiency.
[0015] In some embodiments, displaying the industrial knowledge graph in a global view includes: displaying a first type of node among the plurality of nodes with a first icon; and displaying a second type of node among the plurality of nodes with a second icon, wherein the second icon is different from the first icon. In this way, the overall situation of all nodes can be more intuitively presented in the global view.
[0016] In some embodiments, displaying the industrial knowledge graph in a global view includes: clustering multiple nodes into multiple groups; and displaying the multiple groups in the global view in a point cloud manner. By clustering and grouping, clustering relationships between nodes can be quickly obtained, making it easier to understand the overall situation of the knowledge graph.
[0017] In some embodiments, displaying the industrial knowledge graph in a partial view includes: determining a first group of related nodes within a predetermined distance from a first node; and displaying the first group of related nodes and their text in the partial view. By displaying only nodes near a central node, not only can nodes related to the central node be displayed, but the presentation of non-related nodes can also be reduced, thereby improving the efficiency of knowledge display.
[0018] In some embodiments, displaying the industrial knowledge graph in a partial view further includes: in response to receiving a selection of a second node in the partial view; determining a second group of related nodes within a predetermined distance from the second node; and displaying the second group of related nodes and their text in the partial view. In this manner, the central node can be switched freely and conveniently.
[0019] In some embodiments, displaying the industrial knowledge graph in a focused view includes highlighting a first node in the focused view compared to other displayed nodes. By focusing on the central node, relevant information of the central node currently being focused on by the user can be better emphasized.
[0020] In a second aspect of the present disclosure, an electronic device is provided. The electronic device includes: one or more processors; and a memory for storing computer-executable instructions, wherein the computer-executable instructions, when executed by the one or more processors, enable the electronic device to implement any of the methods described in the first aspect above.
[0021] In a third aspect of the present disclosure, a computer-readable medium is provided, on which computer-executable instructions are stored. When the computer-executable instructions are executed, at least one processor is caused to perform the method according to any one of the above first aspects.
[0022] In a fourth aspect of the present disclosure, a computer program product is provided, comprising computer-executable instructions, which, when executed, cause at least one processor to perform the method according to any one of the above first aspects.
[0023] This summary is provided to introduce a selection of concepts in a simplified form that are further described in the detailed description below. This summary is not intended to identify key features or essential features of the disclosure, nor is it intended to limit the scope of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The above-mentioned characteristics, technical features, advantages and implementation methods of the present disclosure will be further described below in a clear and understandable manner through the description of preferred embodiments in conjunction with the accompanying drawings, wherein:
[0025] FIG1 shows a schematic diagram of an example industrial knowledge graph according to an embodiment of the present disclosure;
[0026] FIG2 shows a flowchart of a method for displaying an industrial knowledge graph according to an embodiment of the present disclosure;
[0027] FIG3A shows a schematic diagram of a hexagonal lattice layout based on a hexagonal lattice according to an embodiment of the present disclosure;
[0028] FIG3B shows a schematic diagram of a hexagonal lattice layout based on a quadrilateral lattice according to an embodiment of the present disclosure;
[0029] FIG4A shows a schematic diagram of an example industrial knowledge graph displayed with multiple icons according to an embodiment of the present disclosure;
[0030] FIG4B shows a schematic diagram of an example industrial knowledge graph displayed in multiple lines according to an embodiment of the present disclosure;
[0031] FIG4C shows a schematic diagram of an industrial knowledge graph with a hidden hexagonal grid layout according to an embodiment of the present disclosure;
[0032] FIG5 shows a schematic diagram of a pseudo-three-dimensional display example industrial knowledge graph according to an embodiment of the present disclosure;
[0033] FIG6 shows a schematic diagram of switching between progressive multiple views of an industrial knowledge graph according to an embodiment of the present disclosure;
[0034] FIG7A shows a schematic diagram of a global view of an example industrial knowledge graph according to an embodiment of the present disclosure;
[0035] FIG7B shows a schematic diagram of a partial view of an example industrial knowledge graph according to an embodiment of the present disclosure;
[0036] FIG7C shows a schematic diagram of a focused view of an example industrial knowledge graph according to an embodiment of the present disclosure; and
[0037] FIG8 shows a block diagram of an example device that can be used to implement an embodiment of the present disclosure.
[0038] 110: Grid
[0039] 120: Node
[0040] 130: Edge
[0041] 310-316: Hexagonal grid
[0042] 360-366: Quadrilateral lattice
[0043] 410: Square Icon
[0044] 420: Hexagon Icon
[0045] 430: Circular Icon
[0046] 460: Broken Line
[0047] 510: Square 3D Icon
[0048] 520: Hexagonal 3D Icon
[0049] 530: Circular 3D Icon
[0050] 610: Global View
[0051] 620: Partial View
[0052] 630: Focus View
[0053] 710: Central Node
[0054] 801: CPU
[0055] 802: ROM
[0056] 803: RAM
[0057] 804: Bus
[0058] 805: I / O interface
[0059] 806: Input unit
[0060] 807: Output unit
[0061] 808: Storage unit
[0062] 809: Communication unit DETAILED DESCRIPTION
[0063] The principles of the present disclosure will be described below with reference to several exemplary embodiments shown in the accompanying drawings. Although preferred embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that these embodiments are described only to enable those skilled in the art to better understand and implement the present disclosure, and are not intended to limit the scope of the present disclosure in any way.
[0064] As used herein, the term "including" and its variations represent open inclusion, i.e., "including but not limited to". Unless otherwise stated, the term "or" means "and / or". The term "based on" means "based at least in part on". The terms "an example embodiment" and "an embodiment" mean "at least one example embodiment". The term "another embodiment" means "at least one additional embodiment". Other explicit and implicit definitions may also be included below. Some example embodiments of the present disclosure are described below with reference to Figures 1-8.
[0065] Knowledge graphs have been widely used in the industry, and due to their inherent visual presentation characteristics, they have the advantage of good interpretability. This tree-like or mesh-like combination of nodes and edges in industrial knowledge graphs can not only directly illustrate which knowledge points are related, but also reveal the semantic relationships behind them. Typically, knowledge graphs in industrial software and products use ovals or circles to represent nodes, and display node information in elliptical or circular text boxes. Straight lines are used to represent edges between nodes, and edge information is displayed on the straight lines. The positions of some nodes can be manually set and fixed, while the positions of other nodes can be automatically generated. You can try to evenly distribute all nodes around the core node, and usually place the center of the knowledge graph at the absolute center of the user interface, displaying all nodes and edges and related information at the same time.
[0066] It can be seen that although industrial knowledge graphs can generally display some knowledge, they are not yet user-friendly. Currently, knowledge graph software, applications, or websites in the industrial sector are generally developed from the developer's perspective, rather than from the user's perspective. Therefore, knowledge graphs in the industrial field usually have a lot of content. Traditional industrial knowledge graph presentation methods have a series of problems such as excessive information density, overlapping visual elements, and rigid overall layout. For example, excessive information display may cause intensive phobia for some users, irregular node distribution may cause overlap between nodes, and strict circle and line methods may cause aesthetic fatigue and poor scalability. Therefore, the traditional industrial knowledge graph user experience is not good.
[0067] To this end, an embodiment of the present disclosure provides a new display method for industrial knowledge graphs, which is based on a hexagonal grid layout (i.e., a hexagonal grid panel) to ensure the distribution of visual elements, display knowledge in a clear and delicate manner, and can flexibly adapt to the design of various visual elements. According to an embodiment of the present disclosure, a hexagonal grid layout is used to assist in the display of the industrial knowledge graph, each node is displayed at the center of each grid, and a variety of optional lines are used to display the edges between the nodes. The content of the industrial knowledge graph can be presented in a complete and clear manner, which greatly improves the user experience when displaying the knowledge graph.
[0068] FIG1 shows a schematic diagram of an example industrial knowledge graph 100 according to an embodiment of the present disclosure. As shown in FIG1 , the embodiment of the present disclosure uses a hexagonal grid layout to assist in displaying the industrial knowledge graph, wherein the hexagonal grid layout includes a plurality of grids of equal size (such as grid 110), and each node (such as node 120) is located in the central area of the grid. The nodes are connected by edges (such as edge 130) based on semantic relationships. It should be understood that although a plurality of hexagonal (especially regular hexagonal) grids (such as grid 110) are used to form a hexagonal grid layout in the preferred example of FIG1 , it can also be based on other polygons (such as quadrilaterals), but it is necessary to ensure that the six adjacent grids around each non-edge grid can form a hexagon. In addition, although a hexagonal node icon is preferably shown in FIG1 , it can also be other shapes or other icons. In some embodiments, the geometric center of the node icon coincides with the geometric center of the grid, and the size of the node icon needs to be smaller than the grid size to ensure that there is no overlap between different nodes.
[0069] A hexagon is a shape with stable geometric characteristics. In the hexagonal grid layout shown in FIG1 , multiple grids of the same size are arranged seamlessly, and the nodes are arranged with reference to the grid layout rather than being placed randomly. Although each node is represented by a smaller hexagon in FIG1 , it can be any other shape, logo, icon, or image of the design. It should be understood that the industrial knowledge graph 100 of FIG1 is an example for describing an embodiment of the present disclosure, and the industrial knowledge graph may include more or fewer nodes and edges.
[0070] Figure 2 shows a flow chart of a method 200 for displaying an industrial knowledge graph according to an embodiment of the present disclosure. The method 200 is described below with reference to Figure 1 and Figures 3A-3B. The method 200 can be executed by an electronic device or computer software.
[0071] As shown in Figure 2, at 210, a hexagonal grid layout for the industrial knowledge graph is determined, wherein in the hexagonal grid layout, the non-edge grid is surrounded by six grids, and the centers of the six grids constitute a hexagon. For example, the hexagonal grid layout of the industrial knowledge graph 100 is first divided, and the grids in the hexagonal grid layout themselves can be in various forms, which may include multiple hexagonal grids or quadrilateral grids. For each grid at the non-edge in the hexagonal grid layout, each grid will be completely surrounded by the six surrounding grids, and the centers of these six adjacent grids will be connected to form a hexagon. It should be understood that the boundary lines in the hexagonal grid layout exist logically, but can be presented or hidden visually. In some embodiments, the hexagonal grid layout can correspond to a hexagonal grid logical coordinate system, including but not limited to: offset coordinates, cubic coordinates, axis coordinates, double rectangular coordinates, and the like.
[0072] Optionally, each grid in the hexagonal grid layout can be a hexagon, and the hexagon formed by the centers of the six grids is an equilateral hexagon. Figure 3A shows a schematic diagram of a hexagonal grid layout 300 based on a hexagonal grid according to an embodiment of the present disclosure, and each grid has the same shape and size. As shown in Figure 3A, each grid in the hexagonal grid layout 300 (such as grids 310-316) is a hexagon, and the center grid 310 is surrounded by six adjacent grids 311-316. The lines connecting the centers of the six grids 311-316 form an equilateral hexagon, and the nodes in the industrial knowledge graph are located at the center of one or more of the six grids 311-316.
[0073] Alternatively, each grid in the hexagonal grid layout can be a quadrilateral, and the hexagon formed by the centers of the six grids is a non-equilateral hexagon. Figure 3B shows a schematic diagram of a hexagonal grid layout 350 based on a quadrilateral grid according to an embodiment of the present disclosure. As shown in Figure 3B, each grid (such as grids 360-366) in the hexagonal grid layout 350 is a quadrilateral, and the center grid 360 is surrounded by six adjacent grids 361-366. Although the six grids 361-366 themselves are quadrilaterals rather than hexagons, the lines connecting the centers of the six grids 361-366 constitute a non-equilateral hexagon, and the nodes in the industrial knowledge graph are located at the centers of one or more grids in the six grids 361-366. Therefore, the embodiment of the present disclosure can implement a hexagonal grid layout based on grids of various shapes, with good flexibility and applicability.
[0074] According to the hexagonal grid layout of the embodiment of the present disclosure, the following conditions need to be met: all grids have the same shape and size; non-edge grids are closely adjacent to the six surrounding grids, and there is no gap or almost no gap between them; the centers of the six adjacent grids form a hexagon, which can be an equilateral or non-equilateral hexagon; the hexagonal grid layout can theoretically be expanded if the above conditions are met.
[0075] Returning to reference Figure 2, at 220, multiple nodes in the industrial knowledge graph are displayed at the center of each of the multiple grids in the hexagonal grid layout. For example, node 120 is placed and set at the center of a grid in the industrial knowledge graph 100 of Figure 1, and other nodes can also be placed and set at the center of other grids. According to the industrial knowledge graph of an embodiment of the present disclosure, the semantics represented by the node include but are not limited to: industrial organizations, facilities, production lines, equipment, components, bit numbers, signals, products, personnel, projects, projects, tasks, events and other entities, as well as abstract descriptions (such as fault phenomena, fault causes, solutions, etc.) or professional terms (technology, algorithms, operating steps, etc.) that describe specific industrial phenomena. According to an embodiment of the present disclosure, each node is located inside a grid in the hexagonal grid layout, and a node will not occupy multiple grids, nor can it be located in an area outside the hexagonal grid layout. Logically, two nodes will not be placed in the same grid, thereby ensuring that the nodes do not visually overlap and are not blocked, thereby improving a good user experience.
[0076] At 230 , based on the semantic relationships between the multiple nodes, multiple edges between the multiple nodes are displayed using at least one of the following lines: a straight line, a broken line, and a curved line. For example, a straight line can be used to connect two nodes in the industrial knowledge graph 100 . Depending on whether a semantic relationship exists between the nodes, a line can be set between the nodes as an edge. Because embodiments of the present disclosure can use multiple lines to display edges, and the lengths of the edges can vary, and the edge connection methods can also vary, it is possible that edges may intersect.
[0077] Therefore, according to method 200 of an embodiment of the present disclosure, a hexagonal grid layout is used to assist in the display of the industrial knowledge graph. Each node is displayed at the center of each grid, and the edges between nodes are displayed using a variety of optional lines. This can present the content of the industrial knowledge graph in a complete and clear manner, greatly improving the user experience when browsing the knowledge graph. The hexagonal grid layout can be used to standardize the distribution of nodes in a specific view to avoid suboptimal visual effects.
[0078] In addition, according to the method 200 of the embodiment of the present disclosure, based on the hexagonal grid layout, nodes are placed at the center (particularly preferably the geometric center) of each grid, rather than at the vertices of the grid. In addition, according to the embodiment of the present disclosure, adjacent nodes can be located in adjacent grids or in non-adjacent grids, and the connection lines between nodes can be presented in the form of broken lines and / or curves in addition to straight lines. In this way, the adjacent nodes of each node can break through the limit of six and can be connected to more than six nodes, thereby increasing the application scope of the knowledge graph.
[0079] In some embodiments, a first type of node in a plurality of nodes can be displayed with an icon, and a second type of node in a plurality of nodes can be displayed with another different icon. That is, different types of nodes can be displayed with different icons / graphics. Figure 4A shows a schematic diagram of an industrial knowledge graph 400 displayed with multiple icons according to an embodiment of the present disclosure. As shown in Figure 4A, the nodes of the industrial knowledge graph 400 can be divided into three types, corresponding to, for example, production lines, equipment, and personnel, where production line-related nodes are represented by square icons 410, equipment-related nodes are represented by hexagonal icons 420, and personnel-related nodes are represented by circular icons 430. In this way, the distribution and association relationships of various types of nodes can be seen very intuitively. When the display of the industrial knowledge graph is triggered, the hexagonal grid layout is initialized so that all nodes included in the industrial knowledge graph can be covered, and the total number of grids is ensured to be greater than the total number of nodes, and each grid can be placed with one node or no node. As shown in Figure 4A, each hexagonal grid occupies a certain area through its outer boundary, and the visual elements representing the nodes (such as graphics, icons) are set in the center of the grid and do not exceed the boundary. In addition, the border of the grid can exist logically but be invisible visually (ie, the border of the grid can be hidden and not displayed).
[0080] In some embodiments, a first node may be placed in a first grid among a plurality of grids, a second node may be placed in a second grid among a plurality of grids, wherein the second grid is adjacent to the first grid, and a third node may be placed in a third grid among a plurality of grids, wherein the third grid is not adjacent to the first grid and the second grid. For example, the node of the circular icon 430 is adjacent to the node of the hexagonal icon 420, and these two nodes are not adjacent to the node of the square icon 410. In this way, the nodes can be located in any grid on the chessboard, and any two nodes can be located in adjacent grids or in non-adjacent grids (with an empty grid in the middle), so that the nodes are not particularly dense and crowded, and a sparse arrangement is achieved. In addition, since the industrial knowledge graph of the embodiment of the present disclosure does not restrict the nodes to be adjacent, there may be edge intersections between the multiple edges of the industrial knowledge graph of the embodiment of the present disclosure.
[0081] FIG4B shows a schematic diagram of an industrial knowledge graph 450 with a multi-line display according to an embodiment of the present disclosure. According to an embodiment of the present disclosure, the connection line of the edge between the nodes can be represented not only by a straight line, but also by other connection lines such as a broken line and a curve. As shown in FIG4B , the edge between two nodes can be represented by a broken line 460. When connected by a broken line, the length of each segment in the broken line can be fixed, and each segment is always a connection line between the centers of two adjacent nodes. In this way, the flexibility and aesthetics of the connection lines between the nodes are improved. Preferably, when two nodes are not adjacent, the connection line between the two nodes is obtained by connecting the center points of the adjacent grids of the grids where the two nodes are located. For example, when two nodes are not adjacent, a connected path can be obtained through the adjacent middle grids to each other, and then the broken line connects each segment, and then connects the center points of all adjacent grids in the path in turn.
[0082] FIG4C shows a schematic diagram of an industrial knowledge graph 490 with a hidden hexagonal grid layout according to an embodiment of the present disclosure. As shown in FIG4C , the hexagonal grid layout can be hidden, but the placement of each node is still arranged with reference to the hidden hexagonal grid layout. For example, a switch button can be set on the user interface for the user to choose whether to turn on or hide the hexagonal grid layout. By hiding the hexagonal grid layout, the user can focus more on the display of the nodes and edges in the industrial knowledge graph.
[0083] Figure 5 shows a schematic diagram of a pseudo-three-dimensional display of an industrial knowledge graph 500 according to an embodiment of the present disclosure. For example, a pseudo-three-dimensional (such as 2.5-dimensional) industrial knowledge graph 500 can be generated by skew and rotate a certain angle of the hexagonal grid layout shown in Figure 4A, wherein the square stereo icon 510, the hexagonal stereo icon 520, and the circular stereo icon 530 can be presented with a three-dimensional sense. In some embodiments, the hexagonal grid layout can be deflected clockwise or counterclockwise first, and then rotated clockwise or counterclockwise. Alternatively, the two-dimensional knowledge graph according to the embodiment of the present disclosure can be converted into a three-dimensional knowledge graph by adding height information. It should be understood that although the industrial knowledge graph is displayed in a pseudo-three-dimensional or three-dimensional form, its auxiliary hexagonal grid layout can still be displayed or hidden. According to an embodiment of the present disclosure, when the industrial knowledge graph is displayed with a pseudo-three-dimensional or three-dimensional effect, it is still auxiliary displayed based on the two-dimensional hexagonal grid layout.
[0084] FIG6 shows a schematic diagram 600 of switching between progressive multiple views of an industrial knowledge graph according to an embodiment of the present disclosure. As shown in FIG6 , the progressive multiple views include a global view 610, a local view 620, and a focused view 630, with different amounts of information presented in different views, and the three views present a relationship such as zooming in / out. In some embodiments, the global view 610, the local view 620, and the focused view 630 can be assisted in display using the hexagonal grid layout described above. That is, the nodes in the global view 610, the local view 620, and the focused view 630 are all placed with reference to the hexagonal grid layout.
[0085] Figure 7A shows a schematic diagram of a global view 610 of an industrial knowledge graph according to an embodiment of the present disclosure. The global view is an overall overview display of the industrial knowledge graph, which can be regarded as a panoramic view. In the global view 610, all nodes and edges in the industrial knowledge graph can be displayed, wherein the relevant text of at least one of the nodes and edges is hidden. In this way, an overall clear display effect can be guaranteed. In some embodiments, in the global view 610, different types of nodes can be displayed by different icons / graphics. In some embodiments, the relevant nodes in the industrial knowledge graph can be clustered into multiple groups, and the multiple groups can be displayed in the global view in a point cloud manner or a super node manner, thereby presenting the semantic distribution between all nodes. According to an embodiment of the present disclosure, although all nodes are displayed in the global view, the text in the nodes and / or edges is hidden, reducing the dense phobia disorder of all information being displayed densely.
[0086] Figure 7B shows a schematic diagram of a partial view 620 of an industrial knowledge graph according to an embodiment of the present disclosure. A partial view is a detailed display of a portion of the industrial knowledge graph and is the primary way to view nodes and related node information. In the partial view 620, the text of at least one of the nodes and edges associated with the central node (also called the core node) is displayed. In some embodiments, the name of each node can be displayed in the partial view 620, such as C1, R1, P1, S1, etc.
[0087] In some embodiments, in the local view 620, related nodes within a predetermined distance from the central node can be displayed. For example, nodes with a predetermined hop (e.g., two hops, where a hop refers to the length of the edge of the shortest path between two nodes) from the central node C1 can be displayed, which include nodes P1, P2, P3, R1, R2, R2, S1, and S2, but do not include the other nodes shown in Figure 7A. Alternatively, related nodes whose semantic relationship with the central node is within a predetermined threshold can also be selected for presentation. In some embodiments, the number of predetermined hops can be configured so that all nodes included in the local view can be well visually displayed and / or described in text. For example, on a large-sized screen, the threshold for the predetermined hop can be set larger. On a small-sized screen, the number of predetermined hops can be set smaller. Of course, the number of predetermined hops can also be manually configured by the user.
[0088] In some embodiments, the central node can be switched in the local view 620. For example, when the user selects node R1, the related nodes within a predetermined distance from node R1 are re-determined, and the knowledge graph is redrawn. If node R1 is the central node, nodes P1, S1, and S2 will not be displayed.
[0089] Figure 7C shows a schematic diagram of a focused view 630 of an industrial knowledge graph according to an embodiment of the present disclosure, where the focused view is a prominent presentation of a certain node in the industrial knowledge graph. In the focused view 630, the descriptive information of the central node can be displayed through window 795. For example, window 795 can display the name, type, description, related nodes and other information of node C1. In addition, compared with other displayed nodes, the focused node C1 is highlighted, thereby enabling a comprehensive understanding of the detailed information of the central node that the user is concerned about. On the contrary, if there is no separate window to display specific node information, there may be obstacles to understanding due to incomplete information.
[0090] Referring back to FIG6 , a schematic diagram illustrating switching between progressive multiple views is depicted. In some embodiments, in global view 610, if a first user input is received for a node in the industrial knowledge graph (e.g., a click on node 710 in FIG7A , or searching for node 710 through an interactive operation), the global view 610 is switched and enlarged to display in local view 620 , as shown in 611 . In local view 620, if a second user input is received for a node (e.g., a double-click on node C1 in FIG7B ), the local view 620 is switched to display in focused view 630 , as shown in 612 .
[0091] In some embodiments, in the focused view 630, if a third user input is received (for example, the user instructs to zoom out in FIG. 7C ), the display is switched to the local view 620, as shown in 621. In the local view 620, if a fourth user input is received (for example, the user instructs to zoom out in FIG. 7B or presses a special key, such as the Esc key), the display is switched to the global view 610, as shown in 622.
[0092] In some embodiments, it is also possible to switch directly between the global view 610 and the focused view 630. In the global view 610, if a fifth user input is received (for example, a user double-clicks the node 710 in FIG. 7A ), the display is switched to the focused view 630, as shown in 631. In the focused view 630, if a sixth user input is received (for example, the user zooms out in FIG. 7C or presses a special key), the display is switched to the global view 610, as shown in 632. In this way, switching between different views can be faster, improving the efficiency of knowledge graph browsing and meeting the information needs of various users at various levels.
[0093] Optionally, switching between the global view 610, the local view 620 and the focused view 630 can be achieved by mouse clicks and / or keyboard keys. Alternatively, in a touch display screen, switching between views can also be achieved by finger touch, pressing duration, zooming and other operations. According to the setting method of the progressive multi-view embodiment of the present disclosure, the knowledge graph can be presented with an appropriate information density, avoiding the simultaneous display of too many visual elements that make it impossible for users to locate certain knowledge, or even trigger psychological or physical discomfort, and reducing the possibility that users cannot obtain knowledge graph information.
[0094] Furthermore, when switching from the global view 610 to the local view 620, the industrial knowledge graph needs to be redrawn due to the differences in the size of the hexagonal grid layout, the total number of grids, and the total number of nodes. However, when switching from the local view 620 to the focused view 630, the hexagonal grid layout and the positions of the nodes remain unchanged, thus eliminating the need to redraw the industrial knowledge graph.
[0095] In some embodiments, the knowledge graph data can be read from a local device (such as a computer) to implement the method for displaying the industrial knowledge graph according to the embodiment of the present disclosure. Alternatively, the knowledge graph data can be obtained from the cloud (such as a cloud server or a distributed server) and the industrial knowledge graph of the embodiment of the present disclosure can be presented on the local device. In addition, part of the knowledge graph data can be obtained from the cloud and the other part can be read from the local device, and the embodiments of the present disclosure are not limited to this.
[0096] FIG8 shows a schematic block diagram of an example device 800 that can be used to implement an embodiment of the present disclosure. The device 800 can be used to implement the method 200 described in FIG2 . For example, the local device and / or cloud server described above can be implemented by one or more components in the example device 800. As shown in FIG8 , the device 800 includes a processor, such as a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to computer program instructions stored in a read-only memory (ROM) 802 or computer program instructions loaded from a storage unit 808 into a random access memory (RAM) 803. In RAM 803, various programs and data required for the operation of the device 800 can also be stored. CPU 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.
[0097] Various components in device 800 are connected to I / O interface 805, including an input unit 806, such as a keyboard, mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, optical disk, etc.; and a communication unit 809, such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows device 800 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.
[0098] The processing unit 801 performs the various methods and processes described above, such as method 200. For example, in some embodiments, method 200 can be implemented as a computer software program or computer program product, which is tangibly contained in a computer-readable medium, such as a non-transient computer-readable medium (e.g., storage unit 808). In some embodiments, part or all of the computer program can be loaded and / or installed on the device 800 via ROM 802 and / or communication unit 809. When the computer program is loaded into RAM 803 and executed by CPU 801, one or more steps in the method or process described above can be performed. Alternatively, in other embodiments, CPU 801 can be configured to perform the method or process of an embodiment of the present disclosure in any other appropriate manner (e.g., by means of firmware).
[0099] It should be understood by those skilled in the art that the various steps of the method of the present disclosure described above can be implemented by a general-purpose computing device. They can be concentrated on a single computing device or distributed on a network composed of multiple computing devices. Alternatively, they can be implemented using program codes executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the present disclosure is not limited to any specific combination of hardware and software. For example, certain embodiments of the present disclosure also include various program modules and / or integrated circuit modules for executing one or more steps of method 200 and / or one or more other steps described in other embodiments of the present disclosure. These program modules can be included or embodied in a device, such as the device 800 in Figure 8.
[0100] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.
[0101] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0102] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable information presentation device, thereby producing a machine such that when these instructions are executed by the processing unit of the computer or other programmable information presentation device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable information presentation device, and / or other device to operate in a specific manner, such that the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.
[0103] Computer-readable program instructions can be loaded onto a computer, other programmable information presentation apparatus, or other device, so that a series of operational steps are performed on the computer, other programmable information presentation apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable information presentation apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowcharts and / or block diagrams of the embodiments of the present disclosure.
[0104] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0105] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.
Claims
1. A method (200) for displaying an industrial knowledge graph, comprising: Determining (210) a hexagonal grid layout for the industrial knowledge graph, wherein in the hexagonal grid layout, a non-edge grid is surrounded by six grids, and the centers of the six grids form a hexagon; Displaying (220) a plurality of nodes in the industrial knowledge graph at the center of each of the plurality of grids in the hexagonal grid layout; as well as Based on the semantic relationship between the plurality of nodes, the plurality of edges between the plurality of nodes are displayed (230) using at least one of the following lines: a straight line, a broken line, and a curved line.
2. The method (200) according to claim 1, wherein the non-edge grid (310) and the six grids (311, 312, 313, 314, 315, 316) are all hexagons, and the hexagon formed by the centers of the six grids is an equilateral hexagon.
3. The method (200) according to claim 1, wherein the non-edge grid (360) and the six grids (361, 362, 363, 364, 365, 366) are all quadrilaterals, and the hexagon formed by the centers of the six grids is a non-equilateral hexagon.
4. The method (200) according to claim 1, wherein displaying a plurality of nodes in the industrial knowledge graph at the center of each of a plurality of grids in the hexagonal grid layout comprises: placing a first node in a first grid among the plurality of grids; placing a second node in a second grid among the plurality of grids, wherein the second grid is adjacent to the first grid; as well as A third node is placed in a third grid among the plurality of grids, wherein the third grid is not adjacent to the first grid and the second grid.
5. The method (200) of claim 1, further comprising: The industrial knowledge graph is displayed in a pseudo-three-dimensional or three-dimensional form by deflecting and rotating the hexagonal grid layout.
6. The method (200) of claim 1, further comprising: Displaying the industrial knowledge graph in a global view (610), wherein in the global view (610), text of at least one of the plurality of nodes and the plurality of edges is hidden; In response to receiving a first user input for a first node (710) among the plurality of nodes in the global view (610), displaying the industrial knowledge graph in a local view (620), wherein text of at least one of a node and an edge associated with the first node (710) is displayed in the local view (620); as well as In response to receiving a second user input to the first node (710) in the local view (620), the industrial knowledge graph is displayed in a focused view (630), wherein in the focused view (630), description information of the first node (710) is displayed through a window.
7. The method (200) of claim 6, further comprising: In response to receiving a third user input in the focused view (630), displaying the industrial knowledge graph in the partial view (620); as well as In response to receiving a fourth user input in the local view (620), the industrial knowledge graph is displayed in the global view (610).
8. The method (200) of claim 7, further comprising: In response to receiving a fifth user input to the first node (710) in the global view (610), displaying the industrial knowledge graph in the focused view (630); as well as In response to receiving a sixth user input in the focused view (630), the industrial knowledge graph is displayed in the global view (610).
9. The method (200) according to claim 6, wherein displaying the industrial knowledge graph in a global view (610) comprises: Displaying a first type of node among the plurality of nodes with a first icon (410); as well as A second type of node in the plurality of nodes is displayed with a second icon (420), wherein the second icon (420) is different from the first icon (410).
10. The method (200) according to claim 6, wherein displaying the industrial knowledge graph in a global view (610) comprises: Aggregating the plurality of nodes into a plurality of groups; as well as The plurality of groups are displayed in the global view (610) in a point cloud manner.
11. The method (200) according to claim 6, wherein displaying the industrial knowledge graph in a partial view (620) comprises: determining a first set of related nodes that are within a predetermined distance from the first node (710); as well as The first set of related nodes and their text are displayed in the local view (620).
12. The method (200) according to claim 11, wherein displaying the industrial knowledge graph in a partial view (620) further comprises: In response to receiving a selection of a second node in the local view (620); determining a second group of related nodes that are within a predetermined distance from the second node; as well as The second set of related nodes and their text are displayed in the local view (620).
13. The method (200) according to claim 6, wherein displaying the industrial knowledge graph in a focused view (630) comprises: The first node (710) is highlighted in the focused view (630) compared to other displayed nodes.
14. An electronic device (800), comprising: one or more processors (801); as well as A memory (803) is configured to store computer-executable instructions, wherein the computer-executable instructions, when executed by the one or more processors (801), enable the electronic device (800) to implement the method according to any one of claims 1 to 13.
15. A computer-readable storage medium (803) having computer-executable instructions stored thereon, wherein the computer-executable instructions, when executed by a processor (801), implement the method according to any one of claims 1 to 13.
16. A computer program product comprising computer executable instructions which, when executed by a processor (801), implement the method according to any one of claims 1 to 13.
Citation Information
Cited By
Method and device for generating knowledge graph, equipment, medium and program product
CN120930745A