Interface display method and device, equipment, medium and product

Abstract

The invention discloses an interface display method and device, equipment, a medium and a product, and belongs to the technical field of electronic equipment. The interface display method comprises the steps of receiving second input under the condition that a second-level interface of a knowledge graph interface is displayed; in response to the second input, displaying a third-level interface of the knowledge graph interface; receiving a third input to a third target node in the third level interface; in response to the third input, displaying a classification object corresponding to the third target node; wherein the second-level interface comprises second-level nodes, the third-level interface comprises third-level nodes, and the classification levels of the second-level nodes and the third-level nodes are different.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to an interface display method, device, equipment, medium and product. Background Art

[0002] When a user needs to search for content related to a certain topic on an electronic device, there are often multiple types of files related to this topic in the electronic device, and these different types of files are often located in different applications. This requires the user to search for files corresponding to the topic in each application, resulting in low search efficiency. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide an interface display method, device, equipment, medium and product, which can improve the efficiency of information search.

[0004] In a first aspect, an embodiment of the present application provides an interface display method, comprising:

[0005] In the case of displaying the second level interface of the knowledge graph interface, receiving a second input;

[0006] In response to the second input, displaying a third level interface of the knowledge graph interface;

[0007] receiving a third input to a third target node in the third level interface;

[0008] In response to the third input, displaying the classification object corresponding to the third target node;

[0009] The second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and the third-level nodes have different classification levels.

[0010] In a second aspect, an embodiment of the present application provides an interface display device, characterized in that it includes: a receiving module and a display module;

[0011] A receiving module, used to receive a second input when displaying the second level interface of the knowledge graph interface;

[0012] A display module, configured to display a third level interface of the knowledge graph interface in response to the second input;

[0013] The receiving module is further used to receive a third input to a third target node in the third level interface;

[0014] The display module is further used to display the classification object corresponding to the third target node in response to the third input;

[0015] The second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and the third-level nodes have different classification levels.

[0016] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the steps of the method described in the first aspect.

[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the method described in the first aspect.

[0020] In an embodiment of the present application, when displaying the second level interface of the knowledge graph interface, a second input is received; in response to the second input, a third level interface of the knowledge graph interface is displayed; a third input to a third target node in the third level interface is received; in response to the third input, a classification object corresponding to the third target node is displayed; wherein the second level interface includes a second level node, the third level interface includes a third level node, and the second level node and the third level node have different classification levels. That is, the embodiment of the present application can classify objects in electronic devices according to different classification levels, and users can quickly find an object based on its various classification levels without having to search in various applications, thereby improving the search efficiency of classified objects. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A flowchart of an interface display method provided in an embodiment of the present application;

[0022] Figure 2 A schematic diagram of a second-level interface provided in an embodiment of the present application;

[0023] Figure 3 A schematic diagram of a third-level interface provided in an embodiment of the present application;

[0024] Figure 4 A schematic diagram of a details interface provided in an embodiment of the present application;

[0025] Figure 5 A flowchart of another interface display method provided in an embodiment of the present application;

[0026] Figure 6a A schematic diagram of a first-level interface provided in an embodiment of the present application;

[0027] Figure 6b A schematic diagram of another first-level interface provided in an embodiment of the present application;

[0028] Figure 7 A flowchart of another interface display method provided in an embodiment of the present application;

[0029] Figure 8 A schematic diagram of another second-level interface provided in an embodiment of the present application;

[0030] Fig. 9 A schematic diagram of another third-level interface provided in an embodiment of the present application;

[0031] Fig.10 A schematic diagram of a process for determining a third label corresponding to a classification object provided in an embodiment of the present application;

[0032] Fig.11 A schematic diagram of another process of determining a third label corresponding to a classification object provided in an embodiment of the present application;

[0033] Fig.12a A schematic diagram of a first region provided in an embodiment of the present application;

[0034] Figure 12b A schematic diagram of a second region provided in an embodiment of the present application;

[0035] Fig.12c A schematic diagram of a parsing interface provided in an embodiment of the present application;

[0036] Fig.13 A schematic diagram of the structure of an interface display device provided in an embodiment of the present application;

[0037] Fig.14 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0038] Fig.15 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0040] The terms "first", "second", etc. in the specification of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are usually a class, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0041] When a user needs to search or browse all types of files related to a certain topic on an electronic device, it is often necessary to open multiple applications to search and browse. For example, if a user needs to search for content related to "xx travel" on an electronic device, such as photos of xx travel, guide documents of xx travel, videos of xx travel, itinerary records of xx travel, favorite links of xx travel, etc., it is necessary to search for relevant keywords in each corresponding application and browse to find multiple types of files or records related to the theme of "xx travel". The process is cumbersome and the search efficiency is low.

[0042] To this end, the embodiments of the present application provide an interface display method, apparatus, device, medium and product, which can classify objects in electronic devices according to different classification levels. Users can quickly find an object based on the classification levels of an object without having to search in each application, thereby improving the search efficiency of classified objects.

[0043] The following, in conjunction with the accompanying drawings, describes in detail the interface display method, device, equipment, medium and product provided in the embodiments of the present application through specific embodiments and their application scenarios.

[0044] Figure 1 This is a flow chart of an interface display method provided in an embodiment of the present application. The interface display method can be applied to electronic devices such as mobile phones, tablets, and laptops. Figure 1 As shown, the interface display method may include the following steps:

[0045] S110. When displaying the second level interface of the knowledge graph interface, receive a second input.

[0046] S120. In response to the second input, display the third level interface of the knowledge graph interface.

[0047] S130 , receiving a third input to a third target node in the third level interface.

[0048] S140. In response to the third input, display the classification object corresponding to the third target node.

[0049] The second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and the third-level nodes have different classification levels.

[0050] The above steps are described in detail below:

[0051] In S110, a knowledge graph may be generated based on objects in the electronic device and association relationships between different objects.

[0052] The object here can be an object stored in an electronic device, or an object collected by a user in an electronic device, such as a collection of links, records, etc. The object can include at least two forms, such as pictures, audio, video, word documents, PDF documents, collection records, etc. Through the knowledge graph, users can quickly find the required objects and can more intuitively understand the relationship between objects, which provides convenience for subsequent use.

[0053] Exemplarily, the electronic device may periodically acquire objects in the electronic device to periodically update the knowledge graph and improve the accuracy of the knowledge graph.

[0054] In an embodiment of the present application, the knowledge graph may include multiple levels. Taking the knowledge graph including three layers as an example, illustratively, the second-level interface may be a second-level knowledge graph, also known as a second-level knowledge graph. Exemplarily, the second-level interface may also be a third-level knowledge graph, also known as a third-level knowledge graph. Exemplarily, the second-level interface may also be a first-level knowledge graph, also known as a first-level knowledge graph.

[0055] The first-level knowledge graph may include first-level nodes, the second-level knowledge graph may include second-level nodes, and the third-level knowledge graph may include third-level nodes. Taking the first-level knowledge graph, the second-level knowledge graph, and the third-level knowledge graph as an example, which are respectively the first-level knowledge graph, the second-level knowledge graph, and the tertiary knowledge graph, exemplarily, each first-level node may include at least one second-level node, and each second-level node may include at least one third-level node.

[0056] Taking the first-level knowledge graph, the second-level knowledge graph and the third-level knowledge graph as an example, which are respectively a third-level knowledge graph, a second-level knowledge graph and a first-level knowledge graph, exemplarily, each third-level node may include at least one second-level node, and each second-level node may include at least one first-level node.

[0057] Taking the example that the knowledge graph includes four levels, illustratively, the second-level interface can be any one of the first-level knowledge graph, the second-level knowledge graph, the third-level knowledge graph and the fourth-level knowledge graph.

[0058] The second input is used to display the third-level interface, which can be the previous interface or the next interface of the second-level interface. That is, through the knowledge graph provided by the embodiment of the present application, the user can obtain the classification object corresponding to each low level in order from high to low levels, and can also understand the high-level classification objects to which each low-level classification object belongs in order from low to high levels, thereby improving the flexibility of the knowledge graph.

[0059] Taking the second-level interface as a secondary knowledge graph, which includes three levels as an example, illustratively, the second input can be used to display a knowledge graph adjacent to the secondary knowledge graph, for example, it can be used to display a third-level knowledge graph or a first-level knowledge graph.

[0060] Exemplarily, the second input may include but is not limited to touch input, voice input, gesture input, etc. of the user on the second level interface, and the touch input may include but is not limited to zoom input, single-click input, double-click input, etc.

[0061] Taking the second-level interface as a second-level knowledge graph and the third-level interface as a first-level knowledge graph as an example, in some embodiments, the second input may be a user's zoom-out input on the second-level interface. That is, the user may display the first-level knowledge graph by zooming out the second-level interface.

[0062] Taking the second level interface as a second-level knowledge graph and the third level interface as a third-level knowledge graph as an example, in some embodiments, the second input may be a user's zoom input on the second level interface. That is, the user may display the next level interface by zooming in on the second level interface.

[0063] In S120, illustratively, when the electronic device receives the second input, it may display a third level interface.

[0064] Taking the second-level interface corresponding to the second-level knowledge graph as an example, illustratively, when the electronic device receives the second input, it can display the next-level knowledge graph of the second-level knowledge graph, that is, the third-level knowledge graph.

[0065] In S130, the third target node may be one or more third-level nodes, where the third-level nodes are nodes included in the knowledge graph corresponding to the third-level interface.

[0066] The third-level nodes are at a different classification level from the second-level nodes. In some embodiments, the second-level nodes may include the third-level nodes. In some embodiments, the third-level nodes may also include the second-level nodes, which is specifically related to the inclusion relationship of the hierarchical knowledge graphs to which the second-level nodes and the third-level nodes belong.

[0067] The third input is used to select a third target node. Exemplarily, the third input may include but is not limited to a user's touch input, voice input, gesture input, etc. to the third target node.

[0068] In S140, illustratively, when the electronic device receives the third input of the user to the third target node, it can display the classification object corresponding to the third target node.

[0069] Taking the third-level interface corresponding to the third-level knowledge graph as an example, illustratively, the classification objects corresponding to the third target node may include but are not limited to identity cards, real estate certificates, social security cards, etc. The same third target node may correspond to one or more classification objects. When there are multiple classification objects, the multiple classification objects may correspond to the same data form, such as all pictures, or may correspond to multiple data forms, such as some classification objects corresponding to pictures, some classification objects corresponding to documents, and some classification objects corresponding to videos, etc. In this way, users can obtain one or more classification objects through one node.

[0070] The above interface display process is described below through an embodiment.

[0071] Figure 2 A schematic diagram of a second-level interface is exemplarily listed, such as Figure 2 As shown, the second-level interface 200 takes the secondary knowledge graph as an example, and the second-level interface 200 includes three second levels as an example, namely the second-level node 201, the second-level node 202 and the second-level node 203, wherein the second-level node 201 includes two nodes, namely gardening maintenance 2011 and plant species 2012, the second-level node 202 includes one node, namely animal species 2021, and the second-level node 203 includes two nodes, namely food seasoning 2031 and gourmet dishes 2032.

[0072] Taking the case where the user zooms in on the second level interface 200 as an example, for example, Figure 3 As shown, the electronic device can display the third level interface 300. Figure 3Taking the third-level interface corresponding to the third-level knowledge graph as an example, the third-level interface 300 exemplarily lists some third-level nodes. In actual application, the user can view other third-level nodes by dragging the third-level interface 300.

[0073] For example, in Figure 3 In the example, the gardening maintenance 2011 of the second-level node 201 may include flower pots and potted plants, and the plant types 2012 of the second-level node 201 may include lotus, petals, bouquets, sunflowers, trees, etc. The animal types 2021 of the second-level node 202 may include pandas, insects, lions, cats, rabbits, swans, and penguins. That is, the user can display the third-level interface 300 by zooming in on the second-level interface 200, and can quickly and intuitively obtain the third-level nodes contained in each second-level node through the third-level interface 300, without having to search for each application one by one, thereby simplifying the user's operation and improving the efficiency of information search.

[0074] In the third level interface 300, taking the example of the user selecting the insect node as the third target node, illustratively, as Figure 4 As shown, when the user clicks on an insect node, the electronic device may display a detail interface 400, and the detail interface 400 may display the insect corresponding to the insect node. Figure 4 Take the insect node corresponding to three kinds of insects as an example. The insects displayed in the detail interface 400 are the insects stored in the electronic device. Figure 4 Take the example of three insects all being pictures, that is, the three classification objects correspond to the same data form, which are all pictures.

[0075] It is understandable that the user can also switch from the third-level interface to the second-level interface for viewing through input operations, for example, the user performs a zoom-out operation on the third-level interface.

[0076] So, combined Figure 2-Figure 4 , users only need to perform simple input operations on the second-level nodes and the third-level interface to quickly obtain the classification object corresponding to a node, without having to search for each application one by one, which greatly simplifies the user's operation, saves time, and improves the efficiency of information search.

[0077] Figure 5 A flowchart of another interface display method provided in an embodiment of the present application, Figure 5 and Figure 1 The difference is that Figure 5 Also includes S510-S520.

[0078] S510. When displaying the first level interface of the knowledge graph interface, receive a first input.

[0079] In some embodiments, the first-level interface may be the upper-level interface of the second-level interface. For example, the second-level interface corresponds to the second-level knowledge graph. For example, the first-level interface may correspond to the first-level knowledge graph. At this time, the user may search for the required information in the order from the coarse-grained classification level to the fine-grained classification level.

[0080] In some embodiments, the first-level interface may also be the next-level interface of the second-level interface. For example, the second-level interface corresponds to the second-level knowledge graph. For example, the first-level interface may correspond to the third-level knowledge graph. At this time, the user may search for the required information in the order from the fine-grained classification level to the coarse-grained classification level.

[0081] The first input is used to display the second-level interface. Exemplarily, the first input may include but is not limited to the user's touch input, voice input, and gesture input to the first-level interface. Taking the second-level interface corresponding to the second-level knowledge graph and the first-level interface corresponding to the first-level knowledge graph as an example, the first input may be the user's zoom-in input to the first-level interface. Taking the second-level interface corresponding to the second-level knowledge graph and the first-level interface corresponding to the third-level knowledge graph as an example, the first input may be the user's zoom-out input to the first-level interface.

[0082] S520. In response to the first input, display a second level interface of the knowledge graph interface.

[0083] The first-level interface includes first-level nodes, and the classification levels of the first-level nodes, the second-level nodes, and the third-level nodes are different.

[0084] Exemplarily, the first-level nodes, the second-level nodes and the third-level nodes may be in a sequential inclusion relationship, that is, a first-level node may include at least one second-level node, and a second-level node may include at least one third-level node.

[0085] Exemplarily, the first-level nodes, the second-level nodes and the third-level nodes may be in a relationship of being included in sequence, that is, a third-level node may include at least one second-level node, and a second-level node may include at least one first-level node.

[0086] In an embodiment of the present application, users can view the knowledge graph in the order from fine-grained classification level to coarse-grained classification level, or in the order from coarse-grained classification level to fine-grained classification level. This can meet the personalized needs of users. Moreover, through knowledge graphs at different levels, users can also more intuitively understand the implicit relationship between data, which provides a basis for the use of data.

[0087] Taking the first-level nodes belonging to the first-level knowledge graph as an example, in some embodiments, the node parameters of the second-level nodes belonging to the same first-level nodes are the same, and the node parameters here may include at least one of the following: color, shape, and size.

[0088] Taking the example that the first-level node includes two second-level nodes, illustratively, the node parameters of the two second-level nodes are the same. Taking the example that the node parameters include color, illustratively, the colors of the second-level nodes are the same, that is, for the secondary knowledge graph, the colors of the second-level nodes belonging to the same first-level node in the secondary knowledge graph are the same.

[0089] Figure 6a A schematic diagram of a first-level interface is exemplarily listed, such as Figure 6a As shown, the first-level interface 600 includes three first-level nodes, namely, first-level node 601, first-level node 602 and first-level node 603. Among them, first-level node 601 includes second-level node 201, first-level node 602 includes second-level node 202, and first-level node 603 includes second-level node 203. When the first-level nodes are actually displayed, each first-level node can be displayed in a different color to facilitate user distinction. Exemplarily, when a first-level node is located in the target area of ​​the screen, the corresponding color can be displayed. If the first-level node is located in an area other than the target area, the first-level node can be displayed transparently.

[0090] For example, Figure 6b As shown, the first-level node 602 is located in the central area of ​​the screen, then the first-level node 602 is displayed in purple, and the first-level nodes 601 and the first-level nodes 603 are both located in other areas, then the first-level nodes 601 and the first-level nodes 603 can be displayed in transparent colors. Only when the first-level node 601 is located in the central area, can the color be displayed as shown in FIG. Figure 6a The colors shown are similar for the first level nodes 603 .

[0091] Taking the node parameter including color as an example, since both gardening maintenance 2011 and plant species 2012 belong to the same first-level node 601, the node colors of gardening maintenance 2011 and plant species 2012 are the same. Similarly, the node colors of food seasoning 2031 and gourmet dishes 2032 are the same.

[0092] The second-level area is an area included in the second-level interface, which is used to display second-level nodes. In an embodiment of the present application, the second-level interface may include at least two second-level areas to display at least two second-level nodes, thereby improving the display effect of the knowledge graph.

[0093] Each second-level region may include at least one second-level node. When a second-level region includes multiple second-level nodes, the multiple second-level nodes belong to the same first-level node.

[0094] by Figure 2 For example, illustratively, assume that the area where the second-level node 201 is located is a second-level area, and the second-level area includes two second-level nodes, namely gardening maintenance 2011 and plant species 2012. Gardening maintenance 2011 and plant species 2012 belong to the same first-level node 601: plants.

[0095] The embodiment of the present application limits the number of second-level nodes included in the second-level interface, and the node parameters of the second-level nodes belonging to the same first-level node are the same, which can improve the display effect of the knowledge graph, and through the node parameters, users can more intuitively understand the relationship between different nodes.

[0096] In some embodiments, the attraction between second-level nodes belonging to the same first-level node is greater than the attraction between second-level nodes belonging to different first-level nodes.

[0097] The gravitational force between different nodes can be determined through a force-directed graph, which can be understood as a force model that can add grouping forces to nodes according to the level to which the nodes belong, so that different nodes belonging to the same category are close to each other, and nodes in different categories are far away from each other.

[0098] For example, Figure 2 As shown, the gardening maintenance 2011 and the plant species 2012 belong to the same first-level node: plant 601, the animal species 2021 belongs to the first-level node: animal cute pet 602, and the plant 601 and the animal cute pet 602 belong to different first-level nodes. Therefore, the gravitational force between the gardening maintenance 2011 and the plant species 2012 is greater than the gravitational force between the gardening maintenance 2011 and the animal species 2021, and the gravitational force between the gardening maintenance 2011 and the plant species 2012 is greater than the gravitational force between the plant species 2012 and the animal species 2021. The gravitational force between different nodes can be represented by distance, and the smaller the distance, the greater the gravitational force, and the larger the distance, the smaller the gravitational force. That is, the distance between the gardening maintenance 2011 and the plant species 2012 is smaller than the distance between the plant species 2012 and the animal species 2021, and the distance between the gardening maintenance 2011 and the plant species 2012 is smaller than the distance between the plant species 2012 and the animal species 2021.

[0099] In this way, the second-level nodes belonging to the same first-level node can be close to each other, and the second-level nodes belonging to different first-level nodes can be kept away from each other. This can avoid the second-level nodes belonging to different first-level nodes from crossing each other, thereby improving the display effect of the knowledge graph.

[0100] In some embodiments, the node parameters of the third-level nodes belonging to the same second-level node are the same, and the node parameters include at least one of the following: color, shape, and size. Taking the node parameters of color, shape, and size as an example, illustratively, Figure 3 As shown, flower pots and potted plants both belong to Gardening Maintenance 2011, and Gardening Maintenance 2011 is a second-level node. The color, shape, and size of the nodes corresponding to the flower pots and potted plants are respectively the same.

[0101] The third-level interface includes at least two third-level areas, each of which includes third-level nodes belonging to the same second-level node. The layout of the third-level interface is similar to that of the second-level interface, that is, the third-level interface includes at least two third-level nodes, which can avoid the number of third-level nodes being too small and ensure the display effect of the knowledge graph.

[0102] The embodiment of the present application limits the number of third-level nodes included in the third-level interface, and the node parameters of the third-level nodes belonging to the same second-level node are the same, which can improve the display effect of the knowledge graph, and through the node parameters, users can more intuitively understand the relationship between different nodes.

[0103] In some embodiments, the attraction between third-level nodes belonging to the same second-level node is greater than the attraction between third-level nodes belonging to different second-level nodes. Figure 3 As shown, both the flower pot and the potted plant belong to the second-level node: Gardening Maintenance 2011, while the panda belongs to the second-level node: Animal Species 2021. Since Gardening Maintenance 2011 and Animal Species 2021 belong to different second-level nodes, the gravitational force between the flower pot and the potted plant is greater than the gravitational force between the flower pot and the panda, and also greater than the gravitational force between the potted plant and the panda. That is, the distance between the flower pot and the potted plant is smaller than the distance between the flower pot and the panda, and also smaller than the distance between the potted plant and the panda.

[0104] In this way, the third-level nodes belonging to the same second-level node can be close to each other, and the third-level nodes belonging to different second-level nodes can be kept away from each other. This can avoid the third-level nodes belonging to different second-level nodes from crossing each other, thereby improving the display effect of the knowledge graph.

[0105] Figure 7 A flowchart of another interface display method provided in an embodiment of the present application, Figure 7and Figure 1 The difference is that Figure 1 The S110 in can be refined into Figure 7 S710 in Figure 1 The S120 in can be refined into Figure 7 The S720 in the.

[0106] S710. When the second level interface of the knowledge graph interface is displayed and the second target node is in a selected state, receive a second input.

[0107] The second target node is a node in the second level interface that is in a selected state. For example, when the second target node is located in a designated area of ​​the screen of the electronic device, the second target node can be considered to be in a selected state. The designated area can be, for example, the central area of ​​the screen, or other areas except the central area.

[0108] Taking the designated area as the central area of ​​the screen as an example, for example, Figure 8 As shown, the user can drag the second level interface to make the second target node located in the central area, so that the second target node is in a selected state. Figure 8 For example, taking Gardening Maintenance 2011 as the second target node, Gardening Maintenance 2011 is located in the central area of ​​the screen, that is, it is in a selected state. That is, the user can drag the second level interface to make the second target node located in the central area of ​​the screen, providing a basis for further viewing the third level nodes of the second target node.

[0109] Exemplarily, when the second target node is in the selected state, the user can perform the second input. If the second target node is not in the selected state, even if the user performs the second input, the electronic device cannot respond to the second input, so that the user can avoid misoperation of the knowledge graph interface.

[0110] S720. In response to the second input, a third-level interface of the knowledge graph interface is displayed, wherein the third-level nodes belonging to the second target node are in the target area.

[0111] The target area here may be the central area of ​​the screen. Exemplarily, when the second target node is in a selected state and the second input is received, the electronic device may display the third level interface. Since the second target node is located in the central area of ​​the screen, the third level node of the second target node is also located in the central area of ​​the screen.

[0112] Taking the second target node as gardening maintenance 2011 as an example, for example, Fig. 9As shown, when the electronic device receives the second input, it can display the third level interface 300, and the flower pots and potted plants included in the gardening maintenance 2011 are located in the central area of ​​the screen.

[0113] In the embodiment of the present application, the electronic device will display the third-level interface only when the second target node is in the selected state and the second input is received, so that the user can avoid misoperation of the knowledge graph interface and improve the accuracy of the interface display. Moreover, the third-level nodes belonging to the second target node are located in the target area, so that the user can more intuitively obtain the third-level nodes belonging to the second target node, saving the search time of the third-level nodes and improving the search efficiency.

[0114] Taking the classification object corresponding to the third label and the third label corresponding to the third level node as an example, illustratively, Fig.10 As shown, Fig.10 A schematic diagram of a process for determining a third label corresponding to a classification object provided in an embodiment of the present application.

[0115] S1010: Determine an initial label of the classification object using the first classification model.

[0116] The first classification model is used to determine the label of the classification object. For example, the first classification model may be an artificial intelligence (AI) model. The initial label is the label directly output by the first classification model.

[0117] Exemplarily, the first classification model may extract keywords of the classification object, and based on the keywords, set corresponding labels for the classification object to obtain initial labels. A classification object may correspond to one or more initial labels.

[0118] In some embodiments, taking into account the high power consumption and temperature rise of the labeling process, in order not to affect user usage, the classification object can be labeled using the first classification model to obtain the initial label of the classification object when the electronic device is turned off or charging.

[0119] In some embodiments, when outputting the initial label of each classified object, the first classification model may further output the confidence of each initial label, where the confidence is used to characterize the accuracy of the initial label for the classified object.

[0120] S1020: Determine a third label corresponding to the classification object according to a matching relationship between a reference label in the label library and the initial label.

[0121] The tag library is used to store multiple standard classification tags. The classification tags stored in the tag library can correspond to multiple classification levels. For example, the tag library includes standard first-level tags, second-level tags, and third-level tags. That is, each third-level tag has a corresponding standard second-level tag, and each second-level tag has a corresponding standard first-level tag. The tag library helps determine the nodes that belong to each level, providing an accurate basis for the subsequent construction of the knowledge graph.

[0122] The matching relationship between the reference tag and the initial tag is used to characterize whether the initial tag matches the reference tag. Exemplarily, when the initial tag is the same as a reference tag, it can be considered that the initial tag matches the reference tag. Exemplarily, it can also be determined whether the initial tag matches the reference tag based on the similarity between the initial tag and the reference tag. For example, if the similarity between the initial tag and a reference tag is greater than a similarity threshold, it can be considered that the initial tag matches the reference tag.

[0123] The third label is a label determined by the classification object, which can be a fine-grained label, such as a label corresponding to a third-level node. The number of third labels of the classification object can be more than one. After the third label is determined, in combination with the label library, other labels with a hierarchical relationship with the third label can be further obtained.

[0124] The embodiment of the present application can use the first classification model to label the classification object to obtain the initial label of the classification object. According to the matching relationship between the reference label in the label library and the initial label, the third label of the classification object can be accurately determined. Then, combined with the multiple classification levels stored in the label library, other labels with a hierarchical relationship with the third label can be obtained, providing an accurate basis for constructing a knowledge graph.

[0125] Taking the number of initial tags as at least two as an example, illustratively, Fig.11 As shown, Fig.11 and Fig.10 The difference is that Fig.10 The S1020 in can be refined into Fig.11 S1110-S1120 in.

[0126] S1110. For an initial label having a matching reference label in the label library, determine the reference label matching the initial label as a third label corresponding to the classification object.

[0127] Exemplarily, for the initial label, if there is a reference label matching the initial label in the label library, the reference label matching the initial label can be directly determined as the third label of the corresponding classification object. Since the label library stores standard labels and has standard classification labels of multiple classification levels, the reference label matching the initial label in the label library is determined as the third label of the classification object, which can ensure the accuracy of the third label, and in combination with the label library, the node to which the third label belongs can be determined more accurately, thereby improving the accuracy of the knowledge graph.

[0128] S1120. When the number of reference labels matching the initial label is less than a quantity threshold, for the initial label for which there is no matching reference label in the label library, a supplementary label is determined based on the confidence of each initial label, and the supplementary label is determined as the third label corresponding to the classification object.

[0129] For a certain classification object, it needs to have a specified number of third labels. When the number of reference labels matching the initial labels is less than a quantity threshold, it is necessary to further determine the supplementary labels based on the remaining initial labels.

[0130] Taking the example that the initial tags include four, assuming that there is one reference tag matching the initial tag 1 and one reference tag matching the initial tag 2, the number of reference tags matching the initial tags can be recorded as 2.

[0131] Exemplarily, if the number of reference tags matching the initial tag is less than the number threshold, it means that at least some of the initial tags do not match all the reference tags in the tag library. For the initial tags for which there are no matching reference tags in the tag library, the supplementary tags can be further determined from the initial tags according to the confidence of the initial tags. The content of the confidence can be referred to in the above embodiment, and will not be repeated here for the sake of brevity.

[0132] For example, supplementary tags may be determined from the initial tags according to the confidence of each initial tag until the number of supplementary tags and matching reference tags equals a quantity threshold. The value of the quantity threshold may be set according to actual needs, for example, may be set to 3.

[0133] Continuing with the above example, the number of reference labels that match the initial label is 2. Assuming that the confidence of initial label 3 is greater than the confidence of initial label 4, the initial label 3 with the highest confidence can be used as a supplementary label, and initial label 3 is also determined as the third label of the classification object.

[0134] Exemplarily, if the number of reference tags matching the initial tags is greater than or equal to a number threshold, there is no need to determine the supplementary tags.

[0135] The embodiment of the present application can determine the third label of the classification object based on whether the initial label matches the reference label in the label library, and the number of matches, while taking into account the number and accuracy of the third label, thereby improving the accuracy of the knowledge graph while improving the display effect of the knowledge graph.

[0136] In some embodiments, the interface display method may further include the following steps:

[0137] The second classification model is used to determine the second-level node to which the third-level node corresponding to the supplementary label belongs.

[0138] The second classification model is used to classify the supplementary tag to determine the second-level node to which the third-level node corresponding to the supplementary tag belongs. The second classification model may be, for example, an AI model.

[0139] Exemplarily, for the supplementary label, the second classification model may be used to classify the initial label to obtain the second-level node corresponding to the initial label.

[0140] That is, the embodiment of the present application can use the second classification model to further classify the initial labels, and obtain the second-level nodes to which the third-level nodes corresponding to the supplementary labels belong, thereby determining the hierarchical relationship between different nodes and providing a basis for the construction of the knowledge graph.

[0141] In some embodiments, the tag library includes a reference tag and a parent tag of the reference tag;

[0142] The interface display method may further include the following steps:

[0143] By using the hierarchical relationship between the reference tag and the upper-level tag in the tag library, the second-level node to which the third-level node corresponding to the initial tag matching the reference tag belongs is determined.

[0144] Exemplarily, if a certain initial tag has a matching reference tag in the tag library, the hierarchical relationship between the reference tag and the upper-level tag in the tag library can be combined to determine the second-level node to which the third-level node corresponding to the initial tag belongs. That is, if a certain initial tag has a matching reference tag in the tag library, the second-level node to which the third-level node corresponding to the initial tag belongs can be determined in combination with the tag library, thereby ensuring the accuracy of the hierarchical relationship.

[0145] Table 1 exemplarily lists some tags of a tag library. Table 1 takes the tag library including three levels of tags as an example, namely, a first-level tag, a second-level tag and a third-level tag. The third-level tag can be the reference tag mentioned in the above embodiment. In some embodiments, the third-level tag can correspond to the third-level node, the second-level tag can correspond to the second-level node, and the first-level tag can correspond to the first-level node.

[0146] Table 1

[0147]

[0148] In some embodiments, for the third-level tags, connections can be further established between the third-level nodes corresponding to different third-level tags, so as to facilitate users to view and discover the connections between knowledge and knowledge.

[0149] Exemplarily, association relationships between different third-level nodes may be established according to association rules, where the association rules include at least one of the following information: the number of classification objects to which different third-level nodes belong, and the number of identical third-level nodes contained in different classification objects.

[0150] Taking the example that the association rule includes the number of classification objects to which different third-level nodes belong (Rule 1), illustratively, when different third-level nodes belong to multiple classification objects at the same time, a connection relationship between each two nodes in the different third-level nodes can be established.

[0151] Taking the second quantity threshold as 2, classification object 1 corresponding to third-level node A, third-level node B, third-level node C and third-level node D, and classification object 2 corresponding to third-level node B, third-level node C, third-level node E and third-level node F as an example, since third-level node B and third-level node C belong to classification object 1 and classification object 2 at the same time, a connection relationship between third-level node B and third-level node C can be established. That is, when displaying the third-level interface, in addition to displaying third-level node B and third-level node C, a connection line between third-level node B and third-level node C can also be displayed to indicate that third-level node B and third-level node C have an association relationship.

[0152] For another example, classification object 3 corresponds to third-level node B, third-level node C, third-level node E and third-level node F. Since third-level node B, third-level node C and third-level node E belong to classification object 2 and classification object 3 at the same time, a connection relationship can be established between any two nodes in third-level node B, third-level node C and third-level node E. For example, a connection relationship between third-level node B and third-level node C, a connection relationship between third-level node B and third-level node E, and a connection relationship between third-level node C and third-level node E can be established.

[0153] Taking the example of the association rule including the number of the same third-level nodes contained in different classification objects (Rule 2), illustratively, when two classification objects have multiple identical third-level nodes and different third-level nodes belong to the same second-level node, a connection relationship can be established between different third-level nodes of the two classification objects.

[0154] Still taking classification object 1 and classification object 2 as an example, there are 3 identical third-level nodes in classification object 1 and classification object 2, and the third-level node A and the third-level node D corresponding to classification object 1, and the third-level node E and the third-level node F corresponding to classification object 2 belong to the same second-level node, then a connection relationship between the third-level node A and the third-level node E, a connection relationship between the third-level node A and the third-level node F, a connection relationship between the third-level node D and the third-level node E, and a connection relationship between the third-level node D and the third-level node F can be established.

[0155] In some embodiments, when the number of connections between different third-level nodes obtained based on rule 1 is small, the connection relationship between different third-level nodes can continue to be established based on rule 2, so as to ensure that the number of connections between different third-level nodes is uniform.

[0156] When establishing associations according to Rule 2, the same third-level node can establish association relationships with at most three other third-level nodes, so as to ensure that the number of connections between different third-level nodes is uniform. Of course, the number relationship can also be adjusted according to actual needs.

[0157] After the hierarchical relationships between nodes at each level and nodes at different levels are determined, the knowledge graph in the above embodiment can be constructed. The following takes the construction of a three-layer knowledge graph as an example.

[0158] Exemplarily, the position of the second-level node may be determined based on information such as the position, quantity, and size of the third-level node.

[0159] Exemplarily, if the number of third-level nodes contained in the same second-level node is greater than or equal to the first quantity threshold, and the total number of third-level nodes is greater than or equal to the second quantity threshold, the second-level node can be displayed in the second-level interface, otherwise, the second-level node is not displayed on the second-level interface. That is, not all determined second-level nodes can be displayed on the second-level interface. Exemplarily, the first quantity threshold can be set to 4, and the second quantity threshold can be set to 30. The total number of third-level nodes here can be the total number of third-level nodes contained in all second-level nodes. In this way, it can be avoided that the number of nodes on the second-level interface is too small, which affects the display effect of the knowledge graph.

[0160] Similarly, if the number of second-level nodes contained under the same first-level node is greater than or equal to the third number, and the total number of second-level nodes is greater than or equal to the fourth number threshold, the first-level node can be displayed in the first-level interface, otherwise, the first-level node is not displayed on the first-level interface. That is, not all determined first-level nodes can be displayed on the first-level interface. Exemplarily, the third number threshold can be set to 3, and the fourth number threshold can be set to 10. In this way, it can be avoided that the number of nodes on the first-level interface is too small, which affects the display effect of the knowledge graph.

[0161] After determining which second-level nodes and which first-level nodes need to be displayed, the positions of the second-level nodes and the first-level nodes can be further determined. The positions of the second-level nodes and the first-level nodes can be determined according to the positions of the third-level nodes, and the positions of the third-level nodes can be determined by the force-directed graph.

[0162] Exemplarily, the first area can be determined based on the positions of the third-level nodes contained in the second-level nodes, and the first area includes the third-level nodes contained in the second-level nodes; the target point and the distance between the target point and the target edge of the first area are determined from the first area; the second area is determined based on the target point and the distance, and the position of the second area is determined as the position of the second-level node.

[0163] For example, for each second-level node that needs to be displayed, the boundaries of the third-level nodes included in the second-level node along the horizontal direction and the vertical direction can be determined. Fig.12a As shown, the second-level node S includes five third-level nodes, namely 1201, 1202, 1203, 1204 and 1205. In some embodiments, the boundaries of each third-level node along the horizontal and vertical directions can be determined, and a rectangular area 1200 can be obtained based on the horizontal and vertical boundaries. The rectangular area 1200 here is also the first area in the above embodiment.

[0164] After the first area is determined, a target point can be determined from the first area. The target point can be any point in the first area. In some embodiments, for example, Fig.12a As shown, the target point may be the center point P of the first area 1200 .

[0165] The target edge may be any edge of the first area 1200, for example, the target edge may be the left edge L, the right edge R, the upper edge U, or the lower edge D of the first area 1200. In some embodiments, the distances between the center point P and the left edge L, the right edge R, the upper edge U, and the lower edge D may be calculated respectively, and the edge with the largest distance is determined as the target edge. Fig.12a Take the target edge as the left edge L as an example.

[0166] After the target edge is determined, the distance between the target point and the target edge can be calculated. Fig.12a For example, the distance R between the center point P and the left edge L can be calculated. According to the center point P and the distance R, the second area can be determined, and the position of the second area is the position of the second-level node.

[0167] For example, the second area can be generated with the center point P as the center and the radius R. Figure 12b As shown, the circular area 1206 is the second area, that is, the location of the second-level node.

[0168] In some embodiments, if the areas of different second-level nodes actually determined overlap, the radius of the overlapping area can be reduced to ensure that there is a certain gap between different second-level nodes, thereby improving the display effect of the knowledge graph. For example, if the area where the second-level node M and the second-level node N are located partially overlap, the radius of the area where the second-level node M and the second-level node N are located can be reduced.

[0169] The embodiment of the present application can adaptively determine the position of the second-level nodes based on the position of the third-level nodes, fully consider the inclusion relationship between nodes at different levels, and improve the display effect of the knowledge graph.

[0170] A second-level interface may be generated according to the positions of the second-level nodes.

[0171] Exemplarily, for each first-level node that needs to be displayed, all third-level nodes contained in the first-level node can be determined, and the position of the first-level node can be determined based on the positions of all third-level nodes. The specific determination process can be found in the second-level node, and for the sake of brevity, it will not be repeated here.

[0172] A first-level interface may be generated according to the position of each first-level node.

[0173] Exemplarily, by integrating the first-level interface, the second-level interface, and the third-level interface, a knowledge graph can be obtained.

[0174] Exemplarily, when displaying a knowledge graph, the electronic device may preferentially display the first-level interface, at which point the user may zoom in or click on the first-level interface to switch to the second-level interface, and similarly, zoom in or click on the second-level interface to switch to the third-level interface. Taking the switching from the first-level interface to the second-level interface as an example, exemplarily, when the first-level interface is zoomed in to a certain magnification, it may switch to the second-level interface.

[0175] Taking the first-level node corresponding to the first-level label, the second-level node corresponding to the second-level label, and the third-level node corresponding to the third-level label as an example, in some embodiments, the coloring of the same first-level node and all the second-level nodes corresponding to the first-level node can be the same, and the third-level nodes under different second-level nodes corresponding to the same first-level node can be colored using rules similar to the colors of the first-level nodes. For example, the color of the first-level node A is a, and the defined similar color pool is sorted as: a, b, c, d. The different second-level nodes under the first-level node A are B1, B2, and B3, and these second-level nodes are all colored with color a; multiple third-level nodes C11-C1n, B21-B2m, and C31-C3j under the B1, B2, and B3 classifications are colored with a, b, and c, respectively. This coloring method can ensure the continuity of the colors of the first, second, and third levels, and enhance the user's group association experience when viewing different levels of maps.

[0176] Taking the case where the classification objects corresponding to the third-level nodes include files as an example, illustratively, the interface display method may further include the following steps:

[0177] receiving a fourth input of a target classification object;

[0178] In response to the fourth input, a parsing result of the target classification object is displayed, where the parsing result includes at least one of the following: a summary of the target classification object and a key question pair, where the key question pair is obtained by parsing the target classification object.

[0179] The fourth input is used to display the analysis result of the target classification object. Exemplarily, the fourth input may include but is not limited to the user's touch input of the target classification object through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs. The specific input can be determined according to actual use requirements, and the embodiment of the present application is not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input. For example, the fourth input mentioned above can be: a user's click input of the target classification object.

[0180] Both the summary and the key question pair are obtained by parsing the target classification object. The key question pair includes the question and the answer. By refining the key question pair, the user's reading interest can be improved.

[0181] For example, Fig.12cAs shown, the third-level interface also includes a "Master's Thesis" node 1207. When the user clicks on the "Master's Thesis" node 1207, the electronic device can display four documents related to the master's thesis in the electronic device, namely document 1, document 2, document 3 and document 4. When the user clicks on document 1, the electronic device can display a parsing interface 1208, which includes the summary, summary, outline, key issues and other information obtained by parsing document 1. In this way, it can quickly help users establish an understanding of the context of document 1, so that users can quickly understand the key points of document 1, reduce the reading difficulty of users, improve reading efficiency, and help users have a memory enhancement effect on related content.

[0182] The embodiment of the present application labels the classification objects in the electronic device, merges and organizes the classification objects of different modalities from the dimension of content labels, and visualizes them in the form of a graph, so that the user can discover the implicit relationship between different classification objects through the graph, and can also quickly view classification objects of different forms, thereby improving the search efficiency of classification objects.

[0183] It should be noted that the interface display method provided in the embodiment of the present application can be executed by an interface display device or a processing module in the interface display device for executing the interface display method. In the embodiment of the present application, the interface display device executing the interface display method is taken as an example to illustrate the interface display device provided in the embodiment of the present application.

[0184] Fig.13 A schematic diagram of the structure of an interface display device provided in an embodiment of the present application.

[0185] like Fig.13 As shown, the interface display device 1300 may include: a receiving module 1301 and a display module 1302;

[0186] A receiving module 1301 is used to receive a second input when displaying the second level interface of the knowledge graph interface;

[0187] Display module 1302, for displaying a third level interface of the knowledge graph interface in response to the second input;

[0188] The receiving module 1301 is further configured to receive a third input to a third target node in the third level interface;

[0189] The display module 1302 is further configured to display the classification object corresponding to the third target node in response to the third input;

[0190] The second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and the third-level nodes have different classification levels.

[0191] In an embodiment of the present application, when displaying the second level interface of the knowledge graph interface, a second input is received; in response to the second input, a third level interface of the knowledge graph interface is displayed; a third input to a third target node in the third level interface is received; in response to the third input, a classification object corresponding to the third target node is displayed; wherein the second level interface includes a second level node, the third level interface includes a third level node, and the second level node and the third level node have different classification levels. That is, the embodiment of the present application can classify objects in electronic devices according to different classification levels, and users can quickly find an object based on its various classification levels without having to search in various applications, thereby improving the search efficiency of classified objects.

[0192] In some possible implementations of the embodiments of the present application, the receiving module 1301 is further configured to receive a first input before receiving a second input, when the first level interface of the knowledge graph interface is displayed;

[0193] The display module 1302 is further configured to display a second level interface of the knowledge graph interface in response to the first input;

[0194] The first-level interface includes first-level nodes, and the classification levels of the first-level nodes, the second-level nodes, and the third-level nodes are different.

[0195] In some possible implementations of the embodiments of the present application, the node parameters of the second-level nodes belonging to the same first-level node are the same, and the node parameters include at least one of the following: color, shape, and size; the second-level interface includes at least two second-level areas, and each second-level area includes second-level nodes belonging to the same first-level node.

[0196] In some possible implementations of the embodiments of the present application, the attraction between the second-level nodes belonging to the same first-level node is greater than the attraction between the second-level nodes belonging to different first-level nodes.

[0197] In some possible implementations of the embodiments of the present application, the node parameters of the third-level nodes belonging to the same second-level node are the same, and the node parameters include at least one of the following: color, shape, and size; the third-level interface includes at least two third-level areas, and each third-level area includes third-level nodes belonging to the same second-level node.

[0198] In some possible implementations of the embodiments of the present application, the attraction between third-level nodes belonging to the same second-level node is greater than the attraction between third-level nodes belonging to different second-level nodes.

[0199] In some possible implementations of the embodiments of the present application, the receiving module 1301 is specifically configured to:

[0200] When the second level interface of the knowledge graph interface is displayed and the second target node is in a selected state, receiving a second input;

[0201] The display module 1302 is specifically used for:

[0202] In response to the second input, a third-level interface of the knowledge graph interface is displayed, wherein the third-level nodes belonging to the second target node are in the target area.

[0203] In some possible implementations of the embodiments of the present application, the classification object corresponds to a third label, and the third label corresponds to a third-level node;

[0204] The interface display device 1300 may further include:

[0205] A determination module, used to determine an initial label of a classification object using a first classification model;

[0206] According to the matching relationship between the reference label in the label library and the initial label, the third label corresponding to the classification object is determined.

[0207] In some possible implementations of the embodiments of the present application, the number of initial tags is at least two;

[0208] Identify modules, specifically for:

[0209] For an initial label having a matching reference label in the label library, determining the reference label matching the initial label as a third label corresponding to the classification object;

[0210] When the number of reference labels matching the initial label is less than the quantity threshold, for the initial label for which there is no matching reference label in the label library, a supplementary label is determined based on the confidence of each initial label, and the supplementary label is determined as the third label corresponding to the classification object.

[0211] In some possible implementations of the embodiments of the present application, the determination module is further used to determine, by using the second classification model, the second-level node to which the third-level node corresponding to the supplementary label belongs.

[0212] In some possible implementations of the embodiments of the present application, the tag library includes a reference tag and a parent tag of the reference tag;

[0213] The determination module is further used to determine the second-level node to which the third-level node corresponding to the initial tag matching the reference tag belongs, by using the hierarchical relationship between the reference tag and the upper-level tag in the tag library.

[0214] The embodiment of the present application labels the classification objects in the electronic device, merges and organizes the classification objects of different modalities from the dimension of content labels, and visualizes them in the form of a graph, so that the user can discover the implicit relationship between different classification objects through the graph, and can also quickly view classification objects of different forms, thereby improving the search efficiency of classification objects.

[0215] The interface display device in the embodiment of the present application can be a device, or a component in an electronic device, such as an integrated circuit or a chip. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a user digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a user computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

[0216] The electronic device in the embodiment of the present application may be a terminal with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0217] The interface display device provided in the embodiment of the present application can implement each process in the above-mentioned interface display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0218] like Fig.14 As shown, an embodiment of the present application also provides an electronic device 1400, including a processor 1401 and a memory 1402, wherein the memory 1402 stores programs or instructions that can be executed on the processor 1401, and when the program or instructions are executed by the processor 1401, the various steps of the above-mentioned interface display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0219] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile terminals and non-mobile terminals.

[0220] Fig.15 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0221] The electronic device 1500 includes but is not limited to: a radio frequency unit 1501, a network module 1502, an audio output unit 1503, an input unit 1504, a sensor 1505, a display unit 1506, a user input unit 1507, an interface unit 1508, a memory 1509, and a processor 1510 and other components.

[0222] Those skilled in the art will appreciate that the electronic device 1500 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1510 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.15 The structure of the electronic device 1500 shown in the figure does not constitute a limitation of the electronic device 1500. The electronic device 1500 may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0223] The user input unit 1507 is used to receive a second input when the display unit 1506 displays the second level interface of the knowledge graph interface;

[0224] A display unit 1506, configured to display a third level interface of the knowledge graph interface in response to the second input;

[0225] The user input unit 1507 is further used to receive a third input to a third target node in the third level interface;

[0226] The display unit 1506 is further configured to display the classification object corresponding to the third target node in response to the third input;

[0227] The second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and the third-level nodes have different classification levels.

[0228] In an embodiment of the present application, when displaying the second level interface of the knowledge graph interface, a second input is received; in response to the second input, a third level interface of the knowledge graph interface is displayed; a third input to a third target node in the third level interface is received; in response to the third input, a classification object corresponding to the third target node is displayed; wherein the second level interface includes a second level node, the third level interface includes a third level node, and the second level node and the third level node have different classification levels. That is, the embodiment of the present application can classify objects in electronic devices according to different classification levels, and users can quickly find an object based on its various classification levels without having to search in various applications, thereby improving the search efficiency of classified objects.

[0229] In some possible implementations of the embodiments of the present application, the user input unit 1507 is further configured to receive a first input before receiving a second input, when the display unit 1506 displays the first level interface of the knowledge graph interface;

[0230] The display unit 1506 is further configured to display a second level interface of the knowledge graph interface in response to the first input;

[0231] The first-level interface includes first-level nodes, and the classification levels of the first-level nodes, the second-level nodes, and the third-level nodes are different.

[0232] In some possible implementations of the embodiments of the present application, the node parameters of the second-level nodes belonging to the same first-level node are the same, and the node parameters include at least one of the following: color, shape, and size; the second-level interface includes at least two second-level areas, and each second-level area includes second-level nodes belonging to the same first-level node.

[0233] In some possible implementations of the embodiments of the present application, the attraction between the second-level nodes belonging to the same first-level node is greater than the attraction between the second-level nodes belonging to different first-level nodes.

[0234] In some possible implementations of the embodiments of the present application, the node parameters of the third-level nodes belonging to the same second-level node are the same, and the node parameters include at least one of the following: color, shape, and size; the third-level interface includes at least two third-level areas, and each third-level area includes third-level nodes belonging to the same second-level node.

[0235] In some possible implementations of the embodiments of the present application,

[0236] The attraction between the third-level nodes belonging to the same second-level node is greater than the attraction between the third-level nodes belonging to different second-level nodes.

[0237] In some possible implementations of the embodiments of the present application, the user input unit 1507 is specifically used to:

[0238] When the display unit 1506 displays the second level interface of the knowledge graph interface and the second target node is in a selected state, receiving a second input;

[0239] The display unit 1506 is specifically used for:

[0240] In response to the second input, a third-level interface of the knowledge graph interface is displayed, wherein the third-level nodes belonging to the second target node are in the target area.

[0241] In some possible implementations of the embodiments of the present application, the classification object corresponds to a third label, and the third label corresponds to a third-level node;

[0242] Processor 1510, configured to determine an initial label of a classification object using a first classification model;

[0243] According to the matching relationship between the reference label in the label library and the initial label, the third label corresponding to the classification object is determined.

[0244] In some possible implementations of the embodiments of the present application, the number of initial tags is at least two;

[0245] The processor 1510 is specifically configured to:

[0246] For an initial label having a matching reference label in the label library, determining the reference label matching the initial label as a third label corresponding to the classification object;

[0247] When the number of reference labels matching the initial label is less than the quantity threshold, for the initial label for which there is no matching reference label in the label library, a supplementary label is determined based on the confidence of each initial label, and the supplementary label is determined as the third label corresponding to the classification object.

[0248] In some possible implementations of the embodiments of the present application, the processor 1510 is further configured to use a second classification model to determine the second-level node to which the third-level node corresponding to the supplementary label belongs.

[0249] In some possible implementations of the embodiments of the present application, the tag library includes a reference tag and a parent tag of the reference tag;

[0250] The processor 1510 is further configured to determine the second-level node to which the third-level node corresponding to the initial tag matching the reference tag belongs, by using the hierarchical relationship between the reference tag and the upper-level tag in the tag library.

[0251] The embodiment of the present application labels the classification objects in the electronic device, merges and organizes the classification objects of different modalities from the dimension of content labels, and visualizes them in the form of a graph, so that the user can discover the implicit relationship between different classification objects through the graph, and can also quickly view classification objects of different forms, thereby improving the search efficiency of classification objects.

[0252] It should be understood that in the embodiment of the present application, the input unit 1504 may include a graphics processor (Graphics Processing Unit, GPU) 15041 and a microphone 15042, and the graphics processor 15041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1506 may include a display panel 15061, and the display panel 15061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1507 includes a touch panel 15071 and at least one of other input devices 15072. The touch panel 15071 is also called a touch screen. The touch panel 15071 may include two parts: a touch detection device and a touch controller. Other input devices 15072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0253] The memory 1509 can be used to store software programs and various data. The memory 1509 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1509 may include a volatile memory or a non-volatile memory, or the memory 1509 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1509 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0254] The processor 1510 may include one or more processing units; optionally, the processor 1510 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1510.

[0255] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned interface display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0256] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0257] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned interface display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0258] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0259] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned interface display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0260] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0261] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0262] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An interface display method, characterized in that: include: In the case of displaying the second level interface of the knowledge graph interface, receiving a second input; In response to the second input, displaying a third level interface of the knowledge graph interface; receiving a third input to a third target node in the third level interface; In response to the third input, displaying the classification object corresponding to the third target node; The second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and the third-level nodes have different classification levels.

2. The method according to claim 1, characterized in that In the case of displaying the second level interface of the knowledge graph interface, before receiving the second input, the method further includes: In a case where the first level interface of the knowledge graph interface is displayed, receiving a first input; In response to the first input, displaying a second level interface of the knowledge graph interface; The first-level interface includes first-level nodes, and the first-level nodes, the second-level nodes, and the third-level nodes have different classification levels.

3. The method according to claim 2, characterized in that The node parameters of the second-level nodes belonging to the same first-level node are the same, and the node parameters include at least one of the following: color, shape, and size; the second-level interface includes at least two second-level areas, and each second-level area includes second-level nodes belonging to the same first-level node.

4. The method according to claim 3, characterized in that The attraction between the second-level nodes belonging to the same first-level node is greater than the attraction between the second-level nodes belonging to different first-level nodes.

5. The method according to claim 1, characterized in that The node parameters of the third-level nodes belonging to the same second-level node are the same, and the node parameters include at least one of the following: color, shape, and size; the third-level interface includes at least two third-level areas, and each third-level area includes third-level nodes belonging to the same second-level node.

6. The method according to claim 5, characterized in that The attraction between the third-level nodes belonging to the same second-level node is greater than the attraction between the third-level nodes belonging to different second-level nodes.

7. The method according to claim 1, characterized in that The receiving a second input when displaying the second level interface of the knowledge graph interface includes: When the second level interface of the knowledge graph interface is displayed and the second target node is in a selected state, receiving the second input; The step of displaying the third level interface of the knowledge graph interface in response to the second input includes: In response to the second input, a third-level interface of the knowledge graph interface is displayed, wherein the third-level nodes belonging to the second target node are in a target area.

8. The method according to claim 1, characterized in that The classification object corresponds to a third label, and the third label corresponds to the third-level node; The step of determining a third label corresponding to the classification object includes: Determining an initial label of the classification object using a first classification model; According to the matching relationship between the reference label in the label library and the initial label, a third label corresponding to the classification object is determined.

9. The method according to claim 8, characterized in that The number of the initial tags is at least two; The determining, according to the matching relationship between the reference label in the label library and the initial label, a third label corresponding to the classification object comprises: For an initial label having a matching reference label in the label library, determining the reference label matching the initial label as a third label corresponding to the classification object; When the number of reference labels matching the initial label is less than a quantity threshold, for initial labels for which there are no matching reference labels in the label library, a supplementary label is determined based on the confidence of each of the initial labels, and the supplementary label is determined as the third label corresponding to the classification object.

10. The method according to claim 9, characterized in that The method further comprises: The second classification model is used to determine the second-level node to which the third-level node corresponding to the supplementary label belongs.

11. The method according to claim 9, characterized in that The tag library includes a reference tag and a parent tag of the reference tag; The method further comprises: The hierarchical relationship between the reference tag in the tag library and the upper-level tag is used to determine the second-level node to which the third-level node corresponding to the initial tag matching the reference tag belongs.

12. An interface display device, characterized in that: include: Receiving module and display module; The receiving module is used to receive a second input when the second level interface of the knowledge graph interface is displayed; The display module is used to display a third level interface of the knowledge graph interface in response to the second input; The receiving module is further used to receive a third input to a third target node in the third level interface; The display module is further configured to display the classification object corresponding to the third target node in response to the third input; The second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and the third-level nodes have different classification levels.

13. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 11 are implemented.

14. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.

15. A computer program product, characterized in that The program product is stored in a storage medium, and the program product is executed by at least one processor to implement the steps of the method according to any one of claims 1 to 11.

Images