Interface display method and apparatus, device, medium, and product
By introducing a multi-level structure into the knowledge graph interface of electronic devices, users can quickly find files related to a topic, solving the problem of low search efficiency in multiple applications and achieving efficient information retrieval.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- VIVO MOBILE COMM CO LTD
- Filing Date
- 2025-12-08
- Publication Date
- 2026-06-18
AI Technical Summary
When users search for files related to a certain topic on their electronic devices, they need to search through multiple applications, resulting in low search efficiency.
By introducing a multi-level structure into the knowledge graph interface, users can receive input in the second-level interface to display the third-level interface, and display the corresponding category object by selecting the third target node, thus realizing quick search at different category levels.
It simplifies user operations and improves information retrieval efficiency, saving users time by eliminating the need to search through each application one by one.
Smart Images

Figure CN2025140630_18062026_PF_FP_ABST
Abstract
Description
Interface display methods, devices, equipment, media and products
[0001] Cross-reference to related applications
[0002] This application claims priority to Chinese Patent Application No. 202411835278.0, filed on December 12, 2024, entitled “Interface Display Method, Apparatus, Device, Medium and Product”, the entire contents of which are incorporated herein by reference. Technical Field
[0003] This application belongs to the field of electronic equipment technology, specifically relating to an interface display method, apparatus, device, medium, and product. Background Technology
[0004] When a user needs to search for content related to a certain topic on an electronic device, there are often multiple types of files related to that topic on the device. These different types of files are often located in different applications, which means that the user has to search for the file corresponding to the topic in each application, resulting in low search efficiency. Summary of the Invention
[0005] The purpose of this application is to provide an interface display method, apparatus, device, medium, and product that can improve the efficiency of information retrieval.
[0006] In a first aspect, embodiments of this application provide an interface display method, including:
[0007] When the second level interface of the knowledge graph is displayed, receive the second input;
[0008] In response to the second input, the third level of the knowledge graph interface is displayed;
[0009] Receive the third input to the third target node in the third-level interface;
[0010] In response to the third input, display the category object corresponding to the third target node;
[0011] The second-level interface includes second-level nodes, and the third-level interface includes third-level nodes. The second-level nodes and the third-level nodes have different classification levels.
[0012] Secondly, embodiments of this application provide an interface display device, including: a receiving module and a display module;
[0013] The receiving module is used to receive the second input when the second-level interface of the knowledge graph interface is displayed;
[0014] The display module is used to respond to the second input and display the third-level interface of the knowledge graph interface;
[0015] The receiving module is also used to receive third input to the third target node in the third-level interface;
[0016] The display module is also used to respond to a third input and display the category object corresponding to the third target node;
[0017] The second-level interface includes second-level nodes, and the third-level interface includes third-level nodes. The second-level nodes and the third-level nodes have different classification levels.
[0018] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the first aspect.
[0019] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method as described in the first aspect.
[0020] Fifthly, embodiments of this application provide a chip, which includes a processor and a communication interface, the communication interface and the processor being coupled together, the processor being used to run programs or instructions to implement the steps of the method as described in the first aspect.
[0021] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the steps of the method as described in the first aspect.
[0022] In this embodiment, when displaying the second-level interface of the knowledge graph interface, a second input is received; in response to the second input, the third-level interface of the knowledge graph interface is displayed; a third input is received for the third target node in the third-level interface; in response to the third input, the category object corresponding to the third target node is displayed; wherein, the second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and third-level nodes have different category levels. That is, this embodiment can classify objects in electronic devices according to different category levels, and users can quickly find an object based on its various category levels without having to search through various applications, thus improving the efficiency of finding categorized objects. Attached Figure Description
[0023] Figure 1 is a flowchart of an interface display method provided in an embodiment of this application;
[0024] Figure 2 is a schematic diagram of a second-level interface provided in an embodiment of this application;
[0025] Figure 3 is a schematic diagram of a third-level interface provided in an embodiment of this application;
[0026] Figure 4 is a schematic diagram of a details interface provided in an embodiment of this application;
[0027] Figure 5 is a flowchart of another interface display method provided in an embodiment of this application;
[0028] Figure 6a is a schematic diagram of a first-level interface provided in an embodiment of this application;
[0029] Figure 6b is a schematic diagram of another first-level interface provided in an embodiment of this application;
[0030] Figure 7 is a flowchart of another interface display method provided in an embodiment of this application;
[0031] Figure 8 is a schematic diagram of another second-level interface provided in an embodiment of this application;
[0032] Figure 9 is a schematic diagram of another third-level interface provided in an embodiment of this application;
[0033] Figure 10 is a schematic diagram of a process for determining a third label corresponding to a classification object according to an embodiment of this application;
[0034] Figure 11 is a schematic diagram of another process for determining the third label corresponding to a classification object according to an embodiment of this application;
[0035] Figure 12a is a schematic diagram of a first region provided in an embodiment of this application;
[0036] Figure 12b is a schematic diagram of a second region provided in an embodiment of this application;
[0037] Figure 12c is a schematic diagram of a parsing interface provided in an embodiment of this application;
[0038] Figure 13 is a schematic diagram of the structure of an interface display device provided in an embodiment of this application;
[0039] Figure 14 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0040] Figure 15 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0041] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0042] The terms "first," "second," etc., used in this application's specification are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class, without limiting the number of objects; for example, a first object can be one or more. Furthermore, in the specification, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects have an "or" relationship.
[0043] When users need to find or browse all types of files related to a specific topic on their electronic devices, they often have to open multiple applications to search and browse. For example, if a user needs to find content related to "xx travel" on their electronic device, such as photos, travel guides, videos, itinerary records, and saved links, they need to search for relevant keywords and browse through various applications to find multiple types of files or records that match the "xx travel" topic. This process is cumbersome and inefficient.
[0044] Therefore, embodiments of this application provide an interface display method, apparatus, device, medium, and product that can categorize objects in electronic devices according to different classification levels. Users can quickly find an object based on its various classification levels without having to search through different applications, thus improving the efficiency of finding categorized objects.
[0045] The interface display method, apparatus, device, medium, and product provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.
[0046] Figure 1 is a flowchart of an interface display method provided in an embodiment of this application. This interface display method can be applied to electronic devices such as mobile phones, tablets, and laptops. As shown in Figure 1, the interface display method may include the following steps:
[0047] S110. When the second level interface of the knowledge graph interface is displayed, receive the second input.
[0048] S120, In response to the second input, display the third level interface of the knowledge graph interface.
[0049] S130, Receive the third input to the third target node in the third-level interface.
[0050] S140. In response to the third input, display the classification object corresponding to the third target node.
[0051] The second-level interface includes second-level nodes, and the third-level interface includes third-level nodes. The second-level nodes and the third-level nodes have different classification levels.
[0052] The above steps are explained in detail below:
[0053] In S110, a knowledge graph can be generated based on objects in an electronic device and the relationships between different objects.
[0054] The objects here can be stored on electronic devices or saved by users on their devices, such as saved links or records. These objects can include at least two formats, such as images, audio, video, Word documents, PDF documents, and saved records. Through knowledge graphs, users can quickly find the objects they need and more intuitively understand the relationships between them, facilitating subsequent use.
[0055] For example, electronic devices can periodically retrieve objects from within the electronic device to periodically update the knowledge graph and improve its accuracy.
[0056] In this embodiment, the knowledge graph may include multiple levels. Taking a knowledge graph with three levels as an example, the second-level interface may, exemplarily, be a second-level knowledge graph, also known as a level-two knowledge graph. Alternatively, the second-level interface may also be a third-level knowledge graph, also known as a level-three knowledge graph. Furthermore, the second-level interface may also be a first-level knowledge graph, also known as a level-one knowledge graph.
[0057] The first-level knowledge graph may include first-level nodes, the second-level knowledge graph may include second-level nodes, and the third-level knowledge graph may include third-level nodes. Taking the first-level knowledge graph, the second-level knowledge graph, and the third-level knowledge graph as a first-level knowledge graph, a second-level knowledge graph, and a third-level knowledge graph, respectively, as an example, each first-level node may include at least one second-level node, and each second-level node may include at least one third-level node.
[0058] Taking the first-level knowledge graph, the second-level knowledge graph, and the third-level knowledge graph as examples, respectively, each third-level node may include at least one second-level node, and each second-level node may include at least one first-level node.
[0059] Taking a knowledge graph comprising four levels as an example, the interface of the second level can be any one of the first-level knowledge graph, the second-level knowledge graph, the third-level knowledge graph, and the fourth-level knowledge graph.
[0060] The second input is used to display the third-level interface. The third-level interface can be the interface before or after the second-level interface. That is, through the knowledge graph provided in this application embodiment, users can obtain the classification objects corresponding to each lower level in order from high to low, or they can understand the higher-level classification objects to which each lower-level classification object belongs in order from low to high, thus improving the flexibility of the knowledge graph.
[0061] Taking the second-level interface as a second-level knowledge graph, which includes three levels, as an example, the second input can be used to display the knowledge graph adjacent to the second-level knowledge graph, for example, it can be used to display the third-level knowledge graph or the first-level knowledge graph.
[0062] For example, the second input may include, but is not limited to, user touch input, voice input, gesture input, etc. on the second-level interface, and touch input may include, but is not limited to, zoom input, single-click input, double-click input, etc.
[0063] Taking a second-level interface as a second-level knowledge graph and a third-level interface as a first-level knowledge graph as an example, in some embodiments, the second input can be a user's zoom-out input on the second-level interface. That is, the user can zoom out of the second-level interface to display the first-level knowledge graph.
[0064] Taking a second-level interface as a two-level knowledge graph and a third-level interface as a three-level knowledge graph as an example, in some embodiments, the second input can be a zoom-in input from the user on the second-level interface. That is, the user can zoom in on the second-level interface to display the next level interface.
[0065] In S120, for example, the electronic device may display a third-level interface upon receiving a second input.
[0066] Taking the second-level interface corresponding to the second-level knowledge graph as an example, for instance, when the electronic device receives the second input, it can display the next level of knowledge graph of the second-level knowledge graph, that is, the third-level knowledge graph.
[0067] In S130, the third target node can be one or more of the third-level nodes, and the third-level nodes are the nodes contained in the knowledge graph corresponding to the third-level interface.
[0068] The classification levels of third-level nodes and second-level nodes are different. In some embodiments, second-level nodes may include third-level nodes, and in some embodiments, third-level nodes may also include second-level nodes, depending on the inclusion relationship of the hierarchical knowledge graphs to which the second-level nodes and third-level nodes belong.
[0069] The third input is used to select a third target node. For example, the third input may include, but is not limited to, user touch input, voice input, gesture input, etc., of the third target node.
[0070] In S140, for example, when the electronic device receives a third input from the user for a third target node, it can display the category object corresponding to the third target node.
[0071] Taking a third-level interface corresponding to a three-level knowledge graph as an example, the category objects corresponding to the third target node can include, but are not limited to, ID cards, property ownership certificates, social security cards, etc. The same third target node can correspond to one or more category objects. When there are multiple category objects, they can correspond to the same data format, such as all being images, or they can correspond to multiple data formats, such as some category objects corresponding to images, some corresponding to documents, and some corresponding to videos. In this way, a user can obtain one or more category objects through a single node.
[0072] The interface display process described above will be illustrated below through an example.
[0073] Figure 2 illustrates a schematic diagram of a second-level interface. As shown in Figure 2, the second-level interface 200 takes a two-level knowledge graph as an example. The second-level interface 200 includes three second-level nodes, namely second-level node 201, second-level node 202, and second-level node 203. Among them, second-level node 201 includes two nodes: horticulture maintenance 2011 and plant species 2012; second-level node 202 includes one node: animal species 2021; and second-level node 203 includes two nodes: food ingredients and seasonings 2031 and gourmet dishes 2032.
[0074] Taking the user zooming in on the second-level interface 200 as an example, as shown in Figure 3, the electronic device can display the third-level interface 300. Figure 3 uses the third-level interface corresponding to a three-level knowledge graph as an example. The third-level interface 300 exemplarily lists some third-level nodes. In actual application, the user can view other third-level nodes by dragging the third-level interface 300.
[0075] For example, in Figure 3, the gardening maintenance 2011 of the second-level node 201 can include flower pots and potted plants, and the plant species 2012 of the second-level node 201 can include lotus flowers, petals, bouquets, sunflowers, trees, etc. The animal species 2021 of the second-level node 202 can include pandas, insects, lions, cats, rabbits, swans, and penguins. That is, by zooming in on the second-level interface 200, the user can display the third-level interface 300, and through the third-level interface 300, they can quickly and intuitively obtain the third-level nodes contained in each second-level node, without having to search for each application one by one. This simplifies the user's operation and improves the efficiency of information retrieval.
[0076] In the third-level interface 300, taking the user's selection of an insect node as the third target node as an example, as shown in Figure 4, when the user clicks on the insect node, the electronic device can display a details interface 400. The details interface 400 can display the insects corresponding to the insect node. Figure 4 shows an example of an insect node corresponding to three types of insects. The insects displayed in the details interface 400 are the insects stored in the electronic device. Figure 4 shows an example where all three types of insects are images, meaning that the three classification objects correspond to the same data format, which is images.
[0077] Understandably, users can also switch from the third-level interface to the second-level interface by inputting commands, such as when a user zooms out on the third-level interface.
[0078] Thus, combining Figures 2-4, users only need to perform simple input operations on the second-level nodes and the third-level interface to quickly obtain the category object corresponding to a certain node, without having to search through each application one by one. This greatly simplifies the user's operation, saves time, and improves the efficiency of information retrieval.
[0079] Figure 5 is a flowchart of another interface display method provided in the embodiment of this application. The difference between Figure 5 and Figure 1 is that Figure 5 also includes S510-S520.
[0080] S510. When the first level interface of the knowledge graph is displayed, receive the first input.
[0081] In some embodiments, the first-level interface can be the interface above the second-level interface. For example, if the second-level interface corresponds to a second-level knowledge graph, the first-level interface can correspond to a first-level knowledge graph. In this case, the user can search for the information they need in order from coarse-grained classification hierarchy to fine-grained classification hierarchy.
[0082] In some embodiments, the first-level interface can also be the next level interface after the second-level interface. For example, if the second-level interface corresponds to a second-level knowledge graph, the first-level interface can correspond to a third-level knowledge graph. In this case, the user can search for the information they need in order from fine-grained classification hierarchy to coarse-grained classification hierarchy.
[0083] The first input is used to display the second-level interface. Exemplarily, the first input may include, but is not limited to, user touch input, voice input, and gesture input on the first-level interface. Taking an example where the second-level interface corresponds to a second-level knowledge graph and the first-level interface corresponds to a first-level knowledge graph, the first input may, for example, be a zoom-in input from the user on the first-level interface. Taking an example where the second-level interface corresponds to a second-level knowledge graph and the first-level interface corresponds to a third-level knowledge graph, the first input may, for example, be a zoom-out input from the user on the first-level interface.
[0084] S520, in response to the first input, displays the second level interface of the knowledge graph interface.
[0085] The first-level interface includes first-level nodes, and the first-level nodes, second-level nodes, and third-level nodes have different classification levels.
[0086] For example, the first-level nodes, second-level nodes, and third-level nodes can be in a sequentially contained relationship, that is, a first-level node can include at least one second-level node, and a second-level node can include at least one third-level node.
[0087] For example, the first-level nodes, the second-level nodes, and the third-level nodes can be in a sequentially contained relationship. That is, a third-level node can include at least one second-level node, and a second-level node can include at least one first-level node.
[0088] In this embodiment, users can view the knowledge graph either in order from fine-grained classification hierarchy to coarse-grained classification hierarchy, or in order from coarse-grained classification hierarchy to fine-grained classification hierarchy. This can meet the personalized needs of users. Moreover, through knowledge graphs of different levels, users can also more intuitively understand the implicit relationships between data, providing a foundation for the use of data.
[0089] Taking a first-level node belonging to a first-level knowledge graph as an example, in some embodiments, second-level nodes belonging to the same first-level node have the same node parameters. These node parameters may include at least one of the following: color, shape, and size.
[0090] Taking a first-level node comprising two second-level nodes as an example, the two second-level nodes have the same node parameters. Similarly, taking node parameters including color as an example, the second-level nodes have the same color; that is, for a two-level knowledge graph, second-level nodes belonging to the same first-level node in the second-level knowledge graph have the same color.
[0091] Taking fill method instead of color as an example, Figure 6a exemplarily illustrates a schematic diagram of a first-level interface. As shown in Figure 6a, the first-level interface 600 includes three first-level nodes: first-level node 601, first-level node 602, and first-level node 603. First-level node 601 includes second-level node 201, first-level node 602 includes second-level node 202, and first-level node 603 includes second-level node 203. In actual display of the first-level nodes, each first-level node can display a different color, represented by different fill methods in Figure 6a, making it easy for users to distinguish them. For example, a first-level node can also display a corresponding color when it is located in a target area of the screen, as shown in Figure 6a, by displaying the corresponding fill method. If the first-level node is located in an area other than the target area, the first-level node can be displayed transparently, as shown in Figure 6a, by not using any fill method.
[0092] For example, as shown in Figure 6b, if the first-level node 602 is located in the central area of the screen, then the first-level node 602 will display purple, which is reflected in the grid fill method in Figure 6b. If the first-level nodes 601 and 603 are both located in other areas, then the first-level nodes 601 and 603 can display transparent colors, which is reflected in Figure 6b as no fill method is used. Only when the first-level node 601 is located in the central area can it display the corresponding color, which is reflected in Figure 6a as the corresponding fill method is displayed. The same applies to the first-level node 603.
[0093] Taking node parameters including color as an example, Figure 2 shows the corresponding fill method. Because both Horticulture Maintenance 2011 and Plant Type 2012 belong to the same first-level node 601, their node colors are the same, which is reflected in Figure 2 as their node fill method being the same. Similarly, the node colors of Ingredient Seasoning 2031 and Food Dishes 2032 are the same, which is reflected in Figure 2 as their node fill method being the same.
[0094] The second-level region is the area contained in the second-level interface, used to display second-level nodes. In this embodiment, the second-level interface may include at least two second-level regions to display at least two second-level nodes, which can improve the display effect of the knowledge graph.
[0095] Each second-level region may include at least one second-level node. When a second-level region contains multiple second-level nodes, these multiple second-level nodes belong to the same first-level node.
[0096] Taking Figure 2 as an example, for instance, assume that the area where the second-level node 201 is located is a second-level area, which contains two second-level nodes, namely Horticulture Maintenance 2011 and Plant Species 2012. Horticulture Maintenance 2011 and Plant Species 2012 belong to the same first-level node 601: Plant.
[0097] This application embodiment limits the number of second-level nodes included in the second-level interface, and the node parameters of second-level nodes belonging to the same first-level node are the same. This can improve the display effect of the knowledge graph, and through the node parameters, users can more intuitively understand the relationship between different nodes.
[0098] In some embodiments, the gravitational force between second-level nodes belonging to the same first-level node is greater than the gravitational force between second-level nodes belonging to different first-level nodes.
[0099] The gravitational force between different nodes can be determined by a force diagram, which can be understood as a force model. It can add grouping forces to nodes according to their level, so that different nodes belonging to the same category move closer to each other, and nodes in different categories move further apart.
[0100] For example, as shown in Figure 2, Gardening Maintenance 2011 and Plant Species 2012 belong to the same first-level node: Plant 601, while Animal Species 2021 belongs to the same first-level node: Pet 602. Plant 601 and Pet 602 belong to different first-level nodes. Therefore, the attraction between Gardening Maintenance 2011 and Plant Species 2012 is greater than the attraction between Gardening Maintenance 2011 and Animal Species 2021, and the attraction between Gardening Maintenance 2011 and Plant Species 2012 is greater than the attraction between Plant Species 2012 and Animal Species 2021. The attraction between different nodes can be represented by distance; the smaller the distance, the greater the attraction, and the larger the distance, the smaller the attraction. That is, the distance between Gardening Maintenance 2011 and Plant Species 2012 is less than the distance between Plant Species 2012 and Animal Species 2021, and the distance between Gardening Maintenance 2011 and Plant Species 2012 is less than the distance between Plant Species 2012 and Animal Species 2021.
[0101] This allows second-level nodes belonging to the same first-level node to move closer to each other, while second-level nodes belonging to different first-level nodes move further apart. This avoids the intersection of second-level nodes belonging to different first-level nodes and improves the display effect of the knowledge graph.
[0102] In some embodiments, third-level nodes belonging to the same second-level node have the same node parameters, which include at least one of the following: color, shape, and size. Taking color, shape, and size as node parameters as an example, as shown in Figure 3, both flower pots and potted plants belong to Horticulture Maintenance 2011, and Horticulture Maintenance 2011 is a second-level node. Therefore, the color, shape, and size of the nodes corresponding to flower pots and potted plants are the same. In Figure 3, color is represented by the corresponding fill method, that is, the fill method, shape, and size of the nodes corresponding to flower pots and potted plants are the same.
[0103] The third-level interface includes at least two third-level regions, and each third-level region includes third-level nodes belonging to the same second-level node. The layout of the third-level interface is similar to that of the second-level interface; that is, the third-level interface includes at least two third-level nodes. This avoids having too few third-level nodes and ensures the display effect of the knowledge graph.
[0104] This application embodiment limits the number of third-level nodes included in the third-level interface, and the third-level nodes belonging to the same second-level node have the same node parameters. This can improve the display effect of the knowledge graph, and through the node parameters, users can more intuitively understand the relationship between different nodes.
[0105] In some embodiments, the gravitational force between third-level nodes belonging to the same second-level node is greater than the gravitational force between third-level nodes belonging to different second-level nodes. For example, as shown in Figure 3, both the flowerpot and the potted plant belong to the second-level node: Horticulture Maintenance 2011, while the panda belongs to the second-level node: Animal Species 2021. Since Horticulture Maintenance 2011 and Animal Species 2021 belong to different second-level nodes, the gravitational force between the flowerpot and the potted plant is greater than the gravitational force between the flowerpot and the panda, and also greater than the gravitational force between the potted plant and the panda. That is, the distance between the flowerpot and the potted plant is less than the distance between the flowerpot and the panda, and also less than the distance between the potted plant and the panda.
[0106] This allows third-level nodes belonging to the same second-level node to move closer to each other, while third-level nodes belonging to different second-level nodes move further apart. This avoids the intersection of third-level nodes belonging to different second-level nodes and improves the display effect of the knowledge graph.
[0107] Figure 7 is a flowchart of another interface display method provided in the embodiment of this application. The difference between Figure 7 and Figure 1 is that S110 in Figure 1 can be refined into S710 in Figure 7, and S120 in Figure 1 can be refined into S720 in Figure 7.
[0108] S710. When the second level interface of the knowledge graph is displayed and the second target node is selected, the second input is received.
[0109] The second target node is a node in the second-level interface that is in a selected state. For example, when the second target node is located in a designated area of the screen of an electronic device, it can be considered to be in a selected state. The designated area can be, for example, the central area of the screen, or other areas besides the central area.
[0110] Taking the central area of the screen as an example, as shown in Figure 8, the user can drag the second-level interface to place the second target node in the central area, thus making the second target node selected. Figure 8 uses "Gardening Maintenance 2011" as an example of the second target node; in this case, "Gardening Maintenance 2011" is located in the central area of the screen, i.e., it is in a selected state. That is, the user can drag the second-level interface to place the second target node in the central area of the screen, providing a basis for further viewing of the third-level nodes of the second target node.
[0111] For example, when the second target node is selected, the user can perform a second input. If the second target node is not selected, the electronic device will not respond to the second input even if the user performs it, thus avoiding accidental operation of the knowledge graph interface by the user.
[0112] S720, in response to the second input, displays the third-level interface of the knowledge graph interface, wherein the third-level node belonging to the second target node is located in the target area.
[0113] The target area here can be the central area of the screen. For example, when the electronic device is in a selected state for the second target node and receives a second input, it can display a third-level interface. Since the second target node is located in the central area of the screen, its third-level node is also located in the central area of the screen.
[0114] Taking the second target node as gardening maintenance 2011 as an example, as shown in Figure 9, when the electronic device receives the second input, it can display the third-level interface 300, and the flower pots and potted plants contained in gardening maintenance 2011 are located in the central area of the screen.
[0115] In this embodiment, the electronic device displays the third-level interface only when the second target node is selected and the second input is received. This avoids accidental user operations on the knowledge graph interface and improves the accuracy of the interface display. Furthermore, the third-level nodes belonging to the second target node are located in the target area, allowing users to more intuitively obtain these nodes, saving search time and improving search efficiency.
[0116] Taking the third label corresponding to the category object and the third label corresponding to the third level node as an example, as shown in Figure 10, Figure 10 is a schematic diagram of a process for determining the third label corresponding to the category object provided in an embodiment of this application.
[0117] S1010. Use the first classification model to determine the initial labels of the classification objects.
[0118] The first classification model is used to determine the labels of the classified objects. For example, the first classification model can be an artificial intelligence (AI) model. The initial labels are the labels directly output by the first classification model.
[0119] For example, the first classification model can extract keywords for the classification objects, and based on the keywords, set corresponding labels for the classification objects to obtain initial labels. One classification object can correspond to one or more initial labels.
[0120] In some embodiments, considering that the tagging process consumes a lot of power and generates a high temperature, in order not to affect the user's use, the first classification model can be used to tag the classified objects to obtain the initial tags of the classified objects when the electronic device is turned off or charging.
[0121] In some embodiments, when the first classification model outputs the initial label for each classified object, it may further output the confidence score of each initial label, which is used to characterize the accuracy of the initial label for the classified object.
[0122] S1020. Based on the matching relationship between the reference tags in the tag library and the initial tags, determine the third tag corresponding to the classification object.
[0123] The tag library stores multiple standard category tags. These tags can correspond to multiple category levels; for example, the tag library includes standard first-level, second-level, and third-level tags. That is, each third-level tag has a corresponding standard second-level tag, and each second-level tag has a corresponding standard first-level tag. The tag library helps determine the node to which each level belongs, providing an accurate basis for subsequent knowledge graph construction.
[0124] The matching relationship between the reference tag and the initial tag is used to characterize whether the initial tag matches the reference tag. For example, when the initial tag is the same as a reference tag, the initial tag can be considered to match the reference tag. Alternatively, the match between the initial tag and the reference tag can also be determined based on their similarity; for instance, if the similarity between the initial tag and a reference tag is greater than a similarity threshold, the initial tag can be considered to match the reference tag.
[0125] The third label is a label determined for the categorized object. It can be a fine-grained hierarchical label, such as the label corresponding to a third-level node. A categorized object can have more than one third label. After the third label is determined, other labels with hierarchical relationships to the third label can be obtained by combining it with a label library.
[0126] This application embodiment can use a first classification model to label the classified objects to obtain the initial labels of the classified objects. Based on the matching relationship between the reference labels in the label library and the initial labels, the third label of the classified objects can be accurately determined. Then, by combining the multiple classification levels stored in the label library, other labels with hierarchical relationships with the third label can be obtained, providing an accurate basis for constructing a knowledge graph.
[0127] Taking an initial number of at least two labels as an example, as shown in Figure 11, the difference between Figure 11 and Figure 10 is that S1020 in Figure 10 can be refined into S1110-S1120 in Figure 11.
[0128] S1110. For an initial tag that has a matching reference tag in the tag library, the reference tag that matches the initial tag is determined as the third tag corresponding to the classification object.
[0129] For example, for an initial label, if a reference label matching the initial label exists in the label library, the reference label matching the initial label can be directly identified as the third label of the corresponding category object. Since the label library stores standard labels and has standard category labels at multiple classification levels, identifying the reference label matching the initial label in the label library as the third label of the category object can ensure the accuracy of the third label. Moreover, combined with the label library, the node to which the third label belongs can be more accurately determined, thereby improving the accuracy of the knowledge graph.
[0130] S1120. If the number of reference tags that match the initial tag is less than the number threshold, for the initial tag that does not have a matching reference tag in the tag library, a supplementary tag is determined based on the confidence level of each initial tag, and the supplementary tag is determined as the third tag corresponding to the classification object.
[0131] For a given category object, it needs to have a specified number of third labels. If the number of reference labels that match the initial labels is less than the number threshold, supplementary labels need to be determined based on the remaining initial labels.
[0132] Taking an initial tag consisting of four tags as an example, assuming there is one reference tag that matches the initial tag 1 and one reference tag that matches the initial tag 2, then the number of reference tags that match the initial tag can be recorded as 2.
[0133] For example, if the number of reference tags matching the initial tag is less than a threshold, it means that at least some of the initial tags do not match any of the reference tags in the tag library. For initial tags that do not have a matching reference tag in the tag library, supplementary tags can be further determined from the initial tags based on the confidence level of the initial tag. The content of the confidence level can be found in the above embodiments, and will not be repeated here for the sake of brevity.
[0134] For example, supplementary labels can be determined from the initial labels based on the confidence level of each initial label, until the number of supplementary labels and matching reference labels equals a quantity threshold. The size of the quantity threshold can be set according to actual needs, for example, it can be set to 3.
[0135] Following the example above, the number of reference labels that match the initial label is 2. Assuming that the confidence level of the initial label 3 is greater than that of the initial label 4, the initial label 3 with the highest confidence level can be used as a supplementary label, and the initial label 3 can also be determined as the third label of this category object.
[0136] For example, if the number of reference labels that match the initial label is greater than or equal to a number threshold, then there is no need to determine supplementary labels.
[0137] The embodiments of this application can determine the third label of the classification object based on whether the initial label matches the reference labels in the label library, and the number of matches. This balances the quantity and accuracy of the third label, improving the display effect of the knowledge graph while enhancing its accuracy.
[0138] In some embodiments, the interface display method may further include the following steps:
[0139] The second classification model is used to determine the second-level node to which the third-level node corresponding to the supplementary label belongs.
[0140] The second classification model is used to classify supplementary labels to determine the second-level node to which the third-level node corresponding to the supplementary label belongs. The second classification model can be, for example, an AI model.
[0141] For example, for supplementary labels, the initial labels can be classified using a second classification model to obtain the second-level nodes corresponding to the initial labels.
[0142] In other words, the embodiments of this application can use the second classification model to further classify the initial labels, obtain the second-level nodes to which the third-level nodes corresponding to the supplementary labels belong, thereby determining the hierarchical relationship between different nodes and providing a foundation for the construction of knowledge graphs.
[0143] In some embodiments, the tag library includes reference tags and the parent tags of the reference tags;
[0144] The interface display method may also include the following steps:
[0145] By utilizing the hierarchical relationship between reference tags and parent tags in the tag library, determine the second-level node to which the third-level node corresponding to the initial tag that matches the reference tag belongs.
[0146] For example, if an initial tag has a matching reference tag in the tag library, the hierarchical relationship between the reference tag and the parent tag in the tag library can be used to determine the second-level node to which the third-level node corresponding to the initial tag belongs. In other words, if an initial tag has a matching reference tag in the tag library, the second-level node to which the third-level node corresponding to the initial tag belongs can be determined by combining the tag library, thus ensuring the accuracy of the hierarchical relationship.
[0147] Table 1 provides an example of a partial list of tags in a tag library. Table 1 uses a tag library with three levels of tags as an example: first-level tags, second-level tags, and third-level tags. The third-level tags can be the reference tags mentioned in the above embodiments. In some embodiments, the third-level tags can correspond to third-level nodes, the second-level tags can correspond to second-level nodes, and the first-level tags can correspond to first-level nodes.
[0148] Table 1
[0149] In some embodiments, for third-level tags, connections can be further established between the third-level nodes corresponding to different third-level tags, making it easier for users to view and discover the connections between knowledge.
[0150] For example, associations between different third-level nodes can be established according to association rules, which include at least one of the following: the number of category objects to which different third-level nodes belong, and the number of the same third-level nodes contained in different category objects.
[0151] Taking the association rule including the number of classification objects to which different third-level nodes belong (rule 1) as an example, for instance, when different third-level nodes belong to multiple classification objects at the same time, a connection relationship can be established between each pair of nodes in the different third-level nodes.
[0152] Taking a second quantity threshold of 2 as an example, where category 1 corresponds to third-level nodes A, B, C, and D, and category 2 corresponds to third-level nodes B, C, E, and F, since third-level nodes B and C belong to both category 1 and category 2, a connection can be established between them. That is, when displaying the third-level interface, in addition to showing third-level nodes B and C, the connection between them can also be displayed to indicate that a relationship exists between them.
[0153] For example, category 3 corresponds to third-level nodes B, C, E, and F. Since third-level nodes B, C, and E belong to both category 2 and category 3, pairwise connections can be established between any two nodes within these categories. Specifically, connections can be established between third-level nodes B and C, B and E, and C and E.
[0154] Taking the connection rule including the number of the same third-level nodes contained in different category objects (rule 2) as an example, for instance, when two category objects have multiple identical third-level nodes, and different third-level nodes belong to the same second-level node, a connection relationship can be established between the different third-level nodes of these two category objects.
[0155] Taking category object 1 and category object 2 as examples, category object 1 and category object 2 have 3 identical third-level nodes. Furthermore, the third-level nodes A and D corresponding to category object 1, and the third-level nodes E and F corresponding to category object 2 belong to the same second-level node. Therefore, we can establish connection relationships between third-level nodes A and E, between third-level nodes A and F, between third-level nodes D and E, and between third-level nodes D and F.
[0156] In some embodiments, when the number of connections between different third-level nodes obtained based on rule 1 is small, the connection relationship between different third-level nodes can be established based on rule 2, so as to ensure that the number of connections between different third-level nodes is uniform.
[0157] According to Rule 2, when establishing connections, a single third-level node can establish connections with a maximum of three other third-level nodes to ensure a uniform number of connections between different third-level nodes. Of course, this number can be adjusted according to actual needs.
[0158] Once the nodes at each level and the hierarchical relationships between nodes at different levels are determined, the knowledge graph in the above embodiment can be constructed. The following example uses the construction of a three-layer knowledge graph.
[0159] For example, the position of the second-level node can be determined based on information such as the position, number, and size of the third-level node.
[0160] For example, if the number of third-level nodes contained under the same second-level node is greater than or equal to a first threshold, and the total number of third-level nodes is greater than or equal to a second threshold, then the second-level node can be displayed on the second-level interface; otherwise, it will not be displayed. That is, not all identified second-level nodes can be displayed on the second-level interface. For example, the first threshold can be set to 4, and the second threshold can be set to 30. The total number of third-level nodes here can be the total number of third-level nodes contained in all second-level nodes. This avoids having too few nodes on the second-level interface, which would affect the display effect of the knowledge graph.
[0161] Similarly, if the number of second-level nodes contained under the same first-level node is greater than or equal to a third threshold, and the total number of second-level nodes is greater than or equal to a fourth threshold, then that first-level node can be displayed on the first-level interface; otherwise, it will not be displayed. That is, not all identified first-level nodes can be displayed on the first-level interface. For example, the third threshold can be set to 3, and the fourth threshold can be set to 10. This avoids having too few nodes on the first-level interface, which would negatively impact the display effect of the knowledge graph.
[0162] After determining which second-level nodes and which first-level nodes need to be displayed, the positions of the second-level and first-level nodes can be further determined. The positions of the second-level and first-level nodes can be determined based on the positions of the third-level nodes, which can be determined by the force diagram.
[0163] For example, a first region can be determined based on the positions of the third-level nodes contained in the second-level nodes, the first region including the third-level nodes contained in the second-level nodes; a target point and the distance between the target point and the target edge of the first region can be determined from the first region; a second region can be determined based on the target point and the distance, and the position of the second region can be determined as the position of the second-level node.
[0164] For example, for each second-level node that needs to be displayed, the boundaries of each third-level node contained in that second-level node along the horizontal and vertical directions can be determined. As shown in Figure 12a, the second-level node S contains five third-level nodes, namely 1201, 1202, 1203, 1204, and 1205. In some embodiments, the boundaries of each third-level node along the horizontal and vertical directions can be determined. Based on the horizontal and vertical boundaries, a rectangular region 1200 can be obtained. This rectangular region 1200 is also the first region in the above embodiment.
[0165] After the first region is determined, a target point can be determined from the first region. The target point can be any point in the first region. In some embodiments, as shown in FIG12a, the target point can be the center point P of the first region 1200.
[0166] The target edge can be any edge of the first region 1200. For example, the target edge can be the left edge L, right edge R, upper edge U, or lower edge D of the first region 1200. In some embodiments, the distances between the center point P and the left edge L, right edge R, upper edge U, and lower edge D can be calculated respectively, and the edge with the largest distance can be determined as the target edge. Figure 12a shows an example where the target edge is the left edge L.
[0167] Once the target edge is determined, the distance between the target point and the target edge can be calculated. Taking Figure 12a as an example, the distance R between the center point P and the left edge L can be calculated. Based on the center point P and the distance R, the second region can be determined, and the location of the second region is the location of the second-level node.
[0168] For example, a second region can be generated with center point P as the center and radius R. As shown in Figure 12b, the circular region 1206 is the second region, which is also the location of the second-level node.
[0169] In some embodiments, if the areas of different second-level nodes overlap, the radius of the overlapping region can be reduced to ensure a certain gap between different second-level nodes, thereby improving the display effect of the knowledge graph. For example, if the regions where second-level node M and second-level node N are located partially overlap, the radius of the regions where second-level node M and second-level node N are located can be reduced.
[0170] The embodiments of this application can adaptively determine the position of the second-level node based on the position of the third-level node, fully considering the inclusion relationship between nodes of different levels and improving the display effect of the knowledge graph.
[0171] The second-level interface can be generated based on the position of the second-level node.
[0172] For example, for each first-level node that needs to be displayed, all third-level nodes contained in the first-level node can be determined, and the position of the first-level node can be determined based on the position of all third-level nodes. The specific determination process can be referred to the second-level node, which will not be elaborated here for the sake of brevity.
[0173] The first-level interface can be generated based on the position of each first-level node.
[0174] For example, a knowledge graph can be obtained by merging the first-level interface, the second-level interface, and the third-level interface.
[0175] For example, when an electronic device displays a knowledge graph, it can prioritize displaying the first-level interface. The user can then zoom in or click on the first-level interface to switch to the second-level interface. Similarly, they can zoom in or click on the second-level interface to switch to the third-level interface. Taking switching from the first-level interface to the second-level interface as an example, for instance, when the first-level interface is zoomed in to a certain magnification, the user can switch to the second-level interface.
[0176] Taking a first-level node corresponding to a first-level label, a second-level node corresponding to a second-level label, and a third-level node corresponding to a third-level label as an example, in some embodiments, the same first-level node and all its corresponding second-level nodes can be colored the same. For third-level nodes under different second-level nodes corresponding to the same first-level node, a color similar to that of the first-level node can be used for coloring. For example, the color of first-level node A is 'a', and the defined similar color pool is ordered as a, b, c, d. Different second-level nodes under first-level node A are B1, B2, and B3, and these second-level nodes are all colored with color 'a'. Multiple third-level nodes C11-C1n, B21-B2m, and C31-C3j under the categories B1, B2, and B3 are colored with colors a, b, and c, respectively. This coloring method can ensure the continuity of colors across the first, second, and third levels, enhancing the user's experience of grouping and associating different levels of the graph.
[0177] Taking the category object corresponding to the third-level node as an example, which includes files, the interface display method may also include the following steps:
[0178] Receive the fourth input for the target classification object;
[0179] In response to the fourth input, the parsing results of the target classification object are displayed. The parsing results include at least one of the following: a summary of the target classification object and a key question pair, which are obtained by parsing the target classification object.
[0180] The fourth input is used to display the parsing results of the target classification object. Exemplarily, the fourth input may include, but is not limited to, user touch input on the target classification object using a finger or stylus, a voice command input by the user, a specific gesture input by the user, or other feasible inputs. The specific input can be determined according to actual usage needs, and this application embodiment does not limit it. The specific gesture in this application embodiment can be any one of a single-click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, or a double-click gesture. The click input in this application embodiment can be a single-click input, a double-click input, or any number of clicks, and can also be a long-press input or a short-press input. For example, the aforementioned fourth input can be: user click input on the target classification object.
[0181] Both the abstract and the key question pairs are obtained by parsing the target classification objects. The key question pairs include questions and answers. By extracting the key question pairs, users' reading interest can be enhanced.
[0182] For example, as shown in Figure 12c, the third-level interface also includes a "Master's Thesis" node 1207. When the user clicks on the "Master's Thesis" node 1207, the electronic device can display four documents related to the master's thesis: Document 1, Document 2, Document 3, and Document 4. When the user clicks on Document 1, the electronic device can display a parsing interface 1208, which includes information such as the abstract, summary, outline, and key issues obtained from parsing Document 1. This allows the user to quickly grasp the structure of Document 1, understand its key points, reduce reading difficulty, improve reading efficiency, and enhance memory of the relevant content.
[0183] This application embodiment tags the classified objects in electronic devices, merges and organizes classified objects of different modalities from the dimension of content tags, and presents them in a visual way in the form of a graph. This allows users to discover the implicit relationships between different classified objects through the graph, and also to quickly view classified objects of different forms, thereby improving the efficiency of finding classified objects.
[0184] It should be noted that the interface display method provided in this application embodiment can be executed by an interface display device or a processing module within that interface display device for executing the interface display method. This application embodiment uses an interface display device executing the interface display method as an example to illustrate the interface display device provided in this application embodiment.
[0185] Figure 13 is a schematic diagram of the structure of an interface display device provided in an embodiment of this application.
[0186] As shown in Figure 13, the interface display device 1300 may include: a receiving module 1301 and a display module 1302;
[0187] The receiving module 1301 is used to receive a second input when the second-level interface of the knowledge graph interface is displayed;
[0188] Display module 1302 is used to display the third level interface of the knowledge graph interface in response to the second input;
[0189] The receiving module 1301 is also used to receive a third input to the third target node in the third-level interface;
[0190] The display module 1302 is also used to display the classification object corresponding to the third target node in response to the third input;
[0191] The second-level interface includes second-level nodes, and the third-level interface includes third-level nodes. The second-level nodes and the third-level nodes have different classification levels.
[0192] In this embodiment, when displaying the second-level interface of the knowledge graph interface, a second input is received; in response to the second input, the third-level interface of the knowledge graph interface is displayed; a third input is received for the third target node in the third-level interface; in response to the third input, the category object corresponding to the third target node is displayed; wherein, the second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and third-level nodes have different category levels. That is, this embodiment can classify objects in electronic devices according to different category levels, and users can quickly find an object based on its various category levels without having to search through various applications, thus improving the efficiency of finding categorized objects.
[0193] In some possible implementations of the embodiments of this application, the receiving module 1301 is further configured to receive the first input while displaying the first level interface of the knowledge graph interface before receiving the second input;
[0194] Display module 1302 is also used to display the second-level interface of the knowledge graph interface in response to the first input;
[0195] The first-level interface includes first-level nodes, and the first-level nodes, second-level nodes, and third-level nodes have different classification levels.
[0196] In some possible implementations of the embodiments of this application, the node parameters of the second-level nodes belonging to the same first-level nodes are the same, and the node parameters include at least one of the following: color, shape, and size; the second-level interface includes at least two second-level regions, and each second-level region includes second-level nodes belonging to the same first-level nodes.
[0197] In some possible implementations of the embodiments of this application, the gravitational force between second-level nodes belonging to the same first-level node is greater than the gravitational force between second-level nodes belonging to different first-level nodes.
[0198] In some possible implementations of the embodiments of this application, the node parameters of third-level nodes belonging to the same second-level nodes are the same, and the node parameters include at least one of the following: color, shape, and size; the third-level interface includes at least two third-level regions, and each third-level region includes third-level nodes belonging to the same second-level nodes.
[0199] In some possible implementations of the embodiments of this application, the gravitational force between third-level nodes belonging to the same second-level node is greater than the gravitational force between third-level nodes belonging to different second-level nodes.
[0200] In some possible implementations of the embodiments of this application, the receiving module 1301 is specifically used for:
[0201] In the second level interface of the knowledge graph, and with the second target node selected, the second input is received.
[0202] Display module 1302 is specifically used for:
[0203] In response to the second input, the third-level interface of the knowledge graph is displayed, in which the third-level node belonging to the second target node is located in the target area.
[0204] In some possible implementations of the embodiments of this application, the classification object corresponds to the third label, and the third label corresponds to the third-level node;
[0205] The interface display device 1300 may also include:
[0206] The determination module is used to determine the initial labels of the classified objects using the first classification model;
[0207] Based on the matching relationship between the reference tags in the tag library and the initial tags, determine the third tag corresponding to the category object.
[0208] In some possible implementations of the embodiments of this application, the number of initial tags is at least two;
[0209] The module is specifically used for:
[0210] For an initial tag that has a matching reference tag in the tag library, the reference tag that matches the initial tag is determined as the third tag corresponding to the category object;
[0211] If the number of reference tags that match the initial tag is less than the number threshold, for the initial tag that does not have a matching reference tag in the tag library, supplementary tags are determined based on the confidence level of each initial tag, and the supplementary tags are determined as the third tag corresponding to the classification object.
[0212] In some possible implementations of the embodiments of this application, the determining module is further configured to use the second classification model to determine the second-level node to which the third-level node corresponding to the supplementary label belongs.
[0213] In some possible implementations of embodiments of this application, the tag library includes a reference tag and a parent tag of the reference tag;
[0214] The determination module is also used to determine the second-level node to which the third-level node corresponding to the initial tag that matches the reference tag belongs by utilizing the hierarchical relationship between the reference tag and the parent tag in the tag library.
[0215] This application embodiment tags the classified objects in electronic devices, merges and organizes classified objects of different modalities from the dimension of content tags, and presents them in a visual way in the form of a graph. This allows users to discover the implicit relationships between different classified objects through the graph, and also to quickly view classified objects of different forms, thereby improving the efficiency of finding classified objects.
[0216] The interface display device in this application embodiment can be a device or a component in an electronic device, such as an integrated circuit or a chip. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.
[0217] The electronic device in this application embodiment can be a terminal with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.
[0218] The interface display device provided in this application embodiment can implement each process in the above interface display method embodiment and achieve the same technical effect. To avoid repetition, it will not be described again here.
[0219] As shown in Figure 14, this application embodiment also provides an electronic device 1400, including a processor 1401 and a memory 1402. The memory 1402 stores programs or instructions that can run on the processor 1401. When the program or instructions are executed by the processor 1401, they implement the various steps of the above-described interface display method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.
[0220] It should be noted that the electronic devices in the embodiments of this application include the mobile terminals and non-mobile terminals mentioned above.
[0221] Figure 15 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.
[0222] The electronic device 1500 includes, but is not limited to, components such as: radio frequency unit 1501, network module 1502, audio output unit 1503, input unit 1504, sensor 1505, display unit 1506, user input unit 1507, interface unit 1508, memory 1509, and processor 1510.
[0223] Those skilled in the art will understand that the electronic device 1500 may also include a power supply (such as a battery) for powering various components. The power supply can be logically connected to the processor 1510 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The structure of the electronic device 1500 shown in Figure 15 does not constitute a limitation on the electronic device 1500. The electronic device 1500 may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0224] The user input unit 1507 is used to receive a second input when the second-level interface of the knowledge graph interface is displayed on the display unit 1506.
[0225] Display unit 1506 is used to display the third level interface of the knowledge graph interface in response to the second input;
[0226] The user input unit 1507 is also used to receive a third input to a third target node in the third-level interface;
[0227] The display unit 1506 is also used to display the classification object corresponding to the third target node in response to the third input;
[0228] The second-level interface includes second-level nodes, and the third-level interface includes third-level nodes. The second-level nodes and the third-level nodes have different classification levels.
[0229] In this embodiment, when displaying the second-level interface of the knowledge graph interface, a second input is received; in response to the second input, the third-level interface of the knowledge graph interface is displayed; a third input is received for the third target node in the third-level interface; in response to the third input, the category object corresponding to the third target node is displayed; wherein, the second-level interface includes second-level nodes, the third-level interface includes third-level nodes, and the second-level nodes and third-level nodes have different category levels. That is, this embodiment can classify objects in electronic devices according to different category levels, and users can quickly find an object based on its various category levels without having to search through various applications, thus improving the efficiency of finding categorized objects.
[0230] In some possible implementations of the embodiments of this application, the user input unit 1507 is further configured to receive the first input while the first-level interface of the knowledge graph interface is displayed on the display unit 1506 before receiving the second input;
[0231] The display unit 1506 is also used to display the second-level interface of the knowledge graph interface in response to the first input.
[0232] The first-level interface includes first-level nodes, and the first-level nodes, second-level nodes, and third-level nodes have different classification levels.
[0233] In some possible implementations of the embodiments of this application, the node parameters of the second-level nodes belonging to the same first-level nodes are the same, and the node parameters include at least one of the following: color, shape, and size; the second-level interface includes at least two second-level regions, and each second-level region includes second-level nodes belonging to the same first-level nodes.
[0234] In some possible implementations of the embodiments of this application, the gravitational force between second-level nodes belonging to the same first-level node is greater than the gravitational force between second-level nodes belonging to different first-level nodes.
[0235] In some possible implementations of the embodiments of this application, the node parameters of third-level nodes belonging to the same second-level nodes are the same, and the node parameters include at least one of the following: color, shape, and size; the third-level interface includes at least two third-level regions, and each third-level region includes third-level nodes belonging to the same second-level nodes.
[0236] In some possible implementations of the embodiments of this application,
[0237] The gravitational pull between third-level nodes that belong to the same second-level node is greater than the gravitational pull between third-level nodes that belong to different second-level nodes.
[0238] In some possible implementations of the embodiments of this application, the user input unit 1507 is specifically used for:
[0239] When the second level interface of the knowledge graph is displayed on the display unit 1506 and the second target node is in the selected state, the second input is received.
[0240] Display unit 1506 is specifically used for:
[0241] In response to the second input, the third-level interface of the knowledge graph is displayed, in which the third-level node belonging to the second target node is located in the target area.
[0242] In some possible implementations of the embodiments of this application, the classification object corresponds to the third label, and the third label corresponds to the third-level node;
[0243] Processor 1510 is used to determine the initial label of the classified object using a first classification model;
[0244] Based on the matching relationship between the reference tags in the tag library and the initial tags, determine the third tag corresponding to the category object.
[0245] In some possible implementations of the embodiments of this application, the number of initial tags is at least two;
[0246] Processor 1510, specifically used for:
[0247] For an initial tag that has a matching reference tag in the tag library, the reference tag that matches the initial tag is determined as the third tag corresponding to the category object;
[0248] If the number of reference tags that match the initial tag is less than the number threshold, for the initial tag that does not have a matching reference tag in the tag library, supplementary tags are determined based on the confidence level of each initial tag, and the supplementary tags are determined as the third tag corresponding to the classification object.
[0249] In some possible implementations of the embodiments of this application, the processor 1510 is further configured to use the second classification model to determine the second-level node to which the third-level node corresponding to the supplementary label belongs.
[0250] In some possible implementations of the embodiments of this application, the tag library includes a reference tag and a parent tag of the reference tag;
[0251] The processor 1510 is also used to determine the second-level node to which the third-level node corresponding to the initial tag that matches the reference tag belongs by utilizing the hierarchical relationship between the reference tag and the parent tag in the tag library.
[0252] This application embodiment tags the classified objects in electronic devices, merges and organizes classified objects of different modalities from the dimension of content tags, and presents them in a visual way in the form of a graph. This allows users to discover the implicit relationships between different classified objects through the graph, and also to quickly view classified objects of different forms, thereby improving the efficiency of finding classified objects.
[0253] It should be understood that, in this embodiment, the input unit 1504 may include a graphics processing unit (GPU) 15041 and a microphone 15042. The GPU 15041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1506 may include a display panel 15061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1507 includes a touch panel 15071 and at least one of other input devices 15072. The touch panel 15071 is also called a touch screen. The touch panel 15071 may include a touch detection device and a touch controller. Other input devices 15072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.
[0254] The memory 1509 can be used to store software programs and various data. The memory 1509 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1509 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1509 in this embodiment includes, but is not limited to, these and any other suitable types of memory.
[0255] Processor 1510 may include one or more processing units; optionally, processor 1510 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 1510.
[0256] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described interface display method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0257] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.
[0258] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the above-described interface display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0259] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0260] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the interface display method embodiment described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0261] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0262] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the related technology, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0263] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. A method for displaying an interface, comprising: When the second level interface of the knowledge graph is displayed, receive the second input; In response to the second input, the third-level interface of the knowledge graph is displayed; Receive a third input to the third target node in the third-level interface; In response to the third input, the classification object corresponding to the third target node is displayed; The second-level interface includes second-level nodes, and the third-level interface includes third-level nodes. The second-level nodes and the third-level nodes have different classification levels.
2. The method according to claim 1, wherein before receiving the second input when displaying the second-level interface of the knowledge graph interface, the method further comprises: When the first level of the knowledge graph interface is displayed, receive the first input; In response to the first input, the second-level interface of the knowledge graph is displayed; The first-level interface includes a first-level node, and the first-level node, the second-level node, and the third-level node have different classification levels.
3. The method according to claim 2, wherein, Second-level nodes belonging to the same first-level node have the same node parameters, which include at least one of the following: color, shape, and size; the second-level interface includes at least two second-level regions, and each second-level region includes second-level nodes belonging to the same first-level node.
4. The method according to claim 3, wherein, The gravitational pull between second-level nodes that belong to the same first-level node is greater than the gravitational pull between second-level nodes that belong to different first-level nodes.
5. The method according to claim 1, wherein, The third-level nodes belonging to the same second-level nodes have the same node parameters, and the node parameters include at least one of the following: color, shape, and size; the third-level interface includes at least two third-level regions, and each third-level region includes third-level nodes belonging to the same second-level nodes.
6. The method according to claim 5, wherein, The gravitational pull between third-level nodes that belong to the same second-level node is greater than the gravitational pull between third-level nodes that belong to different second-level nodes.
7. The method according to claim 1, wherein, In the case of displaying the second-level interface of the knowledge graph interface, receiving the second input includes: The second input is received when the second target node is selected in the second level interface of the knowledge graph interface; The third-level interface of the knowledge graph interface, displayed in response to the second input, includes: In response to the second input, the third-level interface of the knowledge graph is displayed, wherein the third-level node belonging to the second target node is located in the target area.
8. The method according to claim 1, wherein, The classification object corresponds to the third label, and the third label corresponds to the third-level node; The step of determining the third label corresponding to the classified object includes: The initial labels of the classified objects are determined using the first classification model; Based on the matching relationship between the reference tags in the tag library and the initial tags, the third tag corresponding to the classification object is determined.
9. The method according to claim 8, wherein, The number of initial tags is at least two; The step of determining the third label corresponding to the classification object based on the matching relationship between the reference labels in the label library and the initial label includes: For an initial tag that has a matching reference tag in the tag library, the reference tag that matches the initial tag is determined as the third tag corresponding to the classification object; If the number of reference tags that match the initial tag is less than a threshold, for an initial tag that does not have a matching reference tag in the tag library, a supplementary tag is determined based on the confidence level of each initial tag, and the supplementary tag is determined as the third tag corresponding to the classification object.
10. The method according to claim 9, further comprising: The second classification model is used to determine the second-level node to which the third-level node corresponding to the supplementary label belongs.
11. The method according to claim 9, wherein, The tag library includes reference tags and the parent tags of the reference tags; The method further includes: By utilizing the hierarchical relationship between the reference tags in the tag library and the parent tag, the second-level node to which the third-level node corresponding to the initial tag that matches the reference tag belongs is determined.
12. An interface display device, comprising: Receive module and display module; The receiving module is used to receive a second input when the second-level interface of the knowledge graph interface is displayed; The display module is used to display the third-level interface of the knowledge graph interface in response to the second input; The receiving module is also used to receive a third input to the third target node in the third-level interface; The display module is also used to display the classification object corresponding to the third target node in response to the third input; The second-level interface includes second-level nodes, and the third-level interface includes third-level nodes. The second-level nodes and the third-level nodes have different classification levels.
13. An electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as claimed in any one of claims 1 to 11.
14. A readable storage medium on which a program or instructions are stored, wherein the program or instructions, when executed by a processor, implement the steps of the method as claimed in any one of claims 1 to 11.
15. A computer program product stored in a storage medium, the program product being executed by at least one processor to implement the steps of the method as claimed in any one of claims 1 to 11.
16. A chip comprising a processor and a communication interface coupled to the processor, the processor being configured to run a program or instructions to implement the steps of the method as claimed in any one of claims 1 to 11.
17. An electronic device configured to perform the steps of the method as claimed in any one of claims 1 to 11.