Display control program, display control method, and information processing apparatus
The information processing apparatus uses a graph structure to represent articles with causal relationships, allowing for efficient navigation and deep understanding of related content, addressing the challenge of presenting complex article relationships.
Patent Information
- Application Number
- JP2021172472
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-10-21
- Publication Date
- 2025-06-09
- Estimated Expiration
- 2041-10-21
AI Technical Summary
Existing technologies face challenges in efficiently organizing and presenting the causal relationships between articles, such as myths, legends, and recipes, which often have complex chronological and logical sequences.
An information processing apparatus is developed that uses a graph structure defined by nodes and edges to represent articles, where nodes represent entities like people, events, or places, and edges represent causal relationships between them. The apparatus includes an output unit that displays node icons and connection icons, allowing users to navigate and view associated articles.
This solution enables clear and understandable presentation of relationships between articles, allowing users to deepen their understanding of topics by exploring related content efficiently.
Smart Images

Figure 0007689802000001 
Figure 0007689802000002 
Figure 0007689802000003
Abstract
Description
Technical Field
[0001] The present invention relates to a display control program, a display control method, and an information processing apparatus.
Background Art
[0002] For example, there are various formulated texts that describe causal relationships such as chronological and logical sequences. For example, there are various texts related to various myths, legends, tales, and traditions throughout the country. By reading such formulated texts, one can learn about the history and local conditions of each region and satisfy spiritual and intellectual curiosity. Another example of such formulated texts includes cooking recipes.
[0003] Also, technologies related to display control are known (for example, Patent Documents 1 to 4).
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Patent Document 2
Patent Document 3
Patent Document 4
Summary of the Invention
Problems to be Solved by the Invention
[0005] For example, although a written article can be enjoyed on its own, reading it together with another related article may deepen the enjoyment or make it more convenient to use. For example, when viewing a legend about a certain person, if another legend related to that person can be viewed, one can gain a deeper understanding of that person. Or, for example, when viewing a certain recipe, if another recipe using the same ingredients or having the same cooking steps can be viewed, it may be possible to efficiently cook multiple dishes. However, it may be difficult to organize and present the causal relationships such as the chronological and logical sequences described in such written articles.
[0006] In one aspect, the present invention aims to clearly present the relationships between articles describing causal relationships.
Means for Solving the Problem
[0007] An information processing apparatus according to one aspect of the present invention is a graph defined by nodes and edges for connecting the nodes to destination nodes, where the nodes include information indicating a person, thing / event, place, or time, and the nodes are associated with node information including information explaining the nodes, and the edges include a written article indicating a logical causal relationship or a temporal causal relationship between the nodes and the destination nodes, and an output unit that outputs display information for displaying a node icon associated with a node from among the graphs, and when the node icon is selected, the display information is changed so as to display the node information associated with the node, and when the node information has been viewed, the display information is changed so as to connect and display a connection icon associated with the edge connecting the node to the destination node to the node icon associated with the node, and when the connection icon is selected, the display information is changed so as to display the article included in the edge, and when the article associated with the connection icon has been viewed, the display information is changed so as to connect and display the node icon and the destination node icon associated with the destination node via the connection icon by an edge icon. The information processing apparatus includes a changing unit.
Advantages of the Invention
[0008] The relationship between sentences describing causal relationships can be presented clearly and understandably.
Brief Description of Drawings
[0009]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Embodiments for Carrying Out the Invention
[0010] Hereinafter, some embodiments of the present invention will be described in detail with reference to the drawings. Note that the same reference numerals are assigned to corresponding elements in multiple drawings.
[0011] As described above, there are various formulated sentences indicating causal relationships. For example, various episodes such as myths, legends, tales, and traditions are left as sentences throughout the country. Such sentences of myths, legends, tales, and traditions can be enjoyed even when read alone, but there may also be other related sentences.
[0012] FIG. 1 is a diagram illustrating two related passages according to an embodiment. In FIG. 1(a), a passage about the episode of "Yotsuya-hime and the Transformed Camellia" is shown, and in FIG. 1(b), a passage about the episode of "Yotsuya-hime's Rock" is shown. And, for example, when reading the passage about "Yotsuya-hime and the Transformed Camellia", if one can also read the passage about "Yotsuya-hime's Rock", which is another passage about the same Yotsuya-hime, one's understanding of Yotsuya-hime can be deepened.
[0013] Also, FIG. 2 is a diagram illustrating two other related passages according to an embodiment. In FIG. 2(a), the episode of "Yotsuya-hime and the Transformed Camellia" is shown, and in FIG. 2(b), the episode of the "Transformed Camellia" that appears in "Yotsuya-hime and the Transformed Camellia" is shown. In this way, when reading the episode about "Yotsuya-hime and the Transformed Camellia", if one can also read the episode about the "Transformed Camellia" that appears in "Yotsuya-hime and the Transformed Camellia", one's understanding of the episode of "Yotsuya-hime and the Transformed Camellia" can be deepened.
[0014] However, since the relationships between such passages including causal relationships have complex relationships among multiple passages, it may be difficult to efficiently organize or present the relationships between passages in an easy-to-understand manner.
[0015] In the embodiments described below, passages including causal relationships are treated as edges of a graph structure, and nodes connected by edges are extracted from the passages. Thereby, it becomes possible to present the relationships between passages in an easy-to-understand manner. Note that in the following embodiments, for example, texts indicating causal relationships are used for the passages. For example, passages without causal relationships such as simple greeting passages may be excluded from the generation target of the graph structure. Hereinafter, the embodiments will be described in more detail.
[0016] FIG. 3 is a diagram illustrating a functional block configuration of an information processing apparatus 300 according to an embodiment. The information processing apparatus 300 includes, for example, a control unit 301, a storage unit 302, and a communication unit 303. The control unit 301 includes, for example, an output unit 311 and a modification unit 312, and may also include other functional units. The storage unit 302 of the information processing apparatus 300 may store information such as graph information 600 and node detail information 800 described later. The communication unit 303 may communicate with other devices according to an instruction from the control unit 301, for example. Details of each of these units and details of the information stored in the storage unit 302 will be described later.
[0017] FIG. 4 is a diagram illustrating generation of a graph structure from a sentence according to an embodiment. As shown in FIG. 4, in the embodiment, a sentence is used as an edge in the graph structure, and a source node that is the starting point of the edge and a node connected to the edge are extracted from the sentence.
[0018] For example, a sentence including a causal relationship that describes a chronological or logical sequence is generally expressed using 5w1h. Among 5w1h, why and how tend to be easily made into set phrases (episodized). In the embodiment, sentences corresponding to why and how are extracted and used as edges during graph generation. Also, among the descriptions in the sentence, the remaining 4w, namely person (who), thing / event (what), time (when), and place (where), are used as nodes.
[0019] For example, in FIG. 4, using the text of "Yotsuya Kaidan" as an edge, three nodes, namely, "Yotsuya Kaidan", "the transformed camellia tree", and "Mangyoji Temple", are extracted from the text. For example, the control unit 301 may analyze the text of the episode and extract words corresponding to a person (who), a thing / event (what), a time (when), and a place (where) as nodes. Note that the extraction of nodes may be performed using, for example, techniques of natural language processing, or may be performed using a trained model generated by machine learning. In one example, the control unit 301 may perform the extraction of nodes from the text using a trained model that has been machine-learned to extract words corresponding to a person (who), a thing / event (what), a time (when), and a place (where) from the text. Furthermore, in another embodiment, for example, the extraction of nodes from the text may be performed using other algorithms, such as extracting words included in a pre-prepared word dictionary as nodes. In FIG. 4, three nodes, namely, "Yotsuya Kaidan", "the transformed camellia tree", and "Mangyoji Temple", are extracted as nodes from the text of "Yotsuya Kaidan".
[0020] Note that when the number of nodes extracted from the text is large, the graph structure becomes complex. Therefore, in one embodiment, the control unit 301 may perform a process of thinning out the nodes extracted from the text. For example, the control unit 301 may perform a node extraction process on each of a plurality of texts prepared for generating a graph, and among the plurality of extracted nodes, perform a process of thinning out nodes whose extraction count as a node satisfies a predetermined condition and is small (for example, equal to or less than a predetermined number).
[0021] In addition, the control unit 301 determines a source node that becomes the starting point of an edge from among the extracted nodes. The determination of the source node may also be performed using, for example, techniques of natural language processing, or may be performed using a trained model generated by machine learning. In one example, the control unit 301 may determine as the source node a node with a large number of appearances in the text or a large number of times used as a subject.
[0022] Further, among the extracted nodes, the control unit 301 may determine other nodes other than the node determined as the original node as connection destination nodes indicating the connection destinations of the edges. In the example of FIG. 4, among the three nodes of "Yotsuya-hime" (Eight Hundred Nuns), "Bake Tsubaki" (Demon Camellia), and "Mangonshi" (Ten Thousand Wish Temple) extracted from the sentence "Yotsuya-hime and Bake Tsubaki", "Yotsuya-hime" has been determined as the original node, and the remaining "Bake Tsubaki" and "Mangonshi" have been determined as connection destination nodes.
[0023] For example, as described above, by using the sentences as edges and extracting a plurality of nodes from the sentences and determining them as the original nodes and the connection destination nodes, a graph structure can be generated from the sentences as shown in FIG. 5.
[0024] FIG. 5 is a diagram illustrating a graph according to an embodiment. As shown in FIG. 5, node 1 is connected from node 2 to node 4 using sentence 1 as an edge. Also, node 1 is connected to node 5 using sentence 2 as an edge. In this way, by extracting nodes from sentences, a graph structure can be generated using the sentences as edges.
[0025] FIG. 6 is a diagram illustrating graph information 600 according to an embodiment. In the graph information 600, for example, information on the nodes and edges of the graph structure is registered in association. In the nodes of the graph information 600, for example, identification information for identifying the original nodes that are the starting points of the edges corresponding to the sentences is registered. Also, the edges of the graph information 600 may include, for example, the information of the sentences and the analysis results of the sentences. As the analysis results of the sentences, for example, the connection destination nodes extracted from the sentences may be classified and registered as people, places, things, events, and times.
[0026] For example, in FIG. 6, in the graph information 600, the sentences "Yotsuya-hime and Bake Tsubaki" and "The Rock of Yotsuya-hime" are registered as edges. Also, for each edge between the sentences "Yotsuya-hime and Bake Tsubaki" and "The Rock of Yotsuya-hime" in the graph information 600, the connection destination nodes are registered.
[0027] FIG. 7 illustrates a graph structure generated for the sentences of "Yotsuya-hime and the Transformed Camellia" and the sentence of "The Rock of Yotsuya-hime" in the graph information 600 of FIG. 6. As shown in FIG. 7, the node icon 701 of "Yotsuya-hime" is connected by an edge icon 703 to a destination node icon 701 via a connection icon 702 that indicates a sentence based on the information in the graph information 600. In this way, a graph can be generated based on the information in the graph information 600.
[0028] Also, depending on the embodiment, for example, node detail information 800 for further explaining the nodes in the graph information 600 may be stored in the storage unit 302.
[0029] FIG. 8 is a diagram illustrating the node detail information 800 according to the embodiment. In the node detail information 800, for example, records associating nodes with node information are registered. In the nodes of the node detail information 800, for example, identification information for identifying the nodes corresponding to the records may be registered. In the node information of the node detail information 800, detailed information regarding the nodes corresponding to the records may be registered. The node information may include, for example, information for explaining the nodes. In the example of FIG. 8, since the node identified by "Yotsuya-hime" is a node indicating a person, detailed information about items such as the birth, genealogy, and main characteristics of that person is registered in the main text in the node information. Note that the node information may be collected, for example, from the sentences from which the nodes are extracted, or may be collected from other sentences. Also, in the node detail information 800, similarly, detailed information about each of the plurality of nodes may be registered.
[0030] Next, the graph display process according to the embodiment will be described. For example, as described above, when generating a graph structure based on sentences, the number of sentences can become extremely large, so the graph can also become complex. Therefore, the embodiment provides a technique for presenting the relationship between sentences describing the causal relationship included in the graph in an easy-to-understand manner. Hereinafter, the graph display process according to the embodiment will be illustrated.
[0031] FIG. 9 is a diagram illustrating the display of a graph according to an embodiment. In the display screen of FIG. 9(a), several nodes and corresponding node icons 701 are shown. Note that, for example, the node icons 701 initially displayed on a display screen such as an initial screen may be carefully selected from predetermined nodes. The predetermined nodes may, in one example, be nodes that satisfy predetermined conditions. For example, when generating a graph structure by collecting a plurality of sentences in a certain area and displaying the graph, the predetermined conditions may be a predetermined number of nodes that are popular from viewpoints such as tourism among the original nodes collected from the sentences. Also, as shown in FIG. 9(a), connection icons 702 indicating the formulated sentences from which the nodes are extracted as original nodes are connected to the node icons 701.
[0032] For example, the control unit 301 generates display information for connecting and displaying the node icons 701 of predetermined nodes from among the graphs generated based on the graph information 600 with the connection icons 702 indicating the formulated sentences corresponding to the respective nodes of the predetermined nodes. Then, for example, when generating the display information, the control unit 301 may output the display information to the display device. When receiving the display information, the display device may display the predetermined node icons 701 connected to the connection icons 702 on the display screen as shown in FIG. 9(a).
[0033] Then, for example, assume that the user inputs an operation such as a pinch-out in order to view in detail the area of a certain node icon 701. In this case, as shown in FIG. 9(b), the control unit 301 may change the display information so that a certain node icon 701 is zoomed in on the display screen and the node icon 701 is enlarged and displayed.
[0034] Next, for example, assume that the user selects the enlarged node icon 701 by tapping it. In this case, as shown in FIG. 10, the control unit 301 may change the display information so that the node information 1002 about the selected node icon 701 is displayed on the display screen of the display device. Then, for example, when changing the display information, the control unit 301 may output the changed display information to the display device. In the example of FIG. 10, the node information 1002 about the selected node icon 701 is read from the node detailed information 800 and displayed on the display screen. Thereby, the user can obtain knowledge about the node.
[0035] Also, when the browsing of the node information of the selected node icon 701 is completed, the control unit 301 further changes the display information so as to indicate that the display format of the node icon 701 has been browsed. For example, as shown in FIG. 10, the control unit 301 may change the display information to change the color of the display format of the node icon 701. Thereby, the user can know whether the node icon 701 has already been browsed by looking at the color. Note that the control unit 301 may determine that the browsing of the node information 1002 is completed, for example, when the node information 1002 is displayed, when the node information 1002 is displayed for a predetermined time or longer, or when the user inputs the completion of the browsing of the node information 1002.
[0036] Also, when the browsing of the node information corresponding to the node icon 701 is completed, the user may input an operation to delete the node information 1002 corresponding to the node icon 701 to the information processing device 300. When an operation to delete the node information 1002 is input, the control unit 301 may change the display information to delete the node information 1002 from the display screen.
[0037] Next, for example, assume that the user selects by tapping the connection icon 702 connected to the node icon 701. In this case, as shown in FIG. 11, the control unit 301 may change the display information so that the text corresponding to the selected connection icon 702 is displayed on the display screen. In the example of FIG. 11, the text 1102 corresponding to the selected connection icon 702 is read from the graph information 600 and displayed on the display screen of the display device. Thereby, the user can read the text 1102 related to the node of the node icon 701 and deepen the knowledge about the node of the node icon 701.
[0038] Further, when the browsing of the text corresponding to the selected connection icon 702 is completed, the control unit 301 further changes the display information so that the display format of the connection icon 702 indicates that it has been browsed. For example, as shown in FIG. 11, the control unit 301 may change the display information so as to change the color of the display format of the connection icon 702. Thereby, the user can know whether the connection icon 702 for which the text has already been browsed by looking at the color. Note that the control unit 301 may determine that the browsing of the text 1102 is completed, for example, when the text 1102 is displayed, when the text 1102 is displayed for a predetermined time or longer, or when the user inputs the completion of the browsing of the text 1102.
[0039] Also, after browsing the text corresponding to the connection icon 702, the user may input an operation to the information processing apparatus 300 to delete the text 1102 corresponding to the connection icon 702. When an operation to delete the text 1102 corresponding to the connection icon 702 is input, the control unit 301 may change the display information so as to delete the text 1102 from the display screen.
[0040] Next, assume that an operation to reduce the display is input to the information processing apparatus 300, such as by pinching in the node icon 701 that was enlarged and displayed on the display screen of the display device. In this case, for example, as shown in FIG. 12, the control unit 301 may change the display information by reducing the node icon 701 to expand the display range so that more node icons 701 of nodes are displayed. In FIG. 12, due to the pinch-in operation, the area is reduced on the display screen and a plurality of node icons 701 are displayed.
[0041] Further, for example, the control unit 301 may change the display information so that the node icon 701 is connected and displayed to the node icon 701 of the destination node via the connection icon 702 by the edge icon 703. For example, in FIG. 12, the node icon 701 of the destination node of the connection icon 702 indicating the text selected and viewed by the user is displayed, and the connection icon 702 indicating the text is connected to the node icon 701 of the destination node by the edge icon 703. Note that the node icon 701 of the destination node may be a node displayed on the display screen or may be displayed when viewing of the text corresponding to the connection icon 702 is completed.
[0042] Similarly, for example, when the user selects another connection icon 702 indicating a text and viewing of the connection icon 702 indicating the text is completed, the control unit 301 may change the display information so that the connection icon 702 indicating the text is connected to the node icon 701 of the destination node by the edge icon 703. For example, in FIG. 13, a connection icon 702 indicating the text of "The Rock of Otohime" is further selected and the display format is changed, and the connection icon 702 indicating the text of "The Rock of Otohime" is connected to the node icon 701 of the destination node by the edge icon 703. In the example of FIG. 13, only the node icon 701 of the destination node of "The Stone-Lifting Festival" is displayed within the display range, but the connection icon 702 of "The Rock of Otohime" may also be connected to the node icons 701 of the destination nodes of other "Omiya Bisha Shrine", "The Rock of Otohime", and "Owari Fuji" by the edge icon 703.
[0043] As described above, according to the display process according to the embodiment, for example, when the connection icon 702 indicating the text is selected and the viewing of its content is completed, the node icon 701 related to the text of the connection icon 702 can be presented to the user. Therefore, the user can efficiently collect knowledge related to the text corresponding to the connection icon 702 according to their own interests.
[0044] Also, according to the embodiment, since the connection icon 702 indicating the text related to the node icon 701 is connected to the node icon 701, the user can deepen their knowledge about the node of the node icon 701 by viewing the text corresponding to the connection icon 702 connected to the node icon 701.
[0045] Also, in the embodiment, the graph structure is generated using the text information as edges. Therefore, it becomes possible to clearly represent and present the relationship between texts describing causal relationships using the graph structure.
[0046] Subsequently, the operation flow of the display process according to the embodiment will be exemplified.
[0047] FIG. 14 is a diagram illustrating the operation flow of the display process according to the embodiment. For example, when the display instruction of the graph structure generated from the connection icon 702 indicating the text is input to the control unit 301 of the information processing apparatus 300, the operation flow of FIG. 14 may be started.
[0048] In S1401, the control unit 301 outputs display information for displaying the node icon 701 on, for example, a display device connected to the information processing apparatus 300. The display device displays the node icon 701 on the display screen according to the received display information. For example, the control unit 301 may output display information for displaying a plurality of node icons 701 as shown in FIG. 9(a) based on the graph information 600. Note that, for example, the node icon 701 initially displayed on a display screen such as an initial screen may be carefully selected from predetermined nodes.
[0049] In S1402, the control unit 301 determines whether an operation for changing the display area has been input. For example, as illustrated in FIG. 9, when a pinch-out operation is input to expand and display a part of the display area, or as illustrated in FIG. 12, when a pinch-in operation is input to reduce the display and widen the display range, the control unit 301 may determine YES in S1402. When an operation for changing the display area has been input in S1402 (S1402 is YES), the flow proceeds to S1403.
[0050] In S1403, the control unit 301 changes the display information so that the display on the display screen changes according to the input change operation, for example, and the flow proceeds to S1410.
[0051] In S1410, the control unit 301 outputs the display information, and the flow returns to S1402. Note that the display device may update the display on the display screen according to the received display information.
[0052] When an operation for changing the display area has not been input in S1402 (S1402 is NO), the flow proceeds to S1404.
[0053] In S1404, the control unit 301 determines whether a selection operation of the node icon 701 has been input. For example, as illustrated in FIG. 10, when a selection operation of the node icon 701 is input, such as by the user tapping, the control unit 301 may determine YES in S1404. If a selection operation of the node icon 701 is input in S1404 (S1404 is YES), the flow proceeds to S1405.
[0054] In S1405, the control unit 301 sets the state of the selected node icon 701 as viewed, and changes the display information so as to display the information of the node icon 701 on the display screen, and the flow proceeds to S1410. For example, as shown in FIG. 10, the control unit 301 may change the display format of the selected node, and change the display information so as to display the node information 1002 about the selected node icon 701. Here, when the control unit 301 displays the node information 1002 corresponding to the node icon 701, it executes a process of changing the display format of the node icon 701 as if the node information 1002 has been viewed. However, in another embodiment, the user may be prompted to input whether the viewing of the displayed node information 1002 is completed.
[0055] If a selection operation of the node icon 701 is not input in S1404 (S1404 is NO), the flow proceeds to S1406.
[0056] In S1406, the control unit 301 determines whether a selection operation of the connection icon 702 indicating a sentence has been input. For example, as illustrated in FIG. 10, when a selection operation of the connection icon 702 indicating a sentence is input, such as by the user tapping, the control unit 301 may determine YES in S1406. If a selection operation of the connection icon 702 indicating a sentence is input in S1406 (S1406 is YES), the flow proceeds to S1407.
[0057] In S1407, the control unit 301 changes the state of the selected connection icon 702 to viewed, connects the connection icon 702 to the destination node using the edge icon 703, changes the display information so as to display the text corresponding to the connection icon 702, and the flow proceeds to S1410. For example, as shown in FIG. 11, the control unit 301 may change the display format of the selected connection icon 702, connect the connection icon 702 to the destination node using the edge icon 703, and change the display information so as to display the text 1102 corresponding to the selected connection icon 702. Here, when the control unit 301 displays the information of the text corresponding to the connection icon 702, it executes the process of connecting the connection icon 702 to the destination node as if the text has been viewed. However, in another embodiment, the user may be asked whether the viewing of the displayed text is completed.
[0058] If the selection operation of the connection icon 702 indicating the text is not input in S1406 (S1406 is NO), the flow proceeds to S1408.
[0059] In S1408, the control unit 301 determines whether an operation to clear the display has been input. For example, assume that the user inputs an operation to clear the display for the node information 1002 about the node icon 701 in FIG. 10 and the text 1102 corresponding to the connection icon 702 in FIG. 11. In this case, the control unit 301 may determine YES in S1408, and the flow proceeds to S1409.
[0060] In S1409, the control unit 301 changes the display information to clear the display of the object for which the operation to clear the display has been input, and the flow proceeds to S1410. For example, the control unit 301 may change the display information to remove from the display screen the objects such as the node information 1002 about the node icon 701 in FIG. 10 and the text 1102 corresponding to the connection icon 702 in FIG. 12, which are the objects to be cleared. Also, if the operation to clear the display is not input in S1408 (S1408 is NO), the flow proceeds to S1410, and the display information may be output with the current settings.
[0061] As described above, according to the embodiment, for example, when the connection icon 702 is selected and the viewing of the text corresponding to the connection icon 702 is completed, the display information is changed so that the connection icon 702 is connected and displayed to the connection destination node related to the text of the connection icon 702 using the edge icon 703. Therefore, it is possible to present the user with the information of the node icon 701 corresponding to the text of the connection icon 702. Thereby, the user can efficiently collect knowledge related to the text corresponding to the connection icon 702 according to his or her own interests.
[0062] Also, according to the embodiment, a connection icon 702 indicating a text related to the node of the node icon 701 is connected to the node icon 701. Therefore, the user can deepen the knowledge about the node of the node icon 701 by viewing the text corresponding to the connection icon 702 connected to the node icon 701.
[0063] Also, in the embodiment, the graph structure is generated using the text information as edges. Therefore, it becomes possible to clearly represent and present the relationship between texts describing causal relationships using the graph structure.
[0064] In the above, embodiments have been illustrated, but the embodiments are not limited thereto. For example, the above-described operation flow is an illustration, and the embodiments are not limited thereto. If possible, the operation flow may be executed by changing the order of processing, may include additional processing, or some processing may be omitted.
[0065] In addition, in the above-described embodiment, examples are shown in which the text is various texts related to myths, legends, folklore, and traditions. However, the embodiment is not limited to this. For example, the embodiment may be applied to other documented documents such as cooking recipes, musical pamphlets, and game texts. Thereby, for example, in the case of a cooking recipe, when viewing a certain recipe, it becomes possible to view another recipe using the same ingredients or having the same cooking steps.
[0066] In addition, in the above-described embodiment, an example is described in which the information processing apparatus 300 outputs display information to the connected display device for display, but the embodiment is not limited to this. In another embodiment, the information processing apparatus 300 may operate as a server and receive requests from other client terminals. In this case, the control unit 301 of the information processing apparatus 300 may generate display information according to, for example, a request from the terminal and output the display information addressed to the terminal. The terminal can present information using the graph according to the received display information.
[0067] In addition, in the above-described embodiment, text data is exemplified as the text, but the embodiment is not limited to this. For example, in another embodiment, the text may include other data such as image data.
[0068] In addition, in the above-described embodiment, it is also conceivable to connect edge to edge. For example, assume that there are a plurality of edges that connect a predetermined node and a predetermined destination node according to graph theory. Among these plurality of edges, if the text associated with an edge is a text based on the perspective of the node side, then that edge is an edge associated with the node. Also, among the plurality of edges, if the text associated with an edge is a text based on the perspective of the destination node side, then that edge is a destination edge associated with the destination node. And, for example, when the degree of coincidence between the text associated with an edge and the text associated with the destination edge is equal to or greater than a predetermined degree of coincidence, the control unit 301 estimates that the text associated with the edge and the text associated with the destination edge are relevant, and outputs display information in which the connection icon associated with the edge and the destination connection icon associated with the destination edge are connected. Thereby, it is possible to organize and output relevant texts among the texts associated with a plurality of edges according to graph theory.
[0069] FIG. 15 is a diagram illustrating the connection of edges according to the embodiment. For example, assume that there is a text corresponding to the connection icon 1511 of an edge that connects a certain node icon 1501 to a destination node icon 1502. For example, the text corresponding to the connection icon 1511 of this edge may be written from the perspective of a certain node icon 1501 side. For example, assume that a certain node is Matthew extracted from a text written from the perspective of Matthew about the miracles of Jesus Christ.
[0070] Also, assume that there is a text corresponding to the connection icon 1512 of an edge that connects this destination node icon 1502 to a certain node icon 1501. For example, the text corresponding to the connection icon 1512 of this edge may be written from the perspective of the destination node icon 1502 side. For example, assume that the destination node is Luke extracted from a text written from the perspective of Luke about the miracles of Jesus Christ.
[0071] Although these two texts have different descriptions due to different perspectives, on the other hand, since they are texts written about the same miracle, they may contain similar content. And, for example, when the control unit 301 evaluates the similarity of the texts, the similarity may be highly evaluated as being equal to or higher than a predetermined threshold. In this case, the control unit 301 may output display information for connecting two connection icons 702 corresponding to two texts whose similarity is equal to or higher than the predetermined threshold with one edge icon 1503. FIG. 15(b) illustrates two connection icons 702 connected by one edge icon 1503 in this case.
[0072] Note that, for example, assume that the connection icon 1512 corresponding to the connection destination edge that connects the connection destination node to the node, and the text of the connection icon 1512 connected to the connection destination node has been viewed. In this case, the control unit 301 may, for example, change the display information so as to bidirectionally connect the node and the connection destination node with one edge icon 1503 via the connection icon 1511 of the node and the connection icon 1512 of the connection destination node. Note that, in one example, the edge icon 1503 for bidirectional connection may be a bidirectional edge.
[0073] By combining the edges in this way, the connections of the edges can be integrated and simplified, and the visibility of the display on the display screen can be improved. Also, among the texts associated with a plurality of edges according to graph theory, texts having relevance can be sorted and output. Furthermore, since texts written from different perspectives about one matter are related, it becomes possible to know more deeply about that matter.
[0074] Note that the bidirectional connection by the edge icons 703 between such connection icons 702 may be executed, for example, when both connection icons 702 have been viewed. For example, the control unit 301 may execute a bidirectional connection by one edge icon 703 when one connection icon 702 has already been viewed and the other connection icon 702 has also been viewed. Further, in another embodiment, for example, when one connection icon 702 has been viewed, a connection icon 702 may also be displayed on the other node icon 701 side, and the two connection icons 702 may be connected by one edge icon 703.
[0075] As described above, for example, in the case of a second connection icon corresponding to a second edge that connects from a connection destination node to a node, and the second connection icon connected to the connection destination node has been viewed, it is assumed that the text associated with the connection icon of the node has been viewed. In this case, in the embodiment, the control unit 301 may change the display information so as to connect the node and the connection destination node by one edge icon via the connection icon of the node and the second connection icon of the connection destination node.
[0076] Incidentally, in the example of FIG. 15, the node icon 1501 and the connection icon 1511 are directly coupled, and the connecting line is omitted. Thus, the connection between the node icon 1501 and the connection icon 1511 may be explicitly shown in any expression.
[0077] Also, the above-described transition of the display screen is an example, and the embodiment is not limited to the above-described transition of the display screen. For example, in another embodiment, the transition of the display screen shown in FIGS. 16 to 19 below may be used.
[0078] FIG. 16 is a diagram illustrating a display screen displayed when a user selects a node. For example, the control unit 301 may output display information for displaying the display screen of FIG. 16 when the user taps the node icon 701 of the node of "Yotsuya-hime".
[0079] FIG. 16 shows a node icon 701 of the "Eight Hundred Buddhist Nuns" node and a connection icon 702 linked to that node. Also, in FIG. 16, node information 1002 of the node icon 701 of the "Eight Hundred Buddhist Nuns" node is displayed. In the example of FIG. 16, since the node information 1002 has not yet been viewed, the connection icon 702 connected to the node icon 701 has no title displayed and is displayed as "?", and may be in a state where it cannot be selected (for example, an inactive state). And, for example, when the viewing of the node information 1002 is completed by receiving an input of an operation indicating viewed from the user, the control unit 301 may output display information in which the color of the display format of the node icon 701 is changed to indicate that it has been viewed.
[0080] FIG. 17 shows a display screen in which the connection icon 702 is changed to be selectable. For example, in FIG. 17, the node icon 701 is displayed with its color inverted, indicating that it has been viewed. Also, the control unit 301 may change and output the display information so that the connection icon 702 can be selected (active state). In the example of FIG. 17, a title is displayed on the connection icon 702, and the connection icon 702 may be displayed in a state where it can be selected (active state). Also, for example, when the viewing of the node information 1002 is completed, the control unit 301 may output display information in which each connection icon 702 can be individually selected. And when the connection icon 702 is selected, the control unit 301 may change the display information so as to display the text related to the connection icon 702.
[0081] FIG. 18 is a diagram illustrating a display screen when the connection icon 702 of "Yakushi Nyorai and the Transformed Camellia" is selected. For example, the control unit 301 may change the display information so as to display the text 1102 related to the connection icon 702 selected by the user. Then, for example, when the input of an operation indicating that the user has viewed the text 1102 is received from the user and the viewing of the text 1102 is completed, the control unit 301 may output the display information in which the display format of the connection icon 702 is changed to indicate that it has been viewed. For example, in FIG. 19, the connection icon 702 of "Yakushi Nyorai and the Transformed Camellia" is displayed with its color inverted, indicating that it has been viewed. Further, when the connection icon 702 has been viewed, the control unit 301 may change the display information so as to display a link 1801 (for example, a character string indicating the name of the destination node) of a character string indicating the destination node connected by the connection icon 702 together with an edge icon 1802 indicating the destination, and output the changed display information. Thereby, the user can easily access the information of the destination node.
[0082] As shown in the transition of the display screens shown in FIGS. 16 to 19, the graph according to the embodiment can be displayed in various display formats.
[0083] Further, the embodiment may perform further display control. FIG. 20 is a diagram illustrating further display control according to the embodiment. For example, the connection icon 702 may be masked until a predetermined edge icon 703 is connected to the node icon 701. For example, in FIG. 20(a), it is assumed that the connection icon 702 of "C" connected to the node icon 701 of node Y is masked and not displayed.
[0084] For example, in this case, it is assumed that the connection icon 702 of "A" connected to the node icon 701 of node X has been viewed. Then, as shown in FIG. 20(b), the control unit 301 changes the display format of the connection icon 702 of "A" to indicate that it has been viewed, and also displays the edge icon 703 corresponding to the connection icon 702 of "A", and changes the display information so that the connection icon 702 of "A" is connected to the destination node Y.
[0085] Further, when the connection destination node Y is connected to the connection icon 702 of "A" by the edge icon 703, the control unit 301 displays the connection icon 702 of "C" of the connection destination node Y. Thus, in the embodiment, when a certain edge is connected to a connection destination node, the control unit 301 may display the edge (for example, the connection icon 702 or the edge icon 703) of the connection destination node associated with that edge. For example, when the predetermined edge icon 703 is connected to the node icon 701, the control unit 301 may change the display information so as to dynamically display the predetermined connection icon 702 masked by the node icon 701. Note that the connection icon 702 of "C" of the node Y may be referred to as a third connection icon in one example, and the edge corresponding to the connection icon 702 of "C" of the node Y may be referred to as a third edge.
[0086] Note that the display of the masked connection icon 702 may be controlled, for example, in a one-to-many and many-to-many relationship. For example, when the predetermined edge icon 703 is connected to the node icon 701, the control unit 301 may display a plurality of masked connection icons 702 corresponding to the predetermined edge icon 703 at the node icon 701. Alternatively, for example, the control unit 301 may display the masked connection icon 702 of a certain node icon 701 when a plurality of predetermined edge icons 703 are connected. Further, when a plurality of predetermined edge icons 703 are connected to a certain node icon 701, the control unit 301 may display a plurality of masked connection icons 702 corresponding to the plurality of predetermined edge icons 703 at the node icon 701.
[0087] In addition, in the embodiment, for example, the connection icon 702 does not necessarily have to be connected to another connection destination node icon 1502 when the corresponding text has been viewed. For example, as described above, when a plurality of texts are analyzed and nodes are extracted, the connection destination node may be thinned out from the nodes because the number of times of extraction does not satisfy a predetermined condition and is small. For example, in such a case, the connection icon 702 may not be connected to the connection destination node. FIG. 20(c) illustrates a case where the connection icon 702 is not connected to the connection destination node icon 1502 when the text corresponding to the connection icon 702 has been viewed. In FIG. 20(c), even if the connection icon 702 of "D" has been viewed, the edge icon 703 to the connection destination node is not displayed and is not connected to the connection destination node.
[0088] Even when the connection icon 702 is not connected to the destination node icon 1502, the connection icon 702 is associated with its own node. Therefore, when the text corresponding to the connection icon 702 has been viewed, the connection icon 702 may be connected to the node icon 701 of its own node by the edge icon 703. FIG. 20(d) illustrates the connection of the connection icon 702 to the node icon 701 of its own node by the edge icon 703 in this case. Then, the connection of the edge icon 703 to its own node can also be used for the display of another connection icon 702. For example, in FIG. 20(d), when the text of the connection icon 702 has been viewed and the edge icon 703 (which may be omitted) from the connection icon 702 of "D" is connected to node Z, the control unit 301 may display the connection icon 702 of "E" associated with the connection icon 702 of "D". Also, the edge icon 703 to its own node may be omitted. Thereby, it is possible to suppress the complication of the graph display. Note that node Z may be called the second node in one example. Also, the connection icon 702 of "D" and the edge icon 703 of node Z may be called the second connection icon and the second edge icon in one example. The edge corresponding to the connection icon 702 of "D" and the edge icon 703 of node Z and the text of that edge may be called the second edge and the second text in one example.
[0089] Also, the embodiment is applicable to, for example, a game. FIG. 21 is a diagram illustrating a case where the graph display control according to the embodiment is applied to a game. Also, FIGS. 22 to 25 are diagrams illustrating the control of the graph display in the game according to the embodiment.
[0090] In the graph of FIG. 21, the control unit 301 may display the node icon 701 of "Event: Incident" at the beginning of the game. Then, as shown in FIG. 22, when the node icon 701 of "Event: Incident" is selected, the control unit 301 may display the connection icon 702 of "A".
[0091] Subsequently, when the connection icon 702 of "A" is read, the control unit 301 connects the edge icon 703 to the node icon 701 of "matter: event" and displays the connection icon 702 of "B" based on the connection. In this way, by displaying the masked connection icon 702 of "B" through the connection of the edge icon 703 from the connection icon 702 of "A" associated with the connection icon 702 of "B", the browsing flow of the user can be controlled. Thereby, for example, it becomes possible to provide information in various variations in a form that is easier for the user to understand.
[0092] Also, here, the connection icon 702 of "B" is displayed by connecting the edge icon 703 to the self-node of the connection icon 702 of "A". In this way, when the text of the connection icon 702 of "A" has been browsed, by connecting the edge icon 703 to the self-node, more diverse information provision control becomes possible. Note that the display of the edge icon 703 connected to the self-node may be omitted. Thereby, it is possible to suppress the complication of the graph display.
[0093] The subsequent display flow of the graph is illustrated in FIGS. 22 to 25. The control unit 301 may control the display of the graph in FIG. 21, for example, by performing the control shown in FIGS. 22 to 25. Thereby, it becomes possible to efficiently provide information according to the user's interest. Note that in FIGS. 21 to 25, the masked connection icon 702 is shown shaded.
[0094] As described above, for example, when the display information is changed so that the node icon 701 and the destination node icon 701 are connected by an edge icon 703 indicating an edge via a connection icon 702. In this case, further, the control unit 301 may change the display information so that another connection icon 702 corresponding to another edge of the destination node icon 701 associated with the edge is also displayed. Note that, in one example, this connection icon 702 and another connection icon 702 may be associated with each other in advance in the storage unit 302, and when an edge icon 703 corresponding to an edge is connected from the connection icon 702 associated with another connection icon 702, the control unit 301 may change the display information so that another connection icon 702 is displayed.
[0095] Also, in the embodiment, the graph may include an edge that does not connect a node to another node. In this case, when the text corresponding to the edge that does not connect a node to another node has been viewed, the control unit 301 may change the display information so that the display format of the connection icon corresponding to the edge indicates that it has been viewed, without changing the display information to display the edge icon corresponding to the edge. Further, in another embodiment, when the text corresponding to the edge that does not connect a node to another node has been viewed, the control unit 301 may change the display information to display an edge icon 703 that connects the connection icon 702 of the edge to the own node.
[0096] Note that, in the above-described embodiment, the graph may be defined by, for example, a node and an edge for connecting the node to a destination node. Also, the node may include information indicating, for example, a person (who), a thing / event (what), a place (where), or a time (when), and the node may be associated with node information including information explaining the node. Further, the edge may include a formulated text indicating a logical causal relationship or a temporal causal relationship between the node and the destination node.
[0097] Then, for example, the control unit 301 may output display information for displaying the node icon 701 associated with the node from among the graphs. Further, when the node icon 701 is selected, the control unit 301 may change the display information so as to display the node information associated with the node. When the node information has been viewed, the control unit 301 may change the display information so as to connect and display the connection icon 702 associated with the edge connecting the node to the destination node to the node icon 701 associated with the node. When the connection icon 702 is selected, the control unit 301 may change the display information so that the text included in the edge is displayed. When the text associated with the connection icon 702 has been viewed, the control unit 301 may change the display information so as to connect and display the node icon 701 and the destination node icon 701 associated with the destination node via the connection icon 702 by the edge icon 703.
[0098] In the above-described embodiment, for example, in the processes of S1401 and S1410, the control unit 301 operates as the output unit 311. Further, for example, in the processes from S1402 to S1409, the control unit 301 operates as the change unit 312.
[0099] FIG. 26 is a diagram illustrating a hardware configuration of a computer 2600 for realizing the information processing apparatus 300 according to the embodiment. The hardware configuration for realizing the information processing apparatus 300 in FIG. 26 includes, for example, a processor 2601, a memory 2602, a storage device 2603, a reading device 2604, a communication interface 2606, an input / output interface 2607, and a display device 2611. Note that the processor 2601, the memory 2602, the storage device 2603, the reading device 2604, the communication interface 2606, and the input / output interface 2607 are connected to each other via, for example, a bus 2608.
[0100] Processor 2601 may be, for example, a single processor, a multi-processor, or a multi-core processor. By using memory 2602 to execute a program that describes the procedures of the above-described operation flow, for example, processor 2601 provides some or all of the functions of control unit 301 described above. For example, by reading and executing the program stored in storage device 2603, processor 2601 operates as output unit 311 and change unit 312.
[0101] Memory 2602 is, for example, a semiconductor memory and may include a RAM area and a ROM area. Storage device 2603 is, for example, a hard disk, a semiconductor memory such as a flash memory, or an external storage device. Note that RAM is an abbreviation for Random Access Memory. Also, ROM is an abbreviation for Read Only Memory.
[0102] Reading device 2604 accesses removable storage medium 2605 according to an instruction from processor 2601. Removable storage medium 2605 is realized by, for example, a semiconductor device, a medium in which information is input and output by a magnetic action, a medium in which information is input and output by an optical action, and the like. Note that the semiconductor device is, for example, a USB (Universal Serial Bus) memory. Also, the medium in which information is input and output by a magnetic action is, for example, a magnetic disk. The medium in which information is input and output by an optical action is, for example, a CD-ROM, a DVD, a Blu-ray Disc, etc. (Blu-ray is a registered trademark). CD is an abbreviation for Compact Disc. DVD is an abbreviation for Digital Versatile Disk.
[0103] Storage unit 302 includes, for example, memory 2602, storage device 2603, and removable storage medium 2605. For example, graph information 600 and node detail information 800 are stored in storage device 2603.
[0104] The communication interface 2606 communicates with other devices according to the instructions of the processor 2601. The communication interface 2606 is, for example, an example of the communication unit 303.
[0105] The input / output interface 2607 may be, for example, an interface between an input device and an output device. The input / output interface 2607 is connected to, for example, the display device 2611. The display device 2611 may display, for example, the display screen according to the instructions of the processor 2601 in the above-described embodiment. Further, the input / output interface 2607 may be connected to an input device such as a keyboard, a mouse, a touch panel, etc. that receives instructions from a user. The output device is, for example, an audio device such as a speaker, a printing device, etc.
[0106] Each program according to the embodiment is provided to the information processing apparatus 300 in the following forms, for example. (1) It is pre-installed in the storage device 2603. (2) It is provided by the removable storage medium 2605. (3) It is provided from a server such as a program server.
[0107] Note that the hardware configuration of the computer 2600 for realizing the information processing apparatus 300 described with reference to FIG. 26 is an example, and the embodiment is not limited thereto. For example, a part of the above-described configuration may be deleted, or a new configuration may be added. Further, in another embodiment, for example, some or all of the functions of the above-described control unit 301 may be implemented as hardware by an FPGA, an SoC, an ASIC, a PLD, etc. Note that FPGA is an abbreviation for Field Programmable Gate Array. SoC is an abbreviation for System-on-a-chip. ASIC is an abbreviation for Application Specific Integrated Circuit. PLD is an abbreviation for Programmable Logic Device.
[0108] In the above, several embodiments have been described. However, the embodiments are not limited to the above-described embodiments, and should be understood to include various modifications and alternative forms of the above-described embodiments. For example, it will be understood that the various embodiments can be embodied by modifying the components without departing from the spirit and scope thereof. Also, it will be understood that various embodiments can be implemented by appropriately combining a plurality of components disclosed in the above-described embodiments. Furthermore, those skilled in the art will understand that various embodiments can be implemented by deleting some components from all the components shown in the embodiments or adding some components to the components shown in the embodiments.
Explanation of Signs
[0109] 300: Information processing apparatus 301: Control unit 302: Storage unit 303: Communication unit 311: Output unit 312: Modifying unit 701: Node icon 702: Connection icon 703: Edge icon 1501: Node icon 1502: Destination node icon 1503: Edge icon 1511: Connection icon 1512: Connection icon 1801: Link 1802: Edge icon 2600: Computer 2601: Processor 2602: Memory 2603: Storage device 2604: Reading device 2605: Removable storage medium 2606: Communication interface 2607: Input / output interface 2608: Bus 2611: Display device
Claims
1. A graph defined by nodes and edges for connecting the nodes to destination nodes, wherein the nodes include information indicating a person, thing / event, place, or time, and the nodes are associated with node information including information explaining the nodes, wherein the edges include formulated sentences indicating a logical or temporal causal relationship between the nodes and the destination nodes, outputting display information for displaying node icons associated with the nodes from among the graphs, changing the display information to display the node information associated with the nodes when the node icons are selected, changing the display information to connect and display a connection icon associated with an edge connecting the node to the destination node to the node icon associated with the node when the node information has been viewed, changing the display information to display the sentence included in the edge when the connection icon is selected, changing the display information to connect and display the node icon and a destination node icon associated with the destination node via the connection icon by an edge icon when the sentence associated with the connection icon has been viewed, A display control program for causing an information processing apparatus to execute the processing.
2. further causing the information processing apparatus to execute processing of changing the display information so that a display format of the connection icon associated with the sentence indicates that it has been viewed when the sentence has been viewed, The display control program according to claim 1.
3. further causing the information processing apparatus to execute processing of changing the display information so that a display format of the node icon indicates that it has been viewed when viewing of the node information is completed, The display control program according to claim 1 or 2.
4. A second connection icon corresponding to a second edge connecting the destination node to the node, wherein when the second connection icon connected to the destination node has been viewed and the sentence associated with the connection icon has been viewed, changing the display information to connect the node and the destination node via the connection icon of the node and the second connection icon of the destination node by one edge icon. The display control program according to any one of claims 1 to 3, further causing the information processing apparatus to execute the process.
5. The graph includes a second node and a second edge that does not connect the second node to other nodes. Furthermore, when the second sentence corresponding to the second edge has been viewed, without changing the display information to display the second edge icon corresponding to the second edge, the display information is changed so that the display format of the second connection icon corresponding to the second edge indicates that it has been viewed. The display control program according to any one of claims 1 to 3, further causing the information processing apparatus to execute the process.
6. When the display information is changed so that the node icon and the connection destination node icon are connected by the edge icon via the connection icon, the display information is further changed so that a third connection icon corresponding to a third edge of the connection destination node icon associated with the edge is also displayed. The display control program according to any one of claims 1 to 5, further causing the information processing apparatus to execute the process.
7. A display control method executed by an information processing apparatus, wherein the information processing apparatus is a graph defined by nodes and edges for connecting the nodes to connection destination nodes, the nodes include information indicating a person, thing / event, place, or time, and the nodes are associated with node information including information explaining the nodes, the edges include formulated sentences indicating a logical causal relationship or a temporal causal relationship between the nodes and the connection destination nodes, outputs display information for displaying node icons associated with the nodes from among the graphs, when the node icon is selected, changes the display information to display the node information associated with the node, when the node information has been viewed, changes the display information to display a connection icon associated with an edge connecting the node to the connection destination node, connected to the node icon associated with the node, when the connection icon is selected, changes the display information to display the sentence included in the edge. When the text associated with the connection icon has been viewed, the display information is changed so that the node icon and the connection destination node icon associated with the connection destination node are connected and displayed by an edge icon via the connection icon. A display control method including this.
8. A graph defined by a node and an edge for connecting the node to a connection destination node, The node includes information indicating a person, thing / event, place, or time, and the node is associated with node information including information explaining the node. The edge includes a formulated text indicating a logical causal relationship or a temporal causal relationship between the node and the connection destination node. An output unit that outputs display information for displaying a node icon associated with the node from among the graphs; When the node icon is selected, the display information is changed so that the node information associated with the node is displayed. When the node information has been viewed, the display information is changed so that a connection icon associated with an edge connecting the node to the connection destination node is connected to and displayed on the node icon associated with the node. When the connection icon is selected, the display information is changed so that the text included in the edge is displayed. When the text associated with the connection icon has been viewed, the display information is changed so that the node icon and the connection destination node icon associated with the connection destination node are connected and displayed by an edge icon via the connection icon. A change unit; An information processing apparatus including this.
Citation Information
Patent Citations
Operation device
JP1999191029A
Device for retrieving associative information
JP2001195428A
Visualization graph providing method on computer and computer providing visualization graph
JP2005100376A
Data retrieval system, data retrieval method, and computer program
JP2008146219A
Responding to situations using knowledge representation and reasoning
JP2008529163A