Computing apparatus capable of automatically setting bookmarks based on data from a user's interaction with electronic documents and the operating method thereof

Abstract

The present invention provides a computing device capable of setting automatic bookmarks based on user interaction data regarding an electronic document and a method of operation thereof, thereby enabling the user to review and utilize the contents of an electronic document more quickly by using bookmarks automatically set for the electronic document.

Description

Technology Field

[0001] The present invention relates to a computing device capable of setting automatic bookmarks based on user interaction data regarding electronic documents and a method of operation thereof. Background Technology

[0002] Recently, with the widespread adoption of computing devices such as computers, smartphones, and tablet PCs, various types of electronic document programs are being released that enable users to view, create, and edit electronic documents using these devices.

[0003] As electronic documents are easy to view, create, and edit, the number of people utilizing them is steadily increasing. As the use and volume of electronic documents grow, there is a need to introduce various convenience features to enhance the ease of use.

[0004] As one such measure, one can consider introducing a feature that measures the degree of user interaction with each page constituting the electronic document when the user views a specific electronic document, and automatically sets and provides bookmarks to the user for pages identified as key among the multiple pages constituting the document.

[0005] If bookmarks can be automatically set and provided to users based on their interaction data with the electronic document, users will be able to quickly check the main contents of the document by viewing the bookmarked pages the next time they access it, thereby enhancing the convenience of using the electronic document.

[0006] Therefore, research is needed on technology that supports users in more quickly reviewing and utilizing the contents of electronic documents by automatically setting and providing bookmarks to users based on user interaction data. The problem to be solved

[0007] The present invention aims to support users in reviewing and utilizing the contents of electronic documents more quickly by using automatically set bookmarks, by presenting a computing device capable of setting automatic bookmarks based on user interaction data regarding electronic documents and a method of operation thereof. means of solving the problem

[0008] A computing device according to an embodiment of the present invention comprises: a collection event generating unit that, when an electronic document composed of a plurality of pages is opened on the computing device and a command is granted from a user instructing to set an automatic bookmark for a key page of the electronic document, generates a collection event to collect interaction data of the user regarding the electronic document; a guidance message display unit that, when the collection event occurs, calculates a collection time for collecting interaction data based on the number of the plurality of pages, and then generates and displays a guidance message on a screen instructing the user to perform interaction with the electronic document during the collection time; and, from the time the guidance message is displayed until the collection time elapses, calculates a cumulative time corresponding to each of the plurality of pages by measuring, for each page, the cumulative time during which the center point of the screen is located at each of the plurality of pages, calculates a cumulative number of clicks corresponding to each of the plurality of pages by measuring, for each page, how many times a mouse click occurs by the user on each of the plurality of pages, and calculates a cumulative number of screen adjustments corresponding to each of the plurality of pages by measuring, for each page, the number of times the screen is enlarged or reduced by the user on each of the plurality of pages. A calculation unit; a calculation event generating unit that generates a calculation event to calculate the degree of user interaction per page of the electronic document when the collection time has elapsed after the above guidance message is displayed; an importance score calculating unit that calculates an importance score representing the degree of user interaction for each of the plurality of pages based on the accumulated time, accumulated click count, and accumulated screen adjustment count corresponding to each of the plurality of pages when the calculation event is generated; among the plurality of pages,The system includes: a designation unit that selects up to n (where n is a natural number greater than or equal to 2) first pages as major pages in order of importance score, and then assigns a bookmark tag indicating that each of the first pages selected as major pages has been set as a bookmark; a popup display unit that generates and displays a popup message on a screen indicating that a bookmark has been set on the electronic document when the electronic document is opened again on the computing device after the designation of the bookmark tag for each of the first pages is completed and the open state of the electronic document on the computing device is terminated; and a graph display unit that, when a command is issued from the user to display bookmark information, identifies the first pages among the plurality of pages for which bookmark tags have been assigned, generates a graph in which nodes corresponding to each of the first pages are arranged sequentially according to page number and edges are connected between the nodes corresponding to each of the first pages, and then floats and displays the graph on the screen where the body of the electronic document is displayed.

[0009] In addition, a method of operation of a computing device according to an embodiment of the present invention comprises the steps of: generating a collection event to collect interaction data of the user regarding the electronic document when a command instructing the user to set an automatic bookmark for a key page of the electronic document is granted from the user while the electronic document composed of a plurality of pages is open on the computing device; when the collection event is generated, calculating a collection time for collecting interaction data based on the number of the plurality of pages, and then generating and displaying a guidance message on a screen instructing the user to perform interaction with the electronic document during the collection time; calculating a cumulative time corresponding to each of the plurality of pages by measuring the cumulative time in which the center point of the screen is located at each of the plurality of pages from the time the guidance message is displayed until the collection time has elapsed for each page, and calculating a cumulative number of clicks corresponding to each of the plurality of pages by measuring how many times a mouse click occurred by the user on each of the plurality of pages for each page, and calculating a cumulative number of screen adjustments corresponding to each of the plurality of pages by measuring the number of times the screen was enlarged or reduced by the user on each of the plurality of pages for each page, and the guidance A step of generating a calculation event to calculate the degree of user interaction per page of the electronic document when the collection time has elapsed after the message is displayed; a step of, when the calculation event is generated, calculating an importance score representing the degree of user interaction for each of the plurality of pages based on the accumulated time, accumulated number of clicks, and accumulated number of screen adjustments corresponding to each of the plurality of pages; among the plurality of pages,The method includes the steps of: selecting up to n (where n is a natural number greater than or equal to 2) first pages as major pages in order of importance score, and assigning a bookmark tag indicating that each of the first pages selected as major pages has been set as a bookmark; generating and displaying a popup message on the screen indicating that a bookmark has been set on the electronic document when the electronic document is opened again on the computing device after the assignment of the bookmark tag for each of the first pages is completed and the open state of the electronic document on the computing device is terminated; and, when a command is authorized from the user to display bookmark information, identifying the first pages among the plurality of pages for which bookmark tags have been assigned, generating a graph having a form in which edges are connected between the nodes corresponding to each of the first pages while the nodes corresponding to each of the first pages are arranged sequentially according to page order, and then floating and displaying the graph on the screen where the body of the electronic document is displayed. Effects of the invention

[0010] The present invention provides a computing device capable of setting automatic bookmarks based on user interaction data regarding an electronic document and a method of operation thereof, thereby enabling the user to review and utilize the contents of an electronic document more quickly by using bookmarks automatically set for the electronic document. Brief explanation of the drawing

[0011] FIG. 1 is a diagram illustrating the structure of a computing device according to an embodiment of the present invention. FIGS. 2 to 7 are drawings for explaining a computing device according to an embodiment of the present invention. FIG. 8 is a flowchart illustrating a method of operation of a computing device according to an embodiment of the present invention. Specific details for implementing the invention

[0012] Embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. This description is not intended to limit the present invention to specific embodiments and should be understood to include all modifications, equivalents, and substitutions that fall within the spirit and scope of the present invention. Similar reference numerals have been used for similar components in describing each drawing, and unless otherwise defined, all terms used in this specification, including technical or scientific terms, have the same meaning as generally understood by a person skilled in the art to which the present invention pertains.

[0013] In this document, when a part is described as "including" a component, it means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, in various embodiments of the present invention, each component, functional block, or means may be composed of one or more sub-components, and the electrical, electronic, or mechanical functions performed by each component may be implemented by various known devices or mechanical elements, such as electronic circuits, integrated circuits, and ASICs (Application Specific Integrated Circuits), and may be implemented separately or two or more may be integrated into one.

[0014] Meanwhile, the blocks in the attached block diagram or the steps in the flowchart may be interpreted as computer program instructions that perform designated functions by being loaded into the processor or memory of data-processing equipment, such as general-purpose computers, specialized computers, portable notebook computers, and network computers. Since these computer program instructions may be stored in memory provided in a computer device or in memory readable by a computer, the functions described in the blocks in the block diagram or the steps in the flowchart may be produced as manufactured products containing means of instruction to perform them. Furthermore, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing a specific logical function(s). Also, it should be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may be executed in a different order than the prescribed order. For example, two blocks or steps shown in succession may be performed substantially simultaneously or in reverse order, and in some cases, some blocks or steps may be omitted.

[0015] FIG. 1 is a diagram illustrating the structure of a computing device according to an embodiment of the present invention.

[0016] Referring to FIG. 1, a computing device (110) according to the present invention includes a collection event generation unit (111), a guidance message display unit (112), a calculation unit (113), a calculation event generation unit (114), an importance score calculation unit (115), a designation unit (116), a popup display unit (117), and a graph display unit (118).

[0017] The collection event generating unit (111) generates a collection event to collect interaction data of the user regarding the electronic document when a command instructing the user to set an automatic bookmark for the main page of the electronic document is issued when the electronic document consisting of a plurality of pages is open on the computing device (110).

[0018] When the collection event occurs, the guidance message display unit (112) calculates the collection time for collecting interaction data based on the number of the plurality of pages, and then generates and displays a guidance message on the screen instructing the user to perform an interaction with the electronic document during the collection time.

[0019] At this time, according to one embodiment of the present invention, the guidance message display unit (112) can calculate the collection time by referring to a table in which a plurality of range values ​​consisting of a lower limit value and an upper limit value for the number of pages and different reference times corresponding to each of the plurality of range values ​​are recorded, confirming a first reference time corresponding to the range value to which the number of the plurality of pages belongs, and then multiplying the number of the plurality of pages by the first reference time.

[0020] In this regard, the above table may be configured as shown in Table 1 below.

[0022] Multiple range values Standard time 1 or more, 3 or fewer pages 60 seconds More than 3, no more than 6 pages 55 seconds More than 6, no more than 9 pages 50 seconds More than 9 pages 45 seconds

[0024] At this time, when the number of the multiple pages is '10', the guidance message display unit (112) can refer to a table such as Table 1 to confirm the first reference time corresponding to the range value to which the number of the multiple pages, '10', belongs as '45 seconds', and then calculate the collection time, which is '450 seconds', by multiplying the number of the multiple pages, '10', by the first reference time, '45 seconds'.

[0025] When the above collection time is calculated in this way, the guidance message display unit (112) can generate and display a guidance message on the screen instructing the user to perform an interaction with the electronic document during the above collection time of '450 seconds'.

[0026] In this regard, the above guidance message may include content that induces the user to view the electronic document by turning through multiple pages constituting the electronic document for '450 seconds', and to perform interactions such as clicking a mouse or zooming in or out on the screen. Then, the user can view the content of each page while turning through the pages of the electronic document, and at this time, may spend more time on pages that they consider important than on other pages, and may perform interactions such as pressing a mouse click button on parts they consider important, or zooming in or out on parts they consider important.

[0027] The calculation unit (113) calculates the cumulative time corresponding to each of the plurality of pages by measuring the cumulative time in which the center point of the screen is located in each of the plurality of pages from the time the guidance message is displayed until the collection time elapses, calculates the cumulative number of clicks corresponding to each of the plurality of pages by measuring how many times mouse clicks occur by the user in each of the plurality of pages, and calculates the cumulative number of screen adjustments corresponding to each of the plurality of pages by measuring the number of times the screen is enlarged or reduced by the user in each of the plurality of pages.

[0028] Here, the center point refers to the point corresponding to the center of the screen (210), as indicated by the reference numeral 211, in the case where the screen on which the document is displayed is the same as reference numeral 210 in FIG. 2.

[0029] In this regard, the process of the calculation unit (113) calculating the cumulative time corresponding to each of the plurality of pages is explained with reference to FIG. 3 as follows.

[0030] First, let us assume that one of the aforementioned multiple pages is the same as reference numeral 310 in FIG. 3. Then, the calculation unit (113) can measure the cumulative time during which the center point (211) is located on the page (310) from the time the guidance message is displayed until the collection time elapses, as shown in the figure in FIG. 3. In this regard, if the user stays on the page (310) for about '10 seconds' while reading the electronic document, and the center point (211) is located on the page (310) for about '10 seconds', and then the user moves the screen to another page and then moves back to the page (310), and the center point (211) stays on the page (310) for about '20 seconds' again, the calculation unit (113) can measure the cumulative time for the page (310) as '30 seconds'. In this way, the output unit (113) can measure the cumulative time at which the center point (211) is located in each of the plurality of pages for each page.

[0031] And the calculation unit (113) can calculate the cumulative number of clicks corresponding to each of the plurality of pages by measuring how many times the mouse click occurred by the user on each of the plurality of pages. For example, if the mouse click by the user occurred a total of '5 times' on any one of the plurality of pages, the calculation unit (113) can calculate the cumulative number of clicks corresponding to that page as '5 times'.

[0032] Additionally, the calculation unit (113) can calculate the cumulative number of screen adjustments corresponding to each of the plurality of pages by measuring the number of times the screen is enlarged or reduced by the user on each of the plurality of pages. For example, if the screen on any one of the plurality of pages is enlarged '3 times' and reduced '2 times' by the user, the calculation unit (113) can calculate the cumulative number of screen adjustments corresponding to that page as '5 times'.

[0033] The output event generating unit (114) generates an output event to calculate the degree of user interaction per page of the electronic document when the collection time has elapsed after the above guidance message is displayed.

[0034] In this regard, as in the example above, if the collection time is '450 seconds', the output event generating unit (114) can generate an output event to calculate the degree of user interaction per page of the electronic document when '450 seconds' have elapsed from the time when the guidance message is displayed on the screen.

[0035] When the output event is generated through the output event generation unit (114) in this way, the importance score calculation unit (115) calculates an importance score representing the degree of user interaction for each of the plurality of pages based on the accumulated time, accumulated number of clicks, and accumulated number of screen adjustments corresponding to each of the plurality of pages.

[0036] In this case, according to one embodiment of the present invention, the importance score calculation unit (115) may include a first partial score allocation unit (119), a second partial score allocation unit (120), a third partial score allocation unit (121), and a score calculation unit (122).

[0037] The first partial score allocation unit (119) assigns a ranking to each of the plurality of pages in order of the largest accumulated time of each page, and then assigns a first partial score to each of the plurality of pages according to the operation of the following mathematical formula 1.

[0039]

[0041] Here, ... refers to a first partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the ranking of the cumulative time specified on the page.

[0042] The second partial score allocation unit (120) assigns a ranking to each of the plurality of pages in order of the cumulative number of clicks of each page, and then assigns a second partial score to each of the plurality of pages according to the operation of mathematical formula 2 below.

[0044]

[0046] Here, ... refers to a second partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the ranking of the cumulative number of clicks specified on the page.

[0047] The third part score allocation unit (121) assigns a ranking to each of the plurality of pages in order of the cumulative screen adjustment count of each page, and then assigns a third part score to each of the plurality of pages according to the operation of mathematical formula 3 below.

[0049]

[0051] Here, ... refers to a third partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the ranking of the cumulative number of screen adjustments specified on the page.

[0052] The score calculation unit (122) generates a row vector corresponding to each of the plurality of pages by configuring a row vector having a first partial score, a second partial score, and a third partial score assigned to each of the plurality of pages as components, and then calculates the result obtained when matrix multiplying the row vector corresponding to each of the plurality of pages with a column vector having a pre-set first weight, a second weight, and a third weight as components as an importance score corresponding to each of the plurality of pages.

[0053] Here, the first weight, the second weight, and the third weight are rational numbers greater than 0 and less than 1, and the sum of the first weight, the second weight, and the third weight is 1.

[0054] Below, the operation of the first partial score allocation unit (119), the second partial score allocation unit (120), the third partial score allocation unit (121), and the score calculation unit (122) will be explained in detail with examples.

[0055] First, as in the example above, if the number of the plurality of pages is '10' and the cumulative time of 'Page 1' among the '10' pages is the largest, the first partial score allocation unit (119) assigns a rank of '1st place' to 'Page 1' and then assigns the first partial score for 'Page 1' according to the operation of the mathematical formula 1. It can be assigned as '. In this way, the first partial score assignment unit (119) can assign a first partial score for each of the '10' pages.

[0056] And the second partial score allocation unit (120) can assign a second partial score according to the operation of mathematical formula 2 to each of the '10' pages after ranking each of the '10' pages in order of the cumulative number of clicks of each page.

[0057] In this regard, if the cumulative number of clicks on 'Page 3' among the above '10' pages is the highest, the second partial score allocation unit (120) assigns a rank of '1st place' to 'Page 3' and then assigns the second partial score for 'Page 3' according to the operation of the above mathematical formula 2. It can be assigned as '. In this way, the second part score assignment unit (120) can assign a second part score for each of the '10' pages.

[0058] In addition, the third part score allocation unit (121) can assign a third part score according to the operation of mathematical formula 3 to each of the '10' pages after ranking each of the '10' pages in order of the number of accumulated screen adjustments of each page.

[0059] In this regard, if the cumulative number of screen adjustments for 'Page 5' among the above '10' pages is the highest, the third part score allocation unit (121) assigns a rank of '1st place' to 'Page 5' and then assigns the third part score for 'Page 5' according to the operation of the above mathematical formula 3. It can be assigned as '. In this way, the third part score assignment unit (121) can assign a third part score for each of the '10' pages.

[0060] When the assignment of the first partial score, the second partial score, and the third partial score to each of the above '10' pages is completed in this way, the score calculation unit (122) generates a row vector corresponding to each of the '10' pages by constructing a row vector having the first partial score, the second partial score, and the third partial score assigned to each of the above '10' pages as components, and then calculates the result obtained when matrix multiplying the row vector corresponding to each of the plurality of pages with a column vector having a pre-set first weight, the second weight, and the third weight as components as the importance score corresponding to each of the plurality of pages.

[0061] For example, if the first partial score assigned to 'Page 1' among the above '10' pages is '10 points', the second partial score is '5 points', and the third partial score is '7 points', and the preset first weight is '0.3', the second weight is '0.5', and the third weight is '0.2', the score calculation unit (122) can generate a row vector for 'Page 1' having the first partial score, the second partial score, and the third partial score as components, such as '[10 5 7]'. Then, the score calculation unit (122) generates a column vector '[0.3 0.5 0.2]' having the preset first weight, the second weight, and the third weight as components, in the row vector '[10 5 7]' corresponding to 'Page 1'. T The result '6.9', which is produced when ' is matrix multiplied, can be calculated as the importance score corresponding to 'Page 1'.

[0062] In this way, the score calculation unit (122) can calculate an importance score corresponding to each of the '10' pages.

[0063] The designation unit (116) selects up to n (n is a natural number greater than or equal to 2) first pages as major pages in order of importance score among the plurality of pages, and then designates a bookmark tag indicating that each of the first pages selected as major pages has been set as a bookmark.

[0064] In this regard, let's assume that the number of the aforementioned multiple pages is '10', that the multiple pages consist of 'Page 1, Page 2, Page 3, Page 4, Page 5, Page 6, Page 7, Page 8, Page 9, Page 10', and that n is '5'.

[0065] Then, the designation unit (116) can select up to five first pages as major pages in order of importance score among 'page 1, page 2, page 3, page 4, page 5, page 6, page 7, page 8, page 9, page 10'.

[0066] For example, if the above multiple pages are arranged in order of importance score as ‘Page 7, Page 8, Page 1, Page 3, Page 2, Page 4, Page 6, Page 5, Page 9, Page 10’, the designation unit (116) can select the five first pages, ‘Page 7, Page 8, Page 1, Page 3, Page 2’, as the main pages.

[0067] Then, the designation unit (116) can designate a bookmark tag indicating that each of the selected main pages, ‘Page 7, Page 8, Page 1, Page 3, Page 2’, has been set as a bookmark.

[0068] The popup display unit (117) generates and displays a popup message on the screen indicating that a bookmark has been set on the electronic document when the electronic document is opened again on the computing device (110) after the bookmark tag has been assigned to each of the first pages and after the open state of the electronic document on the computing device (110) has ended.

[0069] In this regard, let us assume that the first pages mentioned above are 'Page 7, Page 8, Page 1, Page 3, Page 2', as in the example above.

[0070] Let us assume that after the designation of bookmark tags for each of the first pages, 'Page 7, Page 8, Page 1, Page 3, Page 2', is completed by the designation unit (116), and after the open state of the electronic document in the computing device (110) is terminated as the user authorizes a 'document close command', the electronic document in the computing device (110) is opened again as the user authorizes a 'document open command'.

[0071] Then, the popup display unit (117) can generate and display a popup message on the screen, such as 'A bookmark has been set on the document. Would you like to display bookmark information?', which indicates that a bookmark has been set on the electronic document.

[0072] When a command is issued from the user to display bookmark information, the graph display unit (118) identifies the first pages among the plurality of pages that have bookmark tags assigned to them, and then generates a graph in which nodes corresponding to each of the first pages are arranged sequentially according to page order and edges are connected between the nodes corresponding to each of the first pages, and then displays the graph by floating it on the screen where the body of the electronic document is displayed.

[0073] In this regard, as in the example above, let us assume that the number of the plurality of pages is '10', that the plurality of pages consists of 'Page 1, Page 2, Page 3, Page 4, Page 5, Page 6, Page 7, Page 8, Page 9, Page 10', and that the first pages are 'Page 7, Page 8, Page 1, Page 3, Page 2'.

[0074] Then, when a command is issued from the user to display bookmark information, the graph display unit (118) can identify the first pages, 'Page 7, Page 8, Page 1, Page 3, Page 2', which have bookmark tags assigned among 'Page 1, Page 2, Page 3, Page 4, Page 5, Page 6, Page 7, Page 8, Page 9, Page 10'.

[0075] After that, the graph display unit (118) can generate a graph in which nodes corresponding to each of the first pages, 'page 7, page 8, page 1, page 3, page 2', are arranged sequentially as 'node 1' (411), 'node 2' (412), 'node 3' (413), 'node 4' (414), and 'node 5' (415) according to the page order, and have edges connected between the nodes corresponding to each of the first pages, as in the graph (416) of FIG. 4, and then plot and display the graph (416) on the screen (410) where the body of the electronic document is displayed as illustrated in FIG. 4.

[0076] According to one embodiment of the present invention, the computing device (110) may further include a summary display unit (123).

[0077] The summary display unit (123) generates a summary by inputting text inserted in the second page as input to a pre-trained summary generation model when the mouse pointer is hovered over the node corresponding to the second page, which is one of the nodes corresponding to each of the first pages existing on the graph, for a preset time or longer while the graph is being displayed on the screen, and then displays the summary at an adjacent point in the area where the graph is displayed.

[0078] Here, the aforementioned summary generation model refers to an artificial intelligence model based on BERT (Bidirectional Encoder Representations from Transformers) that produces a summary corresponding to the input text as output when text is input.

[0079] At this time, BERT refers to a natural language processing model that, when a specific text is input, tokenizes the text to generate a specific input sequence, and then sequentially feeds this input sequence to BERT layers composed of layer normalization, multihead self-attention, dropout, and feed forward networks to generate an output sequence.

[0080] In this regard, the above summary generation model may be a machine learning model that minimizes the error between the predicted value produced when each of the multiple training texts is fed into BERT and the correct label corresponding to each training text, while the training dataset is configured with multiple training texts and a summary corresponding to each training text designated as the correct label.

[0081] In this regard, let us assume that a graph (416) is floating and displayed on a screen (410) where the body of the electronic document is displayed, as shown in the figure in Fig. 4.

[0082] At this time, as shown in the figure illustrated in FIG. 5, when the mouse pointer (10) hovers over 'Node 2' (412), which corresponds to 'Page 2', among the nodes corresponding to each of the first pages existing on the graph (416) by the user, for a preset time (e.g., '3 seconds'), the summary display unit (123) can input the text inserted in 'Page 2' as input to a pre-trained summary generation model to generate a summary, and then display the summary at an adjacent point (511) of the area where the graph (416) is displayed, as shown in the figure illustrated in FIG. 5.

[0083] According to one embodiment of the present invention, the computing device (110) may further include a moving part (124).

[0084] The moving unit (124) performs page movement so that when the graph is displayed on the screen, and a selection command is applied by the user for a node corresponding to the third page, which is one of the nodes corresponding to each of the first pages existing on the graph, the graph that is floating and displayed on the screen is removed, and the third page is displayed on the screen where the body of the electronic document is displayed.

[0085] In this regard, let us assume that a graph (416) is floating and displayed on a screen (410) where the body of the electronic document is displayed, as shown in the figure in Fig. 4.

[0086] At this time, as shown in the figure in FIG. 6, if the user places a mouse pointer (10) on 'Node 1' (411), which corresponds to 'Page 1', among the nodes corresponding to each of the first pages existing on the graph (416), such as 'Node 1' (411), 'Node 2' (412), 'Node 3' (413), 'Node 4' (414), and 'Node 5' (415), and then the user performs an action of clicking the mouse, thereby applying a selection command for 'Node 1 (411)' to the computing device (110), the movement unit (124) can remove the graph (416) that is floating and displayed on the screen (410), and then perform page movement so that 'Page 1' is displayed on the screen (410) where the body of the electronic document is displayed, as shown in the figure in FIG. 7.

[0087] FIG. 8 is a flowchart illustrating a method of operation of a computing device according to an embodiment of the present invention.

[0088] In step (S810), when an electronic document consisting of multiple pages is open on the computing device, if a command is issued from a user instructing to set an automatic bookmark for a key page of the electronic document, a collection event is generated to collect interaction data of the user regarding the electronic document.

[0089] In step (S820), when the collection event occurs, the collection time for collecting interaction data is calculated based on the number of the plurality of pages, and then a guidance message is generated and displayed on the screen instructing the user to perform interaction with the electronic document during the collection time.

[0090] In step (S830), from the time the guidance message is displayed until the collection time elapses, the cumulative time at which the center point of the screen is located on each of the plurality of pages is measured for each page to calculate the cumulative time corresponding to each of the plurality of pages, the number of mouse clicks by the user on each of the plurality of pages is measured for each page to calculate the cumulative number of clicks corresponding to each of the plurality of pages, and the number of times the screen is enlarged or reduced by the user on each of the plurality of pages is measured for each page to calculate the cumulative number of screen adjustments corresponding to each of the plurality of pages.

[0091] In step (S840), after the above guidance message is displayed and the above collection time has elapsed, a calculation event is generated to calculate the degree of user interaction per page for the above electronic document.

[0092] In step (S850), when the above-mentioned output event occurs, an importance score representing the degree of user interaction with each of the plurality of pages is calculated based on the accumulated time, accumulated number of clicks, and accumulated number of screen adjustments corresponding to each of the plurality of pages.

[0093] In step (S860), among the plurality of pages, up to n (n is a natural number greater than or equal to 2) first pages are selected as major pages in order of importance score, and then a bookmark tag is assigned to each of the first pages selected as major pages to indicate that it has been set as a bookmark.

[0094] In step (S870), after the designation of bookmark tags for each of the first pages is completed and after the open state of the electronic document on the computing device is terminated, when the electronic document is opened again on the computing device, a popup message is generated and displayed on the screen indicating that a bookmark has been set on the electronic document.

[0095] In step (S880), when a command is issued from the user to display bookmark information, the first pages among the plurality of pages that have bookmark tags assigned are identified, and then a graph is created in which the nodes corresponding to each of the first pages are arranged sequentially according to the page order and the edges are connected between the nodes corresponding to each of the first pages, and then the graph is displayed by floating it on the screen where the body of the electronic document is displayed.

[0096] At this time, according to one embodiment of the present invention, in step (S820), a table is recorded in which a plurality of range values ​​consisting of a lower limit value and an upper limit value for the number of pages and different reference times corresponding to each of the plurality of range values ​​are recorded, and a first reference time corresponding to the range value to which the number of the plurality of pages belongs is identified, and then the collection time can be calculated by multiplying the number of the plurality of pages by the first reference time.

[0097] In addition, according to one embodiment of the present invention, in step (S850), for each of the plurality of pages, a ranking is assigned in order of increasing cumulative time of each page, and then a first partial score is assigned to each of the plurality of pages according to the operation of the following mathematical formula 1; for each of the plurality of pages, a ranking is assigned in order of increasing cumulative click count of each page, and then a second partial score is assigned to each of the plurality of pages according to the operation of the following mathematical formula 2; for each of the plurality of pages, a ranking is assigned in order of increasing cumulative screen adjustment count of each page, and then a third partial score is assigned to each of the plurality of pages according to the operation of the following mathematical formula 3; and for each of the plurality of pages, a row vector is constructed having the first partial score, the second partial score, and the third partial score assigned to each page as components, thereby generating a row vector corresponding to each of the plurality of pages, and then a pre-set first weight, second weight, and third weight (the first weight, second weight, and third weight are greater than 0) is applied to the row vector corresponding to each of the plurality of pages The method may include a step of calculating the result obtained when matrix multiplying a column vector having components (a rational number less than 1, and the sum of the first weight, second weight, and third weight is 1) as an importance score corresponding to each of the plurality of pages.

[0098] In addition, according to one embodiment of the present invention, the method of operation of the computing device may further include the step of generating a summary by inputting text inserted in the second page as input to a pre-trained summary generation model (the summary generation model is a BERT-based artificial intelligence model that outputs a summary corresponding to the input text when text is input, wherein the summary generation model is a machine-learned model configured such that the error between the predicted value calculated when each of the plurality of training texts is input to BERT and the correct label corresponding to each training text is minimized, while a training dataset is configured with a plurality of pre-produced training texts and a summary corresponding to each training text designated as the correct label) and then displaying the summary at an adjacent point in the area where the graph is displayed.

[0099] In addition, according to one embodiment of the present invention, the method of operation of the computing device may further include the step of removing the graph that is floating and displayed on the screen and then performing a page movement so that the third page is displayed on the screen where the body of the electronic document is displayed, when a selection command is applied by the user for a node corresponding to the third page, which is one of the nodes corresponding to each of the first pages existing on the graph.

[0100] Hereinafter, a method of operation of a computing device according to an embodiment of the present invention has been described with reference to FIG. 8. Since the method of operation of a computing device according to an embodiment of the present invention may correspond to the configuration of the operation of the computing device (110) described using FIG. 1 to 7, a more detailed description thereof will be omitted.

[0101] A method of operation of a computing device according to one embodiment of the present invention can be implemented as a computer program stored in a storage medium for execution through combination with a computer.

[0102] In addition, a method of operation of a computing device according to an embodiment of the present invention may be implemented in the form of computer program instructions for execution through combination with a computer and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either individually or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

[0103] As described above, the present invention has been explained by specific details such as specific components, limited embodiments, and drawings; however, this is provided merely to aid in a more comprehensive understanding of the invention, and the invention is not limited to the above embodiments. A person skilled in the art can make various modifications and variations from this description.

[0104] Therefore, the scope of the present invention is not limited to the described embodiments, and all things equivalent to or having equivalent variations to the claims set forth below, as well as the claims set forth below, shall be considered to fall within the scope of the concept of the present invention. Explanation of the symbols

[0105] 110: Computing device 111: Collection Event Generation Unit 112: Guidance Message Display Unit 113: Output unit 114: Output event generation unit 115: Importance Score Calculation Unit 116: Designation Unit 117: Popup display 118: Graph display 119: 1st Part Score Allocation Unit 120: 2nd Part Score Allocation Unit 121: Part 3 Score Allocation Unit 122: Score Calculation Unit 123: Summary display section 124: Movement section

Claims

Claim 1 In a computing device, when an electronic document composed of multiple pages is open in the computing device, and a command is granted from a user instructing to set an automatic bookmark for a key page of the electronic document, a collection event generating unit for generating a collection event to collect interaction data of the user regarding the electronic document; when the collection event is generated, a collection time for collecting interaction data is calculated based on the number of the multiple pages, and then a guidance message generating and displaying on a screen a guidance message instructing the user to perform interaction with the electronic document during the collection time; a calculation unit for calculating a cumulative time corresponding to each of the multiple pages by measuring, for each page, the cumulative time at which the center point of the screen is located on each of the multiple pages from the time the guidance message is displayed until the collection time elapses, calculating a cumulative number of clicks corresponding to each of the multiple pages by measuring, for each page, how many times a mouse click occurred by the user on each of the multiple pages, and calculating a cumulative number of screen adjustments corresponding to each of the multiple pages by measuring, for each page, the number of times the screen was enlarged or reduced by the user on each of the multiple pages; and when the guidance message is displayed Subsequently, when the above collection time has elapsed, a calculation event generating unit that generates a calculation event to calculate the degree of user interaction for each page of the electronic document; and when the calculation event is generated, an importance score calculating unit that calculates an importance score representing the degree of user interaction for each of the plurality of pages based on the accumulated time, accumulated number of clicks, and accumulated number of screen adjustments corresponding to each of the plurality of pages.A computing device comprising: a designation unit that selects up to n (where n is a natural number greater than or equal to 2) first pages among the plurality of pages in order of importance score as major pages, and then assigns a bookmark tag indicating that each of the first pages selected as major pages has been set as a bookmark; a popup display unit that generates and displays a popup message on a screen indicating that a bookmark has been set on the electronic document when the electronic document is opened again on the computing device after the designation of the bookmark tag for each of the first pages is completed and the open state of the electronic document on the computing device is terminated; and a graph display unit that, when a command instructing the user to display bookmark information is granted, identifies the first pages among the plurality of pages for which bookmark tags have been assigned, generates a graph having a form in which edges are connected between the nodes corresponding to each of the first pages while the nodes corresponding to each of the first pages are arranged sequentially according to page number, and then floats and displays the graph on a screen where the body of the electronic document is displayed. Claim 2 A computing device according to claim 1, wherein the guidance message display unit calculates the collection time by referring to a table in which a plurality of range values ​​consisting of a lower limit value and an upper limit value for the number of pages and different reference times corresponding to each of the plurality of range values ​​are recorded, confirming a first reference time corresponding to the range value to which the number of the plurality of pages belongs, and then multiplying the number of the plurality of pages by the first reference time. Claim 3 In claim 1, the importance score calculation unit comprises: a first partial score allocation unit that assigns a first partial score to each of the plurality of pages in order of increasing cumulative time of each page, and then assigns a first partial score to each of the plurality of pages according to the operation of the following mathematical formula 1; a second partial score allocation unit that assigns a second partial score to each of the plurality of pages in order of increasing cumulative click count of each page, and then assigns a second partial score to each of the plurality of pages according to the operation of the following mathematical formula 2; and a third partial score allocation unit that assigns a third partial score to each of the plurality of pages in order of increasing cumulative screen adjustment count of each page, and then assigns a third partial score to each of the plurality of pages according to the operation of the following mathematical formula 3. A computing device comprising a score calculation unit that generates a row vector corresponding to each of the plurality of pages by configuring a row vector having a first partial score, a second partial score, and a third partial score assigned to each of the plurality of pages as components for each of the plurality of pages, and then calculates the result obtained when matrix multiplying the row vector corresponding to each of the plurality of pages with a column vector having a pre-set first weight, a second weight, and a third weight—where the first weight, the second weight, and the third weight are rational numbers greater than 0 and less than 1, and the sum of the first weight, the second weight, and the third weight is 1—as an importance score corresponding to each of the plurality of pages. [Mathematical Formula 1] Here, ... refers to a first partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the rank of the cumulative time specified on the corresponding page.[Mathematical Formula 2] Here, ... refers to a second partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the ranking of the cumulative number of clicks specified for the page.[Mathematical Formula 3] Here, ... refers to a third partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the ranking of the cumulative number of screen adjustments specified on the page. Claim 4 A computing device further comprising, in the state where the graph is displayed on a screen, a summary display unit that, when a mouse pointer is hovered by the user over a node corresponding to a second page, which is one of the nodes corresponding to each of the first pages existing on the graph, for a preset time or longer, inputs text inserted on the second page as input to a pre-trained summary generation model—the summary generation model is an artificial intelligence model based on BERT (Bidirectional Encoder Representations from Transformers) that produces a summary corresponding to the input text when text is input, wherein the summary generation model is a machine-learned model configured such that the error between the predicted value produced when each of the plurality of training texts is input to BERT and the correct label corresponding to each training text is minimized, while a training dataset is configured with a plurality of pre-produced training texts and a summary corresponding to each training text designated as the correct label—and then generates a summary and displays the summary at an adjacent point of the area where the graph is displayed. Claim 5 A computing device according to claim 1, further comprising a moving unit that, when the graph is displayed on a screen, when a selection command is applied by the user for a node corresponding to a third page, which is one of the nodes corresponding to each of the first pages existing on the graph, removes the graph that is floating and displayed on the screen and then performs a page movement so that the third page is displayed on the screen where the body of the electronic document is displayed. Claim 6 A method of operating a computing device, wherein, when an electronic document composed of multiple pages is open on the computing device, a command is issued from a user instructing to set an automatic bookmark for a key page of the electronic document, thereby generating a collection event to collect interaction data of the user regarding the electronic document; when the collection event occurs, a collection time for collecting interaction data is calculated based on the number of the multiple pages, and then a guidance message is generated and displayed on a screen instructing the user to perform interaction with the electronic document during the collection time; from the time the guidance message is displayed until the collection time has elapsed, the cumulative time corresponding to each of the multiple pages is calculated by measuring the cumulative time in which the center point of the screen is located at each of the multiple pages for each page, and the cumulative number of clicks corresponding to each of the multiple pages is calculated by measuring the number of times mouse clicks occurred by the user on each of the multiple pages for each page, and the cumulative number of screen adjustments corresponding to each of the multiple pages is calculated by measuring the number of times the screen was enlarged or reduced by the user on each of the multiple pages for each page; and after the guidance message is displayed, the collection time is all A step of generating a calculation event to calculate the degree of user interaction for each page of the electronic document when the calculation event occurs; a step of calculating an importance score representing the degree of user interaction for each of the plurality of pages based on the accumulated time, accumulated number of clicks, and accumulated number of screen adjustments corresponding to each of the plurality of pages when the calculation event occurs;A method of operation of a computing device comprising: a step of selecting up to n (where n is a natural number greater than or equal to 2) first pages among the plurality of pages in order of increasing importance score as major pages, and then assigning a bookmark tag indicating that each of the first pages selected as major pages has been set as a bookmark; a step of generating and displaying a popup message on a screen indicating that a bookmark has been set on the electronic document when the electronic document is opened again on the computing device after the assignment of the bookmark tag for each of the first pages is completed and the open state of the electronic document on the computing device is terminated; and a step of, when a command instructing the user to display bookmark information is granted, identifying the first pages among the plurality of pages for which bookmark tags have been assigned, generating a graph having a form in which edges are connected between the nodes corresponding to each of the first pages while the nodes corresponding to each of the first pages are arranged sequentially according to page number, and then floating and displaying the graph on the screen where the body of the electronic document is displayed. Claim 7 A method of operation of a computing device according to claim 6, wherein the step of generating and displaying the guidance message on a screen is characterized by calculating the collection time by multiplying the number of pages by the first reference time, after confirming the first reference time corresponding to the range value to which the number of pages belongs by referring to a table in which a plurality of range values ​​consisting of a lower limit value and an upper limit value for the number of pages and different reference times corresponding to each of the plurality of range values ​​are recorded. Claim 8 In claim 6, the step of calculating the importance score comprises: a step of assigning a rank to each of the plurality of pages in order of increasing cumulative time of each page, and then assigning a first partial score to each of the plurality of pages according to the operation of the following mathematical formula 1; a step of assigning a rank to each of the plurality of pages in order of increasing cumulative click count of each page, and then assigning a second partial score to each of the plurality of pages according to the operation of the following mathematical formula 2; and a step of assigning a rank to each of the plurality of pages in order of increasing cumulative screen adjustment count of each page, and then assigning a third partial score to each of the plurality of pages according to the operation of the following mathematical formula 3. A method of operation of a computing device comprising the step of: generating a row vector corresponding to each of the plurality of pages by configuring a row vector having a first partial score, a second partial score, and a third partial score assigned to each of the plurality of pages as components for each of the plurality of pages; and then multiplying the row vector corresponding to each of the plurality of pages by a column vector having a pre-set first weight, a second weight, and a third weight—where the first weight, the second weight, and the third weight are rational numbers greater than 0 and less than 1, and the sum of the first weight, the second weight, and the third weight is 1—as a result obtained when performing matrix multiplication, and calculating the result obtained as an importance score corresponding to each of the plurality of pages. [Mathematical Formula 1] Here, ... refers to a first partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the rank of the cumulative time specified on the corresponding page.[Mathematical Formula 2] Here, ... refers to a second partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the ranking of the cumulative number of clicks specified for the page.[Mathematical Formula 3] Here, ... refers to a third partial score to be assigned to any one of the aforementioned plurality of pages, and is the number of the aforementioned multiple pages, represents the ranking of the cumulative number of screen adjustments specified on the page. Claim 9 A method of operation of a computing device according to claim 6, further comprising the step of generating a summary by inputting text inserted in the second page as input to a pre-trained summary generation model—a BERT (Bidirectional Encoder Representations from Transformers)-based artificial intelligence model that outputs a summary corresponding to the input text when text is input, wherein the summary generation model is a machine-learned model configured such that the error between the predicted value calculated when each of the plurality of training texts is input to BERT and the correct label corresponding to each training text is minimized, while a training dataset is configured with a plurality of pre-produced training texts and a summary corresponding to each training text designated as the correct label—and then displaying the summary at an adjacent point in the area where the graph is displayed. Claim 10 A method of operation of a computing device according to claim 6, further comprising the step of, when a selection command is applied by the user for a node corresponding to a third page, which is one of the nodes corresponding to each of the first pages existing on the graph while the graph is displayed on the screen, removing the graph that is floating and displayed on the screen and then performing a page movement so that the third page is displayed on the screen where the body of the electronic document is displayed. Claim 11 A computer-readable recording medium having a computer program for executing the method of any one of paragraphs 6 through 10 in combination with a computer. Claim 12 A computer program stored on a storage medium for executing the method of any one of paragraphs 6 through 10 through combination with a computer.

Images