Electronic apparatus that can extract pairs of similar documents by measuring the similarity between documents and the operating method thereof
Patent Information
- Application Number
- KR1020240019482
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-02-08
- Publication Date
- 2026-09-04
- Estimated Expiration
- 2044-02-08
Smart Images

Figure 112024015729127-PAT00001_ABST
Abstract
Description
Technology Field
[0001] The present invention relates to an electronic device capable of extracting pairs of similar documents through the measurement of similarity between documents, and a method of operation thereof. Background Technology
[0002] Recently, with the widespread adoption of electronic devices such as computers, smartphones, and tablet PCs, various types of electronic document programs are being released that enable users to view, create, and edit electronic documents using these devices.
[0003] These electronic document programs include word processors that support the creation and editing of basic documents, spreadsheets that assist with data input, formula calculations, and data management, and presentation programs that assist the presenter's presentation.
[0004] Typically, users often update documents multiple times by adding or modifying content. In such cases, numerous similar documents with different filenames are generated, frequently causing users difficulties in document management.
[0005] In this regard, it is necessary to introduce technology that can support users in performing more efficient document management.
[0006] In this regard, regarding documents stored on an electronic device, the introduction of a technology that measures the similarity between documents, extracts pairs of documents with high similarity, and enables users to receive information about the extracted pairs of documents can be considered.
[0007] In addition, to enable users to manage documents more easily, the introduction of technology capable of removing duplicates from extracted similar document pairs may also be considered. The problem to be solved
[0008] The electronic device and method of operation according to the present invention aim to support a user in performing more efficient document management by measuring the similarity between documents regarding documents stored on the electronic device, extracting pairs of documents with high similarity, and displaying information about the extracted pairs of documents on a screen. means of solving the problem
[0009] An electronic device capable of extracting similar document pairs through similarity measurement between documents according to an embodiment of the present invention comprises: a file storage unit in which document files for each of a plurality of documents are stored; a sequence assignment unit that randomly assigns a sequence number to each of the plurality of documents when an extraction request command requesting the extraction of similar document pairs among the plurality of documents is authorized from a user; a storage processing unit that stores the sequence numbers of the plurality of documents in ascending order in a queue when a sequence number is randomly assigned to each of the plurality of documents; a generation unit that generates a plurality of sequence number pairs by repeating the process of extracting the sequence numbers of the plurality of documents one by one in ascending order from the queue—whereby the sequence number extracted from the queue is deleted from the queue—and matching the remaining sequence numbers on the queue one by one to the extracted sequence number to form a sequence number pair, until no sequence numbers remain on the queue; and for each of the plurality of sequence number pairs, between the documents corresponding to the two sequence numbers included in each sequence number pair The system includes a similarity measuring unit that generates a similarity corresponding to each of the plurality of sequence number pairs by measuring similarity; a selection unit that, when a similarity corresponding to each of the plurality of sequence number pairs is generated, selects a sequence number pair having a similarity greater than or equal to a preset reference similarity among the plurality of sequence number pairs; and a display unit that, when at least one first sequence number pair is selected as a result of the selection unit, changes the at least one first sequence number pair into at least one first file name pair by replacing the two sequence numbers included in each pair with the file name of the document corresponding to each sequence number for each of the at least one first sequence number pairs, and then displays the at least one first file name pair as a list on the screen.
[0010] In addition, a method of operation of an electronic device capable of extracting similar document pairs through similarity measurement between documents according to an embodiment of the present invention comprises: maintaining a file storage unit in which document files for each of a plurality of documents are stored; when an extraction request command requesting the extraction of similar document pairs among the plurality of documents is granted by a user, a step of randomly assigning a sequence number to each of the plurality of documents; when a sequence number is randomly assigned to each of the plurality of documents, a step of storing the sequence numbers of the plurality of documents in ascending order in a queue; when the sequence numbers of the plurality of documents are stored in the queue, a step of generating a plurality of sequence number pairs by repeating the process of extracting the sequence numbers of the plurality of documents one by one in ascending order from the queue—whereby the sequence number extracted from the queue is deleted from the queue—and matching the remaining sequence numbers in the queue one by one to the extracted sequence number to form sequence number pairs, until no sequence numbers remain in the queue; and for each of the plurality of sequence number pairs, a similarity between documents according to two sequence numbers included in each sequence number pair The method includes the steps of: generating a similarity corresponding to each of the plurality of sequence number pairs by measuring; when a similarity corresponding to each of the plurality of sequence number pairs is generated, selecting a sequence number pair having a similarity greater than or equal to a preset reference similarity among the plurality of sequence number pairs; and, when at least one first sequence number pair is selected as a result of the selection step, changing the at least one first sequence number pair into at least one first filename pair by replacing the two sequence numbers included in each pair with the filename of the document corresponding to each sequence number for each of the at least one first sequence number pairs, and then displaying the at least one first filename pair as a list on the screen. Effects of the invention
[0011] The electronic device and the method of operation according to the present invention can support a user in performing more efficient document management by measuring the similarity between documents for documents stored on the electronic device, extracting pairs of documents with high similarity, and displaying information about the extracted pairs of documents on a screen. Brief explanation of the drawing
[0012] FIG. 1 is a diagram illustrating the structure of an electronic device capable of extracting similar document pairs through similarity measurement between documents according to an embodiment of the present invention. FIG. 2 is a flowchart illustrating the operation method of an electronic device capable of extracting similar document pairs through similarity measurement between documents according to an embodiment of the present invention. Specific details for implementing the invention
[0013] Embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. This description is not intended to limit the present invention to specific embodiments and should be understood to include all modifications, equivalents, and substitutions that fall within the spirit and scope of the present invention. Similar reference numerals have been used for similar components in describing each drawing, and unless otherwise defined, all terms used in this specification, including technical or scientific terms, have the same meaning as generally understood by a person skilled in the art to which the present invention pertains.
[0014] In this document, when a part is described as "including" a component, it means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, in various embodiments of the present invention, each component, functional block, or means may be composed of one or more sub-components, and the electrical, electronic, or mechanical functions performed by each component may be implemented by various known devices or mechanical elements, such as electronic circuits, integrated circuits, and ASICs (Application Specific Integrated Circuits), and may be implemented separately or two or more may be integrated into one.
[0015] Meanwhile, the blocks in the attached block diagram or the steps in the flowchart may be interpreted as computer program instructions that perform designated functions by being loaded into the processor or memory of data-processing equipment, such as general-purpose computers, specialized computers, portable notebook computers, and network computers. Since these computer program instructions may be stored in memory provided in a computer device or in memory readable by a computer, the functions described in the blocks in the block diagram or the steps in the flowchart may be produced as manufactured products containing means of instruction to perform them. Furthermore, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing a specific logical function(s). Also, it should be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may be executed in a different order than the prescribed order. For example, two blocks or steps shown in succession may be performed substantially simultaneously or in reverse order, and in some cases, some blocks or steps may be omitted.
[0016] FIG. 1 is a diagram illustrating the structure of an electronic device capable of extracting similar document pairs through measuring similarity between documents, according to an embodiment of the present invention.
[0017] Referring to FIG. 1, an electronic device (110) according to one embodiment of the present invention includes a file storage unit (111), a sequence number assignment unit (112), a storage processing unit (113), a generation unit (114), a similarity measurement unit (115), a selection unit (116), and a display unit (117).
[0018] The file storage unit (111) stores document files for each of the multiple documents.
[0019] When an extraction request command is granted by a user requesting to extract a pair of similar documents among the plurality of documents, the sequence assignment unit (112) randomly assigns a sequence number to each of the plurality of documents.
[0020] When a sequence number is randomly assigned to each of the plurality of documents, the storage processing unit (113) stores the sequence numbers of the plurality of documents in ascending order in a queue.
[0021] When the sequence numbers of the plurality of documents are stored in the queue, the generating unit (114) extracts the sequence numbers of the plurality of documents from the queue one by one in ascending order (the sequence numbers extracted from the queue are deleted from the queue), and matches the remaining sequence numbers on the queue to the extracted sequence numbers one by one to form sequence number pairs, repeating this process until no sequence numbers remain on the queue, thereby generating a plurality of sequence number pairs.
[0022] Below, the operation of the sequence assignment unit (112), the storage processing unit (113), and the generation unit (114) will be explained in detail with examples.
[0023] First, let's assume that document files for 'document 1, document 2, document 3, document 4, document 5' are stored on the file storage unit (111).
[0024] At this time, when an extraction request command requesting to extract similar document pairs among ‘document 1, document 2, document 3, document 4, document 5’ is applied to the electronic device (110), the sequence number assignment unit (112) can randomly assign sequence numbers to each of ‘document 1, document 2, document 3, document 4, document 5’ as shown in Table 1 below.
[0026] document Document 1 Document 2 Document 3 Document 4 Document 5 turn 1 2 3 4 5
[0028] In this way, when a sequence number is randomly assigned to each of ‘document 1, document 2, document 3, document 4, document 5’, the storage processing unit (113) can store the sequence numbers of ‘document 1, document 2, document 3, document 4, document 5’ in ascending order in a queue. In this regard, the storage processing unit (113) can store the sequence numbers in the queue in the form of Table 2 below.
[0030] 1 2 3 4 5
[0032] Thus, when the sequence numbers of 'document 1, document 2, document 3, document 4, document 5' are stored in the queue, the generating unit (114) can generate multiple sequence number pairs by repeating the process of extracting the sequence numbers of 'document 1, document 2, document 3, document 4, document 5' from the queue in ascending order one by one (the sequence numbers extracted from the queue are deleted from the queue) and matching the remaining sequence numbers on the queue to the extracted sequence numbers one by one to form sequence number pairs, until no sequence numbers remain on the queue.
[0033] In this regard, the generating unit (114) can generate sequence number pairs such as ‘(1, 2), (1, 3), (1, 4), (1, 5)’ by first extracting a sequence number ‘1’ from the queue and matching the remaining sequence numbers ‘2, 3, 4, 5’ on the queue to the extracted sequence number ‘1’ to form sequence number pairs.
[0034] In this way, the above queue can be changed into the form shown in Table 3 below.
[0036] 2 3 4 5
[0038] After that, the generation unit (114) can generate sequence number pairs such as ‘(2, 3), (2, 4), (2, 5)’ by extracting a sequence number ‘2’ from the queue and matching the remaining sequence numbers ‘3, 4, 5’ on the queue to the extracted sequence number ‘2’ to form sequence number pairs.
[0039] In this way, the above queue can be changed into the form shown in Table 4 below.
[0041] 3 4 5
[0043] After that, the generation unit (114) can generate sequence number pairs such as '(3, 4)' and '(3, 5)' by extracting a sequence number '3' from the queue and matching the remaining sequence numbers '4' and '5' on the queue to the extracted sequence number '3' to form sequence number pairs.
[0044] In this way, the above queue can be changed into the form shown in Table 5 below.
[0046] 4 5
[0048] After that, the generation unit (114) can generate a sequence number pair called '(4, 5)' by extracting a sequence number called '4' from the queue and matching the extracted sequence number called '4' with the remaining sequence number '5' on the queue to form a sequence number pair.
[0049] In this way, the above queue can be changed into the form shown in Table 6 below.
[0051] 5
[0053] After that, the generating unit (114) extracts a sequence number '5' from the queue and performs the task of matching the remaining sequence number on the queue with the extracted sequence number '5' to form a sequence number pair, but since there is no remaining sequence number on the queue, the generating unit (114) can terminate the process of forming the sequence number pair.
[0054] Ultimately, the generating unit (114) can generate multiple pairs of sequence numbers, such as '(1, 2), (1, 3), (1, 4), (1, 5), (2, 3), (2, 4), (2, 5), (3, 4), (3, 5), (4, 5)', by repeating the process of forming sequence number pairs.
[0055] The similarity measuring unit (115), when the generation of the plurality of sequence number pairs is completed through the generation unit (114), generates a similarity corresponding to each of the plurality of sequence number pairs by measuring the similarity between the documents corresponding to the two sequence numbers included in each sequence number pair for each of the plurality of sequence number pairs.
[0056] At this time, according to one embodiment of the present invention, a similarity measuring unit (115) can perform a process of measuring the similarity between documents corresponding to two sequence numbers included in one of the plurality of sequence number pairs, by confirming a first document and a second document corresponding to two sequence numbers included in the sequence number pair, dividing the text included in the first document into pre-set character units to create a plurality of first text groups, dividing the text included in the second document into character units to create a plurality of second text groups, calculating the length of the Longest Common Subsequence (LCS) between text groups of the same sequence number among the plurality of first text groups and the plurality of second text groups, dividing the total sum of the lengths of the calculated LCS by the total number of characters constituting the text included in the first document, and calculating the result value as the similarity.
[0057] In this regard, as in the example above, the plurality of sequence number pairs are said to have been generated as '(1, 2), (1, 3), (1, 4), (1, 5), (2, 3), (2, 4), (2, 5), (3, 4), (3, 5), (4, 5)', and the process of measuring the similarity between documents according to the sequence number '1' and '4' included in '(1, 4)', which is one of the plurality of sequence number pairs, is explained as follows.
[0058] First, if a document assigned a sequence number of '1' is called the first document and a document assigned a sequence number of '4' is called the second document, the similarity measuring unit (115) can divide the text included in the first document into pre-set character units to create a plurality of first text groups and divide the text included in the second document into character units to create a plurality of second text groups.
[0059] In this regard, if the number of characters is defined as '100 characters' including spaces, the similarity measuring unit (115) can divide the text included in the first document into units of '100 characters' to create multiple first text groups, and divide the text included in the second document into units of '100 characters' to create multiple second text groups.
[0060] After that, the similarity measuring unit (115) can calculate the length of the LCS between text groups of the same order among the plurality of first text groups and the plurality of second text groups. Here, LCS means consecutive strings that match in two strings. In this regard, if the two strings are respectively 'ACAYKP' and 'CAPCAK', the LCS between the two strings is 'ACAK', so the length of the LCS between the two strings is '4'.
[0061] In this regard, when the plurality of first text groups are referred to as 'text group 1, text group 2, text group 3, ...' and the plurality of second text groups are referred to as 'text group A, text group B, text group C, ...', the similarity measuring unit (115) can calculate the length of the LCS between text groups of the same order, such as 'text group 1 - text group A', 'text group 2 - text group B', 'text group 3 - text group C', in the plurality of first text groups and the plurality of second text groups, and produce a calculation result for the length of the LCS as shown in Table 7 below.
[0063] Multiple first text groups Multiple second text groups LCS length Text group 1 Text group A LCS 1 Text group 2 Text group B LCS 2 Text group 3 Text group C LCS 3 ... ... ...
[0065] After that, the similarity measuring unit (115) can calculate the total sum of the lengths of the LCS between each text group, 'LCS 1+LCS 2+LCS 3+...', and then divide the total sum by the total number of characters constituting the text included in the first document, and calculate the result value as the similarity between the first document and the second document.
[0066] In this way, the similarity measuring unit (115) can generate a similarity corresponding to each of ‘(1, 2), (1, 3), (1, 4), (1, 5), (2, 3), (2, 4), (2, 5), (3, 4), (3, 5), (4, 5)’ by measuring the similarity between documents according to two sequence numbers included in the sequence number pairs called ‘(1, 2), (1, 3), (1, 4), (1, 5), (2, 3), (2, 4), (2, 5), (3, 4), (3, 5), (4, 5)’.
[0067] At this time, according to one embodiment of the present invention, when the similarity measuring unit (115) calculates the length of the LCS between text groups of the same order among the plurality of first text groups and the plurality of second text groups, if the number of the plurality of first text groups and the number of the plurality of second text groups do not match each other, and a remaining text group is generated in which there is no relative text group of the same order, the length of the LCS for the remaining text group can be calculated as 0.
[0068] In this regard, if, as a result of generating text groups for the first document and the second document, a total of '50' first text groups are generated and a total of '48' second text groups are generated, it is impossible to calculate the length of the LCS for the last two text groups among the multiple first text groups because there is no relative text group with the same sequence number among the multiple second text groups. In this case, the similarity measurement unit (115) can calculate the length of the LCS as 0 for the last two text groups among the multiple first text groups.
[0069] The selection unit (116), when a similarity corresponding to each of the plurality of sequence pairs is generated through the similarity measurement unit (115), selects a sequence pair having a similarity greater than or equal to a preset reference similarity among the plurality of sequence pairs.
[0070] When at least one first sequence number pair is selected as a result of selection by the selection unit (116), the display unit (117) changes the at least one first sequence number pair into at least one first file name pair by replacing the two sequence numbers included in each pair with the file name of the document corresponding to each sequence number for each of the at least one first sequence number pairs, and then displays the at least one first file name pair as a list on the screen.
[0071] Below, the operation of the selection unit (116) and the display unit (117) will be explained in detail with examples.
[0072] First, as in the example above, let us assume that the plurality of sequence pairs are referred to as '(1, 2), (1, 3), (1, 4), (1, 5), (2, 3), (2, 4), (2, 5), (3, 4), (3, 5), (4, 5)', and that the similarity corresponding to each of the plurality of sequence pairs is generated as shown in Table 8 below through the similarity measuring unit (115).
[0074] Multiple sequence pairs Similarity (1, 2) Similarity 1 (1, 3) Similarity 2 (1, 4) Similarity 3 (1, 5) Similarity 4 (2, 3) Similarity 5 (2, 4) Similarity 6 (2, 5) Similarity 7 (3, 4) Similarity 8 (3, 5) Similarity 9 (4, 5) Similarity 10
[0076] Then, the selection unit (116) can select a pair of sequence numbers having a similarity of at least a preset reference similarity (e.g., 0.9) among the plurality of sequence number pairs, '(1, 2), (1, 3), (1, 4), (1, 5), (2, 3), (2, 4), (2, 5), (3, 4), (3, 5), (4, 5)'. In this regard, among 'similarity 1, similarity 2, ..., similarity 10', if 'similarity 1, similarity 3, similarity 6, similarity 7, similarity 9' is said to be at least the reference similarity, the selection unit (116) can select '(1, 2), (1, 4), (2, 4), (2, 5), (3, 5)' as at least one first pair of sequence numbers having a similarity of at least the reference similarity.
[0077] Then, the display unit (117) can change the at least one first sequence number pair into at least one first file name pair such as ‘(file name 1, file name 2), (file name 1, file name 4), (file name 2, file name 4), (file name 2, file name 5), (file name 3, file name 5)’ by replacing the two sequence numbers included in each pair with the file name of the document corresponding to each sequence number for each of the at least one first sequence number pairs.
[0078] Then, the display unit (117) can display the at least one first filename pair, '(filename 1, filename 2), (filename 1, filename 4), (filename 2, filename 4), (filename 2, filename 5), (filename 3, filename 5)', as a list on the screen.
[0079] Through this, the user can view the list displayed on the screen and easily identify documents with high similarity at a glance.
[0080] At this time, according to one embodiment of the present invention, the electronic device (110) may further include a deletion part (118).
[0081] The deletion unit (118), after the at least one first filename pair is displayed as a list through the display unit (117), when a duplicate file removal command for any one of the at least one first filename pairs is issued by the user, checks the third document and the fourth document according to the two filenames included in the filename pair, checks the total number of characters constituting the text included in the third document and the total number of characters constituting the text included in the fourth document, and deletes the document file corresponding to the document with the smaller number of characters among the third document and the fourth document from the file storage unit (111).
[0082] In this regard, let us assume that at least one first pair of filenames, such as '(filename 1, filename 2), (filename 1, filename 4), (filename 2, filename 4), (filename 2, filename 5), (filename 3, filename 5)', is displayed as a list on the screen through the display unit (117).
[0083] In this state, if a duplicate file removal command for one of the filename pairs '(filename 2, filename 4)' among at least one first filename pair '(filename 1, filename 2), (filename 1, filename 4), (filename 2, filename 4), (filename 2, filename 5), (filename 3, filename 5)' is applied to the electronic device (110) from the user, the deletion unit (118) can identify documents corresponding to two filenames included in a filename pair such as '(filename 2, filename 4)'. In this regard, the deletion unit (118) can identify 'document 2' corresponding to 'filename 2' and 'document 4' corresponding to 'filename 4' from a filename pair such as '(filename 2, filename 4)'.
[0084] Then, the deletion unit (118) can check the total number of characters constituting the text included in ‘document 2’ and the total number of characters constituting the text included in ‘document 4’, and delete the document file corresponding to the document with fewer characters among ‘filename 2’ and ‘filename 4’ from the file storage unit (111). For example, if the total number of characters constituting the text included in ‘document 2’ is ‘4800 characters’ and the total number of characters constituting the text included in ‘document 4’ is ‘5000 characters’, the deletion unit (118) can delete the document file corresponding to ‘document 2’ with fewer characters from the file storage unit (111).
[0085] That is, when the document file for 'Document 2' is deleted from the file storage unit (111) where document files for 'Document 1, Document 2, Document 3, Document 4, Document 5' were stored through the deletion unit (118), only the document files for 'Document 1, Document 3, Document 4, Document 5' remain in the file storage unit (111), and through this, the user can more easily perform the duplicate file removal operation.
[0086] At this time, according to one embodiment of the present invention, the electronic device (110) may further include a removal performing unit (119).
[0087] The removal execution unit (119), when a document file for either the third document or the fourth document is deleted from the file storage unit (111) through the deletion unit (118), removes all file name pairs that include the file name of the deleted document file among at least one first file name pair displayed as a list on the screen.
[0088] In this regard, as in the example described above, let us assume that at least one first filename pair is '(filename 1, filename 2), (filename 1, filename 4), (filename 2, filename 4), (filename 2, filename 5), (filename 3, filename 5)', and that a document file for 'document 2' is deleted from the file storage unit (111) through the deletion unit (118).
[0089] Then, the removal execution unit (119) can remove all filename pairs that include ‘filename 2’, which is the filename of a document file for ‘document 2’, among the at least one first filename pair displayed as a list on the screen, ‘(filename 1, filename 2), (filename 1, filename 4), (filename 2, filename 4), (filename 2, filename 5), (filename 3, filename 5)’.
[0090] In this regard, among '(filename 1, filename 2), (filename 1, filename 4), (filename 2, filename 4), (filename 2, filename 5), (filename 3, filename 5)', the filename pairs containing 'filename 2' within the filename pairs are '(filename 1, filename 2), (filename 2, filename 4), (filename 2, filename 5)', so the removal execution unit (119) is able to remove all of '(filename 1, filename 2), (filename 2, filename 4), (filename 2, filename 5), (filename 3, filename 5)' from among '(filename 1, filename 2), (filename 1, filename 4), (filename 2, filename 4), (filename 2, filename 5)' displayed as a list on the screen, and thereby, ultimately, the electronic of the present invention The device (110) displays only '(filename 1, filename 4), (filename 3, filename 5)' as a list on the screen.
[0091] FIG. 2 is a flowchart illustrating the operation method of an electronic device capable of extracting similar document pairs through measuring similarity between documents, according to an embodiment of the present invention.
[0092] In step (S210), a file storage unit is maintained in which document files for each of the multiple documents are stored.
[0093] In step (S220), when an extraction request command is issued by the user requesting to extract similar document pairs among the plurality of documents, a random sequence number is assigned to each of the plurality of documents.
[0094] In step (S230), when a sequence number is randomly assigned to each of the plurality of documents, the sequence numbers of the plurality of documents are stored in a queue in ascending order.
[0095] In step (S240), when the sequence numbers of the plurality of documents are stored in the queue, the sequence numbers of the plurality of documents are extracted one by one in ascending order from the queue (the sequence numbers extracted from the queue are deleted from the queue), and the process of forming sequence number pairs by matching the remaining sequence numbers in the queue to the extracted sequence numbers one by one is repeated until no sequence numbers remain in the queue, thereby generating a plurality of sequence number pairs.
[0096] In step (S250), for each of the plurality of sequence number pairs, a similarity corresponding to each of the plurality of sequence number pairs is generated by measuring the similarity between the documents according to the two sequence numbers included in each sequence number pair.
[0097] In step (S260), when a similarity corresponding to each of the plurality of sequence pairs is generated, a sequence pair having a similarity greater than or equal to a preset reference similarity is selected among the plurality of sequence pairs.
[0098] In step (S270), if at least one first sequence number pair is selected as a result of the selection in step (S260), for each of the at least one first sequence number pairs, the two sequence numbers included in each pair are replaced with the filename of the document corresponding to each sequence number, thereby changing the at least one first sequence number pair into at least one first filename pair, and then the at least one first filename pair is displayed as a list on the screen.
[0099] At this time, according to one embodiment of the present invention, in step (S250), in order to measure the similarity between documents corresponding to two sequence numbers included in any one sequence number pair among the plurality of sequence number pairs, a first document and a second document corresponding to two sequence numbers included in the sequence number pair are identified, and then the text included in the first document is divided into pre-set character units to create a plurality of first text groups, and the text included in the second document is divided into character units to create a plurality of second text groups, and then the length of the LCS between text groups of the same sequence number among the plurality of first text groups and the plurality of second text groups is calculated, and then the total sum of the calculated LCS lengths is divided by the total number of characters constituting the text included in the first document, and the result value is calculated as the similarity.
[0100] At this time, according to one embodiment of the present invention, in step (S250), when calculating the length of the LCS between text groups of the same order among the plurality of first text groups and the plurality of second text groups, if the number of the plurality of first text groups and the number of the plurality of second text groups do not match each other, and a remaining text group is generated in which there is no relative text group of the same order, the length of the LCS for the remaining text group can be calculated as 0.
[0101] In addition, according to one embodiment of the present invention, the method of operating the electronic device may further include the step of, through step (S270), after the at least one first filename pair is displayed as a list, when a duplicate file removal command for any one of the at least one first filename pairs is issued by the user, checking a third document and a fourth document according to the two filenames included in the filename pair, checking the total number of characters constituting the text included in the third document and the total number of characters constituting the text included in the fourth document, and deleting the document file corresponding to the document with fewer characters among the third document and the fourth document from the file storage unit.
[0102] At this time, according to one embodiment of the present invention, the method of operation of the electronic device may further include the step of removing all filename pairs containing a filename for the deleted document file among at least one first filename pair displayed as a list on the screen when a document file for either the third document or the fourth document is deleted from the file storage unit through the deletion step.
[0103] Hereinafter, a method of operation of an electronic device according to an embodiment of the present invention has been described with reference to FIG. 2. Here, since the method of operation of an electronic device according to an embodiment of the present invention may correspond to the configuration of the operation of the electronic device (110) described using FIG. 1, a more detailed description thereof will be omitted.
[0104] A method of operation of an electronic device according to one embodiment of the present invention can be implemented as a computer program stored in a storage medium for execution through combination with a computer.
[0105] In addition, a method of operation of an electronic device according to an embodiment of the present invention may be implemented in the form of computer program instructions for execution through combination with a computer and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either individually or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.
[0106] As described above, the present invention has been explained by specific details such as specific components, limited embodiments, and drawings; however, this is provided merely to aid in a more comprehensive understanding of the invention, and the invention is not limited to the above embodiments. A person skilled in the art can make various modifications and variations from this description.
[0107] Accordingly, the scope of the present invention is not limited to the described embodiments, and all things equivalent to or having equivalent variations to the claims set forth below, as well as the claims set forth below, shall be considered to fall within the scope of the concept of the present invention. Explanation of the symbols
[0108] 110: Electronic device 111: File storage unit 112: Sequence assignment unit 113: Storage processing unit 114: Generation unit 115: Similarity measurement unit 116: Selection unit 117: Display section 118: Deletion section 119: Removal Execution Unit
Claims
Claim 1 An electronic device capable of extracting similar document pairs by measuring similarity between documents, comprising: a file storage unit storing document files for each of a plurality of documents; a sequence assignment unit that randomly assigns a sequence number to each of the plurality of documents when an extraction request command requesting the extraction of similar document pairs among the plurality of documents is authorized from a user; a storage processing unit that stores the sequence numbers of the plurality of documents in ascending order in a queue when a sequence number is randomly assigned to each of the plurality of documents; a generation unit that generates a plurality of sequence number pairs by repeating the process of extracting the sequence numbers of the plurality of documents one by one in ascending order from the queue—whereby the sequence number extracted from the queue is deleted from the queue—and matching the remaining sequence numbers on the queue one by one to the extracted sequence number to form a sequence number pair, until no sequence numbers remain on the queue; and for each of the plurality of sequence number pairs, by measuring the similarity between documents corresponding to the two sequence numbers included in each sequence number pair, thereby the plurality A similarity measuring unit that generates a similarity corresponding to each pair of sequence numbers; a selection unit that, when a similarity corresponding to each of the plurality of sequence number pairs is generated, selects a pair of sequence numbers having a similarity greater than or equal to a preset reference similarity among the plurality of sequence number pairs; and a display unit that, when at least one first pair of sequence numbers is selected as a result of the selection by the selection unit, changes the at least one first pair of sequence numbers into at least one first pair of filenames by replacing the two sequence numbers included in each pair with the filename of the document corresponding to each sequence number for each of the at least one first pair of sequence numbers, and then displays the at least one first pair of filenames as a list on a screen.An electronic device comprising a deletion unit that, after at least one first filename pair is displayed as a list through the display unit, when a duplicate file removal command for any one of the at least one first filename pairs is authorized from the user, checks a third document and a fourth document corresponding to the two filenames included in the filename pair, checks the total number of characters constituting the text included in the third document and the total number of characters constituting the text included in the fourth document, and deletes a document file corresponding to the document with the smaller number of characters among the third document and the fourth document from the file storage unit. Claim 2 An electronic device according to claim 1, wherein the similarity measuring unit performs a process to measure the similarity between documents corresponding to two sequence numbers included in any one of the plurality of sequence number pairs, by identifying a first document and a second document corresponding to two sequence numbers included in the said sequence number pair, dividing the text included in the first document into pre-set character units to create a plurality of first text groups, dividing the text included in the second document into character units to create a plurality of second text groups, calculating the length of the Longest Common Subsequence (LCS) between text groups of the same sequence number among the plurality of first text groups and the plurality of second text groups, and then dividing the total sum of the calculated LCS lengths by the total number of characters constituting the text included in the first document to calculate the resulting value as similarity. Claim 3 An electronic device according to claim 2, wherein the similarity measuring unit, when calculating the length of the LCS between text groups of the same order among the plurality of first text groups and the plurality of second text groups, calculates the length of the LCS as 0 for the remaining text group when the number of the plurality of first text groups and the number of the plurality of second text groups do not match each other, resulting in a remaining text group in which there is no relative text group of the same order. Claim 4 delete Claim 5 An electronic device according to claim 1, further comprising a removal execution unit that, when a document file for any one of the third document and the fourth document is deleted from the file storage unit through the deletion unit, removes all file name pairs containing a file name for the deleted document file among at least one first file name pair displayed as a list on the screen. Claim 6 A method of operation for an electronic device capable of extracting similar document pairs by measuring similarity between documents, comprising: maintaining a file storage unit in which document files for each of a plurality of documents are stored; a step of randomly assigning a sequence number to each of the plurality of documents when an extraction request command requesting the extraction of similar document pairs among the plurality of documents is authorized from a user; a step of storing the sequence numbers of the plurality of documents in ascending order in a queue when the sequence numbers of the plurality of documents are randomly assigned to each of the plurality of documents; a step of generating a plurality of sequence number pairs by repeating the process of extracting the sequence numbers of the plurality of documents one by one in ascending order from the queue—whereby the sequence number extracted from the queue is deleted from the queue—and matching the remaining sequence numbers in the queue one by one to the extracted sequence number to form sequence number pairs, until no sequence numbers remain in the queue; and for each of the plurality of sequence number pairs, measuring the similarity between documents according to the two sequence numbers included in each sequence number pair, thereby the plurality of sequence numbers A step of generating a similarity corresponding to each pair; a step of, when a similarity corresponding to each of the plurality of sequence number pairs is generated, selecting a sequence number pair having a similarity greater than or equal to a preset reference similarity among the plurality of sequence number pairs; a step of, when at least one first sequence number pair is selected as a result of the selection step, changing the at least one first sequence number pair into at least one first filename pair by replacing the two sequence numbers included in each pair with the filename of the document corresponding to each sequence number for each of the at least one first sequence number pairs, and then displaying the at least one first filename pair as a list on the screen;A method of operation of an electronic device comprising the step of, after the at least one first filename pair is displayed as a list through the above-mentioned displaying step, when a duplicate file removal command for any one of the at least one first filename pairs is authorized from the user, confirming a third document and a fourth document corresponding to the two filenames included in the filename pair, confirming the total number of characters constituting the text included in the third document and the total number of characters constituting the text included in the fourth document, and deleting a document file corresponding to the document with the smaller number of characters among the third document and the fourth document from the file storage unit. Claim 7 A method of operation of an electronic device according to claim 6, wherein the step of generating similarity comprises, in order to measure the similarity between documents corresponding to two sequence numbers included in any one of the plurality of sequence number pairs, identifying a first document and a second document corresponding to two sequence numbers included in said sequence number pair, dividing the text included in said first document into pre-set character units to generate a plurality of first text groups, dividing the text included in said second document into character units to generate a plurality of second text groups, calculating the length of the Longest Common Subsequence (LCS) between text groups of the same sequence number among the plurality of first text groups and the plurality of second text groups, dividing the total sum of the calculated LCS lengths by the total number of characters constituting the text included in said first document, and calculating the resulting value as similarity. Claim 8 A method of operation of an electronic device according to claim 7, wherein the step of generating the similarity is characterized by calculating the length of the LCS between text groups of the same order among the plurality of first text groups and the plurality of second text groups, and when the number of the plurality of first text groups and the number of the plurality of second text groups do not match each other, resulting in a residual text group in which there is no relative text group of the same order, the length of the LCS for the residual text group is calculated as 0. Claim 9 delete Claim 10 A method of operation of an electronic device according to claim 6, further comprising the step of removing all filename pairs containing a filename for the deleted document file among at least one first filename pair displayed as a list on the screen, when a document file for either the third document or the fourth document is deleted from the file storage unit through the above-deleting step. Claim 11 A computer-readable recording medium having a computer program for executing the method of any one of paragraphs 6, 7, 8, or 10 through combination with a computer. Claim 12 A computer program stored on a storage medium for executing the method of any one of paragraphs 6, 7, 8, or 10 through combination with a computer.
Citation Information
Patent Citations
Method for evaluating software similarity using stack and apparatus therefor
KR1020150111610A
System and method for associating an extensible set of data with documents downloaded by a web crawler
US6351755B1
Document similarity detection
US7734627B1
