Deduplication method and device for eTMF system, electronic equipment and medium

Abstract

The application discloses an eTMF system duplicate checking method and device, electronic equipment and medium. The eTMF system duplicate checking method comprises the following steps: splitting text information in a to-be-checked file into part text information, and converting the part text information into corresponding to-be-checked information abstracts; searching the to-be-checked information abstracts in a database of an eTMF system, if there is the same information abstract, adding the repeated information corresponding to the information abstract to a repeated information list of the to-be-checked file, wherein the database comprises information abstracts corresponding to each storage file; and judging whether the to-be-checked file has repeated information in the database according to the repeated information list of the to-be-checked file. The application solves the technical problem of low accuracy of duplicate checking of electronic documents in an eTMF system.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of information processing, and particularly relates to an eTMF system duplicate checking method and device, electronic equipment and medium. BACKGROUND

[0002] The clinical research electronic document management system (eTMF, electronic Trial Master File) is a kind of convenient and practical file management system through which a user sets a folder first and then uploads a file to the designated folder. At present, when duplicate checking of electronic documents in the eTMF system is performed, the duplicate files in a database are searched through the file name of the file to be checked, so as to determine whether the file to be checked is stored in the system. However, the duplicate checking method may cause the file name to be different but the file content to be duplicated, or the file name to be the same but the content not to be duplicated, thereby resulting in low accuracy of duplicate checking of electronic documents in the eTMF system. SUMMARY

[0003] The main purpose of the present application is to provide an eTMF system duplicate checking method, device, electronic equipment and medium, and to solve the technical problem of low accuracy of duplicate checking of electronic documents in the eTMF system.

[0004] To achieve the above purpose, the present application provides an eTMF system duplicate checking method, which comprises the following steps:

[0005] Text information in a file to be checked is split into part text information, and each part text information is converted into corresponding information summary to be checked.

[0006] Each information summary to be checked is searched in a database of an eTMF system, if there is the same information summary, the duplicate information corresponding to the information summary is added to a duplicate information list of the file to be checked, wherein the database comprises information summaries corresponding to each stored file.

[0007] According to the duplicate information list of the file to be checked, it is determined whether there is duplicate information of the file to be checked in the database.

[0008] Optionally, the step of splitting the text information in the file to be checked into part text information and converting each part text information into corresponding information summary to be checked comprises the following steps:

[0009] The text information is split into each part text information based on the punctuation in the text information.

[0010] Each part text information is encrypted to obtain the corresponding information summary to be checked.

[0011] Optionally, the step of splitting the text information in the file to be searched into each part of text information and converting each part of text information into a corresponding information digest of the file to be searched comprises:

[0012] Splitting the text information into each part of text information based on the punctuation marks in the text information;

[0013] Adding each part of text information into a list of text information of the file to be searched based on the order of each part of text information in the text information;

[0014] Processing each part of text information in the list of text information by a hash function to obtain a corresponding information digest of each part of text information.

[0015] Optionally, the repeated information comprises the part of text information, the file serial number and the file name corresponding to each information digest, and the step of searching each information digest in the database of the eTMF system, if there is the same information digest, adding the repeated information corresponding to the information digest into a list of repeated information of the file to be searched comprises:

[0016] Obtaining a classification number corresponding to the file to be searched, and determining a database group according to the classification number;

[0017] Searching each information digest in the list of text information in the database group in turn;

[0018] When an information digest matching the information digest of the file to be searched is searched, adding the part of text information, the file serial number and the file name corresponding to the information digest into the list of repeated information.

[0019] Optionally, the repeated information comprises the part of text information, the file serial number and the file name corresponding to each information digest, and the step of searching each information digest in the database of the eTMF system, if there is the same information digest, adding the repeated information corresponding to the information digest into a list of repeated information of the file to be searched comprises:

[0020] Searching each information digest in the database in turn;

[0021] When an information digest matching the information digest of the file to be searched is searched, adding the part of text information, the file serial number and the file name corresponding to the information digest into the list of repeated information.

[0022] Optionally, before the step of splitting the text information in the file to be searched into each part of text information, further comprising:

[0023] The suffix information of the file to be checked is intercepted to determine whether the file to be checked is a document format file;

[0024] If yes, the format of the file to be checked is converted into txt format, and the text information of the file to be checked is extracted.

[0025] Optionally, the step of determining whether the file to be checked has repeated information in the database according to the repeated information list of the file to be checked comprises:

[0026] If the repeated information list is empty, it is determined that the file to be checked does not have repeated information in the database;

[0027] If the repeated information list is not empty, each information digest corresponding to the partial text information, the file serial number and the file name in the repeated information list are pushed to the user to show the repeated information in the file to be checked to the user, wherein the repeated information is used for the user to refer to whether to continue uploading the file to be checked.

[0028] The application also provides an eTMF system duplicate checking device, which is applied to an eTMF system duplicate checking equipment, and comprises:

[0029] An information digest module is configured to split the text information in a file to be checked into partial text information, and convert each piece of partial text information into a corresponding information digest of the file to be checked;

[0030] An information comparison module is configured to search each information digest of the file to be checked in a database of an eTMF system, and if there is a same information digest, add repeated information corresponding to the information digest to a repeated information list of the file to be checked, wherein the database comprises information digests corresponding to each stored file;

[0031] A duplicate checking judgment module is configured to determine whether the file to be checked has repeated information in the database according to the repeated information list of the file to be checked.

[0032] Optionally, the information digest module is further configured to:

[0033] Split the text information into each piece of partial text information based on punctuation marks in the text information;

[0034] Encrypt each piece of partial text information to obtain an information digest corresponding to each piece of partial text information.

[0035] Optionally, the information digest module is further configured to:

[0036] splitting the text information into the partial text information based on the punctuation in the text information;

[0037] adding the partial text information into a text information list of the file to be searched based on the order of the partial text information in the text information;

[0038] processing the partial text information in the text information list by a hash function to obtain a to-be-searched information digest corresponding to the partial text information.

[0039] Optionally, the information comparison module is further configured to:

[0040] obtaining a classification number corresponding to the file to be searched, and determining a database group according to the classification number;

[0041] sequentially searching the to-be-searched information digest in the database group;

[0042] when a to-be-searched information digest matching the to-be-searched information digest is searched, adding the partial text information, the file serial number and the file name corresponding to the to-be-searched information digest into the repeated information list.

[0043] Optionally, the information comparison module is further configured to:

[0044] sequentially searching the to-be-searched information digest in the database group;

[0045] when a to-be-searched information digest matching the to-be-searched information digest is searched, adding the partial text information, the file serial number and the file name corresponding to the to-be-searched information digest into the repeated information list.

[0046] Optionally, the information digest module is further configured to:

[0047] determining whether the file to be searched is a document format file by intercepting suffix information of the file to be searched;

[0048] if yes, converting the format of the file to be searched into txt format, and extracting text information of the file to be searched.

[0049] Optionally, the duplicate judgment module is further configured to:

[0050] if the repeated information list is empty, determining that the file to be searched does not exist in the database;

[0051] If the duplicate information list is not empty, the user is pushed with the part text information, file serial number and file name corresponding to each information digest in the duplicate information list to show the user the duplicate information in the to-be-searched file, wherein the duplicate information is used for the user to refer to whether to continue uploading the to-be-searched file.

[0052] The application further provides an electronic device, which is a physical device, and the electronic device comprises a memory, a processor, and a program of the eTMF system duplicate checking method stored in the memory and executable on the processor, and the program of the eTMF system duplicate checking method can realize the steps of the eTMF system duplicate checking method when executed by the processor.

[0053] The application further provides a computer readable storage medium, which stores a program of an eTMF system duplicate checking method, and the program of the eTMF system duplicate checking method realizes the steps of the eTMF system duplicate checking method when executed by a processor.

[0054] The application further provides a computer program product, which comprises a computer program, and the computer program realizes the steps of the eTMF system duplicate checking method when executed by a processor.

[0055] The application provides an eTMF system duplicate checking method and device, an electronic device and a medium. First, text information in a to-be-searched file is split into part text information, and each part text information is converted into a corresponding to-be-searched information digest. Then, each to-be-searched information digest is searched in a database of an eTMF system. If there is a same information digest, duplicate information corresponding to the information digest is added to a duplicate information list of the to-be-searched file. The database comprises information digests corresponding to each stored file. Then, whether the to-be-searched file has duplicate information in the database is determined according to the duplicate information list of the to-be-searched file. The application extracts part text information from text information in an electronic document and converts the part text information into an information digest form to compare with information digests corresponding to stored files in the database, realizes duplicate checking based on the content of the electronic document, overcomes technical defects caused by duplicate checking based on only file names of electronic documents, and improves the duplicate checking accuracy of electronic documents in the eTMF system. BRIEF DESCRIPTION OF DRAWINGS

[0056] The accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments consistent with the present application and, together with the description, further serve to explain the principles of the application.

[0057] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, for those of ordinary skill in the art, the other drawings can be obtained based on these drawings without any creative effort.

[0058] Figure 1 A flowchart of the eTMF system duplicate checking method according to the first embodiment of the present application;

[0059] Figure 2 A flowchart of steps A10 to A60 in the eTMF system duplicate checking method according to the first embodiment of the present application;

[0060] Figure 3 A flowchart of steps S30 to S32 in the eTMF system duplicate checking method according to the first embodiment of the present application;

[0061] Figure 4 A structural composition diagram of the eTMF system duplicate checking device according to the present application;

[0062] Figure 5 A device structure diagram of the hardware running environment involved in the eTMF system duplicate checking method according to the embodiments of the present application.

[0063] The object implementation, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0064] In order to make the above object, features and advantages of the present application more apparent and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without any creative effort fall within the scope of protection of the present application.

[0065] Embodiment One

[0066] The electronic document management system is a kind of convenient and practical file management system by setting folder first and then uploading file to the designated folder, at present, when the repeated inspection of electronic document is carried out in the electronic document management system, the repeated files in the database are searched by the file name of the file to be inspected, so as to judge whether the file repeated with the file to be inspected has been stored in the system, but this repeated inspection method may appear the case that the file name is different but the file content is repeated, or the file name is the same but the content is not repeated, so as to cause the low accuracy of the repeated inspection of electronic document in the electronic document management system, the eTMF system repeated inspection method in the application is applied in the clinical research electronic document management system, which can simplify the clinical trial research process and standardize the management of the documents and files produced by clinical trial.

[0067] The eTMF system repeated inspection method provided in the embodiments of the application, in the first embodiment of the eTMF system repeated inspection method of the application, referring to Figure 1 , the eTMF system repeated inspection method comprises:

[0068] Step S10, the text information in the file to be inspected is divided into each part of text information, and each part of text information is converted into corresponding information summary to be inspected;

[0069] Step S20, each information summary to be inspected is searched in the database of the eTMF system, if the same information summary exists, the repeated information corresponding to the information summary is added to the repeated information list of the file to be inspected, wherein the database comprises information summary corresponding to each stored file;

[0070] Step S30, according to the repeated information list of the file to be inspected, it is judged whether the file to be inspected has repeated information in the database.

[0071] In the embodiments of the application, it should be noted that the file to be inspected is a file uploaded to the database by the user, and the format is document format, including PDF (Portable Document Format, portable document format) and word (text) and other formats, the part of text information is each text information divided by each punctuation mark, such as “,.?!” and the like, in the application, each text information is taken as a repeated inspection unit, and the repeated inspection of the file to be inspected in the database is carried out.

[0072] As an example, steps S10 to S30 include: performing text segmentation on the file to be searched uploaded by the user to the database to generate text information for each part; performing one-way encryption on each part of the text information to generate a summary of the information to be searched corresponding to each part of the text information; matching each summary of the information to be searched in the database, and if a summary of information that matches the summary of the information to be searched is found, adding the duplicate information corresponding to the summary of information to the duplicate information list of the file to be searched to characterize the duplicate content of the file to be searched in the database, wherein the database includes the summary of information corresponding to each stored file; after each summary of information to be searched has been searched, determining whether the file to be searched has duplicate information in the database based on the duplicate information in the duplicate information list of the file to be searched.

[0073] The step of splitting the text information in the file to be searched into various parts of text information and converting each part of text information into a corresponding summary of the information to be searched includes:

[0074] Step S11: Based on the punctuation marks in the text information, the text information is split into the respective partial text information;

[0075] Step S12: Encrypt each of the aforementioned partial text information to obtain the information summary to be searched corresponding to each of the aforementioned partial text information.

[0076] In this embodiment of the application, it should be noted that the encryption process can be to perform one-way hash calculation on the partial text information through a hash function to generate a uniform-length MD5 (Message-Digest Algorithm 5) form. The MD5 forms of the message digests to be searched generated by different partial text information are different. Therefore, by comparing the message digests to be searched with the message digests in the database, it can be determined whether there are the same partial text information in the database.

[0077] As an example, steps S11 to S12 include: dividing the text information into several parts by marking the punctuation marks in the text information, wherein each part of the text information contains one or a group of punctuation marks to divide the part of the text information; and generating a corresponding MD5-format summary of the information to be searched by calculating each part of the text information using a hash function.

[0078] Among them, reference Figure 2 The step of splitting the text information in the file to be searched into various parts of text information and converting each part of text information into a corresponding summary of the information to be searched includes:

[0079] Step A10, splitting the text information into each part of text information based on the punctuation marks in the text information;

[0080] Step A20, adding each part of text information into the text information list of the file to be searched based on the order of each part of text information in the text information;

[0081] Step A30, processing each part of text information in the text information list by a hash function to obtain the corresponding information digest of each part of text information to be searched.

[0082] In the embodiments of the present application, it should be noted that the text information list is used to store each part of text information of the file to be searched and the corresponding information digest, and the order is the row and column order of each part of text information in the text information.

[0083] As an example, steps A10 to A30 include: splitting the text information into each part of text information by marking the punctuation marks in the text information, wherein each part of text information contains one or a group of punctuation marks to divide the part of text information; adding each part of text information into the text information list of the file to be searched, wherein the order of each part of text information in the text information list is determined according to the row and column order of each part of text information in the text information; and calculating each part of text information in the text information list by a hash function to generate the corresponding information digest in the form of MD5, wherein each information digest is stored in the text information list.

[0084] The repeated information includes the part of text information, the file serial number and the file name corresponding to each information digest, and the step of searching each information digest in the database of the eTMF system and adding the repeated information corresponding to the information digest to the repeated information list of the file to be searched if the same information digest exists includes: Figure 2

[0085] Step A40, obtaining the classification number corresponding to the file to be searched and determining the database group according to the classification number;

[0086] Step A50, searching each information digest in the text information list in the database group in turn;

[0087] Step A60, when the information digest matching the information digest to be searched is searched, adding the part of text information, the file serial number and the file name corresponding to the information digest to the repeated information list.

[0088] ​In the embodiments of the present application, it should be noted that the classification number is the category corresponding to the to-be-searched file, such as a test plan, test data, and test results, so as to avoid a large range of queries when searching in the database, thereby improving the search efficiency; the to-be-searched information abstracts match the respective corresponding partial text information consistent with the information abstracts, that is, the database contains repeated content parts of the to-be-searched file; and the repeated information list is used to store the repeated content of each part of the text information of the to-be-searched file in the database, so as to provide the user with a judgment on whether to stop uploading the file according to the degree of repeated content.

[0089] As an example, steps A40 to A60 include: obtaining the classification number corresponding to the to-be-searched file, and querying the corresponding database group in the database according to the classification number; sequentially searching each to-be-searched information abstract in the database according to the order of each to-be-searched information abstract in the text information list, and judging whether there is a file with the same partial text information in the database; when an information abstract matching the to-be-searched information abstract is searched, adding the partial text information, file serial number, and file name corresponding to the information abstract to the repeated information list; and if a matching information abstract is not searched throughout the search process, it is determined that there is no file with the same partial text information as each part of the text information in the to-be-searched file in the database, that is, the repeated information list is empty.

[0090] The repeated information includes the partial text information, file serial number, and file name corresponding to each information abstract, and the step of searching each to-be-searched information abstract in the database of the eTMF system and adding the repeated information corresponding to the information abstract to the repeated information list of the to-be-searched file if there is the same information abstract includes:

[0091] Step S21, each to-be-searched information abstract is searched in the database, respectively;

[0092] Step S22, when an information abstract matching the to-be-searched information abstract is searched, the partial text information, file serial number, and file name corresponding to the information abstract are added to the repeated information list.

[0093] As an example, steps S21 to S22 include: searching each of the information digests to be searched in the database to determine whether there are files with the same partial text information in the database; when an information digest matching the information digest to be searched is found, adding the partial text information, file number, and file name corresponding to the information digest to the duplicate information list; if no matching information digest is found throughout the entire search process, it is determined that there is no partial text information in the database that is the same as each part of the text information in the file to be searched, that is, the duplicate information list is empty.

[0094] In addition, before the step of splitting the text information in the file to be searched into its constituent parts, the following steps are also included:

[0095] Step B10: Determine whether the file to be checked is a document format file by extracting the file extension information of the file to be checked;

[0096] Step B20: If yes, convert the format of the file to be checked to txt format and extract the text information of the file to be checked.

[0097] In this embodiment of the application, it should be noted that the suffix information is used to characterize the format of the file to be searched. By converting the document format file into txt format, it is easier to extract and split the text information.

[0098] As an example, steps B10 to B20 include: extracting the suffix of the name of the file to be checked, and determining whether the file format is Word or PDF based on the suffix; if the file is not Word or PDF, pushing a visual reminder to the user to indicate that the file cannot be checked for plagiarism; if the file is Word or PDF, converting it to TXT format; extracting text information from the TXT file, wherein the text information is used to split into the respective parts of text information.

[0099] Among them, reference Figure 3 The step of determining whether the file to be searched has duplicate information in the database based on the duplicate information list of the file to be searched includes:

[0100] Step S31: If the duplicate information list is empty, it is determined that the file to be searched does not have duplicate information in the database;

[0101] In step S32, if the repeated information list is not empty, the part of text information, file serial number and file name corresponding to each information digest in the repeated information list are pushed to the user to show the repeated information in the to-be-searched file to the user, wherein the repeated information is used for the user to refer to whether to continue uploading the to-be-searched file.

[0102] In the embodiments of the present application, it should be noted that each information digest can be MD5 information, and the user can judge the number and importance of the repeated information in the repeated information list according to the actual situation, for example, if the number of repeated information is small or the repeated content belongs to template type text, etc., it can be considered that the repetition degree of the to-be-searched file is not high, that is, the to-be-searched file can be continued to be uploaded.

[0103] As an example, steps S31 to S32 include: if the repeated information list is empty, it is determined that the to-be-searched file does not have repeated information in the database, and a visual prompt is pushed to the user to prompt the user that the to-be-searched file has no repeated text information in the database; if the repeated information list is not empty, the part of text information, file serial number and file name corresponding to each MD5 information in the repeated information list are pushed to the user to show the repeated information in the to-be-searched file to the user, wherein the repeated information is used for the user to refer to whether to continue uploading the to-be-searched file.

[0104] The embodiments of the present application provide an eTMF system duplicate checking method, first, the text information in the to-be-searched file is split into each part of text information, and each part of text information is converted into a corresponding to-be-searched information digest, and then each to-be-searched information digest is searched in the database of the eTMF system, if there is the same information digest, the repeated information corresponding to the information digest is added to the repeated information list of the to-be-searched file, wherein the database includes the information digest corresponding to each stored file, and then according to the repeated information list of the to-be-searched file, it is judged whether the to-be-searched file has repeated information in the database, the embodiments of the present application extract each part of text information from the text information in the electronic document and then convert it into an information digest form to compare with the information digest corresponding to the stored file in the database, realize the duplicate checking based on the content of the electronic document, start from the essence of document duplication, that is, content duplication, overcome the technical defects brought by the duplicate checking of the electronic document only through the file name of the electronic document, and improve the duplicate checking accuracy of the electronic document in the electronic document management system.

[0105] Embodiment two

[0106] The embodiments of the present application also provide an eTMF system duplicate checking device, which is applied to an eTMF system duplicate checking equipment, and the eTMF system duplicate checking device is used for Figure 4The eTMF system duplicate checking device comprises:

[0107] An information summary module is configured to split text information in a file to be checked into partial text information, and convert the partial text information into corresponding information summaries to be checked.

[0108] An information comparison module is configured to search the information summaries to be checked in a database of an eTMF system, and if there is a same information summary, add the duplicate information corresponding to the information summary to a duplicate information list of the file to be checked, wherein the database comprises information summaries corresponding to stored files.

[0109] A duplicate checking judgment module is configured to judge whether the file to be checked has duplicate information in the database according to the duplicate information list of the file to be checked.

[0110] Optionally, the information summary module is further configured to:

[0111] split the text information into the partial text information based on punctuation marks in the text information;

[0112] encrypt the partial text information to obtain the information summaries to be checked corresponding to the partial text information.

[0113] Optionally, the information summary module is further configured to:

[0114] split the text information into the partial text information based on punctuation marks in the text information;

[0115] add the partial text information into a text information list of the file to be checked based on the order of the partial text information in the text information;

[0116] process the partial text information in the text information list by a hash function to obtain the information summaries to be checked corresponding to the partial text information.

[0117] Optionally, the information comparison module is further configured to:

[0118] obtain a classification number corresponding to the file to be checked, and determine a database group according to the classification number;

[0119] search the information summaries in the text information list in the database group in sequence;

[0120] when an information summary matching the information summary to be checked is searched, add the partial text information, a file serial number and a file name corresponding to the information summary to the duplicate information list.

[0121] Optionally, the information comparison module is further configured to:

[0122] searching the database for each piece of the to-be-searched information digest;

[0123] when an information digest matching the to-be-searched information digest is searched, adding the partial text information, the file serial number and the file name corresponding to the information digest to the repeated information list.

[0124] Optionally, the information digest module is further configured to:

[0125] determining whether the to-be-searched file is a document format file by intercepting the suffix information of the to-be-searched file;

[0126] if yes, converting the format of the to-be-searched file into txt format and extracting the text information of the to-be-searched file.

[0127] Optionally, the duplicate judgment module is further configured to:

[0128] if the repeated information list is empty, determining that the to-be-searched file does not have repeated information in the database;

[0129] if the repeated information list is not empty, pushing the partial text information, the file serial number and the file name corresponding to each piece of information digest in the repeated information list to a user to show the repeated information in the to-be-searched file to the user, wherein the repeated information is used for the user to refer to whether to continue uploading the to-be-searched file.

[0130] The eTMF system duplicate checking device provided in the application adopts the eTMF system duplicate checking method in the above-mentioned embodiments, and solves the technical problem of low accuracy of duplicate checking of electronic documents in the eTMF system. Compared with the prior art, the eTMF system duplicate checking device provided in the embodiments of the application has the same beneficial effects as the eTMF system duplicate checking method provided in the above-mentioned embodiments, and other technical features in the eTMF system duplicate checking device are the same as the features disclosed in the previous embodiment method, which will not be repeated here.

[0131] Embodiment three

[0132] The embodiments of the application provide an electronic device, which comprises at least one processor and a memory communicatively linked with the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the eTMF system duplicate checking method in the above-mentioned embodiment one.

[0133] Reference will be made to the following Figure 5The diagram illustrates a structural schematic of an electronic device suitable for implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0134] like Figure 5 As shown, an electronic device may include a processing unit (such as a central processing unit, graphics processing unit, etc.) that can perform various appropriate actions and processes based on a program stored in read-only memory (ROM) or a program loaded from a storage device into random access memory (RAM). The RAM also stores various programs and data required for the operation of the electronic device. The processing unit, ROM, and RAM are interconnected via a bus. Input / output (I / O) interfaces are also linked to the bus.

[0135] Typically, the following systems can be linked to the I / O interface: input devices such as touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices such as liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices such as magnetic tapes, hard disks, etc.; and communication devices. Communication devices allow electronic devices to communicate wirelessly or wiredly with other devices to exchange data. Although electronic devices with various systems are shown in the figures, it should be understood that it is not required to implement or possess all the systems shown. More or fewer systems may be implemented alternatively.

[0136] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, it performs the functions defined above in the methods of embodiments of this disclosure.

[0137] The electronic device provided in the application adopts the eTMF system duplicate checking method in the above embodiment, and solves the technical problem of low accuracy of electronic document duplicate checking in the eTMF system. Compared with the prior art, the electronic device provided in the embodiment of the application has the same beneficial effects as the eTMF system duplicate checking method provided in the above embodiment, and other technical features in the electronic device are the same as the features disclosed in the previous embodiment method, which will not be repeated here.

[0138] It should be understood that parts of the present disclosure can be implemented in hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0139] The above is merely specific implementation of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical range disclosed in the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0140] Embodiment four

[0141] The embodiment provides a computer readable storage medium having computer readable program instructions stored thereon, and the computer readable program instructions are used for executing the eTMF system duplicate checking method in the above embodiment one.

[0142] The computer readable storage medium provided in the embodiment of the application may, for example, be a U disk, but is not limited to an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, system or device, or any combination thereof. More specific examples of the computer readable storage medium can include, but are not limited to, an electric link with one or more conductive lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the embodiment, the computer readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer readable storage medium can be transmitted by any appropriate medium, including but not limited to: electric wire, optical cable, RF (radio frequency), etc., or any suitable combination thereof.

[0143] The above computer readable storage medium can be contained in the electronic device; or can exist separately without being assembled into the electronic device.

[0144] The computer readable storage medium carries one or more programs, when the one or more programs are executed by the electronic device, the electronic device is caused to: split text information in a to-be-searched file into part text information, and convert the part text information into corresponding to-be-searched information digest; search the to-be-searched information digest in a database of an eTMF system, if there is the same information digest, add the repeated information corresponding to the information digest to a repeated information list of the to-be-searched file, wherein the database includes information digest corresponding to each storage file; and determine whether the to-be-searched file has repeated information in the database according to the repeated information list of the to-be-searched file.

[0145] Computer program code for carrying out operations of the present disclosure can be written in any of one or more programming languages, including object oriented programming languages such as Java, Smalltalk, C++, or conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer can be linked to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0146] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of systems, methods, and computer program products according to various embodiments disclosed in this application. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flow diagrams, and combinations thereof, can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or combinations of special purpose hardware and computer instructions.

[0147] The modules described in the embodiments of the present disclosure can be implemented by software, or can be implemented by hardware. In some cases, the name of the module does not constitute a limitation on the module itself.

[0148] The computer readable storage medium provided by the application stores computer readable program instructions for executing the eTMF system duplicate checking method described above, and solves the technical problem of low accuracy of electronic document duplicate checking in the eTMF system. Compared with the prior art, the beneficial effects of the computer readable storage medium provided by the embodiments of the application are the same as those of the eTMF system duplicate checking method provided by the above embodiments, and are not described here.

[0149] Embodiment five

[0150] The application also provides a computer program product, comprising a computer program, which, when executed by a processor, implements the steps of the eTMF system duplicate checking method as described above.

[0151] The computer program product provided by the application solves the technical problem of low accuracy of electronic document duplicate checking in the eTMF system. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiments of the application are the same as those of the eTMF system duplicate checking method provided by the above embodiments, and are not described here.

[0152] The above is only the preferred embodiment of the application, and does not limit the patent scope of the application, and any equivalent structure or equivalent process transformation using the content of the specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent processing scope of the application.

Claims

1. An eTMF system duplicate checking method, characterized in that, The eTMF system duplicate checking method comprises the following steps: Splitting the text information in the to-be-checked file into part text information, and converting each part text information into corresponding to-be-checked information digest; Searching each to-be-checked information digest in the database of the eTMF system, if there is the same information digest, adding the duplicate information corresponding to the information digest into the duplicate information list of the to-be-checked file, wherein the database comprises information digests corresponding to each stored file; According to the duplicate information list of the to-be-checked file, judging whether the to-be-checked file has duplicate information in the database; The duplicate information comprises part text information, file serial number and file name corresponding to each information digest, and the step of searching each to-be-checked information digest in the database of the eTMF system, if there is the same information digest, adding the duplicate information corresponding to the information digest into the duplicate information list of the to-be-checked file comprises the following steps: Obtaining the classification number corresponding to the to-be-checked file, and determining the database group according to the classification number; Searching each to-be-checked information digest in the text information list in the database group in sequence; When the information digest matching the to-be-checked information digest is searched, adding the part text information, file serial number and file name corresponding to the information digest into the duplicate information list.

2. The eTMF system duplicate detection method of claim 1, wherein, The step of splitting the text information in the to-be-checked file into part text information, and converting each part text information into corresponding to-be-checked information digest comprises the following steps: Splitting the text information into part text information based on the punctuation in the text information; Encrypting each part text information to obtain the to-be-checked information digest corresponding to each part text information.

3. The eTMF system duplicate detection method of claim 1, wherein, The step of splitting the text information in the to-be-checked file into part text information, and converting each part text information into corresponding to-be-checked information digest comprises the following steps: Splitting the text information into part text information based on the punctuation in the text information; Adding each part text information into the text information list of the to-be-checked file based on the sequence of each part text information in the text information; Processing each part text information in the text information list by a hash function to obtain the to-be-checked information digest corresponding to each part text information.

4. The eTMF system duplicate detection method of claim 1, wherein, The duplicate information comprises part text information, file serial number and file name corresponding to each information digest, and the step of searching each to-be-checked information digest in the database of the eTMF system, if there is the same information digest, adding the duplicate information corresponding to the information digest into the duplicate information list of the to-be-checked file comprises the following steps: Searching each to-be-checked information digest in the database in sequence; When the information digest matching the to-be-checked information digest is searched, adding the part text information, file serial number and file name corresponding to the information digest into the duplicate information list.

5. The eTMF system duplicate detection method of claim 1, wherein, Before the step of splitting the text information in the to-be-checked file into part text information, the method further comprises the following steps: The suffix information of the to-be-searched file is intercepted to determine whether the to-be-searched file is a document format file. If yes, the format of the to-be-searched file is converted into txt format, and the text information of the to-be-searched file is extracted.

6. The eTMF system duplicate detection method of claim 1, wherein, The step of determining whether the to-be-searched file has repeated information in the database according to the repeated information list of the to-be-searched file includes: If the repeated information list is empty, it is determined that the to-be-searched file does not have repeated information in the database. If the repeated information list is not empty, the part of text information, file serial number and file name corresponding to each information digest in the repeated information list are pushed to the user to show the repeated information in the to-be-searched file to the user, wherein the repeated information is used for the user to refer to whether to continue uploading the to-be-searched file.

7. An eTMF system duplicate detection device, characterized by, The eTMF system duplicate checking device includes: An information digest module is configured to split the text information in the to-be-searched file into each part of text information, and convert each part of text information into a corresponding to-be-searched information digest. An information comparison module is configured to search each to-be-searched information digest in the database of the eTMF system, if there is the same information digest, add the repeated information corresponding to the information digest to the repeated information list of the to-be-searched file, wherein the database includes the information digest corresponding to each stored file. A duplicate checking judgment module is configured to determine whether the to-be-searched file has repeated information in the database according to the repeated information list of the to-be-searched file. The repeated information includes each part of text information, file serial number and file name corresponding to each information digest, and the information comparison module is further configured to: obtain the classification number corresponding to the to-be-searched file, determine the database grouping according to the classification number; search each to-be-searched information digest in the text information list in the database grouping in turn; when the information digest matching the to-be-searched information digest is searched, add the part of text information, file serial number and file name corresponding to the information digest to the repeated information list.

8. An electronic device, comprising: The electronic device includes: At least one processor; and The memory is communicatively linked with the at least one processor; wherein The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the eTMF system duplicate checking method of any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a program for implementing the eTMF system duplicate checking method, and the program for implementing the eTMF system duplicate checking method is executed by the processor to implement the steps of the eTMF system duplicate checking method of any one of claims 1 to 6.

Images