Method and system for building book database based on metadata management

Abstract

The present invention discloses a method and system for constructing a book database based on metadata management. The system comprises: a book database, a metadata collection device, a metadata processing device, a metadata management device, a metadata database, and a user query device; the book database is used to store electronic books; the metadata collection device is used to collect metadata information corresponding to the electronic books and send the collected metadata information to the metadata processing device; the metadata processing device is used to obtain the metadata information collected by the metadata collection device and process the metadata information; the metadata database is used to store the metadata information; the metadata management device is used to control the collection function of the metadata collection device and manage the metadata information stored in the metadata database; the user query device is used to query the metadata database and obtain the electronic books stored in the book database.

Description

Technical Field

[0001] The invention belongs to the field of information technology, and in particular relates to a book database construction method and system based on metadata management. Background Art

[0002] Electronic books have the advantages of being easy to obtain, search and use, and have occupied an important position in library business. The collection system of existing libraries is also gradually developing towards the direction of electronic books. At present, the electronic books in libraries are mainly carried by databases. How to effectively manage electronic books has become an important research direction for library collection resource management. The application research of electronic books currently includes metadata description, metadata-based resource integration, sharing, etc.

[0003] Metadata, also known as "data about data", is descriptive data information about data. It is used to describe various characteristics of data and background information of data, and can be used to improve the efficiency of using data sets. How to build a technical solution based on metadata management so that users can use e-books efficiently has become an urgent problem to be solved in this field. Summary of the invention

[0004] The present invention provides a book database construction system based on metadata management, the system comprising: a book database, a metadata collection device, a metadata processing device, a metadata management device, a metadata database, and a user query device;

[0005] The book database is connected to the metadata collection device and the user query device;

[0006] The metadata collection device, metadata processing device, metadata database, and user query device are connected in sequence; the metadata management device is connected to the metadata collection device, the metadata database, and the book database respectively;

[0007] The book database is used to store electronic books;

[0008] The metadata collection device is used to collect metadata information corresponding to the electronic book, and send the collected metadata information to the metadata processing device;

[0009] The metadata processing device is used to obtain the metadata information collected by the metadata collection device and process the metadata information;

[0010] The metadata database is used to store the metadata information;

[0011] The metadata management device is used to control the collection function of the metadata collection device and manage the metadata information stored in the metadata database;

[0012] The user query device is used to query the metadata database and obtain the electronic books stored in the book database.

[0013] The present invention also relates to a method for constructing a book database based on metadata management, the method comprising the following steps:

[0014] S1. Establishing a database for storing electronic books, wherein the electronic books include the full text of the book and / or the bibliographic information of the book and / or the book abstract;

[0015] S2. Establishing a metadata database for storing metadata information;

[0016] S3. Use a metadata collection device to collect metadata information corresponding to the electronic book, each of which includes the following metadata fields: title, language, publisher, publication date, subject classification, book database location address, and copyright authorization status;

[0017] S4. Use the metadata collection device to send the collected metadata information to the metadata processing device;

[0018] S5. Using the metadata processing device to obtain the metadata information collected by the metadata collection device, and processing the metadata information;

[0019] S6. Use the metadata management device to control the collection function of the metadata collection device and manage the metadata information stored in the metadata database;

[0020] S7. Use the user query device to query the metadata database and obtain the electronic books stored in the book database.

[0021] The technical solution of the present invention is based on metadata management, and constructs a system that can automatically collect electronic book metadata, provide users with convenient and accurate metadata retrieval results and corresponding electronic book data, reduce library construction costs, and improve user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a structural block diagram of the book database construction system based on metadata management of the present invention. DETAILED DESCRIPTION

[0023] The present invention will be further described below in conjunction with the accompanying drawings. The following examples are only used to more clearly illustrate the technical solution of the present invention, and cannot be used to limit the scope of protection of the present invention. It should be pointed out that the following detailed description is exemplary and is intended to provide further explanation of the present invention.

[0024] Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those generally understood by those of ordinary skill in the art to which the present invention belongs. It should be noted that the terms used herein are only for the purpose of describing specific embodiments and are not intended to limit exemplary embodiments according to the present invention. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "comprising" and / or "including" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or combinations thereof.

[0025] Embodiment 1 of the present invention relates to a book database construction system based on metadata management, the system comprising: a book database, a metadata collection device, a metadata processing device, a metadata management device, a metadata database, and a user query device. The book database is connected to the metadata collection device and the user query device. The metadata collection device, the metadata processing device, the metadata database, and the user query device are connected in sequence. The metadata management device is respectively connected to the metadata collection device, the metadata database, and the book database.

[0026] The book database is used to store electronic books, and the electronic books include the full text of the books and / or the bibliographic information of the books and / or the book abstracts.

[0027] The metadata collection device is used to collect metadata information corresponding to the electronic book, and each item of the metadata information includes the following metadata fields: title, language, publisher, publication date, subject classification, book database location address, and copyright authorization status.

[0028] The title is specifically the title of the electronic book corresponding to the metadata information stored in the book database; the language is specifically the writing language of the electronic book corresponding to the metadata information stored in the book database; the publisher is specifically the publisher of the electronic book corresponding to the metadata information stored in the book database; the publication date is specifically the publication date recorded in the electronic book corresponding to the metadata information stored in the book database; the subject classification is specifically the subject classification of the electronic book corresponding to the metadata information stored in the book database, for example, the subject classification of the electronic book set according to the higher education major announced by the Ministry of Education; the book database location address is specifically the storage address of the electronic book corresponding to the metadata information stored in the book database; the copyright authorization status is specifically the copyright authorization status of the electronic book corresponding to the metadata information stored in the book database, including obtaining full copyright authorization, not obtaining copyright authorization, and obtaining partial copyright authorization.

[0029] The metadata collection device sends the collected metadata information to the metadata processing device.

[0030] The metadata processing device is used to obtain the metadata information collected by the metadata collecting device and process the metadata information.

[0031] The metadata processing device includes a data monitoring module, a missing data processing module, an abnormal data processing module, a duplicate data processing module, a state feedback module, and a data output module.

[0032] The data monitoring module is used to compare the metadata information sent by the metadata acquisition device to the metadata processing device with the preset monitoring standards, send the metadata information that does not meet the preset monitoring standards to the missing data processing module, the abnormal data processing module or the duplicate data processing module, and send the metadata information that meets the preset monitoring standards to the data output module.

[0033] The preset monitoring standards include: there is no field with missing content in the metadata information, the information of each field of the metadata information conforms to the standard format and standard word length of the field, and there is no duplicate metadata information.

[0034] The sending of metadata information that does not meet the preset monitoring standards to the missing data processing module, the abnormal data processing module or the duplicate data processing module specifically includes: sending metadata information of fields with missing content to the missing data processing module; sending metadata information whose field information does not meet the standard format and standard word length of the field to the abnormal data processing module; sending metadata information with duplication to the duplicate data processing module.

[0035] The missing data processing module is used to supplement the fields of the missing content, send the metadata information of successful supplementation to the data output module, delete the metadata information of failed supplementation, and send an abnormal notification to the status feedback module.

[0036] The abnormal data processing module is used to modify the metadata information that does not conform to the standard format and standard word length of the field to conform to the standard format and standard word length, send the metadata information that has been successfully modified to the data output module, delete the metadata information that has failed to be modified, and send an abnormal notification to the status feedback module.

[0037] The duplicate data processing module is used to delete duplicate metadata information, retain only one piece of metadata information among multiple pieces of duplicate metadata information, and send the retained piece of metadata information to the data output module.

[0038] The state feedback module is used to send an abnormality notification to the metadata collection device, so as to notify the metadata collection device to collect metadata again.

[0039] The data output module is used to send metadata information to the metadata database.

[0040] The metadata database is used to store the metadata information.

[0041] The metadata management device is used to control the collection function of the metadata collection device and manage the metadata information stored in the metadata database.

[0042] The metadata management device includes a metadata collection control module and a metadata editing module.

[0043] The metadata collection control module is used to issue a collection control command to the metadata collection device based on a collection instruction, and the collection instruction is generated based on a time trigger and / or a manual trigger and / or a new book trigger. The time trigger is specifically to automatically generate a trigger after a specified time period, the manual trigger is to generate a trigger based on a manual instruction, and the new book trigger is specifically to automatically generate a trigger when the number of new books in the book database exceeds a threshold.

[0044] The metadata editing module is used to manually add, modify and delete metadata information stored in the metadata database.

[0045] The user query device is used to query the metadata database and obtain the electronic books stored in the book database.

[0046] The user query device comprises a query input module, a data query module, a data transmission module and a data display module.

[0047] The query input module is used to receive a first query instruction input by a user and send it to the data query module. The data query module searches for metadata information that meets the conditions from the metadata database according to the first query instruction and sends it to the data transmission module. The data transmission module sends the metadata information to the data display module for display to the user. The query input module is also used to receive a second query instruction input by a user. The second query instruction is a query instruction for the user to select and query the electronic book corresponding to the metadata information that the user is interested in according to the queried metadata information displayed by the data display module. The query input module sends the second query instruction to the data query module. The data query module searches for electronic books that meet the conditions from the book database according to the second query instruction and sends it to the data transmission module. The data transmission module sends the electronic book to the data display module for display to the user.

[0048] Embodiment 2 of the present invention relates to a method for constructing a book database based on metadata management, the method comprising the following steps:

[0049] S1. Establish a database for storing electronic books, wherein the electronic books include the full text of the books and / or the bibliographic information of the books and / or the book abstracts.

[0050] S2. Establish a metadata database for storing metadata information.

[0051] S3. Use a metadata collection device to collect metadata information corresponding to the electronic book, each item of the metadata information includes the following metadata fields: title, language, publisher, publication date, subject classification, book database location address, and copyright authorization status.

[0052] The title is specifically the title of the electronic book corresponding to the metadata information stored in the book database; the language is specifically the writing language of the electronic book corresponding to the metadata information stored in the book database; the publisher is specifically the publisher of the electronic book corresponding to the metadata information stored in the book database; the publication date is specifically the publication date recorded in the electronic book corresponding to the metadata information stored in the book database; the subject classification is specifically the subject classification of the electronic book corresponding to the metadata information stored in the book database, for example, the subject classification of the electronic book set according to the higher education major announced by the Ministry of Education; the book database location address is specifically the storage address of the electronic book corresponding to the metadata information stored in the book database; the copyright authorization status is specifically the copyright authorization status of the electronic book corresponding to the metadata information stored in the book database, including obtaining full copyright authorization, not obtaining copyright authorization, and obtaining partial copyright authorization.

[0053] S4. Use the metadata collection device to send the collected metadata information to the metadata processing device.

[0054] S5. Use the metadata processing device to obtain the metadata information collected by the metadata collection device, and process the metadata information.

[0055] Specifically include:

[0056] S51. Use the data monitoring module of the metadata processing device to compare the metadata information sent by the metadata acquisition device to the metadata processing device with the preset monitoring standards, and send the metadata information that does not meet the preset monitoring standards to the missing data processing module, abnormal data processing module or duplicate data processing module of the metadata processing device, and send the metadata information that meets the preset monitoring standards to the data output module of the metadata processing device.

[0057] The preset monitoring standards include: there is no field with missing content in the metadata information, the information of each field of the metadata information conforms to the standard format and standard word length of the field, and there is no duplicate metadata information.

[0058] The sending of metadata information that does not meet the preset monitoring standards to the missing data processing module, the abnormal data processing module or the duplicate data processing module specifically includes: sending metadata information of fields with missing content to the missing data processing module; sending metadata information whose field information does not meet the standard format and standard word length of the field to the abnormal data processing module; sending metadata information with duplication to the duplicate data processing module.

[0059] S52. Use the missing data processing module to supplement the fields of the missing content, send the metadata information of successful supplementation to the data output module, delete the metadata information of failed supplementation, and send an abnormal notification to the status feedback module of the metadata processing device.

[0060] S52. Use the abnormal data processing module to modify the metadata information that does not conform to the standard format and standard word length of the field to conform to the standard format and standard word length, send the successfully modified metadata information to the data output module, delete the failed modified metadata information, and send an abnormal notification to the status feedback module.

[0061] S53. Use the duplicate data processing module to delete duplicate metadata information, retain only one piece of duplicate metadata information, and send the retained piece of metadata information to the data output module.

[0062] S54. Use the status feedback module to send an abnormality notification to the metadata collection device, so as to notify the metadata collection device to collect metadata again.

[0063] S55. Use the data output module to send the metadata information to the metadata database.

[0064] S6. Use the metadata management device to control the collection function of the metadata collection device and manage the metadata information stored in the metadata database.

[0065] Specifically include:

[0066] S61. Use the metadata collection control module of the metadata management device to issue a collection control command to the metadata collection device based on a collection instruction, where the collection instruction is generated based on time triggering and / or manual triggering and / or new book triggering.

[0067] The time trigger is automatically generated after a specified time period, the manual trigger is generated based on manual instructions, and the new book trigger is automatically generated when the number of new books in the book database exceeds the threshold.

[0068] S62. Use the metadata editing module of the metadata management device to manually add, modify, or delete metadata information stored in the metadata database.

[0069] S7. Use the user query device to query the metadata database and obtain the electronic books stored in the book database.

[0070] Specifically include:

[0071] S71. Use the query input module of the user query device to receive a first query instruction input by the user, and send it to the data query module of the user query device. The data query module queries the metadata information that meets the conditions from the metadata database according to the first query instruction, and sends it to the data transmission module of the user query device. The data transmission module sends the metadata information to the data display module of the user query device to display it to the user.

[0072] Specifically include:

[0073] S711. Use the Word2Vec tool to convert the text of the first query instruction into a word vector set

[0074] {w q1 …,w qn}

[0075] Among them, w q1 is the vector of the first word, w qn is the vector of the nth word.

[0076] S712. Use the Word2Vec tool to convert the metadata information to be compared into a word vector set

[0077] {w d1 , ..., w dm}

[0078] Among them, w d1 is the vector of the first word, w dm is the vector of the mth word.

[0079] S713. Obtain similarity matrix S,

[0080]

[0081] The element s in the similarity matrix S ijIt represents the cosine similarity between the i-th word in the first query instruction and the j-th word in the metadata information to be compared, expressed as

[0082] s ij = cosine(w qi ,w dj )

[0083] S714. Based on the historical query instruction set, obtain the i-th word w in the first query instruction qi The weight q i ,

[0084]

[0085] Where N is the total number of query instructions in the historical query instruction set, t is an adjustable control constant, and idf i is the i-th word w in the first query instruction qi The document frequency value in reverse order,

[0086]

[0087] where u(w qi ) is the historical query instruction set including word w qi The number of query instructions.

[0088] S715. Obtain the correlation coefficient g between the first query instruction and the metadata information to be compared,

[0089]

[0090] Among them, n is the number of word vectors converted from the text of the first query instruction, m is the number of word vectors converted from the text of the metadata information to be compared, k is a control constant, and tanh() represents a hyperbolic tangent function.

[0091] S716. Determine whether the correlation coefficient g between the first query instruction and the metadata information to be compared exceeds a set threshold. If so, determine that the metadata information to be compared meets the condition. Otherwise, determine that the metadata information to be compared does not meet the condition.

[0092] S72. The query input module receives a second query instruction input by a user, wherein the second query instruction is a query instruction for an electronic book corresponding to metadata information of interest to the user, selected by the user based on metadata information obtained by query and displayed by the data display module. The query input module sends the second query instruction to the data query module, and the data query module queries the book database for electronic books that meet the conditions based on the second query instruction and sends the electronic books to the data transmission module, which sends the electronic books to the data display module for display to the user.

[0093] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present invention. These improvements and modifications should also be regarded as the protection scope of the present invention.

Claims

1. A method for constructing a book database based on metadata management, characterized in that: The method comprises the following steps: S1. Establishing a database for storing electronic books, wherein the electronic books include the full text of the book and / or the bibliographic information of the book and / or the book abstract; S2. Establishing a metadata database for storing metadata information; S3. Use a metadata collection device to collect metadata information corresponding to the electronic book, each of which includes the following metadata fields: title, language, publisher, publication date, subject classification, book database location address, and copyright authorization status; S4. Use the metadata collection device to send the collected metadata information to the metadata processing device; S5. Using the metadata processing device to obtain the metadata information collected by the metadata collection device, and processing the metadata information; S6. Use the metadata management device to control the collection function of the metadata collection device and manage the metadata information stored in the metadata database; S7. Use the user query device to query the metadata database and obtain the electronic books stored in the book database; The step S7 comprises: S71. Use the query input module of the user query device to receive a first query instruction input by the user, and send it to the data query module of the user query device. The data query module searches for metadata information that meets the conditions from the metadata database according to the first query instruction, and sends it to the data transmission module of the user query device. The data transmission module sends the metadata information to the data display module of the user query device for display to the user; S72. The query input module receives a second query instruction input by a user, wherein the second query instruction is a query instruction for an electronic book corresponding to the metadata information that the user is interested in, selected by the user according to the metadata information obtained by query and displayed by the data display module. The query input module sends the second query instruction to the data query module. The data query module queries the electronic books that meet the conditions from the book database according to the second query instruction and sends the electronic books to the data transmission module. The data transmission module sends the electronic books to the data display module for display to the user. The step S71 comprises: S711. Use the Word2Vec tool to convert the text of the first query instruction into a word vector set ； in, is the vector of the first word, is the vector of the nth word; S712. Use the Word2Vec tool to convert the metadata information to be compared into a word vector set ； in, is the vector of the first word, is the vector of the mth word; S713. Obtain similarity matrix S, ； The elements in the similarity matrix S It represents the cosine similarity between the i-th word in the first query instruction and the j-th word in the metadata information to be compared, expressed as ； S714. Based on the historical query instruction set, obtain the i-th word in the first query instruction Weight , ； Where N is the total number of query instructions in the historical query instruction set, t is an adjustable control constant, is the i-th word in the first query instruction The document reverse frequency value of ； in Include words in the historical query command set The number of query instructions; S715. Obtain the correlation coefficient g between the first query instruction and the metadata information to be compared, ； Where n is the number of word vectors converted from the text of the first query instruction, m is the number of word vectors converted from the text of the metadata information to be compared, k is a control constant, and tanh() represents a hyperbolic tangent function; S716. Determine whether the correlation coefficient g between the first query instruction and the metadata information to be compared exceeds a set threshold. If so, determine that the metadata information to be compared meets the condition. Otherwise, determine that the metadata information to be compared does not meet the condition.

2. A method for constructing a book database based on metadata management according to claim 1, characterized in that: The step S5 comprises: S51. Use the data monitoring module of the metadata processing device to compare the metadata information sent by the metadata acquisition device to the metadata processing device with the preset monitoring standard, send the metadata information that does not meet the preset monitoring standard to the missing data processing module, abnormal data processing module or duplicate data processing module of the metadata processing device, and send the metadata information that meets the preset monitoring standard to the data output module of the metadata processing device; S52. Use the missing data processing module to supplement the missing content field, send the successfully supplemented metadata information to the data output module, delete the failed metadata information, and send an abnormal notification to the status feedback module of the metadata processing device; S53. Use the abnormal data processing module to modify the metadata information that does not conform to the standard format and standard word length of the field to conform to the standard format and standard word length, send the successfully modified metadata information to the data output module, delete the failed metadata information, and send an abnormal notification to the status feedback module; S54. Use the duplicate data processing module to delete duplicate metadata information, retain only one of the duplicate metadata information, and send the retained metadata information to the data output module; S55. Using the status feedback module to send an abnormal notification to the metadata collection device, so as to notify the metadata collection device to re-collect metadata; S56. Use the data output module to send the metadata information to the metadata database.

3. A method for constructing a book database based on metadata management according to claim 1, characterized in that: The step S6 comprises: S61. Using the metadata collection control module of the metadata management device to issue a collection control command to the metadata collection device based on a collection instruction, wherein the collection instruction is generated based on a time trigger and / or a manual trigger and / or a new book trigger; S62. Use the metadata editing module of the metadata management device to manually add, modify, or delete metadata information stored in the metadata database.

4. A book database construction system based on metadata management, the system applying the book database construction method according to any one of claims 1 to 3, characterized in that: The system includes: a book database, a metadata collection device, a metadata processing device, a metadata management device, a metadata database, and a user query device; The book database is connected to the metadata collection device and the user query device; The metadata collection device, metadata processing device, metadata database, and user query device are connected in sequence; the metadata management device is connected to the metadata collection device, the metadata database, and the book database respectively; The book database is used to store electronic books; The metadata collection device is used to collect metadata information corresponding to the electronic book, and send the collected metadata information to the metadata processing device; The metadata processing device is used to obtain the metadata information collected by the metadata collection device and process the metadata information; The metadata database is used to store the metadata information; The metadata management device is used to control the collection function of the metadata collection device and manage the metadata information stored in the metadata database; The user query device is used to query the metadata database and obtain the electronic books stored in the book database.

5. The book database construction system based on metadata management according to claim 4 is characterized in that: The metadata processing device includes a data monitoring module, a missing data processing module, an abnormal data processing module, a duplicate data processing module, a state feedback module, and a data output module; The data monitoring module is used to compare the metadata information sent by the metadata collection device to the metadata processing device with the preset monitoring standard, send the metadata information that does not meet the preset monitoring standard to the missing data processing module, the abnormal data processing module or the duplicate data processing module, and send the metadata information that meets the preset monitoring standard to the data output module; The missing data processing module is used to supplement the fields of the missing content, send the metadata information of successful supplementation to the data output module, delete the metadata information of failed supplementation, and send an abnormal notification to the status feedback module; The abnormal data processing module is used to modify the metadata information that does not conform to the standard format and standard word length of the field to conform to the standard format and standard word length, send the metadata information that has been successfully modified to the data output module, delete the metadata information that has failed to be modified, and send an abnormal notification to the status feedback module; The duplicate data processing module is used to delete duplicate metadata information, retain only one piece of metadata information among multiple pieces of duplicate metadata information, and send the retained piece of metadata information to the data output module; The state feedback module is used to send an abnormality notification to the metadata collection device, so as to notify the metadata collection device to collect metadata again; The data output module is used to send metadata information to the metadata database.

6. The book database construction system based on metadata management according to claim 4 is characterized in that: The metadata management device includes a metadata collection control module and a metadata editing module; The metadata collection control module is used to issue a collection control command to the metadata collection device based on a collection instruction, wherein the collection instruction is generated based on time triggering and / or manual triggering and / or new book triggering; The metadata editing module is used to manually add, modify and delete metadata information stored in the metadata database.

7. The book database construction system based on metadata management according to claim 6 is characterized in that: The time trigger is automatically generated after a specified time period, the manual trigger is generated based on manual instructions, and the new book trigger is automatically generated when the number of new books in the book database exceeds the threshold.

8. The book database construction system based on metadata management according to claim 4 is characterized in that: The user query device includes a query input module, a data query module, a data transmission module, and a data display module; The query input module is used to receive a first query instruction input by a user and send it to the data query module; The data query module queries the metadata information that meets the conditions from the metadata database according to the first query instruction, and sends the metadata information to the data transmission module; The data transmission module sends the metadata information to the data display module for display to the user; The query input module is also used to receive a second query instruction input by a user. The second query instruction is a query instruction for an electronic book corresponding to the metadata information that the user is interested in, selected by the user based on the metadata information queried and displayed by the data display module. The query input module sends the second query instruction to the data query module. The data query module queries the book database for electronic books that meet the conditions based on the second query instruction and sends the electronic books to the data transmission module. The data transmission module sends the electronic books to the data display module for display to the user.

Images