Book data processing method and device, equipment and storage medium

By identifying the book's basic and proofreading data and scenarios, and automatically calling the proofreading component for matching processing, the problem of inefficient book data proofreading in the existing technology is solved, and efficient automatic proofreading and diversified demand satisfaction are achieved.

CN118942098APending Publication Date: 2024-11-12BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202310531775.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-11
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The book data identified by existing algorithms is only basic readability, and still requires a lot of manpower to perform fine proofreading, which is inefficient.

Method used

By determining the underlying data, proofreading data and proofreading scenarios of the target book, determining component configuration information based on the scene, calling the corresponding proofreading components for matching processing, and automatically generating proofreading information, which is suitable for different proofreading scenarios.

Benefits of technology

It realizes automatic proofreading of books, improves proofreading efficiency, meets diverse proofreading needs, and improves the versatility of book data processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118942098A_ABST
    Figure CN118942098A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a book data processing method and device, equipment and a storage medium, and relates to the technical field of computers. The method comprises the steps that background data, proofreading data and a target proofreading scene corresponding to a target book are determined, corresponding target component configuration information is determined according to the proofreading scene, the component configuration information comprises identification information of a to-be-called target proofreading component, and different proofreading scenes correspond to different component configuration information; and calling a target proofreading component based on the component configuration information to perform matching processing on the background data and the proofreading data through the target proofreading component, and determining proofreading information of the background data according to a matching processing result. Through adoption of the technical scheme, targeted automatic proofreading can be performed for a specific book proofreading scene, the method can be suitable for different proofreading scenes, the universality of the book proofreading scheme is improved, and various book proofreading requirements of users are met.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular to a book data processing method, apparatus, device and storage medium. Background Art

[0002] Books generally refer to books that are bound into volumes. In order to facilitate readers to view, some types of books can be digitized. Taking ancient books as an example, ancient books refer to books that are not printed using modern printing technology. The digitization of ancient books refers to the use of modern information technology to process ancient books and documents, convert them into electronic data forms, and save and disseminate them through media such as CDs and the Internet.

[0003] At present, artificial intelligence-related technologies can be used to convert data such as pictures corresponding to books into readable data. However, the direct products of existing algorithm recognition only have basic readability, and still require a lot of manpower for detailed proofreading, which is inefficient. Summary of the invention

[0004] The embodiments of the present disclosure provide a book data processing method, apparatus, storage medium and device, which can realize automatic proofreading of books.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for processing book data, comprising:

[0006] Determine the original data, proofreading data and target proofreading scenario corresponding to the target book;

[0007] Determine the corresponding target component configuration information according to the target proofreading scenario, wherein the target component configuration information includes identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information;

[0008] Calling the target proofreading component based on the target component configuration information to match the master copy data with the proofreading data through the target proofreading component;

[0009] The proofreading information of the original data in the target proofreading scenario is determined according to the matching processing result.

[0010] In a second aspect, the present disclosure also provides a book data processing device, including:

[0011] A scenario determination module is used to determine the master data, proofreading data and target proofreading scenario corresponding to the target book;

[0012] A component configuration determination module, used to determine corresponding target component configuration information according to the target proofreading scenario, wherein the target component configuration information includes identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information;

[0013] A matching module, used for calling the target proofreading component based on the target component configuration information, so as to perform matching processing on the master copy data and the proofreading data through the target proofreading component;

[0014] The proofreading information determination module is used to determine the proofreading information of the base text data in the target proofreading scenario according to the matching processing result.

[0015] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0016] one or more processors;

[0017] a storage device for storing one or more programs,

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the book data processing method provided by the embodiment of the present disclosure.

[0019] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the book data processing method provided by an embodiment of the present disclosure.

[0020] The book proofreading scheme provided by the disclosed embodiment determines the base text data, proofreading data and target proofreading scenario corresponding to the target book, determines the corresponding target component configuration information according to the proofreading scenario, wherein the component configuration information includes the identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information. The target proofreading component is called based on the component configuration information to match the base text data and the proofreading data through the target proofreading component, and the proofreading information of the base text data is determined according to the matching processing result. By adopting the above technical scheme, the corresponding target component configuration information is determined according to the target proofreading scenario, and the base text data and the proofreading data corresponding to the target book are matched by calling the target proofreading component indicated in the target component configuration information, and finally the proofreading information of the base text data is determined according to the matching processing result, so that targeted automatic proofreading can be achieved for specific book proofreading scenarios, which can be applied to different proofreading scenarios, improve the versatility of the book proofreading scheme, and meet the diverse book proofreading needs of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0022] Figure 1 A flowchart of a book data processing method provided by an embodiment of the present disclosure;

[0023] Figure 2 A schematic diagram of a book proofreading framework provided by an embodiment of the present disclosure;

[0024] Figure 3 A flowchart of another book data processing method provided by an embodiment of the present disclosure;

[0025] Figure 4 A schematic diagram of a proofreading process in a text proofreading scenario provided by an embodiment of the present disclosure;

[0026] Figure 5 A schematic diagram of a proofreading process in a punctuation proofreading scenario provided by an embodiment of the present disclosure;

[0027] Figure 6 A schematic diagram of a proofreading process in a text proofreading scenario provided by an embodiment of the present disclosure;

[0028] Figure 7 A schematic diagram of a preset special word marking method provided in an embodiment of the present disclosure;

[0029] Figure 8 A schematic diagram of the working principle of a matching algorithm provided in an embodiment of the present disclosure;

[0030] Fig. 9 A schematic diagram of the working principle of another matching algorithm provided by an embodiment of the present disclosure;

[0031] Fig.10 A schematic diagram of the working principle of another matching algorithm provided by an embodiment of the present disclosure;

[0032] Fig.11 A schematic diagram of the structure of a book data processing device provided by an embodiment of the present disclosure;

[0033] Fig.12 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0034] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0035] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0036] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0037] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0038] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0039] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0040] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0041] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0042] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0043] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0044] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0045] Figure 1 A book proofreading process diagram provided in an embodiment of the present disclosure is applicable to the case of book proofreading. The method can be executed by a book data processing device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal such as a mobile phone, a smart watch, a tablet computer, and a personal digital assistant, or a device such as a personal computer (PC) or a server.

[0046] like Figure 1 As shown, the method includes:

[0047] Step 101: Determine the master text data, proofreading data and target proofreading scenario corresponding to the target book.

[0048] Exemplarily, the target book can be understood as a book that needs to be proofread at present, which can be an ancient book, a modern book, or a book of other preset types, without specific limitation. The base data corresponding to the target book can include data obtained after preprocessing the original data of the target book. The data format of the original data is not limited, for example, it can be image data (such as an image obtained by photographing or scanning the book) or Extensible Markup Language (XML) data (such as an XML document obtained after the relevant organization or platform preliminarily organizes the book). The specific method of preprocessing is not limited, for example, it can include artificial intelligence processing, such as optical character recognition (OCR) processing or natural language processing (NLP). After preprocessing, the original data can be converted into readable base data. Due to the complexity of the book, there may be some errors in the base data, which requires further proofreading. In actual application, users (who can be technicians related to book organization or ordinary users) can upload the original data corresponding to the target book. The electronic device pre-processes the original data to obtain the base data. The user can also directly upload the base data, without specific restrictions.

[0049] Exemplarily, the proofreading data corresponding to the target book can be uploaded by the user, or automatically selected by the electronic device according to the target book. The source of the proofreading data can be the data provided by the relevant institution or platform after the manual proofreading of the book, which can serve as a reference, and can include aggregated data from different sources, such as data provided by colleges and universities, and data provided by book sorting institutions. In addition, since books have the characteristics of not being printed using modern printing technology, they are usually handwritten by ancient people, with many versions, and there may be excerpts or quotations between different books. Therefore, the proofreading data corresponding to the target book may come from the manual proofreading data related to the target book itself or the target book's associated books. For example, taking the target book as "The Analects" as an example, the corresponding proofreading data can include the manual proofreading data of various versions of "The Analects", and can also include the manual proofreading data of various versions related to "The Analects" such as "Historical Records" (which can be regarded as an associated book). In summary, proofreading data usually has the characteristics of large data volume and relatively messy.

[0050] For example, for book proofreading, there may be various proofreading requirements, and different proofreading requirements may correspond to different proofreading scenarios, for example, a text proofreading scenario for proofreading the character frame data recognized by OCR, a text fine proofreading scenario for proofreading paragraph data, a punctuation proofreading scenario for proofreading punctuation of paragraph data, etc. The target proofreading scenario may be understood as the current proofreading scenario, which may be automatically determined by the system or determined by the user, and is not specifically limited.

[0051] Step 102: Determine corresponding target component configuration information according to the target proofreading scenario, wherein the target component configuration information includes identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information.

[0052] For example, for different proofreading scenarios, the proofreading functions that need to be implemented are different, such as different proofreading products or different proofreading standards. The book proofreading solution for a specific proofreading scenario is usually not applicable to other proofreading scenarios, resulting in the current book proofreading solution being solid and single, with poor versatility. If there are multiple proofreading requirements, the relevant codes need to be developed separately, which leads to low development efficiency and high development cost.

[0053] In the disclosed embodiments, a proofreading framework applicable to a variety of book proofreading scenarios can be provided, the proofreading framework includes an automatic proofreader, the automatic proofreader may include an automatic proofreader component library (hereinafter referred to as the component library), different components in the component library can be used to implement different capabilities related to book proofreading, and the components in the component library are arranged for different proofreading scenarios, thereby meeting the proofreading requirements of the corresponding proofreading scenarios, and different arrangement methods may correspond to different component configuration information, that is, different proofreading scenarios correspond to different component configuration information. Among them, the component configuration information includes the identification information of the proofreading component to be called (such as the component name or number, etc.), and may also include the calling interface information or calling method information of the proofreading component, etc.

[0054] Step 103: Call the target proofreading component based on the target component configuration information to match the master data with the proofreading data through the target proofreading component.

[0055] Exemplarily, after determining the target component configuration information, the identification information contained therein can be obtained by reading the target component configuration information, that is, the identification information of the target proofreading component that needs to be called, and the target proofreading component is called, and then the base data and the proofreading data are matched by the target proofreading component. The specific matching processing method is related to the capability of the called target proofreading component, for example, it may include identifying abnormal characters in the base data by matching, and the abnormal characters include abnormal words or abnormal punctuation, wherein the abnormal words may include more words (that is, more words compared to the proofreading data), fewer words (that is, fewer words compared to the proofreading data) and wrong words (that is, there are wrong words different from the proofreading data), and the abnormal punctuation may include more punctuation, fewer punctuation and wrong punctuation. Optionally, in different proofreading scenarios, the proofreading entity may be different, and the proofreading entity can be understood as a unit for matching, such as a character box or a paragraph.

[0056] Step 104: Determine the proofreading information of the original data in the target proofreading scenario according to the matching processing result.

[0057] For example, the original data and the proofread data are merged according to the matching processing result, and the differences between the two are marked, so as to obtain the proofreading information of the original data in the target proofreading scenario, for example, which specific position in the original data has fewer words than the proofread data, and which specific words in the proofread data are missing.

[0058] The book data processing method provided by the disclosed embodiment determines the base text data, proofreading data and target proofreading scenario corresponding to the target book, determines the corresponding target component configuration information according to the proofreading scenario, wherein the component configuration information includes the identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information. The target proofreading component is called based on the component configuration information to match the base text data and the proofreading data through the target proofreading component, and the proofreading information of the base text data is determined according to the matching processing result. By adopting the above technical scheme, the corresponding target component configuration information is determined according to the target proofreading scenario, and the base text data and the proofreading data corresponding to the target book are matched by calling the target proofreading component indicated in the target component configuration information, and finally the proofreading information of the base text data is determined according to the matching processing result, so that targeted automatic proofreading can be achieved for specific book proofreading scenarios, which can be applied to different proofreading scenarios, improve the versatility of the book proofreading scheme, and meet the diverse book proofreading needs of users.

[0059] In some embodiments, determining the original text data, proofreading data, and proofreading scenario corresponding to the target book includes: obtaining the original text data and proofreading data corresponding to the target book; determining candidate proofreading scenarios according to the data type of the original text data; and determining the target proofreading scenario corresponding to the target book based on a selection operation for the candidate proofreading scenario. Thus, the user can be automatically provided with optional candidate proofreading scenarios according to the data type of the original text data, helping the user to quickly determine the current proofreading scenario.

[0060] Exemplarily, the user's uploaded materials can be identified. For example, if the user uploads image data, the data type of the corresponding base data can be the data type after OCR processing, and the corresponding candidate proofreading scenarios can include text proofreading, text fine proofreading, and punctuation proofreading; if the user uploads an XML document, the data type of the corresponding base data can be the XML data type, and the corresponding candidate proofreading scenarios can include text fine proofreading and punctuation proofreading. After determining the candidate proofreading scenarios, the candidate proofreading scenarios can be displayed in the user interface, and the user inputs a selection operation for the displayed candidate proofreading scenarios in an optional state, and the candidate proofreading scenario selected by the user is determined as the target proofreading scenario.

[0061] In some embodiments, the target proofreading scenario includes a text proofreading scenario; wherein, the target proofreading component is called based on the target component configuration information to match the base data and the proofreading data through the target proofreading component, including: calling a text matcher based on the target component configuration information to use a first preset matching algorithm in the text matcher to perform a first matching process based on a character frame on the base data and the proofreading data, wherein the first matching process includes identifying abnormal characters in the base data, and the target component configuration information also includes an algorithm identifier of the first preset matching algorithm. Thus, in the text proofreading scenario, the base data can be matched by calling a text matcher to identify the character frames corresponding to the abnormal characters in the base data, thereby meeting the text proofreading requirements. Optionally, the proofreading information of the base data contains identification information of the character frames corresponding to the abnormal characters, and when the proofreading information is displayed, the character frames corresponding to the abnormal characters can be identified according to the identification information.

[0062] Exemplarily, there may be different requirements for text matching, all of which can be implemented by a text matcher. In order to distinguish different requirements, different matching algorithms can be configured in the text matcher. When the text matcher is called, the specific matching algorithm to be used is determined by reading the algorithm identifier in the target component configuration information. The first preset matching algorithm is not specifically limited, for example, it may include an algorithm based on Brute Force (BF), and may also include a matching algorithm based on the Myers difference algorithm, etc.

[0063] For example, OCR can convert the shapes in the image data into computer text, and the recognition results exist in the form of words. Each word corresponds to a word frame and a word recognition result, and the word frame is determined according to the coordinates of the word in the image. When matching words, the word frame is matched with the proofread data. If the words in the word frame are the same as the proofread data, it is not necessary to record or record them as normal words. If the words in the word frame are different from the proofread data, they can be recorded as abnormal words.

[0064] In some embodiments, the target proofreading scenario includes a text proofreading scenario; wherein, the target proofreading component is called based on the target component configuration information to match the base data and the proofreading data through the target proofreading component, including: calling a text matcher based on the target component configuration information to use the second preset matching algorithm in the text matcher to perform a second paragraph-based matching process on the base data and the proofreading data, wherein the second matching process includes identifying at least one of extra characters, missing characters, and wrong characters in the base data, and the target component configuration information also includes an algorithm identifier of the second preset matching algorithm. Thus, in the text proofreading scenario, the base data can be accurately matched by calling the text matcher, and the extra characters, missing characters, or wrong characters in the base data can be accurately identified to meet the precise text proofreading requirements. Among them, the second preset matching algorithm is not specifically limited, for example, it can include an algorithm based on BF, and can also include a matching algorithm based on Myers differential algorithm, etc.

[0065] Optionally, in the text proofreading scenario, the base data can be the XML data in the XML file uploaded by the user, or the data after the OCR recognition result is converted into paragraph data, so that paragraph-based matching processing can be performed. Among them, after text proofreading in the text proofreading scenario, the base data used for text proofreading can be converted into paragraph data as the base data in the text proofreading scenario. At this time, the base data can carry the proofreading information obtained in the text proofreading scenario.

[0066] In some embodiments, the calling of the text matcher based on the target component configuration information to utilize the second preset matching algorithm in the text matcher to perform a second matching process based on paragraphs on the base text data and the proofreading data includes: calling the text locator based on the target component configuration information to utilize the text locator to search the proofreading data for a target proofreading paragraph that meets the preset similarity requirement for the target base text paragraph in the base text data; calling the text matcher based on the target component configuration information to utilize the second preset matching algorithm in the text matcher to perform a second matching process on the target base text paragraph and the target proofreading paragraph. Thus, before performing an accurate matching of the text, similar paragraphs are first screened out from the proofreading data by calling the text locator in units of paragraphs, thereby reducing the computational complexity during matching, avoiding a large burden on the processor caused by directly using a matching algorithm for matching when the proofreading data volume is large (e.g., more than tens of thousands of words), and improving matching efficiency.

[0067] Exemplary, it is assumed that the text in the base data is recorded as a pattern string (abbreviated as pattern string), and the text in the proofread data is recorded as a matching string (abbreviated as matching string). When positioning is performed in units of paragraphs, the pattern string corresponds to a paragraph in the base data, which is recorded as the target base paragraph, and each paragraph in the base data can become a target base paragraph. The matching string is generally all paragraphs in the proofread data, so the pattern string has much fewer words than the matching string. Optionally, the length of the pattern string is counted, which can specifically be the number of characters in the pattern string, and the sliding window length is determined according to the length of the pattern string. For example, the length of the pattern string is 100, and the sliding window length can be 100 or slightly more than 100, such as 110. The matching string is scanned by a sliding window, and the difference distance (which can be understood as similarity) between the matching string and the pattern string in the sliding window is calculated, and the closest N (TopN) positioning results are saved by means of a small top heap, etc., which can be used as the target proofread paragraph, and the target proofread paragraph is used for subsequent text precision matching processing.

[0068] In order to explain the positioning principle of the text locator, three cases are listed below as examples.

[0069] Scenario A:

[0070]

[0071] Case B:

[0072] The original is

[0073] School-based Ah! It is a great pleasure to have friends coming from afar!

[0074] Case C:

[0075]

[0076] For the above three cases, the corresponding difference distances are calculated respectively, recorded as distance A, distance B and distance C. It can be seen that distance A is greater than distance B, and distance B is greater than distance C. If the above N is 1, the matching string in the sliding window in case C can be determined as the target proofreading paragraph.

[0077] In some embodiments, the target proofreading scenario includes a punctuation proofreading scenario; wherein, the target proofreading component is called based on the target component configuration information to match the base data and the proofreading data through the target proofreading component, including: calling a punctuation matcher based on the target component configuration information to use the third preset matching algorithm in the punctuation matcher to perform punctuation matching processing on the base data and the proofreading data, wherein the punctuation matching processing includes identifying at least one of multiple punctuation, few punctuation and wrong punctuation in the base data. Thus, in the punctuation proofreading scenario, the punctuation matching processing can be performed by calling the punctuation matcher to accurately identify multiple punctuation, few punctuation and wrong punctuation in the base data, so as to meet the punctuation proofreading requirements. Optionally, the third preset matching algorithm can be the same as the first preset matching algorithm. Optionally, the punctuation matcher and the text matcher can also be combined into a unified matcher, in which matching algorithms for different proofreading scenarios are configured, such as the first preset matching algorithm, the second preset matching algorithm and the third preset matching algorithm.

[0078] In some embodiments, the target books include target ancient books, and the matcher can be designed accordingly according to the characteristics of the ancient books. Optionally, in the process of matching the base text data and the proofreading data through the target proofreading component, the preset ancient book characters are removed, wherein the preset ancient book characters include character images and / or punctuation marks. In this way, the matching efficiency can be improved. For example, in a text proofreading scenario and / or a text fine proofreading scenario, the preset ancient book characters may include character images, may include punctuation marks, and may include both character images and punctuation marks; in a punctuation proofreading scenario, the preset ancient book characters include character images. Among them, removing the preset ancient book characters may include: removing the preset ancient book characters in the base text data, and / or removing the preset ancient book characters in the proofreading data.

[0079] Exemplarily, a character image can be understood as a picture of a character contained in an ancient book that does not exist in the standard character library. The characters that do not exist in the standard character library may include, for example, characters that cannot be typed using an input method, or characters that cannot be displayed in text form on a page.

[0080] For example, "Hello, China!" and "Hello, .China!" can be considered the same if punctuation marks are removed.

[0081] In some embodiments, the target book includes a target ancient book. During the process of matching the base data and the collated data by the target collating component, the differences between the first character in the base data and the second character in the collated data are ignored, where the first character and the second character are variant characters of each other. Thereby, the matching efficiency can be improved.

[0082] Exemplarily, variant characters may include characters with the same pronunciation and meaning but different glyphs (or writing forms). For example, "猨" and "猿" are variant characters of each other. Optionally, a variant character library can be set up. During the matching process, for different characters in the base data and the collated data, the variant character library can be queried to determine whether they are variant characters of each other. If they are variant characters, the differences between them can be ignored and they can be considered the same.

[0083] In some embodiments, the target book includes a target ancient book, and further includes: searching for preset special characters in the base data based on a preset special character library, and marking the found preset special characters, where the preset special character library includes at least one of the following preset special characters: interchangeable characters, taboo characters, doubtful and incorrect characters, vulgar characters, misused characters in block printing, and non-standard traditional Chinese characters. Wherein, determining the proofreading information of the base data in the target proofreading scenario according to the matching processing result includes: determining the proofreading information of the base data in the target proofreading scenario according to the matching processing result and the preset special character marking result. Thereby, richer reference information can be added to the base data, which is beneficial to assisting manual proofreading, and thus improving the proofreading efficiency and proofreading quality.

[0084] Figure 2The schematic diagram of the book proofreading framework provided by the embodiment of the present disclosure shows a general book proofreading process. Taking the ancient book proofreading scene as an example, the user uploads the material, and the uploaded material may include ancient book images, ancient book texts and proofreading data, and the proofreading data may include text proofreading and punctuation proofreading. Subsequently, the user confirms the target proofreading scene that needs to be used currently, and automatically determines the proofreading entity according to the target proofreading scene confirmed by the user. The automatic proofreader is responsible for realizing the automatic proofreading process, and the general automatic proofreading process includes base proofreading matching, base proofreading merging data, and special processing, wherein the special processing may include marking the preset special characters found. The automatic proofreader contains a variety of components, such as the text locator, matcher, backfiller and extended processor shown in the figure. Different components are used to realize different capabilities, such as the text locator can perform statistical positioning, the matcher can perform accurate matching and fuzzy matching, the backfiller can perform backfilling of more words and fewer words and change word comparison, and the extended processor can perform punctuation splitting and special word splitting. After the proofreading information (proofreading results) is output, manual intervention may be performed to confirm and review the proofreading results to further ensure that accurate proofreading data is released externally, such as publishing it on a proofreading platform for public review.

[0085] Figure 3 This is a flow chart of another method for processing book data provided by an embodiment of the present disclosure. The present disclosure embodiment is optimized based on the various optional solutions in the above embodiments. Taking ancient books as an example, the method specifically includes the following steps:

[0086] Step 301: Determine the original text data and proofreading data corresponding to the target ancient book.

[0087] Step 302, determine the target proofreading scene corresponding to the target ancient book. If the target proofreading scene is a text proofreading scene, execute step 303; if the target proofreading scene is a text proofreading scene, execute step 306; if the target proofreading scene is a punctuation proofreading scene, execute step 304.

[0088] Step 303, obtain the target component configuration information corresponding to the text proofreading scenario, call the text matcher based on the obtained target component configuration information, use the first preset matching algorithm in the text matcher to perform a first matching process based on the character frame on the base data and the proofreading data, and execute step 305.

[0089] Figure 4 A schematic diagram of a proofreading process in a text proofreading scenario provided by an embodiment of the present disclosure is shown in FIG. Figure 4As shown, the user uploads an ancient book image and proofreading data, and after using OCR for text recognition, the base text data is obtained. An ancient book image usually corresponds to a page of the ancient book. First, match by page in the proofreading data to find proofreading data close to the current page. For example, a first preset threshold corresponding to the number of character frames in each page is set, such as 5% of the number of character frames, or a pre-set fixed first preset threshold. If the maximum number of consecutive different characters does not exceed the first preset threshold, it can be considered that the data is matched. If the data is not matched, it can be changed to match by column to find proofreading data close to the current column. For example, a second preset threshold corresponding to the number of character frames in each column is set, such as 10% of the number of character frames, or a pre-set fixed second preset threshold. If the maximum number of consecutive different characters does not exceed the second preset threshold, it can be considered that the data is matched. After matching the proofreading data for comparison, the base text data can be compared with the corresponding proofreading data, and the current character in the base text and the current character in the proofreading can be determined word by word based on the character frame. If they are the same, they can be marked as normal and the proofreading result can be recorded (such as recording the current character in the proofreading). If they are different, further determination can be made to determine whether they are variants of each other. If they are variants, they can also be considered the same and marked as normal. If they are not variants, they are considered different. If the characters are not the same, further determination is made as to whether they are wrong characters. If they are wrong characters, the proofreading result is recorded so that the identification information of the character frame corresponding to the wrong character is included in the proofreading information. When the proofreading information is displayed, the character frame corresponding to the wrong character can be marked according to the identification information. If it is not a wrong character, such as too many characters or too few characters, the proofreading result can be omitted and the current character can be skipped. When the proofreading information is displayed, the situation of too many characters or too few characters can be omitted.

[0090] Step 304, obtain the target component configuration information corresponding to the punctuation proofreading scenario, call the punctuation matcher based on the obtained target component configuration information, use the third preset matching algorithm in the punctuation matcher to perform punctuation matching processing on the base data and the proofreading data, and execute step 305.

[0091] Figure 5 A schematic diagram of a proofreading process in a punctuation proofreading scenario provided by an embodiment of the present disclosure is shown in FIG. Figure 5As shown, the user uploads data, which can specifically be the upload of the original data or the original data corresponding to the original data, as well as the upload of the proofreading data. Optionally, after the text proofreading, the punctuation proofreading can also be continued, and the original data after the text proofreading is converted into paragraph data, as the original data under the punctuation proofreading scene, in this case, the user can no longer perform the data upload operation. After determining that the current scene is the punctuation proofreading scene, the punctuation comparison can be started. In order to facilitate the later marking of punctuation, the current page data can be split according to the punctuation, for example, by calling the punctuation splitting function in the extension processor, the single punctuation contained in the current page data is split into separate rows. Subsequently, the paragraphs are matched with the proofreading, for example, the corresponding third preset threshold is set according to the number of characters in each paragraph, such as 5% of the number of characters, or it can be a pre-set fixed third preset threshold. If the maximum continuous different characters do not exceed the third preset threshold, it can be considered that the data is matched. If the data is not matched, it ends. If the data is matched, the current paragraph is compared with the proofreading. If the current punctuation in the base text is the same as the current punctuation in the proofreading, it is marked as normal. If the current punctuation in the base text is different from the current punctuation in the proofreading, it is determined whether the text before the current punctuation in the base text is the same as the text before the current punctuation in the proofreading. If the text is different, the current punctuation in the base text can be marked as multiple punctuation, saved in the proofreading result data, and the current punctuation in the proofreading is discarded. If the text is the same, it can be further determined whether the current punctuation in the base text and the current punctuation in the proofreading are preset punctuation pairs, and the preset punctuation pairs can include, for example, (?,)(?,)(:,)(:.)(;,) and (;.). If it is a preset punctuation pair, the current punctuation in the base text is marked as less punctuation, and the current punctuation in the proofreading is marked as more punctuation, and saved in the proofreading result data. If it is not a preset punctuation pair, the current punctuation in the base text is marked as normal, and the current punctuation in the proofreading is discarded. Among them, for normal punctuation marks, it is generally not necessary to display prompt information on the front-end page. Therefore, the data of the line where the normal punctuation marks are located can be merged with the lines where the preceding and following texts are located.

[0092] Step 305: Determine the proofreading information of the original text data in the target proofreading scenario according to the matching processing result.

[0093] Step 306, obtaining target component configuration information corresponding to the text proofreading scenario, and calling a text locator based on the obtained target component configuration information, so as to use the text locator to search for a target proofreading paragraph in the proofreading data that meets a preset similarity requirement for a target base text paragraph in the base text data.

[0094] Step 307: Call the text matcher based on the acquired target component configuration information to use the second preset matching algorithm in the text matcher to perform a second matching process on the target original text paragraph and the target proofread text paragraph.

[0095] Step 308: Search for preset special characters in the base data based on a preset special character library, and mark the found preset special characters.

[0096] Step 309: Determine the proofreading information of the base data in the text fine-proofreading scenario according to the matching processing result and the preset special character marking result.

[0097] Figure 6 This is a schematic diagram of the proofreading process in the text fine-proofreading scenario provided by an embodiment of the present disclosure. As Figure 6 shown, the user uploads data, which can specifically be the upload of the base data or the original data corresponding to the base data, as well as the upload of the school-based data. Optionally, after text proofreading, text fine-proofreading can also be continued. After converting the base data that has undergone text proofreading into paragraph data, it is used as the base data in the text fine-proofreading scenario. In this case, the user can avoid the data upload operation. After entering the text fine-proofreading scenario, first call the text locator for paragraph positioning. After obtaining the TopN positioning data, the optimal data can be further matched from the TopN. For example, for each positioning data in the TopN positioning data, it is matched with the bottom data, and the shortest distance between the positioning data and the base data is calculated, such as the absolute value of the number of different characters. If the shortest distance is less than or equal to the preset distance threshold, it can be considered that the optimal data is matched, and this optimal data is determined as the target school-based paragraph, and the text difference is calculated with the target base paragraph. If the shortest distance is greater than the preset distance threshold, it can be considered that the optimal data is not matched. Among them, before determining the target school-based paragraph, the preset ancient book characters included in the positioning data and the base data can be removed first, and then the variant characters in the positioning data and the base data are normalized to ensure that the shortest distance between the positioning data and the base data is not miscalculated due to variant characters. After the text difference calculation is completed, the backfiller can be called to perform multi-character and less-character backfilling and character modification comparison (such as changing the characters in the base to the characters in the school-based), realizing the merger of the base data and the school-based data, and marking the differences between the two.

[0098] For example: The base text is "You learn and review it from time to time, isn't it also pleasant", and the school-based text is "Learn and practice it from time to time, isn't it also pleasant?" After merging the data and marking the differences, the obtained proofreading information is "(Remove 「You」) Learn (「time」 changed to 「practice」) and review it from time to time, isn't it also pleasant (newly added 「?」)".

[0099] Exemplarily, after the matching process, the search for preset special characters can also be performed, which can be performed after any proofreading scenario. In the embodiment of the present disclosure, taking the text fine-proofreading scenario as an example, after the second matching process is completed, the search and marking of preset special characters are performed. Figure 7The following is a schematic diagram of a preset special character marking method provided by an embodiment of the present disclosure. The markings in the figure are for illustration only. The font color of the preset special characters can be changed to enhance the prompting effect. After marking the specific preset special character type, proofreading annotations (abbreviated as proofreading annotations) can be added to further explain the associated information of the preset special characters, such as the proofreading annotations of taboo characters as "correct character A, taboo B", etc.

[0100] The book data processing method provided by the embodiment of the present disclosure can support multiple target proofreading scenarios such as text proofreading, text fine proofreading and punctuation proofreading. By calling the target proofreading component indicated in the target component configuration information, the base text data and proofreading data corresponding to the target book are matched and processed. Special characters can also be searched and marked. Finally, the proofreading information of the base text data is determined according to the matching processing results and the marking results of the special characters. Targeted automatic proofreading can be achieved for specific book proofreading scenarios, and comprehensive and accurate proofreading information can be output, which can assist users in efficient book proofreading.

[0101] In some embodiments, the matching algorithm used when matching the base data and the proofreading data through the target proofreading component includes a first matching algorithm based on a brute force matching algorithm; the first matching algorithm is configured with a first pointer for indicating the current first character to be matched in the proofreading data, and a second pointer for indicating the current second character to be matched in the base data. Among them, the first matching algorithm includes at least one of the following items: when performing an incorrect character judgment, if the current first character to be matched and the current second character to be matched do not match, the first pointer and the second pointer move forward at the same time. If after the movement, the current first character to be matched and the current second character to be matched match, it is determined that the previous character to be matched in the base data is an incorrect character; when performing a multiple-character judgment, if the current first character to be matched and the current second character to be matched do not match, the second pointer moves forward and the first pointer remains stationary. If after the movement, the current first character to be matched and the current second character to be matched match, it is determined that the previous character to be matched in the base data is a multiple character; when performing a fewer-character judgment, if the current first character to be matched and the current second character to be matched do not match, the first pointer moves forward and the second pointer remains stationary. If after the movement, the current first character to be matched and the current second character to be matched match, it is determined that there are fewer characters in the base data. Therefore, an improvement is made on the basis of the BF algorithm. When the characters indicated by the two pointers are different, instead of directly returning to the next position of the starting matching position to restart the matching, the movement method of the pointer is improved according to the different recognition targets of incorrect characters, extra characters and insufficient characters, which can efficiently and accurately identify incorrect characters, extra characters and insufficient characters.

[0102] Optionally, if the current first character to be matched and the current second character to be matched still do not match after the pointer moves one character, it can be determined whether the moving distance exceeds a preset moving distance threshold. If it does not exceed, the pointer can continue to move, and after the movement, it is re-determined whether the current first character to be matched and the current second character to be matched. The preset moving distance threshold can be set according to actual needs, such as 1 or 2, etc. Among them, if it exceeds, it can return to the next position after the starting matching position to start matching again, or return to the starting matching position to perform other matching situations such as more characters or fewer characters.

[0103] Figure 8 It is a schematic diagram of the working principle of a matching algorithm provided by an embodiment of the present disclosure, taking the case of misspelling determination as an example. As Figure 8 shown, in the initial state, the start pointer and the first pointer corresponding to the school text both point to "学", and the second pointer corresponding to the reference text points to "学". When the first pointer points to "实" and the second pointer points to "时", they are different. The first pointer and the second pointer move forward simultaneously. The first pointer points to ",", and punctuation needs to be skipped, so the first pointer points to "习", and the second pointer points to "习". At this time, they are the same, and it is considered that the character "时" in front of the second pointer is a misspelling.

[0104] Fig. 9 It is a schematic diagram of the working principle of another matching algorithm provided by an embodiment of the present disclosure, taking the case of fewer characters determination as an example. As Fig. 9 shown, in the initial state, the start pointer and the first pointer corresponding to the school text both point to "学", and the second pointer corresponding to the reference text points to "学". When the first pointer points to "有" and the second pointer points to "时", they are different. The first pointer moves forward, and the second pointer remains stationary. The first pointer points to ",", and punctuation needs to be skipped, so the first pointer points to "时", and the second pointer points to "时". At this time, they are the same, and it is considered that the reference text lacks the character "有".

[0105] Fig.10 It is a schematic diagram of the working principle of another matching algorithm provided by an embodiment of the present disclosure, taking the case of more characters determination as an example. As Fig.10 shown, in the initial state, the start pointer and the first pointer corresponding to the school text both point to "学", and the second pointer corresponding to the reference text points to "学". The first pointer points to ",", and punctuation needs to be skipped, so the first pointer points to "习", while the second pointer points to "时", they are different. The first pointer remains stationary, and the second pointer moves forward. Then the first pointer points to "习", and the second pointer points to "习". At this time, they are the same, and it is considered that the reference text has an extra character "时".

[0106] In some embodiments, the matching algorithm adopted when the target proofreading component performs matching processing on the base data and the school-based data includes a second matching algorithm based on the Myers difference algorithm; wherein, the second matching algorithm includes: calculating the difference result between the base data and the school-based data based on the Myers difference algorithm; merging the deleted characters and added characters in the difference result into modified characters. Thus, based on the Myers difference algorithm, the matching efficiency can be improved, and by improving on the Myers difference algorithm, the marking requirement for modified characters can be met.

[0107] Exemplarily, assume the base text is: "Is it not pleasant to learn and practice it from time to time!". The school-based text is: "Is it not pleasant to learn and practice it!".

[0108] After removing the punctuation in the school-based text, the school-based text becomes: "Is it not pleasant to learn and practice it".

[0109] After normalizing the variant characters in the base text and the school-based text, the base text is: "Is it not pleasant to learn and practice it!". The school-based text is: "Is it not pleasant to learn and practice it".

[0110] After calculating the difference using the Myers difference algorithm, we get: "Is it not pleasant to learn (delete 「时」)(add 「实」) practice it (delete 「,」) (delete 「!」)".

[0111] Restoring the punctuation in the base text gives: "Is it not pleasant to learn (delete 「时」)(add 「实」) practice it, Is it not pleasant to learn!".

[0112] Restoring the variant characters gives: "Is it not pleasant to learn (delete 「时」)(add 「实」) practice it, Is it not pleasant to learn!".

[0113] Merging the deleted characters and added characters into modified characters gives: "Is it not pleasant to learn (change 「时」 to 「实」) practice it, Is it not pleasant to learn!".

[0114] Fig.11 The following is a schematic structural diagram of a book data processing device provided by an embodiment of the present disclosure, as Fig.11 shown, the device includes:

[0115] A scene determination module 1101, configured to determine the base data, school-based data, and target proofreading scene corresponding to the target book;

[0116] A component configuration determination module 1102, configured to determine the corresponding target component configuration information according to the target proofreading scene, wherein the target component configuration information includes the identification information of the target proofreading component to be called, and different proofreading scenes correspond to different component configuration information;

[0117] A matching module 1103, configured to call the target proofreading component based on the target component configuration information, so as to perform matching processing on the master copy data and the proofreading data through the target proofreading component;

[0118] The proofreading information determination module 1104 is used to determine the proofreading information of the original text data in the target proofreading scenario according to the matching processing result.

[0119] The book data processing device provided by the embodiment of the present disclosure determines the corresponding target component configuration information according to the target proofreading scenario, and matches the base text data and proofreading data corresponding to the target book by calling the target proofreading component indicated in the target component configuration information, and finally determines the proofreading information of the base text data according to the matching processing result. It can realize targeted automatic proofreading for specific book proofreading scenarios, can be applied to different proofreading scenarios, improve the versatility of book proofreading solutions, and meet users' diverse book proofreading needs.

[0120] Optionally, the scene determination module includes:

[0121] A data acquisition unit, used to acquire the master text data and proofreading data corresponding to the target book;

[0122] A candidate scene determination unit, used to determine a candidate proofreading scene according to the data type of the master data;

[0123] The target scene determination unit is used to determine the target proofreading scene corresponding to the target book based on the selection operation on the candidate proofreading scene.

[0124] Optionally, the target proofreading scenario includes a text proofreading scenario; wherein the matching module includes: a first matching unit, used to call a text matcher based on the target component configuration information, so as to utilize a first preset matching algorithm in the text matcher to perform a first matching process based on a character frame on the base data and the proofreading data, wherein the first matching process includes identifying abnormal characters in the base data, and the target component configuration information also includes an algorithm identifier of the first preset matching algorithm.

[0125] Optionally, the target proofreading scenario includes a text proofreading scenario; wherein the matching module includes: a second matching unit, used to call the text matcher based on the target component configuration information, so as to utilize the second preset matching algorithm in the text matcher to perform a second paragraph-based matching process on the base data and the proofreading data, wherein the second matching process includes identifying at least one of extra characters, missing characters and wrong characters in the base data, and the target component configuration information also includes the algorithm identifier of the second preset matching algorithm.

[0126] Optionally, the second matching unit includes:

[0127] A positioning subunit, configured to call a text locator based on the target component configuration information, so as to use the text locator to search the target proofreading paragraph in the proofreading data for a target base text paragraph in the base text data that meets a preset similarity requirement;

[0128] The matching subunit is used to call the text matcher based on the target component configuration information to utilize the second preset matching algorithm in the text matcher to perform a second matching process on the target original text paragraph and the target proofread text paragraph.

[0129] Optionally, the target proofreading scenario includes a punctuation proofreading scenario; wherein the matching module includes: including: a third matching unit, used to call a punctuation matcher based on the target component configuration information, so as to utilize a third preset matching algorithm in the punctuation matcher to perform punctuation matching processing on the base data and the proofreading data, wherein the punctuation matching processing includes identifying at least one of excess punctuation, insufficient punctuation and incorrect punctuation in the base data.

[0130] Optionally, the target book includes a target ancient book, and the matching module removes preset ancient book characters during the process of matching the base text data and the proofreading data through the target proofreading component, wherein the preset ancient book characters include character images and / or punctuation marks.

[0131] Optionally, the target book includes a target ancient book, and the matching module ignores the difference between a first character in the base text data and a second character in the proofreading data during the process of matching the base text data and the proofreading data through the target proofreading component, wherein the first character and the second character are variant forms of each other.

[0132] Optionally, the target book includes a target ancient book, and the device further includes:

[0133] A special character search module, used for searching for preset special characters in the base text data based on a preset special character library, and marking the preset special characters found, wherein the preset special character library includes at least one of the following preset special characters: homophones, taboo characters, doubtful characters, colloquial characters, stereotyped mixed characters and non-standard traditional characters;

[0134] The proofreading information determination module is specifically used to determine the proofreading information of the original text data in the target proofreading scenario according to the matching processing result and the preset special word marking result.

[0135] Optionally, the matching algorithm adopted by the matching module when matching the base data and the proofreading data through the target proofreading component includes a first matching algorithm based on a brute force matching algorithm; the first matching algorithm is configured with a first pointer for indicating the current first character to be matched in the proofreading data, and a second pointer for indicating the current second character to be matched in the base data; wherein the first matching algorithm includes at least one of the following:

[0136] When performing an error character determination, if the current first character to be matched and the current second character to be matched do not match, the first pointer and the second pointer move forward at the same time. If after the movement, the current first character to be matched and the current second character to be matched match, the previous character to be matched in the base data is determined to be an error character.

[0137] When performing multi-character determination, if the current first character to be matched and the current second character to be matched do not match, the second pointer moves forward and the first pointer remains stationary. If after the movement, the current first character to be matched and the current second character to be matched match, it is determined that the previous character to be matched in the base text data is a multi-character.

[0138] When performing the missing character determination, if the current first character to be matched and the current second character to be matched do not match, the first pointer moves forward and the second pointer remains stationary. If after the movement, the current first character to be matched and the current second character to be matched match, the missing characters in the base data are determined.

[0139] Optionally, the matching algorithm adopted by the matching module when matching the master data and the proofread data through the target proofreading component includes a second matching algorithm based on the Myers difference algorithm; wherein the second matching algorithm includes:

[0140] Calculate the difference between the base data and the proofread data based on the Myers difference algorithm;

[0141] The deleted characters and added characters in the difference result are combined into modified characters.

[0142] The book data processing device provided in the embodiments of the present disclosure can execute the book data processing method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0143] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0144] Fig.12 This is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Fig.12 , which shows an electronic device (eg, Fig.12 The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.12 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0145] like Fig.12 As shown, the electronic device 1200 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1201, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1202 or a program loaded from a storage device 1208 to a random access memory (RAM) 1203. In the RAM 1203, various programs and data required for the operation of the electronic device 1200 are also stored. The processing device 1201, the ROM 1202, and the RAM 1203 are connected to each other via a bus 1204. An edit / output (I / O) interface 1205 is also connected to the bus 1204.

[0146] Typically, the following devices may be connected to the I / O interface 1205: an input device 1206 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1207 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1208 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1209. The communication device 1209 may allow the electronic device 1200 to communicate with other devices wirelessly or by wire to exchange data. Although Fig.12 The electronic device 1200 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0147] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1209, or installed from the storage device 1208, or installed from the ROM 1202. When the computer program is executed by the processing device 1201, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0148] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0149] The electronic device provided by the embodiment of the present disclosure and the book data processing method provided by the above embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0150] The embodiment of the present disclosure provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the book data processing method provided by the above embodiment is implemented.

[0151] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0152] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0153] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0154] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: determines the base text data, proofreading data and target proofreading scenario corresponding to the target book; determines the corresponding target component configuration information according to the target proofreading scenario, wherein the target component configuration information includes identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information; calls the target proofreading component based on the target component configuration information to match the base text data and the proofreading data through the target proofreading component; and determines the proofreading information of the base text data under the target proofreading scenario according to the matching processing result.

[0155] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0156] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0157] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a module does not limit the module itself in some cases. For example, the proofreading information determination module may also be described as "a module for determining the proofreading information of the base data in the target proofreading scenario according to the matching processing result".

[0158] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0159] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0160] According to one or more embodiments of the present disclosure, a book data processing method is provided, comprising:

[0161] Determine the original data, proofreading data and target proofreading scenario corresponding to the target book;

[0162] Determine the corresponding target component configuration information according to the target proofreading scenario, wherein the target component configuration information includes identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information;

[0163] Calling the target proofreading component based on the target component configuration information to match the master copy data with the proofreading data through the target proofreading component;

[0164] The proofreading information of the original data in the target proofreading scenario is determined according to the matching processing result.

[0165] According to one or more embodiments of the present disclosure, the step of determining the master copy data, proofreading data, and proofreading scenario corresponding to the target book includes:

[0166] Obtain the master text data and proofreading data corresponding to the target book;

[0167] Determining candidate proofreading scenarios according to the data type of the master data;

[0168] Based on the selection operation on the candidate proofreading scenarios, a target proofreading scenario corresponding to the target book is determined.

[0169] According to one or more embodiments of the present disclosure, the target proofreading scenario includes a text proofreading scenario; wherein the calling of the target proofreading component based on the target component configuration information to match the base text data with the proofreading data through the target proofreading component includes:

[0170] A text matcher is called based on the target component configuration information to utilize a first preset matching algorithm in the text matcher to perform a first matching process based on a character frame on the base text data and the proofread data, wherein the first matching process includes identifying abnormal characters in the base text data, and the target component configuration information also includes an algorithm identifier of the first preset matching algorithm.

[0171] According to one or more embodiments of the present disclosure, the target proofreading scenario includes a text proofreading scenario; wherein the calling of the target proofreading component based on the target component configuration information to match the base text data with the proofreading data through the target proofreading component includes:

[0172] A text matcher is called based on the target component configuration information to utilize a second preset matching algorithm in the text matcher to perform a second paragraph-based matching process on the base text data and the proofreading data, wherein the second matching process includes identifying at least one of extra characters, missing characters, and wrong characters in the base text data, and the target component configuration information also includes an algorithm identifier of the second preset matching algorithm.

[0173] According to one or more embodiments of the present disclosure, calling a text matcher based on the target component configuration information to use a second preset matching algorithm in the text matcher to perform a second paragraph-based matching process on the master copy data and the proofread copy data includes:

[0174] Calling a text locator based on the target component configuration information, so as to use the text locator to search the proofread data for a target original text paragraph in the original text data that meets a preset similarity requirement;

[0175] The text matcher is called based on the target component configuration information to utilize a second preset matching algorithm in the text matcher to perform a second matching process on the target original text paragraph and the target proofread text paragraph.

[0176] According to one or more embodiments of the present disclosure, the target proofreading scenario includes a punctuation proofreading scenario; wherein the calling of the target proofreading component based on the target component configuration information to match the base text data with the proofreading data through the target proofreading component includes:

[0177] A punctuation matcher is called based on the target component configuration information to utilize a third preset matching algorithm in the punctuation matcher to perform punctuation matching processing on the base data and the proofread data, wherein the punctuation matching processing includes identifying at least one of excess punctuation, insufficient punctuation, and incorrect punctuation in the base data.

[0178] According to one or more embodiments of the present disclosure, the target book includes a target ancient book, and in the process of matching the base text data and the proofreading data through the target proofreading component, preset ancient book characters are removed, wherein the preset ancient book characters include character images and / or punctuation marks.

[0179] According to one or more embodiments of the present disclosure, the target book includes a target ancient book, and in the process of matching the base text data and the proofreading data through the target proofreading component, the difference between a first character in the base text data and a second character in the proofreading data is ignored, wherein the first character and the second character are variant forms of each other.

[0180] According to one or more embodiments of the present disclosure, the target book includes a target ancient book, and further includes:

[0181] Searching for preset special characters in the base text data based on a preset special character library, and marking the found preset special characters, wherein the preset special character library includes at least one of the following preset special characters: homophones, taboo characters, doubtful characters, colloquial characters, stereotyped mixed characters, and non-standard traditional characters;

[0182] Wherein, determining the proofreading information of the base text data in the target proofreading scenario according to the matching processing result includes:

[0183] According to the matching processing result and the preset special word marking result, the proofreading information of the base text data in the target proofreading scenario is determined.

[0184] According to one or more embodiments of the present disclosure, the matching algorithm used when the target proofreading component matches the base data and the proofreading data includes a first matching algorithm based on a brute force matching algorithm; the first matching algorithm is configured with a first pointer for indicating the current first character to be matched in the proofreading data, and a second pointer for indicating the current second character to be matched in the base data; wherein the first matching algorithm includes at least one of the following:

[0185] When performing an error character determination, if the current first character to be matched and the current second character to be matched do not match, the first pointer and the second pointer move forward at the same time. If after the movement, the current first character to be matched and the current second character to be matched match, the previous character to be matched in the base data is determined to be an error character.

[0186] When performing multi-character determination, if the current first character to be matched and the current second character to be matched do not match, the second pointer moves forward and the first pointer remains stationary. If after the movement, the current first character to be matched and the current second character to be matched match, it is determined that the previous character to be matched in the base text data is a multi-character.

[0187] When performing the missing character determination, if the current first character to be matched and the current second character to be matched do not match, the first pointer moves forward and the second pointer remains stationary. If after the movement, the current first character to be matched and the current second character to be matched match, the missing characters in the base data are determined.

[0188] According to one or more embodiments of the present disclosure, the matching algorithm used when the base text data and the proofreading data are matched by the target proofreading component includes a second matching algorithm based on the Myers difference algorithm; wherein the second matching algorithm includes:

[0189] Calculate the difference between the base data and the proofread data based on the Myers difference algorithm;

[0190] The deleted characters and added characters in the difference result are combined into modified characters.

[0191] According to one or more embodiments of the present disclosure, there is provided a book data processing device, comprising:

[0192] A scenario determination module is used to determine the master data, proofreading data and target proofreading scenario corresponding to the target book;

[0193] A component configuration determination module, used to determine corresponding target component configuration information according to the target proofreading scenario, wherein the target component configuration information includes identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information;

[0194] A matching module, used for calling the target proofreading component based on the target component configuration information, so as to perform matching processing on the master copy data and the proofreading data through the target proofreading component;

[0195] The proofreading information determination module is used to determine the proofreading information of the base text data in the target proofreading scenario according to the matching processing result.

[0196] According to one or more embodiments of the present disclosure, an electronic device is provided, the electronic device comprising:

[0197] one or more processors;

[0198] a storage device for storing one or more programs,

[0199] When the one or more programs are executed by the one or more processors, the one or more processors implement the book data processing method provided by the embodiment of the present disclosure.

[0200] According to one or more embodiments of the present disclosure, a storage medium containing computer executable instructions is provided. When the computer executable instructions are executed by a computer processor, the book data processing method provided by the embodiment of the present disclosure is executed.

[0201] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0202] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0203] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A method for processing book data, characterized in that: include: Determine the original data, proofreading data and target proofreading scenario corresponding to the target book; Determine the corresponding target component configuration information according to the target proofreading scenario, wherein the target component configuration information includes identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information; Calling the target proofreading component based on the target component configuration information to match the master copy data with the proofreading data through the target proofreading component; The proofreading information of the original data in the target proofreading scenario is determined according to the matching processing result.

2. The method according to claim 1, characterized in that: The determination of the master text data, proofreading data and proofreading scenario corresponding to the target book includes: Obtain the master text data and proofreading data corresponding to the target book; Determining candidate proofreading scenarios according to the data type of the master data; Based on the selection operation on the candidate proofreading scenarios, a target proofreading scenario corresponding to the target book is determined.

3. The method according to claim 1, characterized in that The target proofreading scenario includes a text proofreading scenario; wherein the calling of the target proofreading component based on the target component configuration information to match the base text data with the proofreading data through the target proofreading component includes: A text matcher is called based on the target component configuration information to utilize a first preset matching algorithm in the text matcher to perform a first matching process based on a character frame on the base text data and the proofread data, wherein the first matching process includes identifying abnormal characters in the base text data, and the target component configuration information also includes an algorithm identifier of the first preset matching algorithm.

4. The method according to claim 1, characterized in that: The target proofreading scenario includes a text proofreading scenario; wherein the calling of the target proofreading component based on the target component configuration information to match the base text data with the proofreading data through the target proofreading component includes: A text matcher is called based on the target component configuration information to utilize a second preset matching algorithm in the text matcher to perform a second paragraph-based matching process on the base text data and the proofreading data, wherein the second matching process includes identifying at least one of extra characters, missing characters, and wrong characters in the base text data, and the target component configuration information also includes an algorithm identifier of the second preset matching algorithm.

5. The method according to claim 4, characterized in that The calling of the text matcher based on the target component configuration information to use a second preset matching algorithm in the text matcher to perform a second paragraph-based matching process on the master copy data and the proofread copy data includes: Calling a text locator based on the target component configuration information, so as to use the text locator to search the proofread data for a target original text paragraph in the original text data that meets a preset similarity requirement; The text matcher is called based on the target component configuration information to utilize a second preset matching algorithm in the text matcher to perform a second matching process on the target original text paragraph and the target proofread text paragraph.

6. The method according to claim 1, characterized in that The target proofreading scenario includes a punctuation proofreading scenario; wherein the calling of the target proofreading component based on the target component configuration information to match the base text data with the proofreading data through the target proofreading component includes: A punctuation matcher is called based on the target component configuration information to utilize a third preset matching algorithm in the punctuation matcher to perform punctuation matching processing on the base data and the proofread data, wherein the punctuation matching processing includes identifying at least one of excess punctuation, insufficient punctuation, and incorrect punctuation in the base data.

7. The method according to claim 1, characterized in that The target book includes a target ancient book. In the process of matching the base text data and the proofreading data by the target proofreading component, preset ancient book characters are removed, wherein the preset ancient book characters include character images and / or punctuation marks.

8. The method according to claim 1, characterized in that: The target books include target ancient books. In the process of matching the base text data and the proofreading data by the target proofreading component, the difference between a first character in the base text data and a second character in the proofreading data is ignored, wherein the first character and the second character are variant forms of each other.

9. The method according to claim 1, characterized in that: The target book includes a target ancient book, and the method further includes: Searching for preset special characters in the base text data based on a preset special character library, and marking the found preset special characters, wherein the preset special character library includes at least one of the following preset special characters: homophones, taboo characters, doubtful characters, colloquial characters, stereotyped mixed characters, and non-standard traditional characters; Wherein, determining the proofreading information of the base text data in the target proofreading scenario according to the matching processing result includes: According to the matching processing result and the preset special word marking result, the proofreading information of the base text data in the target proofreading scenario is determined.

10. The method according to claim 1, characterized in that The matching algorithm used when the target proofreading component matches the base data and the proofreading data includes a first matching algorithm based on a brute force matching algorithm; the first matching algorithm is configured with a first pointer for indicating the current first character to be matched in the proofreading data, and a second pointer for indicating the current second character to be matched in the base data; wherein the first matching algorithm includes at least one of the following: When performing an error character determination, if the current first character to be matched and the current second character to be matched do not match, the first pointer and the second pointer move forward at the same time. If after the movement, the current first character to be matched and the current second character to be matched match, the previous character to be matched in the base data is determined to be an error character. When performing multi-character determination, if the current first character to be matched and the current second character to be matched do not match, the second pointer moves forward and the first pointer remains stationary. If after the movement, the current first character to be matched and the current second character to be matched match, it is determined that the previous character to be matched in the base text data is a multi-character. When performing the missing character determination, if the current first character to be matched and the current second character to be matched do not match, the first pointer moves forward and the second pointer remains stationary. If after the movement, the current first character to be matched and the current second character to be matched match, the missing characters in the base data are determined.

11. The method according to claim 1, characterized in that: The matching algorithm used when the target proofreading component matches the master copy data with the proofreading data includes a second matching algorithm based on the Myers difference algorithm; wherein the second matching algorithm includes: Calculate the difference between the base data and the proofread data based on the Myers difference algorithm; The deleted characters and added characters in the difference result are combined into modified characters.

12. A book data processing device, characterized in that: include: A scenario determination module is used to determine the master data, proofreading data and target proofreading scenario corresponding to the target book; A component configuration determination module, used to determine corresponding target component configuration information according to the target proofreading scenario, wherein the target component configuration information includes identification information of the target proofreading component to be called, and different proofreading scenarios correspond to different component configuration information; A matching module, used for calling the target proofreading component based on the target component configuration information, so as to perform matching processing on the master copy data and the proofreading data through the target proofreading component; The proofreading information determination module is used to determine the proofreading information of the base text data in the target proofreading scenario according to the matching processing result.

13. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the book data processing method according to any one of claims 1 to 11.

14. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are used to execute the book data processing method according to any one of claims 1 to 11 when executed by a computer processor.

Citation Information

Patent Citations

  • Proofreading method, system and proofreading server of characters in ancient book

    CN103257954A

  • Television list data local-refreshing method, storage medium, electronic equipment and system

    CN107484003A

  • Character recognition matching method, equipment and device

    CN110032920A

  • Template-based text structured extraction method and tool

    CN113191348A

  • Text information matching method and device and storage medium

    CN115204159A