Bidding document quality inspection methods, devices, electronic equipment and storage media
By constructing a parity mapping structure to bind characters and positions in bidding documents, the problem of difficult positioning caused by fragmented multi-source document processing and large language model rewriting is solved, realizing character-level traceability of bidding documents and improving the accuracy and efficiency of review.
Patent Information
- Application Number
- CN202611262595.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-19
- Publication Date
- 2026-11-17
AI Technical Summary
Existing technologies for reviewing bidding documents suffer from fragmented processing of multi-source documents and difficulty in accurately locating review conclusions, resulting in inconsistent standards, high risk of missed detections, and low efficiency. Furthermore, evidence generated by large language models often deviates from the original text, making it difficult to adapt to the needs of the entire quality inspection process.
By constructing a corresponding mapping structure for bidding documents and binding each character to its position coordinates, character-level traceability is achieved. Combined with a fuzzy matching strategy, evidence text is accurately backfilled to the original text position, generating review conclusions and supporting evidence text.
It achieves character-level traceability of bidding documents, significantly improves the accuracy and efficiency of compliance review, reduces the cost of manual location and review, and ensures the credibility and standardization of the review.
Smart Images

Figure CN123115369A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of artificial intelligence technology, and in particular to a method, apparatus, electronic device, and storage medium for quality inspection of bidding documents. Background Technology
[0002] Bidding and tendering are core components of engineering construction and corporate procurement. Industry, local, and other levels of regulations impose strict requirements on the content arrangement, clause wording, and format specifications of documents. The traditional manual, chapter-by-chapter review model suffers from problems such as inconsistent standards, high risk of omissions, difficulty in tracing review conclusions, and low efficiency.
[0003] Existing intelligent review solutions also have their limitations, failing to balance certainty, generalization, and traceability. In particular, regarding the difficulty in tracing the source of conclusions, existing solutions handle multi-source documents in a fragmented manner, review opinions are mostly empirical descriptions, and evidence generated by large models often deviates from the original text. Relying solely on the method of adding serial numbers for tracing is susceptible to model illusions and cannot accurately locate the original text, making it difficult to adapt to the needs of full-process quality inspection. Summary of the Invention
[0004] This invention provides a method, apparatus, electronic device, and storage medium for quality inspection of bidding documents, in order to solve the problems of fragmented multi-source document processing and difficulty in accurately locating review conclusions in the prior art.
[0005] This invention provides a method for quality inspection of bidding documents, comprising: Identify the tender documents to be inspected; A corresponding mapping structure is constructed based on the character attributes of the bidding documents. The corresponding mapping structure represents the mapping relationship between each character in the bidding documents and its position coordinates. Based on the bidding documents, determine the content to be reviewed corresponding to the quality inspection points to be reviewed, and determine the set of character position intervals corresponding to the content to be reviewed; Based on the set of character position intervals, the content to be reviewed is assessed for compliance, and a review conclusion and supporting evidence text are generated. Based on the aforementioned co-location mapping structure, fuzzy matching is performed on the evidence text to obtain the target position of the evidence text in the bidding document.
[0006] According to a method for quality inspection of bidding documents provided by the present invention, the step of constructing a parity mapping structure based on the character attributes of the bidding documents includes: Extract the character value, page number information, and position coordinates of each character from the text stream of the bidding documents; If the bidding documents contain a table, the table structure is restored in the text stream, and the character value, page number information and position coordinates of each character in each cell of the restored table are extracted. The corresponding mapping structure is constructed based on the character value, page number information, and position coordinates of each character.
[0007] According to a method for quality inspection of bidding documents provided by the present invention, the step of determining the content to be reviewed corresponding to the quality inspection point to be reviewed based on the bidding documents, and determining the set of character position intervals corresponding to the content to be reviewed, includes: Extract the layout and hierarchy features of the bidding documents, and identify the chapter boundaries in the bidding documents based on the layout and hierarchy features; Based on the boundaries of each chapter, a chapter structure tree is constructed to represent the parent-child hierarchical relationship between each chapter in the bidding document; The search conditions configured for the quality inspection points are determined. Based on the search conditions and the chapter structure tree, a search and recall is performed in the bidding documents to obtain the content to be reviewed corresponding to the quality inspection points. The search conditions include at least one of vector query conditions, chapter range conditions, and keyword conditions. Based on the start and end positions of the corresponding characters in the bidding documents for the content to be reviewed, the set of character position intervals is determined.
[0008] According to a method for quality inspection of bidding documents provided by the present invention, the step of performing compliance judgment on the content to be reviewed based on the character position interval set, and generating a review conclusion and evidence text supporting the review conclusion, includes: If there are multiple quality inspection points, then determine the context overlap between the character position intervals corresponding to each quality inspection point in the character position interval set; Based on the aforementioned context overlap, the quality inspection points are clustered and merged to obtain a merged quality inspection group; Based on the union of the pending contents corresponding to each quality inspection point in the merged quality inspection group, the merged pending contents corresponding to the merged quality inspection group are determined. A single review instruction is generated based on the merged content to be reviewed, and the single review instruction is processed based on a large language model to obtain the review conclusion and the evidence text supporting the review conclusion.
[0009] According to a method for quality inspection of bidding documents provided by the present invention, the step of performing compliance judgment on the content to be reviewed based on the character position interval set, and generating a review conclusion and evidence text supporting the review conclusion, includes: Based on the set of character position intervals, at least one of compliance word matching, regular expression pattern matching, and chapter missing determination is performed on the content to be reviewed to obtain a suspected hit result. The suspected hit results are verified using a knowledge base to obtain the verification criteria. The suspected hit result is input into the context of the bidding document and the verification basis clauses for semantic disambiguation in a large language model to obtain the review conclusion and the evidence text supporting the review conclusion.
[0010] According to a method for quality inspection of bidding documents provided by the present invention, the step of performing fuzzy matching on the evidence text based on the corresponding mapping structure to obtain the target position of the evidence text in the bidding document includes: Perform character matching between the evidence text and the character sequence corresponding to the parity mapping structure; If no match is found, the evidence text and the character sequence corresponding to the sliding window in the bidding document are converted into evidence text sparse vectors and sliding text sparse vectors. The intersection similarity between the sparse vector of the evidence text and the sparse vector of the sliding text is determined during the sliding window process, and candidate texts are selected from the bidding documents based on the intersection similarity; the frequency of characters moved out and moved in is only incrementally updated each time the sliding window slides. The candidate text is expanded and matched to obtain the target position of the evidence text in the bidding document.
[0011] According to a method for quality inspection of bidding documents provided by the present invention, the step of performing extended matching on the candidate text to obtain the target position of the evidence text in the bidding document includes: Determine whether the text length of the evidence text is less than a length threshold; If so, then character-by-character expansion is performed with the candidate text as the center point to obtain the expanded text. Based on the character set overlap rate between the expanded text and the evidence text, the expanded text is filtered. Based on the edit distance between the filtered expanded text and the evidence text, the target position is determined. If not, the expansion range is determined with the candidate text as the center point, and the text within the expansion range is segmented according to the punctuation mark level to obtain multiple clauses. The combination of clauses containing the center point is traversed, and the combination of clauses is compared with the evidence text to determine the target location.
[0012] According to the present invention, a method for quality inspection of bidding documents is provided, which generates a review conclusion, and then further includes: Obtain the review use case log containing historical review conclusions, compare the historical review conclusions with the corresponding labeled data, and determine the abnormal review use cases from the review use case log based on the comparison results; The anomaly review test cases are subjected to anti-bias filtering to obtain valid anomaly review test cases; Attribution analysis is performed on the compliance judgment inputs, compliance judgment processes and historical review conclusions corresponding to the valid abnormal review cases to obtain the root causes of configuration defects that lead to abnormal review conclusions. The root causes of configuration defects include at least one of recall configuration defects, rule description defects and process topology defects. Based on the root cause of the configuration defect, update the corresponding review configuration item, perform catastrophic forgetting detection on the updated review configuration item, and apply the updated review configuration item if no degradation occurs.
[0013] According to a method for quality inspection of bidding documents provided by the present invention, the step of updating the corresponding review configuration items based on the root cause of the configuration defect includes: If the root cause of the configuration defect is the recall configuration defect, then at least one of the recall keyword library, vector query conditions, and chapter scope conditions in the current review configuration items shall be adjusted; If the root cause of the configuration defect is the defect in the rule description, then based on the initial version of the rule description, the compliance judgment input corresponding to the valid exception review case, the compliance judgment process, and the root cause of the configuration defect, a rewritten rule description is generated, and the rule description in the current review configuration item is updated to the rewritten rule description. If the root cause of the configuration defect is the process topology defect, and it is characterized by the lack of prerequisite judgment criteria, then a prerequisite operator that can produce the prerequisite judgment criteria will be dynamically attached to the current review configuration item's process topology structure.
[0014] The present invention also provides a bidding document quality inspection device, comprising: The unit for determining the tender documents to be inspected; A construction unit is used to construct a corresponding mapping structure based on the character attributes of the bidding document, wherein the corresponding mapping structure represents the mapping relationship between each character in the bidding document and its position coordinates; The retrieval unit is used to determine the content to be reviewed corresponding to the quality inspection point to be reviewed based on the bidding documents, and to determine the set of character position intervals corresponding to the content to be reviewed; The judgment unit is used to make a compliance judgment on the content to be reviewed based on the set of character position intervals, and generate a review conclusion and evidence text supporting the review conclusion; The tracing unit is used to perform fuzzy matching on the evidence text based on the same-position mapping structure to obtain the target position of the evidence text in the bidding document.
[0015] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program to implement the bidding document quality inspection method as described above.
[0016] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the bidding document quality inspection method as described above.
[0017] The bidding document quality inspection method, apparatus, electronic device, and storage medium provided by this invention extract character attributes and construct a unified isotope mapping structure, binding characters and positions in bidding documents in a unified and equal-length manner. This effectively overcomes the defects of fragmented multi-source document processing and constructs a character-level traceable foundation. Furthermore, based on determining the content to be reviewed and the set of character position intervals, compliance review is conducted to ensure that spatial positions are not lost during the circulation process. Finally, for evidence texts with rewriting or omission, fuzzy matching combined with the isotope mapping structure is used to achieve zero-cost and accurate backfilling of the original text coordinates from the reviewed evidence. This balances the generalization of the review and the traceability of the conclusions, significantly reducing the cost of manual location verification and greatly improving the accuracy, efficiency, and credibility of the compliance review of bidding documents. Attached Figure Description
[0018] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.
[0019] Figure 1 This is a flowchart illustrating the quality inspection method for bidding documents provided by the present invention; Figure 2 This is the overall architecture diagram of the bidding document quality inspection method provided by the present invention; Figure 3 This is a flowchart illustrating the same-length modeling process provided by the present invention. Figure 4 This is a flowchart of the multi-level cost-increasing tracing process provided by the present invention; Figure 5 This is a flowchart of the update process for the review configuration items provided by the present invention; Figure 6 This is a schematic diagram of the structure of the bidding document quality inspection device provided by the present invention; Figure 7 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation
[0020] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.
[0021] Bidding and tendering are core components of engineering construction and corporate procurement. Industry, local, and other levels of regulations impose strict requirements on the content, wording, and format of bidding documents. Traditional bidding document review primarily relies on experts reviewing each chapter and clause meticulously, which generally suffers from inconsistent standards, a high risk of omissions, low efficiency, and difficulty adapting to new scenarios. More significantly, current review opinions are mostly based on experience, making it difficult to pinpoint specific locations within the original text, resulting in extremely high costs for subsequent manual verification—in other words, the review conclusions are difficult to trace back to their source.
[0022] With the development of artificial intelligence technology, existing bidding document review solutions mainly include: rule-based or template-based solutions, which rely on predefined keywords and rule engines, are fast but cannot cover complex semantic judgments and have weak generalization ability; information extraction solutions based on traditional natural language processing, which can extract structured information but are still insufficient in complex semantic understanding and reasoning ability; knowledge graph-based solutions, which have associative reasoning ability, but the cost of graph construction and maintenance is high and they are insufficient in identifying new types of violations; and end-to-end review solutions based on large language models, which have strong semantic understanding ability, but suffer from high time consumption and unstable output format. These four types of solutions each have their own emphasis in practical applications, but it is difficult to simultaneously achieve determinism, generalization, and traceability.
[0023] In particular, existing technologies have significant shortcomings in terms of the traceability of review results. Specifically, existing solutions often employ fragmented processing workflows for text, tables, and scanned documents, lacking a unified data structure to support subsequent traceability. At the output level, review conclusions are mostly plain text descriptions, requiring manual review during verification. More challenging is that evidence citations generated by large language models often rewrite or omit the original text, resulting in character-level differences that render traditional simple matching completely ineffective, while existing solutions lack effective traceability strategies. Furthermore, although some solutions attempt to attach serial numbers to data blocks to assist traceability, this method heavily relies on the model's understanding and memory capabilities, making it highly susceptible to model illusions that generate incorrect serial numbers, leading to traceability failures. Moreover, the granularity of traceability is limited by the block size, failing to locate at the character level and unable to universally cover non-model-based review processes.
[0024] In response, this invention provides a method for quality inspection of bidding documents, aiming to construct a unified document parsing and traceability framework. By extracting character attributes from multi-source bidding documents to construct a corresponding mapping structure, and after compliance determination, using a fuzzy matching strategy to find evidence coordinates, it achieves character-level accurate and traceable backfilling of the review conclusions generated by the large language model and the evidence text to the original text position. This solves the problems of fragmented multi-source processing, matching failure caused by rewriting the large language model, and coarse traceability granularity in traditional solutions, significantly improving the efficiency of review and verification, and ensuring the standardization and fairness of the bidding process.
[0025] Figure 1 This is a flowchart illustrating the quality inspection method for bidding documents provided by the present invention. Figure 2 This is an overall architecture diagram of the bidding document quality inspection method provided by the present invention. This method can be applied to compliance quality inspection engines or review servers. Figure 1 and Figure 2 As shown, the method includes: Step 110: Identify the tender documents to be inspected. Step 120: Construct a parity mapping structure based on the character attributes of the bidding documents. The parity mapping structure represents the mapping relationship between each character in the bidding documents and its position coordinates. Step 130: Based on the bidding documents, determine the content to be reviewed corresponding to the quality inspection points to be reviewed, and determine the set of character position intervals corresponding to the content to be reviewed; Step 140: Based on the set of character position intervals, perform compliance determination on the content to be reviewed, and generate review conclusions and supporting evidence texts. Step 150: Based on the same-position mapping structure, perform fuzzy matching on the evidence text to obtain the target position of the evidence text in the bidding documents.
[0026] Specifically, when conducting a compliance review of bidding documents, the first step is to identify the target of the compliance check, namely, the bidding documents to be inspected. In practice, bidding documents may originate from multiple fields such as engineering construction, corporate procurement, and research institutions, and cover various types including the bidding document itself, technical specifications, contract terms, and prequalification documents.
[0027] Furthermore, the file formats of bidding documents are often diverse and heterogeneous. For example, they may include electronic documents such as PDF, Word, and Excel, or they may include scanned images such as scanned PDFs or image formats.
[0028] After obtaining the bidding documents, considering that traditional solutions employ fragmented processing of text, tables, and scanned documents, which can easily lead to misalignment of text coordinates with the original text during the review process if slicing, splicing, or chapter extraction occurs midway, thus causing source tracing failure, this embodiment of the invention allows for unified parsing and modeling of documents from different sources after obtaining the bidding documents. Specifically, it extracts the character attributes of the characters contained in the documents. These character attributes describe the distribution and content characteristics of characters within the document, such as the character's content value, its page position, and its specific coordinates on the page.
[0029] Furthermore, based on the extracted character attributes, a character-level traceable unified document representation base, namely a positional mapping structure, can be established. This structure is essentially a data structure of equal length that binds original characters to their positions. For example, it could be an equal-length mapping array that represents the mapping relationship between each character in the bidding document and its position coordinates. This means that regardless of whether the text is obtained through PDF parsing or scanning, or even after subsequent processing such as slicing, merging, or cleaning, as long as this positional mapping structure is followed, any intermediate result after processing has the ability to return to the original coordinates at zero cost.
[0030] Here, the same-position mapping structure enables unified acceptance of heterogeneous inputs from multiple sources, such as electronic documents and documents containing scanned images. This eliminates the need for subsequent compliance review processes to be aware of differences in text sources, laying a foundation for unified traceability and ensuring the reliability of end-to-end traceability.
[0031] Subsequently, considering that the review of bidding documents typically revolves around multiple dimensions, such as performance review, qualification review, sensitive word review, and content consistency review, these specific review requirements are abstracted into quality control points to be reviewed in actual business operations. Each quality control point represents a specific compliance inspection task or rule requirement. During quality control, for each quality control point, one or more recall strategies, such as vector semantics, chapter structure trees, and keyword enhancement, can be used to accurately recall text fragments related to the review intent of that quality control point from the entire bidding document. These recalled text fragments are the content to be reviewed. The content to be reviewed can be several lines of text, a specific paragraph, or specific chapter content in the document.
[0032] Furthermore, after determining the content to be reviewed, in order to ensure that subsequent review conclusions can be traced back, in this embodiment of the invention, a corresponding character position interval set for the content to be reviewed in the entire document can be determined using a corresponding mapping structure. Specifically, since the content to be reviewed may be composed of multiple fragments scattered across different page numbers or paragraphs, its corresponding position in the original text is usually represented as a set of several consecutive character intervals, such as a combination of intervals [start position, end position]. Thus, the content to be reviewed corresponding to different quality inspection points is uniformly converted into coordinate intervals on the original text string, providing an index basis for subsequent accurate source tracing.
[0033] Then, based on the aforementioned set of character position ranges, a deep compliance assessment can be conducted on the content to be reviewed. This process will integrate one or more review methods, such as rule matching, knowledge base verification, and the semantic disambiguation capabilities of large language models, to verify whether the content to be reviewed meets the compliance requirements of the corresponding quality control points, such as relevant laws and regulations, industry standards, and project customization requirements.
[0034] After compliance assessment, a corresponding assessment result will be output, namely the review conclusion and the supporting evidence text. The review conclusion can be a clear assessment status, such as compliant, confirmed violation, exemption, or uncertain; the evidence text is the natural language explanation or original text cited when giving the review conclusion.
[0035] Furthermore, it is worth noting that in practical applications, since a bidding document typically contains multiple inspection items, i.e., quality control points, independently calling a large language model for semantic determination would result in high network round-trip overhead and long processing time. Therefore, as a preferred embodiment of the present invention, in the compliance determination stage, multiple quality control points can be merged first, and then the model can be called for determination.
[0036] Finally, because large language models often rewrite, omit, or merge the original text when generating evidence text, there are certain differences between the generated text and the original text characters. This causes traditional string precision search to fail, making it impossible to accurately locate the original text. Therefore, in this embodiment of the invention, after generating the evidence text, fuzzy matching can be performed on the evidence text based on the corresponding mapping structure. That is, without requiring the query string to be absolutely identical to the original text, fault-tolerant algorithms, similarity comparison, and cost-increasing search strategies are used to find the segment in the original character stream of the document that best matches the evidence text in terms of character composition or semantic expression.
[0037] Here, relying on the previously constructed isotopic mapping structure that always maintains the same length, the fuzzy matching process can directly connect to the original coordinate stream of the document. Once a match is successful, the target position of the evidence text in the original document can be determined. The target position here refers to the precise coordinates of the evidence text in the original document, such as the specific page number, page offset, and specific position coordinates. By mapping the review conclusion back to the corresponding target position, precise coordinate backfilling is achieved, allowing reviewers to jump to the specific page of the original electronic document or scanned document with one click when viewing the review conclusion.
[0038] The bidding document quality inspection method provided by this invention extracts character attributes and constructs a unified isotope mapping structure, binding characters and positions in the bidding documents in a unified and equal-length manner. This effectively overcomes the defects of fragmented multi-source document processing and constructs a character-level traceable foundation. Furthermore, based on the determined content to be reviewed and the set of character position intervals, compliance review is conducted to ensure that spatial positions are not lost during the circulation process. Finally, for evidence texts with rewriting or omissions, fuzzy matching combined with the isotope mapping structure is used to achieve zero-cost and accurate backfilling of the original text coordinates from the reviewed evidence. This balances the generalization of the review and the traceability of the conclusions, significantly reducing the cost of manual location verification and greatly improving the accuracy, efficiency, and credibility of the compliance review of bidding documents.
[0039] Based on the above embodiments, step 120 includes: Extract the character value, page number information, and position coordinates of each character from the text stream of the bidding documents; If the bidding documents contain tables, the table structure is restored in the text stream, and the character value, page number information and position coordinates of each character in each cell of the restored table are extracted. Based on the character value, page number information, and position coordinates of each character, a parity mapping structure is constructed.
[0040] Specifically, considering that bidding documents typically contain a wealth of elements, including not only plain text but also numerous tables, seals, signature areas, and other complex layouts, using traditional, fragmented parsing methods can easily lead to the loss of original text coordinates during parsing and reconstruction. Therefore, in this embodiment of the invention, the process of constructing a corresponding mapping structure based on the character attributes of the bidding documents specifically includes the following steps: First, the bidding documents can be scanned and parsed to obtain a text stream. Here, whether the text is obtained from parsing an electronic document or from scanning a document through optical character recognition, it is considered a text stream.
[0041] For this text stream, attribute extraction can be performed down to the character level to obtain the character value of each character, i.e., the specific text symbol; page number information, i.e., which page the character is located on in the document; and position coordinates, i.e., the specific position of the character in the corresponding page, usually represented by the coordinates of a bounding box.
[0042] It is worth noting that tables, such as price quotations and parameter response tables, are crucial and frequently appearing elements in bidding documents. Since large language models have difficulty directly reading tables with formatting information, this embodiment of the invention performs table detection during document scanning. If a table is detected, a structured representation of the table is constructed using methods such as table boundary detection, cell segmentation, and row / column relationship recognition. The table's structure is then restored within the text stream. This restoration typically involves reconstructing the table in a structured format such as Markdown within the text stream, preserving elements like table headers and row / column correspondences, enabling the large language model to accurately understand the table's two-dimensional semantics during subsequent review.
[0043] Most importantly, even after structural restoration, it is still necessary to extract the character value, page number information, and position coordinates of each character in each cell of the table. This means that even if the table content is converted into Markdown and inserted into the text stream, each character in each cell of the table is still included in the same position and length system. This ensures that the source tracing ability of the large language model will not be lost due to format reorganization when referencing the table cell content in the future.
[0044] Furthermore, if the bidding documents contain Excel files, when extracting character attributes, the page number information and position coordinates of the characters can be adjusted to match the sheet page, row number, column number, and the character position within the cell, while the character value remains unchanged. This approach is fully compatible with table-based traceability solutions.
[0045] After extracting the plain text stream and table cell content, a parity mapping structure can be constructed based on the character value, page number information, and position coordinates of each extracted character. Figure 3 This is a flowchart illustrating the same-length modeling process provided by the present invention, such as... Figure 3 As shown, the corresponding mapping structure is essentially a mapping array composed of quadruples or multi-tuples. In this embodiment of the invention, a corresponding length invariant is defined for the entire parsing process. That is, no matter what kind of slicing, merging, cleaning, chapter extraction, table format restoration, or other operations are performed on the text stream, the length of the string array is equal to the length of the mapping array, and the indices correspond one-to-one.
[0046] In this embodiment of the invention, by extracting character attributes from the text stream and restoring the structure of the table, and binding them with character coordinates, a mapping structure based on the same-position, equal-length invariant is constructed. This not only enables the large language model to understand complex table semantics without obstacles, but also breaks the fragmented state of multi-source data processing such as text, tables, and scanned documents. It ensures that any intermediate result that has been cleaned and reorganized can be backed to the original text coordinates at zero cost through the equal-length index, laying a solid data foundation for subsequent character-level accurate positioning and tracing.
[0047] Based on the above embodiments, step 130 includes: Extract the layout and hierarchy features of bidding documents, and identify the chapter boundaries in the bidding documents based on the layout and hierarchy features; Based on the boundaries of each chapter, a chapter structure tree is constructed to represent the parent-child hierarchical relationship between chapters in the bidding documents; Determine the search criteria for the quality inspection points, and based on the search criteria and chapter structure tree, perform a search recall in the bidding documents to obtain the content to be reviewed corresponding to the quality inspection points; the search criteria include at least one of the following: vector query criteria, chapter scope criteria, and keyword criteria. Based on the start and end positions of the corresponding characters in the bidding documents, determine the set of character position intervals.
[0048] Specifically, considering that bidding documents are usually lengthy and complex in structure, blindly searching the entire text or cutting it into fixed-length blocks can easily lead to semantic fragmentation or the retrieval of a large amount of irrelevant information. Therefore, in this embodiment of the invention, the process of determining the content to be reviewed and the corresponding set of character position intervals from the bidding documents specifically includes the following steps: To accurately understand the structure of lengthy bidding documents, this embodiment of the invention can extract the document's layout and hierarchical features during document parsing. Layout features can include heading font size and font characteristics, such as large font size, bolding, line indentation and blank line rhythm, as well as reverse validation features of the table of contents; hierarchical features can be regular expression features such as "Chapter 1 / Section 1 / 1.1 / 1.1.1".
[0049] By comprehensively judging the layout features and hierarchical features, the chapter boundaries in the bidding documents can be accurately identified. That is, by using the layout features and hierarchical features, the specific start and end positions of each chapter and section in the document can be determined.
[0050] After identifying all chapter boundaries, a chapter structure tree representing the parent-child hierarchical relationships between chapters in the bidding document can be constructed using these boundaries. This chapter structure tree is a tree-indexed data structure that not only records the scope of each chapter but also clarifies the parent-child nested hierarchical relationships such as "chapter-section-subsection-clause". This chapter structure tree supports bidirectional navigation between parent and child sections, as well as many-to-many mappings between original document sections and standard review sections, such as the instructions to bidders, technical specifications, and contract clauses.
[0051] Next, the search criteria for the quality inspection point configuration need to be determined. That is, in order to cope with inspection items of different complexity and characteristics, the search criteria in this embodiment of the invention may specifically include at least one of vector query criteria, chapter range criteria, and keyword criteria.
[0052] When configured as a vector query condition, a vector semantic recall strategy is executed. In this case, the document is divided into vector blocks using the chapter / section structure tree, with chapter / section boundaries as block boundaries, avoiding the semantic fragmentation problem caused by fixed-length segmentation. Subsequently, the semantic descriptions of the quality checkpoints are encoded into query vectors, and semantically related text blocks are retrieved and recalled through vector similarity.
[0053] When configured as a chapter-wide condition, a chapter structure tree retrieval strategy is executed. In this case, the chapter structure tree is used to map the chapter keywords configured for the quality control points, such as "Instructions to Bidders," "Technical Specifications," and "Quotation Form," to specific chapter paths. This supports structured operations such as including sub-chaps and excluding specific child nodes, thereby enabling targeted retrieval of relevant content within the defined chapter scope.
[0054] When configured as a keyword condition, a keyword-enhanced recall strategy is executed. In this case, for quality control points where strongly relevant content is concentrated in a few lines, the keyword is matched using the chapter structure number, and multiple lines above and below are extended as key context to accurately pinpoint key evidence paragraphs.
[0055] In this embodiment of the invention, one or more of the above-mentioned search conditions will be automatically selected and combined according to the needs of the quality inspection points, and the chapter structure tree will be used to search and recall in the bidding documents according to the selected recall method, so as to obtain the content to be reviewed corresponding to the quality inspection points. This multi-strategy fusion mechanism can effectively avoid the problems of context overload or insufficient information.
[0056] After this, the set of character position intervals corresponding to the content under review can be accurately determined based on the start and end positions of the corresponding characters in the bidding documents, i.e., using the position coordinate index assigned by the position mapping structure. This set is uniformly represented as a combination of several [start position, end position] character position intervals on the original string.
[0057] In this embodiment of the invention, vector semantics, chapter structure orientation, and keyword-enhanced recall strategies are integrated based on the chapter structure tree. This abandons the traditional full-text blind search and fixed-length block method, which not only avoids semantic fragmentation but also enables the recall strategies to be combined and flexibly downgraded as needed, thereby accurately locking the content to be reviewed corresponding to various complex review intentions. At the same time, the outputs of various recall strategies are uniformly mapped to a set of character position intervals, providing data support for subsequent quality inspection point merging and evidence tracing.
[0058] Based on the above embodiments, step 140 includes: If there are multiple quality inspection points, then determine the contextual overlap between the character position intervals corresponding to each quality inspection point in the character position interval set; Based on contextual overlap, the quality inspection points are clustered and merged to obtain merged quality inspection groups; Based on the union of the pending contents corresponding to each quality inspection point in the merged quality inspection group, the merged pending contents corresponding to the merged quality inspection group are determined. A single review instruction is generated based on the merged content to be reviewed, and the single review instruction is processed based on a large language model to obtain the review conclusion and the evidence text supporting the review conclusion.
[0059] Specifically, considering that in actual compliance review scenarios, dozens or even hundreds of inspection items often need to be checked simultaneously, if multiple inspection items independently call a large language model for judgment, the number of model calls will increase linearly with the number of inspection items. Identical or overlapping common contexts, such as system prompts and overlapping original text fragments, will be repeatedly loaded and transmitted. This not only causes queuing and network round-trip overhead under limited concurrency, resulting in extremely long overall inspection times, but also generates high lexical consumption. Therefore, in this embodiment of the invention, quality inspection points can be merged during the compliance judgment stage to reduce the number of model calls. This process specifically includes: Understandably, after receiving the content to be reviewed, before making a compliance determination, the number of concurrent inspection tasks will be assessed. If there are multiple quality control points, the contextual overlap between the character position intervals of the content to be reviewed corresponding to each quality control point needs to be calculated pairwise. Specifically, the contextual overlap is measured as the ratio of the intersection length to the union length of the character position intervals corresponding to two quality control points, with a value ranging from [0,1]. A higher overlap indicates that the original text segments to be checked by these two quality control points are more similar, resulting in a higher reuse rate of the common context after merging, and thus saving more tokens.
[0060] Next, the calculated context overlap can be used to cluster and merge the quality checkpoints to obtain merged quality check groups. Specifically, to maintain a safety baseline, the merging prerequisites must meet hard constraints: the length of the context lexical units corresponding to the merged quality check group must not exceed the upper limit to prevent context explosion in the model; the number of quality checkpoints in a single merged quality check group must not exceed the upper limit to control the size of a single group and the impact of failure; and only quality checkpoints of the same type can be merged to avoid mutual interference caused by differences in task semantics.
[0061] Under the premise of meeting the above hard constraints, the combined value score of the two quality inspection points can be calculated according to the following scoring formula. : ; In the formula, For context overlap; The word saving rate after merging the two quality control points; This refers to the quality inspection group formed by merging two quality inspection points, i.e., the number of quality inspection points within the merged quality inspection group. To determine the length of the context terms corresponding to the merged quality inspection group; To match the upper limit of length; , , and The weights are configurable and can be adjusted according to the business's preference for cost sensitivity versus accuracy sensitivity.
[0062] in, As a positive indicator, the higher the overlap, the more cost-effective the merger. As a positive indicator, it directly depicts cost-benefit; It is a positive indicator, reflecting the diminishing marginal effect; The ratio of the length of the context lexical to the upper limit of length is used as a length approximation penalty. The closer it is to the upper limit of length, the higher the risk of interference.
[0063] Specifically, when performing cluster merging, each quality checkpoint is first grouped independently, and the merging value score between pairs or groups is calculated. The group with the highest merging value score that meets all hard constraints is selected for merging, and the context word length and number of quality checkpoints of the group are iteratively updated until there are no groups that meet the hard constraints and whose merging value score is higher than the preset score threshold. Finally, several high-value merged quality check groups can be obtained.
[0064] Subsequently, for each merged quality control group, the union of the pending content corresponding to each quality control point within it is calculated to obtain the merged pending content for the merged quality control group. In this way, all the background information and original evidence required for all quality control points within the group are included in the same text without redundancy.
[0065] Finally, a single review instruction can be generated based on the merged content to be reviewed. This single review instruction, such as a Prompt, contains the merged content to be reviewed, as well as the rule descriptions and judgment requirements for each quality control point within the merged quality control group. Next, a large language model can be invoked to process the single review instruction, i.e., to perform single-step model inference. The large language model will perform semantic disambiguation and logical reasoning on each quality control point within the group according to the instruction requirements, and finally return the review conclusions of all quality control points within the group and the supporting evidence text in a structured output format.
[0066] In this embodiment of the invention, the inspection tasks of multiple quality inspection points are merged by clustering and merging based on context overlap and multi-dimensional weighted scoring, which greatly reduces the number of calls to the large language model, significantly reduces queuing time and network round-trip overhead under limited concurrency, and improves the overall inspection speed. At the same time, while ensuring that the inspection results do not interfere with each other, the common context is reused to the maximum extent, which greatly reduces word consumption and computing power costs.
[0067] Based on the above embodiments, step 140 includes: Based on the set of character position intervals, at least one of compliance word matching, regular expression pattern matching, and chapter missing determination is performed on the content to be reviewed to obtain suspected hit results. The suspected hit results are verified using the knowledge base to obtain the verification criteria. The context of the suspected hit result in the bidding documents, along with the verification clauses, are input into a large language model for semantic disambiguation to obtain the review conclusion and the supporting evidence text.
[0068] Specifically, regarding the above-mentioned compliance determination process, this embodiment of the invention also provides a layered optional determination scheme that coordinates rules, knowledge base and large language model, so as to take into account both compliance bottom line and semantic judgment.
[0069] In detail, the first step is to extract the corresponding content to be reviewed based on the set of character position intervals, and then, depending on the complexity of the quality inspection points, perform at least one of the following lightweight, deterministic rule operators to check it: Compliance keyword matching: This involves constructing a dictionary tree with type tags for various types of compliance keywords, such as sensitive words, expired regulations, and explicitly prohibited expressions. Based on this, the content to be reviewed is quickly scanned, and once a match is found, the hit location, context window, and dictionary type are recorded. Regular expression pattern matching: For structured expressions, such as date formats earlier than a specific date, amounts exceeding N yuan, and required chapter title formats, a preset regular expression is used for pattern scanning; Chapter Missing Detection: For checks on missing essential chapters, a reverse lookup is performed using the chapter structure tree; if the keywords of an essential chapter do not match any node in the chapter structure tree, a missing alert is triggered directly.
[0070] By using one or more rule operators for rapid filtering, potentially problematic content segments can be efficiently intercepted and identified, resulting in a suspected hit result. This result typically includes the hit location, context window, and the type of rule triggered.
[0071] Next, for checkpoints that require legal provisions or standards to support a conclusion, this embodiment of the invention also requires verification based on a knowledge base.
[0072] Specifically, keywords from suspected matching results can be extracted to create an index, or they can be converted into vectors for similarity retrieval. This allows for the recall of relevant laws, regulations, and standards from a pre-built knowledge base in the bidding and tendering field (which includes national laws and regulations, industry standards and specifications, and internal corporate policies). These recalled laws and regulations serve as the basis for verification.
[0073] Subsequently, since some suspected hit results may fall under whitelist exemption scenarios or be implicit expressions that are difficult for rules to fully cover, this embodiment of the invention can utilize the powerful semantic understanding capabilities of a large language model for screening. At this point, it is necessary to extract the contextual content corresponding to the suspected hit result in the bidding documents, and assemble it together with the verification basis clauses and the business rule description of the current checkpoint into a structured review instruction. Then, this instruction is input into the large language model, which combines the contextual information and knowledge base regulations to analyze whether the suspected hit result is a genuine violation or a reasonable expression, thereby performing disambiguation confirmation and ultimately obtaining a review conclusion, such as outputting a confirmed violation, exemption, or uncertainty, while simultaneously generating evidence text that details the reasons for the judgment and cites original text excerpts.
[0074] In this embodiment of the invention, the original text recall layer ensures a high recall rate and low cost for hard clauses, the knowledge base verification layer provides objective legal support, and the large language model layer uses semantic understanding for accurate disambiguation. The three layers work together to ensure a rigid compliance bottom line while leveraging the advantages of flexible semantic judgment, effectively avoiding blind calls to the large language model. This significantly reduces operating costs while improving the overall inspection speed and accuracy.
[0075] Based on the above embodiments, step 150 includes: Perform character matching between the evidence text and the character sequence corresponding to the parity mapping structure; If no match is found, the evidence text and the corresponding character sequence of the sliding window in the bidding document will be converted into sparse vectors of evidence text and sparse vectors of sliding text. Determine the intersection similarity between the sparse vector of the evidence text and the sparse vector of the sliding text during the sliding window process, and select candidate texts from the bidding documents based on the intersection similarity; each time the sliding window slides, only the frequency of the characters moved out and moved in is incrementally updated; Extended matching of candidate texts yields the target location of evidence text within the bidding documents.
[0076] Specifically, Figure 4 This is a flowchart of the multi-level cost-increasing tracing process provided by the present invention, such as... Figure 4 As shown, the process of performing fuzzy matching on the evidence text based on the isotope mapping structure to obtain the target position of the evidence text in the bidding document can specifically include: First, perform character matching between the evidence text and the character sequence corresponding to the corresponding mapping structure. If a segment that matches the evidence text generated by the large language model is directly matched in the long string corresponding to the original text, it means that the large language model has not rewritten the original text. At this time, the matched position can be returned directly.
[0077] Conversely, if an exact match is not found, it indicates that the large language model has indeed rewritten the original text. In this case, a sliding window mechanism is introduced to quickly locate highly similar segments in long documents. Specifically, the evidence text and the character sequence corresponding to the sliding window in the bidding document are both converted into sparse vectors, resulting in sparse vectors for the evidence text and the sliding text. These sparse vectors are represented in a sparse dictionary format, establishing a mapping between character encoding and the frequency of occurrence of that character. Through this transformation, complex text comparison is reduced to a calculation of the character frequency set, effectively mitigating the impact of word order reversals or partial omissions.
[0078] After converting the text into sparse vectors, the sliding window begins to slide across the original long string of the bidding document, calculating the intersection similarity between the sparse vectors of the evidence text and the sparse vectors of the sliding text in real time. To reduce computational overhead, this embodiment of the invention does not require recalculating the frequency of all characters within the entire window each time the window moves. Instead, it stipulates that the sliding window only incrementally updates the frequencies of characters that are moved out and characters that are moved in each time it slides. In other words, when the window slides forward one position, it only decrements the frequency of characters that are moved out of the window by 1 and increments the frequency of characters that are moved into the window by 1 in the sparse dictionary.
[0079] This lightweight incremental update method can quickly calculate the intersection similarity between the text and the evidence text at each sliding position, sort them, and extract the top-N high-similarity sliding texts as candidate texts.
[0080] Subsequently, the candidate texts selected through the sliding window similarity filter, while highly similar to the evidence text in character frequency, often lack precise boundaries. Therefore, in this embodiment of the invention, extended matching can be performed on the candidate texts. That is, using the center of the equal-length window of the candidate text as a reference, the optimal matching segment that best matches the original context and semantics of the evidence text is searched within a certain range to the left and right. After finding the optimal segment, the segment is converted into coordinates using a corresponding mapping structure, thereby obtaining the target position of the evidence text in the bidding document.
[0081] In this embodiment of the invention, a multi-level cost-increasing tracing process consisting of precise matching, sparse vector long sliding window filtering, and extended matching effectively resolves the problem of traditional matching failure caused by rewriting large language models and omitting the original text. By utilizing the incremental update strategy of sparse dictionary and sliding window, the time complexity of fuzzy matching of long documents is greatly reduced, and large-scale, low-latency, character-level accurate backfilling of review conclusions to the original text coordinates is achieved.
[0082] Based on the above embodiments, extended matching is performed on the candidate text to obtain the target location of the evidence text in the bidding documents, including: Determine whether the length of the evidence text is less than a length threshold; If so, then the candidate text is expanded character by character with the candidate text as the center point to obtain the expanded text. Based on the character set overlap rate between the expanded text and the evidence text, the expanded text is filtered. Based on the edit distance between the filtered expanded text and the evidence text, the target position is determined. If not, the candidate text is used as the center point to determine the expansion range, and the text within the expansion range is segmented according to the punctuation mark level to obtain multiple clauses. The combination of clauses containing the center point is traversed, and the combination of clauses is compared with the evidence text to determine the target location.
[0083] Specifically, the process of expanding the matching of candidate texts to obtain the target location of evidence texts in the bidding documents includes the following steps: Before expanding the candidate text, it is necessary to determine the length of the evidence text and whether it is less than a length threshold. Considering the actual text characteristics of bidding documents, the length threshold is typically set at 300 characters. This determination allows the expansion matching task to be divided into short queries and long queries, enabling the adoption of the most suitable computational scheduling strategy.
[0084] When the evidence text is a short query, i.e., the text length is less than 300 characters, the computational capacity is relatively strong, so the character-level expansion strategy with the highest precision can be adopted. That is, based on the center of the equal-length window of the candidate text, it is extended outward character by character on the left and right sides, thereby obtaining a series of expanded texts with different boundaries.
[0085] Furthermore, to accelerate the matching speed, in this embodiment of the invention, the extended text is first filtered based on the character set overlap rate between the extended text and the evidence text. That is, the overlap rate is used for rapid pre-filtering to remove extended segments with obviously inconsistent character compositions. Then, the edit distance between the extended text and the evidence text that remain after filtering is calculated. That is, the minimum number of single-character operations required to convert one string into another is calculated, and the extended text with the smallest edit distance is selected as the optimal matching segment. After that, the segment can be mapped back to coordinates using a corresponding mapping structure to obtain the target position of the evidence text in the bidding document.
[0086] When the evidence text is a long query, i.e., the text length is greater than or equal to 300 characters, continuing with a character-level expansion strategy would lead to an explosion in computational complexity. Therefore, a clause-level expansion strategy is adopted instead. That is, the expansion range is first determined based on the center of the equal-length window of the candidate text, but within this range, instead of moving character by character, the text within the expansion range is segmented according to punctuation marks, resulting in multiple clauses. Here, there is a clear priority division for punctuation marks: first, sentence-level separators, such as ".", "!", second, clause-level separators, such as ",", and ":", and finally, typesetting separators such as line breaks and page breaks.
[0087] Furthermore, after segmenting multiple clauses according to the punctuation mark hierarchy, the combination of clauses containing the central point can be traversed, and the combination of clauses can be compared with the evidence text to find the combination with the most complete semantic coverage and the smallest difference. Finally, the coordinates are reversed by relying on the same position mapping structure to accurately determine the target location.
[0088] In this embodiment of the invention, a length threshold is introduced, and a dual-track strategy of short query word-by-word expansion and long query clause expansion is implemented for candidate text. When dealing with short text, it can achieve extremely high-precision boundary anchoring; when dealing with long text, the clause combination traversal mechanism with punctuation level awareness is used to avoid the problem of computational complexity explosion caused by word-by-word expansion of long text. While ensuring high source tracing accuracy, it effectively controls the actual computational cost and time consumption.
[0089] Based on the above embodiments, a review conclusion is generated, which then includes: Obtain the review use case log containing historical review conclusions, compare the historical review conclusions with the corresponding labeled data, and determine the abnormal review use cases from the review use case log based on the comparison results; By performing anti-bias filtering on anomaly review test cases, valid anomaly review test cases are obtained. Attribution analysis is performed on the compliance judgment inputs, compliance judgment process and historical review conclusions corresponding to the valid abnormal review cases to obtain the root cause of the configuration defect that leads to the abnormal review conclusion. The root cause of the configuration defect includes at least one of the following: recall configuration defect, rule description defect, process topology defect. Based on the root cause of the configuration defect, update the corresponding review configuration item, perform catastrophic forgetting detection on the updated review configuration item, and apply the updated review configuration item if no degradation occurs.
[0090] Specifically, considering that in actual business operations, the effectiveness of compliance checks is determined by multiple stages across the entire process, and existing performance optimization often heavily relies on expert manual review and black-box blind parameter tuning, and is prone to degradation during continuous configuration evolution where correcting one issue can lead to errors in many other areas. Therefore, in this embodiment of the invention, after generating the review conclusion, an automatic evolution mechanism is introduced in a non-intrusive manner. This process may specifically include: Figure 5 This is a flowchart of the update process for reviewing configuration items provided by the present invention, such as... Figure 5 As shown, in routine reviews, the contextual input of each review task, the thought process of the large language model, and the final review conclusion are usually fully preserved to form review use cases containing the review conclusions. In this embodiment of the invention, historical review use case logs are obtained, and the actual results confirmed by manual review are collected periodically, i.e., labeled data; then, the historical review conclusions in the review use case logs are compared with the labeled data. Through this comparison, all historical review tasks can be automatically divided into three categories: correct, false positives, and false negatives. Failed use cases with false positives or false negatives are extracted as abnormal review use cases.
[0091] Next, the abnormal review test cases will be filtered to prevent bias. That is, since the real reason for the error is not necessarily a configuration problem, such as incorrect manually provided annotation data, or the original text not containing any judgment basis, attributing these problems to the rule engine will lead to a bias in the optimization direction. Therefore, this embodiment of the invention excludes these situations to ensure that the filtered test cases do have optimizable configuration space, resulting in effective abnormal review test cases.
[0092] After obtaining valid anomaly review test cases, they are handed over to the large language model for review. That is, the inputs corresponding to the valid anomaly review test cases, the large language model's thought process, and the review conclusions are input into the large language model for attribution analysis. The model, considering the context, analyzes which step went wrong, ultimately identifying the root cause of the configuration defect leading to the anomaly in the review conclusion. It should be noted that, for the configuration review aspect of the compliance quality inspection process, the root cause of configuration defects can be categorized into at least one of the following: recall configuration defects (e.g., incomplete retrieval of key information, excessive recall causing interference); rule description defects (e.g., unclear or ambiguous prompts); and process topology defects (e.g., missing necessary pre-operators). This step allows for the identification of the specific configuration item causing the problem, rather than the previously ambiguous results.
[0093] After this, the corresponding review configuration items can be updated based on the root cause of the configuration defect, thus generating an improved configuration. However, to prevent the new configuration from breaking other functions that were originally correctly identified while fixing the current problem (i.e., catastrophic forgetting), this embodiment of the invention sets up a regression gatekeeper mechanism. This mechanism uses a large number of historically accumulated correct review cases to construct a regression test set, and uses this set to perform catastrophic forgetting detection on the updated review configuration items. Only when the new configuration resolves the configuration defect and remains correct on historically passed correct samples (i.e., no degradation occurs in the detection) will the updated review configuration items be applied to the review process.
[0094] In this embodiment of the invention, anomaly comparison and anti-bias filtering driven by labeled data are used to accurately identify real and valid failure samples. Combined with the retained thought process, in-depth attribution analysis is performed, upgrading the traditional black-box blind investigation to root cause-driven optimization for three types of configurations: recall, rules, and topology. At the same time, a catastrophic forgetting detection gatekeeper mechanism to prevent regression is introduced, which not only achieves continuous improvement of performance without training and at low cost, but also avoids the risk of regression in continuous evolution and iteration where correcting one point leads to errors in many other areas, thus ensuring a stable increase in compliance review capabilities.
[0095] Based on the above embodiments, updating the review configuration items corresponding to the root cause of the configuration defect includes: If the root cause of the configuration defect is the recall configuration defect, then at least one of the following in the current review configuration items should be adjusted: recall keyword library, vector query conditions, and chapter scope conditions. If the root cause of the configuration defect is a defect in the rule description, then based on the initial version of the rule description, the compliance judgment input corresponding to the valid exception review test case, the compliance judgment process, and the root cause of the configuration defect, a rewritten rule description is generated, and the rule description in the current review configuration item is updated to the rewritten rule description. If the root cause of the configuration defect is a process topology defect, and it is characterized by a lack of prerequisite judgment criteria, then a prerequisite operator that can generate prerequisite judgment criteria will be dynamically attached to the process topology structure of the current review configuration item.
[0096] Specifically, the process of updating the corresponding review configuration items based on the root cause of configuration defects includes the following different branches: When attribution errors are caused by incomplete retrieval of key information or the introduction of too much useless interference, i.e., the root cause of the configuration defect is a recall configuration defect, the optimization goal at this time is to improve the quality of the recall results. Therefore, at least one of the following can be adjusted in the current review configuration items: the recall keyword library (e.g., automatically adding, deleting, or replacing keywords), vector query conditions (e.g., expanding query variations to increase generalization), and chapter scope conditions (e.g., adding or deleting the chapter boundaries based on the correspondence between question types and chapters).
[0097] It is important to emphasize that any adjustment must substantially change the final recall result before it can be adopted. If an addition or subtraction does not change the final recall result, such as if the information has been covered by other strategies, then the adjustment is deemed to be of no benefit and will not be adopted.
[0098] When errors are caused by ambiguity or unclear requirements in the prompts of the large language model, i.e., the root cause of the configuration defect is a flaw in the rule description, the risk of rule evolution in this case is that it deviates from the original business intent after multiple iterations. Therefore, in this embodiment of the invention, the initial version of the rule description, i.e., the most original intent, is forcibly introduced during optimization. Based on this, a rewritten rule description is generated by combining the compliance judgment input corresponding to the valid anomaly review test cases, the compliance judgment process (the error reasoning chain of the large language model), and the root cause of the configuration defect.
[0099] After generating the rewrite rule description, it needs to be scored by an independent quality evaluator from multiple dimensions such as simplicity, consistency, and clarity. If the score is not up to standard, it will be returned for rewriting. Only after the score meets the standard will the rule description in the current review configuration item be updated to the rewrite rule description. At the same time, the optimization strategy is recorded in the experience base to guide the priority reuse of effective strategies in the future.
[0100] Additionally, it's worth noting that some compliance review points have preconditions, such as a rule only applying to enterprise procurement projects. When attribution reveals that the review is abnormal because the project attribute cannot be directly determined from the original text, i.e., the root cause of the configuration defect is a process topology defect, characterized by a lack of preliminary judgment criteria, the problem is not insufficient recall or incorrect rule writing, but rather a missing key link in the workflow orchestration. Therefore, in this embodiment of the invention, a search can be conducted in a pre-built operator library to find an existing operator that can output the attribute, such as whether it is an enterprise procurement, and dynamically attach the operator to the current review configuration item's process topology. This dynamic re-orchestration automatically completes the information chain, enabling subsequent review processes to obtain complete preliminary criteria and thus arrive at the correct review conclusion. Such topology changes are also versioned to support traceability and rollback.
[0101] In this embodiment of the invention, a refined evolution strategy is provided for the three configuration surfaces unique to compliance review: recall, rules, and topology. Recall configuration optimization is result-oriented, eliminating invalid adjustments. Rule description optimization forces reference to the initial version and combines quality assessment to avoid intent deviation and rule bloat caused by multiple automatic rewrites. Process topology optimization compensates for information incompleteness by dynamically attaching pre-operators. This three-pronged classification optimization mechanism truly achieves training-free, fully automatic, and highly controllable continuous self-tuning of the effect.
[0102] The bidding document quality inspection device provided by the present invention is described below. The bidding document quality inspection device described below can be referred to in correspondence with the bidding document quality inspection method described above.
[0103] Figure 6 This is a schematic diagram of the structure of the bidding document quality inspection device provided by the present invention, as shown below. Figure 6 As shown, the device includes: Unit 610 is used to determine the tender documents to be inspected. The construction unit 620 is used to construct a corresponding mapping structure based on the character attributes of the bidding document, wherein the corresponding mapping structure represents the mapping relationship between each character in the bidding document and its position coordinates. The retrieval unit 630 is used to determine the content to be reviewed corresponding to the quality inspection point to be reviewed based on the bidding documents, and to determine the set of character position intervals corresponding to the content to be reviewed. The judgment unit 640 is used to make a compliance judgment on the content to be reviewed based on the set of character position intervals, and generate a review conclusion and evidence text supporting the review conclusion. The tracing unit 650 is used to perform fuzzy matching on the evidence text based on the same-position mapping structure to obtain the target position of the evidence text in the bidding document.
[0104] The bidding document quality inspection device provided by this invention extracts character attributes and constructs a unified isotope mapping structure, binding characters and positions in bidding documents in a unified and equal-length manner. This effectively overcomes the defects of fragmented multi-source document processing and constructs a character-level traceable foundation. Furthermore, based on the determined content to be reviewed and the set of character position intervals, compliance review is conducted to ensure that spatial positions are not lost during the circulation process. Finally, for evidence texts with rewriting or omissions, fuzzy matching combined with the isotope mapping structure is used to achieve zero-cost and accurate backfilling of the original text coordinates from the reviewed evidence. This balances the generalization of the review and the traceability of the conclusions, significantly reducing the cost of manual location verification and greatly improving the accuracy, efficiency, and credibility of the compliance review of bidding documents.
[0105] Based on the above embodiments, the construction unit 620 is used for: Extract the character value, page number information, and position coordinates of each character from the text stream of the bidding documents; If the bidding documents contain a table, the table structure is restored in the text stream, and the character value, page number information and position coordinates of each character in each cell of the restored table are extracted. The corresponding mapping structure is constructed based on the character value, page number information, and position coordinates of each character.
[0106] Based on the above embodiments, the retrieval unit 630 is used for: Extract the layout and hierarchy features of the bidding documents, and identify the chapter boundaries in the bidding documents based on the layout and hierarchy features; Based on the boundaries of each chapter, a chapter structure tree is constructed to represent the parent-child hierarchical relationship between each chapter in the bidding document; The search conditions configured for the quality inspection points are determined. Based on the search conditions and the chapter structure tree, a search and recall is performed in the bidding documents to obtain the content to be reviewed corresponding to the quality inspection points. The search conditions include at least one of vector query conditions, chapter range conditions, and keyword conditions. Based on the start and end positions of the corresponding characters in the bidding documents for the content to be reviewed, the set of character position intervals is determined.
[0107] Based on the above embodiments, the determination unit 640 is used for: If there are multiple quality inspection points, then determine the context overlap between the character position intervals corresponding to each quality inspection point in the character position interval set; Based on the aforementioned context overlap, the quality inspection points are clustered and merged to obtain a merged quality inspection group; Based on the union of the pending contents corresponding to each quality inspection point in the merged quality inspection group, the merged pending contents corresponding to the merged quality inspection group are determined. A single review instruction is generated based on the merged content to be reviewed, and the single review instruction is processed based on a large language model to obtain the review conclusion and the evidence text supporting the review conclusion.
[0108] Based on the above embodiments, the determination unit 640 is used for: Based on the set of character position intervals, at least one of compliance word matching, regular expression pattern matching, and chapter missing determination is performed on the content to be reviewed to obtain a suspected hit result. The suspected hit results are verified using a knowledge base to obtain the verification criteria. The suspected hit result is input into the context of the bidding document and the verification basis clauses for semantic disambiguation in a large language model to obtain the review conclusion and the evidence text supporting the review conclusion.
[0109] Based on the above embodiments, the traceability unit 650 is used for: Perform character matching between the evidence text and the character sequence corresponding to the parity mapping structure; If no match is found, the evidence text and the character sequence corresponding to the sliding window in the bidding document are converted into evidence text sparse vectors and sliding text sparse vectors. The intersection similarity between the sparse vector of the evidence text and the sparse vector of the sliding text is determined during the sliding window process, and candidate texts are selected from the bidding documents based on the intersection similarity; the frequency of characters moved out and moved in is only incrementally updated each time the sliding window slides. The candidate text is expanded and matched to obtain the target position of the evidence text in the bidding document.
[0110] Based on the above embodiments, the traceability unit 650 is used for: Determine whether the text length of the evidence text is less than a length threshold; If so, then character-by-character expansion is performed with the candidate text as the center point to obtain the expanded text. Based on the character set overlap rate between the expanded text and the evidence text, the expanded text is filtered. Based on the edit distance between the filtered expanded text and the evidence text, the target position is determined. If not, the expansion range is determined with the candidate text as the center point, and the text within the expansion range is segmented according to the punctuation mark level to obtain multiple clauses. The combination of clauses containing the center point is traversed, and the combination of clauses is compared with the evidence text to determine the target location.
[0111] Based on the above embodiments, the device further includes an updating unit, used for: Obtain the review use case log containing historical review conclusions, compare the historical review conclusions with the corresponding labeled data, and determine the abnormal review use cases from the review use case log based on the comparison results; The anomaly review test cases are subjected to anti-bias filtering to obtain valid anomaly review test cases; Attribution analysis is performed on the compliance judgment inputs, compliance judgment processes and historical review conclusions corresponding to the valid abnormal review cases to obtain the root causes of configuration defects that lead to abnormal review conclusions. The root causes of configuration defects include at least one of recall configuration defects, rule description defects and process topology defects. Based on the root cause of the configuration defect, update the corresponding review configuration item, perform catastrophic forgetting detection on the updated review configuration item, and apply the updated review configuration item if no degradation occurs.
[0112] Based on the above embodiments, the updating unit is used for: If the root cause of the configuration defect is the recall configuration defect, then at least one of the recall keyword library, vector query conditions, and chapter scope conditions in the current review configuration items shall be adjusted; If the root cause of the configuration defect is the defect in the rule description, then based on the initial version of the rule description, the compliance judgment input corresponding to the valid exception review case, the compliance judgment process, and the root cause of the configuration defect, a rewritten rule description is generated, and the rule description in the current review configuration item is updated to the rewritten rule description. If the root cause of the configuration defect is the process topology defect, and it is characterized by the lack of prerequisite judgment criteria, then a prerequisite operator that can produce the prerequisite judgment criteria will be dynamically attached to the current review configuration item's process topology structure.
[0113] Figure 7 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 7As shown, the electronic device may include: a processor 710, a communications interface 720, a memory 730, and a communication bus 740, wherein the processor 710, the communications interface 720, and the memory 730 communicate with each other through the communication bus 740. The processor 710 can call logical instructions in the memory 730 to execute a bidding document quality inspection method. This method includes: determining the bidding document to be inspected; constructing a corresponding mapping structure based on the character attributes of the bidding document, wherein the corresponding mapping structure represents the mapping relationship between each character in the bidding document and its position coordinates; determining the content to be reviewed corresponding to the quality inspection point to be reviewed based on the bidding document, and determining the set of character position intervals corresponding to the content to be reviewed; performing a compliance judgment on the content to be reviewed based on the set of character position intervals, generating a review conclusion and supporting evidence text; and performing fuzzy matching on the evidence text based on the corresponding mapping structure to obtain the target position of the evidence text in the bidding document.
[0114] Furthermore, the logical instructions in the aforementioned memory 730 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, essentially, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0115] On the other hand, the present invention also provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, wherein when the program instructions are executed by a computer, the computer is able to execute the bidding document quality inspection method provided by the above methods, the method comprising: determining the bidding document to be inspected; constructing a corresponding mapping structure based on the character attributes of the bidding document, the corresponding mapping structure representing the mapping relationship between each character in the bidding document and its position coordinates; determining the content to be reviewed corresponding to the quality inspection point to be reviewed based on the bidding document, and determining the set of character position intervals corresponding to the content to be reviewed; performing compliance judgment on the content to be reviewed based on the set of character position intervals, generating a review conclusion and evidence text supporting the review conclusion; and performing fuzzy matching on the evidence text based on the corresponding mapping structure to obtain the target position of the evidence text in the bidding document.
[0116] In another aspect, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon. When executed by a processor, the computer program is implemented to perform the bidding document quality inspection method provided by the above-described methods. The method includes: determining the bidding document to be inspected; constructing a corresponding mapping structure based on the character attributes of the bidding document, wherein the corresponding mapping structure represents the mapping relationship between each character in the bidding document and its position coordinates; determining the content to be reviewed corresponding to the quality inspection point to be reviewed based on the bidding document, and determining the set of character position intervals corresponding to the content to be reviewed; performing a compliance judgment on the content to be reviewed based on the set of character position intervals, generating a review conclusion and evidence text supporting the review conclusion; and performing fuzzy matching on the evidence text based on the corresponding mapping structure to obtain the target position of the evidence text in the bidding document.
[0117] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0118] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.
[0119] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for quality inspection of bidding documents, characterized in that, include: Identify the tender documents to be inspected; A corresponding mapping structure is constructed based on the character attributes of the bidding documents. The corresponding mapping structure represents the mapping relationship between each character in the bidding documents and its position coordinates. Based on the bidding documents, determine the content to be reviewed corresponding to the quality inspection points to be reviewed, and determine the set of character position intervals corresponding to the content to be reviewed; Based on the set of character position intervals, the content to be reviewed is assessed for compliance, and a review conclusion and supporting evidence text are generated. Based on the aforementioned co-location mapping structure, fuzzy matching is performed on the evidence text to obtain the target position of the evidence text in the bidding document.
2. The method for quality inspection of bidding documents according to claim 1, characterized in that, The step of constructing a parity mapping structure based on the character attributes of the bidding documents includes: Extract the character value, page number information, and position coordinates of each character from the text stream of the bidding documents; If the bidding documents contain a table, the table structure is restored in the text stream, and the character value, page number information and position coordinates of each character in each cell of the restored table are extracted. The corresponding mapping structure is constructed based on the character value, page number information, and position coordinates of each character.
3. The method for quality inspection of bidding documents according to claim 1, characterized in that, Based on the bidding documents, the process of determining the content to be reviewed corresponding to the quality inspection points to be reviewed, and determining the set of character position intervals corresponding to the content to be reviewed, includes: Extract the layout and hierarchy features of the bidding documents, and identify the chapter boundaries in the bidding documents based on the layout and hierarchy features; Based on the boundaries of each chapter, a chapter structure tree is constructed to represent the parent-child hierarchical relationship between each chapter in the bidding document; The search conditions configured for the quality inspection points are determined. Based on the search conditions and the chapter structure tree, a search and recall is performed in the bidding documents to obtain the content to be reviewed corresponding to the quality inspection points. The search conditions include at least one of vector query conditions, chapter range conditions, and keyword conditions. Based on the start and end positions of the corresponding characters in the bidding documents for the content to be reviewed, the set of character position intervals is determined.
4. The method for quality inspection of bidding documents according to any one of claims 1 to 3, characterized in that, The process of determining compliance of the content to be reviewed based on the set of character position intervals, generating a review conclusion and supporting evidence text, includes: If there are multiple quality inspection points, then determine the context overlap between the character position intervals corresponding to each quality inspection point in the character position interval set; Based on the aforementioned context overlap, the quality inspection points are clustered and merged to obtain a merged quality inspection group; Based on the union of the pending contents corresponding to each quality inspection point in the merged quality inspection group, the merged pending contents corresponding to the merged quality inspection group are determined. A single review instruction is generated based on the merged content to be reviewed, and the single review instruction is processed based on a large language model to obtain the review conclusion and the evidence text supporting the review conclusion.
5. The method for quality inspection of bidding documents according to any one of claims 1 to 3, characterized in that, The process of determining compliance of the content to be reviewed based on the set of character position intervals, generating a review conclusion and supporting evidence text, includes: Based on the set of character position intervals, at least one of compliance word matching, regular expression pattern matching, and chapter missing determination is performed on the content to be reviewed to obtain a suspected hit result. The suspected hit results are verified using a knowledge base to obtain the verification criteria. The suspected hit result is input into the context of the bidding document and the verification basis clauses for semantic disambiguation in a large language model to obtain the review conclusion and the evidence text supporting the review conclusion.
6. The method for quality inspection of bidding documents according to any one of claims 1 to 3, characterized in that, The step of performing fuzzy matching on the evidence text based on the same-position mapping structure to obtain the target position of the evidence text in the bidding document includes: Perform character matching between the evidence text and the character sequence corresponding to the parity mapping structure; If no match is found, the evidence text and the character sequence corresponding to the sliding window in the bidding document are converted into evidence text sparse vectors and sliding text sparse vectors. The intersection similarity between the sparse vector of the evidence text and the sparse vector of the sliding text is determined during the sliding window process, and candidate texts are selected from the bidding documents based on the intersection similarity; the frequency of characters moved out and moved in is only incrementally updated each time the sliding window slides. The candidate text is expanded and matched to obtain the target position of the evidence text in the bidding document.
7. The method for quality inspection of bidding documents according to claim 6, characterized in that, The step of expanding the matching of the candidate text to obtain the target position of the evidence text in the bidding document includes: Determine whether the length of the evidence text is less than a length threshold; If so, then character-by-character expansion is performed with the candidate text as the center point to obtain the expanded text. Based on the character set overlap rate between the expanded text and the evidence text, the expanded text is filtered. Based on the edit distance between the filtered expanded text and the evidence text, the target position is determined. If not, the expansion range is determined with the candidate text as the center point, and the text within the expansion range is segmented according to the punctuation mark level to obtain multiple clauses. The combination of clauses containing the center point is traversed, and the combination of clauses is compared with the evidence text to determine the target location.
8. The method for quality inspection of bidding documents according to any one of claims 1 to 3, characterized in that, The process of generating a review conclusion also includes: Obtain the review use case log containing historical review conclusions, compare the historical review conclusions with the corresponding labeled data, and determine the abnormal review use cases from the review use case log based on the comparison results; The anomaly review test cases are subjected to anti-bias filtering to obtain valid anomaly review test cases; Attribution analysis is performed on the compliance judgment inputs, compliance judgment processes and historical review conclusions corresponding to the valid abnormal review cases to obtain the root causes of configuration defects that lead to abnormal review conclusions. The root causes of configuration defects include at least one of recall configuration defects, rule description defects and process topology defects. Based on the root cause of the configuration defect, update the corresponding review configuration item, perform catastrophic forgetting detection on the updated review configuration item, and apply the updated review configuration item if no degradation occurs.
9. The method for quality inspection of bidding documents according to claim 8, characterized in that, The review configuration items updated based on the root cause of the configuration defect include: If the root cause of the configuration defect is the recall configuration defect, then at least one of the recall keyword library, vector query conditions, and chapter scope conditions in the current review configuration items shall be adjusted; If the root cause of the configuration defect is the defect in the rule description, then based on the initial version of the rule description, the compliance judgment input corresponding to the valid exception review case, the compliance judgment process, and the root cause of the configuration defect, a rewritten rule description is generated, and the rule description in the current review configuration item is updated to the rewritten rule description. If the root cause of the configuration defect is the process topology defect, and it is characterized by the lack of prerequisite judgment criteria, then a prerequisite operator that can produce the prerequisite judgment criteria will be dynamically attached to the current review configuration item's process topology structure.
10. A quality inspection device for bidding documents, characterized in that, include: The unit for determining the tender documents to be inspected; A construction unit is used to construct a corresponding mapping structure based on the character attributes of the bidding document, wherein the corresponding mapping structure represents the mapping relationship between each character in the bidding document and its position coordinates; The retrieval unit is used to determine the content to be reviewed corresponding to the quality inspection point to be reviewed based on the bidding documents, and to determine the set of character position intervals corresponding to the content to be reviewed; The judgment unit is used to make a compliance judgment on the content to be reviewed based on the set of character position intervals, and generate a review conclusion and evidence text supporting the review conclusion; The tracing unit is used to perform fuzzy matching on the evidence text based on the same-position mapping structure to obtain the target position of the evidence text in the bidding document.
11. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the bidding document quality inspection method as described in any one of claims 1 to 9.
12. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the bidding document quality inspection method as described in any one of claims 1 to 9.
