435 results about "Document analysis" patented technology

According to the research and development document processing method and device provided by the embodiment of the invention, unified processing of text, voice and image information is realized by constructing the multi-mode document analysis engine. Different types of data are converted into standardized feature representations through cross-modal preprocessing and a semantic alignment network. The system adopts a deep learning model to identify research and development elements, establishes a multi-modal relation graph, and realizes intelligent extraction and correlation analysis of various types of information in research and development documents. According to the method, the defects of the traditional technology in the aspects of multi-modal information fusion and knowledge system construction are effectively overcome, powerful support is provided for research and development process management and knowledge asset accumulation, and the standardized management level of research and development documents is remarkably improved.

Example systems and methods for analyzing and summarizing legal documents using artificial intelligence are disclosed. A system receives a legal document such as a contract or agreement, and utilizes multiple AI models in combination to process and summarize the document. This includes identifying the type of legal document using a natural language model, and then extracting key information like parties, dates, and monetary values. Related clauses within the document are consolidated using a clause consolidation algorithm even if they are not contiguous. Summaries are generated for each section of the document. Additionally, a question-answering module preemptively generates common questions and answers about the agreement to highlight key considerations for the parties involved. By leveraging an ensemble of customized AI models, the system aims to simplify comprehension of legal documents.

An Artificial Intelligence (AI) & Generative AI-driven cross-domain document analysis system enables accurate and consistent narratives across a longitudinal timeline for an entity regarding communications in different operational aspects. The document analysis and insight system includes an Artificial Intelligence (AI) powered Search Interface (AIPS) and an Advanced Intelligent Knowledge Engine (AIKE). The AIPS is configured to pre-process documents from structured and unstructured data sources to generate data taxonomies and custom synonym files. The AIKE generates a preliminary evaluation of the various Large Language Models (LLMs) and uses the data taxonomies and custom synonym files to generate prompts that are configured to address limitations of the various LLMs to obtain accurate replies to user requirements.

The invention provides a semi-structured file processing method based on an LLMs (Language Language Model), which is used for efficiently analyzing a semi-structured file and converting the semi-structured file, and belongs to the technical field of intelligent document processing and multi-modal learning. The method is characterized by comprising the following steps: multi-modal fusion analysis: adopting a hierarchical cross-modal attention mechanism HCMA, and combining a multi-head attention mechanism with a graph neural network GNN to realize multi-level feature fusion of a text and an image; adaptive structured conversion: adopting a dynamic structure analysis network DPN, and combining reinforcement learning and a generation model to realize adaptive analysis of a document structure; and model generation and multi-modal reasoning: adopting a multi-modal generation reasoning network MGRN, and combining a diffusion model and neural symbol reasoning to realize joint generation and reasoning of the text and the image. According to the method, a remarkable technical breakthrough is brought to the aspects of document analysis, information extraction and intelligent reasoning, and powerful support is provided for data-driven innovation of various industries.

The embodiment of the invention discloses an RAG multi-mode document analysis method and device and a medium, relates to the technical field of natural language processing and is used for solving the problem that an existing analysis mode is low in processing capacity. The method comprises the following steps: identifying a document type of a multi-modal document, and distributing an analysis task of the multi-modal document to a corresponding Kubernetes task node based on the document type; based on the analysis requirement of the multi-modal document, the analysis process of each Kubernetes task node is adjusted, the analysis task of the multi-modal document is executed based on the updated analysis process, and analysis data is obtained; preprocessing the parsed data, and performing semantic slicing on the processed parsed data in a dynamic text windowing mode based on a preset large language model to obtain semantic blocks corresponding to the processed parsed data; and converting the semantic blocks into embedded vectors, and storing the embedded vectors in a preset vector database so as to carry out rapid retrieval based on the preset vector database.

The invention discloses a domain-adaptive retrieval enhancement generation method and system, and the method comprises the steps: carrying out the document analysis and semantic partitioning of a document through a semantic understanding model and a document rule, and storing document fragments; on the basis of the large language model and a preset question library, generating a question and disassembling the question; performing correlation evaluation and sorting on the initial retrieval results in combination with a retrieval technology; candidate content most matched with the cue words is screened out through a large language model, and question-retrieval fragments are scored and marked; performing fusion on the initial retrieval result and the scoring and labeling result to construct positive and negative samples, and constructing a supervised data set; and based on a preset loss function, utilizing the supervised data set to carry out supervised training on the knowledge semantic search model, replacing the RAG mixed search module, and carrying out continuous iteration. By means of the technical scheme, new domain knowledge and operation feedback data can be flexibly applied, and domain self-adaptive retrieval enhancement generation is achieved.

Example document analysis and management systems and methods are described. In one implementation, a document is identified for processing. An artificial intelligence engine extracts information from the document and creates multiple chunks of data associated with the document. Embeddings are performed for the multiple chunks of data to create chunk embeddings, where the chunk embeddings are represented as numerical vectors. The chunk embeddings are stored in a vector database. A large language model (LLM) generates document content insights based on the multiple chunks of data and the chunk embeddings.

The invention provides a multi-modal document content cross-platform analysis system, and relates to the technical field of data processing, and the system comprises a document preprocessing module which is used for receiving multi-source heterogeneous document input data, and generating a preprocessed document through format conversion, page segmentation, noise reduction and optical character recognition; the feature extraction module is used for extracting three types of features, including spatial layout features, semantic features and logic structure features, based on the preprocessed document; according to the method, the multi-source heterogeneous document is cooperatively processed, accurate extraction, calibration and association of features in cross-platform analysis are realized, finally structured data are generated, and the accuracy, consistency and cross-platform applicability of multi-modal document analysis are improved.

The invention discloses a document analysis and query method based on a knowledge graph, and the method comprises the steps: carrying out the part-of-speech tagging of a received to-be-analyzed document, and obtaining a part-of-speech tagging result; extracting knowledge element information from the part-of-speech tagging result based on a preset power grid domain ontology knowledge base, and constructing an initial knowledge graph based on the knowledge element information; combining nodes in the initial knowledge graph to obtain a fused knowledge graph; constructing a mapping table according to the fused knowledge graph, and generating a candidate query template set based on the mapping table; receiving a natural language query statement input by a user, selecting a target query template from the candidate query template set based on the natural language query statement, and generating a target query statement; querying from the fused knowledge graph by using the target query statement, and outputting a query result; according to the method, the accuracy and comprehensiveness of information analysis can be effectively improved, the query intention of the user can be accurately understood, and the accurate query and analysis requirements of professionals on project documents are met.

The invention relates to the technical field of artificial intelligence, in particular to an agent decision path optimization method fusing explicit topology and implicit semantics. The method comprises the following steps: acquiring multi-modal data; performing document analysis according to the multi-modal data to obtain document analysis data; performing knowledge injection according to the document analysis data to obtain knowledge injection data; carrying out implicit semantic detection according to the knowledge injection data to obtain implicit semantic data; constructing a user demand agent blueprint according to the implicit semantic data; constructing an agent workflow according to the agent blueprint required by the user; performing task execution scheduling according to the agent workflow to obtain task execution data; performing node explicit topology construction according to the task execution data to obtain node explicit topology data; and performing communication anomaly analysis based on the node explicit topology data to obtain node communication anomaly data. According to the invention, agent task scheduling and path optimization are realized based on an artificial intelligence technology, and the resource utilization rate of the system is improved.

The invention discloses a semantic recognition system and method based on a heterogeneous graph attention network and dynamic normalization, and belongs to the technical field of natural language processing and artificial intelligence. The system adopts a dual-channel architecture and comprises a general semantic channel and a domain semantic channel, semantic feature extraction is performed through a DIFF attention mechanism and a ToST statistical attention mechanism, and training stability is improved by adopting a DyT dynamic normalization module. Adaptive fusion of cross-channel semantic features is realized through a GeGLU gating mechanism, and high-precision semantic recognition is realized by combining an improved SimCSE + + comparison learning loss and a local minimization editing strategy of semantic perception. According to the method, the problems of inaccurate semantic expression, poor context adaptability and the like in the prior art are solved, the accuracy and applicability of cross-domain semantic recognition are remarkably improved, and the method can be widely applied to scenes of legal document processing, financial document analysis and the like.

The invention discloses a multi-literature intelligent classification and automatic review generation method based on a large language model, which is characterized by comprising the following steps of: retrieving literatures or uploading local literatures, and extracting text contents; identifying keywords by utilizing an algorithm or a large language model; converting the keyword into a vector form by using a vectorization model; summarizing the research direction of the clustering result by using a large language model; comprehensively summarizing the single literature and literatures in different research directions by using a large language model; and executing the steps of reviewing, quotation insertion and the like through a large language model and a vectorization semantic matching technology. Compared with the prior art, the method has the advantages that the efficiency and quality of document classification and review generation are remarkably improved, technologies such as text vectorization, topic clustering and large language model generation are well fused, efficient and accurate multi-document review automatic generation is achieved, the method is suitable for interdisciplinary academic document analysis and information integration application, and the method is suitable for popularization and application. Wide application potential is shown.

The invention discloses a document parsing method and device, a medium and a computer program product, and relates to the technical field of data processing.The document parsing method comprises the steps that a to-be-parsed document is obtained, layout detection is conducted on the to-be-parsed document, and element blocks are obtained; determining a content extraction rule corresponding to the element block according to the layout element of the element block; processing the element block through a content extraction rule to obtain initial content of the element block; and correcting the preliminary content by using a large language model to obtain a target document. According to the method, different element blocks are divided, different content extraction methods are adopted for the element blocks, and the extracted content is corrected by utilizing the large language model, so that the correctness of document analysis is improved.

The invention relates to the technical field of artificial intelligence, and discloses an education data report content interaction method and system generated based on retrieval enhancement, and the method comprises the steps: judging whether a natural language problem is an education field problem or not through a large language model, and if yes, carrying out semantic analysis to generate a structured query instruction; when the problem relates to cross-document association analysis, retrieving the structured semantic index database to generate a retrieval result set; if policy association analysis is involved, matching a policy knowledge graph by combining semantic similarity calculation and an entity linking technology, and then performing cross-modal fusion processing to obtain a retrieval result set; and inputting the retrieval result set into the retrieval enhancement generation model, and calling an education field language model to generate an analysis report. According to the method, the industrial pain points of inaccurate intention recognition, low cross-document analysis efficiency, incapability of dynamically combining with latest policies and the like in a traditional interaction mode can be solved, the efficiency and quality of data report interaction in the education field are remarkably improved, and the user interaction experience is optimized.

A data processing system implements obtaining an image of a document and an indication of one or more content items to generate; analyzing the image of the document to generate a textual representation of contents of the document in the image; constructing a query based on the textual representation; analyzing the query using a second machine learning model to obtain embeddings representing one or more categories of information represented in the query; searching a knowledge graph based on the query embeddings to obtain results of the query; providing the query results to a content generation unit to generate the one or more content items based on the results of the query; and obtaining the one or more content items from the content generate unit.

The invention discloses an enterprise data link management and value management method and system, and the method comprises the steps: carrying out the real-time capturing of multi-source heterogeneous data of all business systems in an enterprise through a distributed data collection engine, and recognizing the types of original data in different formats through a preset data source adapter; if structured data is detected, a relational database connector is adopted for extraction, and if the structured data is recognized as unstructured data, a document analysis module is started for content extraction, and an initial data set containing metadata tags is obtained; performing format conversion and field mapping on the initial data set according to a pre-established data standardization rule base, eliminating duplicate records and abnormal values through a data cleaning algorithm, performing automatic evaluation on a data quality grade by adopting a naive Bayes classifier, if a data quality score is lower than a preset threshold value, triggering a data recovery process, and if the data quality score is lower than the preset threshold value, performing data recovery. And standardized data meeting a unified standard is obtained. The normativity and value utilization efficiency of data management are effectively improved.

The embodiment of the invention provides a document-based intelligent question and answer method and device, electronic equipment and a storage medium, and belongs to the technical field of artificial intelligence. The method comprises the following steps: performing document analysis on a target electronic document to obtain document attributes and document contents; based on the document attribute and the document content, document segmentation is conducted on the target electronic document, document segmentation units and unit position information of the document segmentation units are obtained, and the document segmentation units comprise segmentation unit identifiers; based on the document attribute, performing network construction on the target electronic document to obtain a document structure tree network; on the basis of the unit position information, the document segmentation units are arranged in sequence, and a document linear list is obtained; performing document query on the document structure tree network or the document linear list based on the document problem information and the segmentation unit identifier to obtain document query information; and based on the document query information, performing question reply on the document question information. According to the embodiment of the invention, the intelligent question and answer accuracy based on the document can be improved.

The invention discloses a document analysis method based on an RAG model and a dynamic knowledge graph, and relates to the technical field of artificial intelligence. The method is combined with an RAG model and a dynamic knowledge graph technology, and is realized by the following steps of: performing entity relationship joint extraction on an input document, generating a structural triple, and constructing a dynamically updatable knowledge graph; based on the knowledge graph, mapping entities and relationships into low-dimensional vectors by adopting a graph embedding model, and constructing a local vector knowledge base with a topological structure; receiving user questions in real time, encoding the user questions into query vectors, executing approximate nearest neighbor search based on the vector knowledge base, and matching related map fragments; and combining the retrieved graph fragments with the large language model, and generating a structured answer through path constraint of the injection knowledge graph. The method is used for solving the problem that in the prior art, a model cannot capture document deep semantics and dynamic relations insufficiently.

The invention provides a document analysis method and device, equipment and a storage medium, and relates to the technical field of computers, in particular to the technical field of deep learning, data processing and document analysis. According to the specific implementation scheme, at least one layout area divided by an article to which the document image belongs is determined according to the layout of the document image; identifying element contents of a plurality of layout elements in the document image; sorting the reading sequence of the layout elements in the same layout area; and obtaining structured document information according to the sorting result and the corresponding element content. According to the technical scheme, different article areas on the same page can be accurately identified and separated, the respective reading sequence is correctly reconstructed on the basis, and the content in the document image is converted into structured information.

The invention discloses a method for improving long text processing efficiency and accuracy, and relates to the technical field of natural language processing and large language models.According to the method, text word segmentation embedding, sliding block preprocessing, YaRN position code injection, dynamic sparse attention calculation, multi-level attention fusion, graded KV cache management and output generation are sequentially executed; position drift is inhibited through logarithmic scaling, and key contexts are adaptively screened according to the attention activeness, so that the attention calculation complexity is close to linearity; in million-level Token reasoning, the video memory occupation of the method is reduced, the remote dependency recall rate is improved, and the method is suitable for scenes such as document analysis, code auditing and multi-mode streaming understanding.

Document type specific adapters of a document analysis system are used to provide for additional document types or document specialization when generating answers to user submitted questions targeting information included in a document image provided with the user submitted question. The document analysis system receives a visual question answering (VQA) prompt comprising a document image and a question defining information to be extracted from the document image, generates tokens based on the document image and the question, and adjusts encoding of the tokens using document type specific adapters of a transformer model to extract the information from the document image. A classifier of the document analysis system may determine whether the document image matches a document type supported by the document type specific adapters.

The invention provides a multivariate document analysis method and system, relates to the field of computer information processing, and solves the technical problems of low information extraction efficiency and low accuracy caused by incapability of uniformly analyzing and integrating formats of various types of documents. The method comprises the following steps: identifying the type of a to-be-processed document; the document types comprise a table type, a text type and a demonstration type; the text class comprises a Word format and a PDF format; calling a corresponding analysis function according to the type of the to-be-processed document, and analyzing the to-be-processed document to obtain an analysis result, the analysis result comprising the extracted structure information and content data of the to-be-processed document; and converting an analysis result into a standard JSON format and outputting the standard JSON format. The method and the device are used in a document analysis process.

The invention discloses a Java-based large language model dynamic adaptation method and system, belongs to the technical field of artificial intelligence, and aims to solve the technical problems of overcoming the interface difference of multiple model interfaces, simplifying the development process and providing standardized and high-expansibility large model management. Comprising the following steps: providing a model registration and dynamic loading service, a protocol conversion and parameter standardization service and a load balancing and failover service; a streaming transmission protocol service, a function call dynamic injection service and a global error processing mechanism are provided; when a user provides a document analysis and partitioning service, a vectorization index construction service and an RAG enhanced generation service to ask questions, relevant document blocks in the Pinecone are retrieved through the RAG enhanced generation service to serve as contexts to be injected into cue words of the large language model, and answers generated by the large language model are returned.

A computer-implemented system for multidimensional generative value assessment and applicant selection, consisting of: a data collection unit configured to electronically receive applicant data consisting of structured academic records, work experience records, digital documentation, and unstructured narrative responses generated from generative self-assessment instruments and contextual interviews; a feature extraction unit coupled to the data acquisition unit, configured to apply computer-assisted text processing, semantic analysis, and token-level attribute identification to transform narrative responses and structured data into multidimensional feature vectors that represent generative indicators of innovation, mentoring, collaborative performance, resilience, social contribution, ethical consistency, and predicted institutional impact; a weighting calculation unit configured to assign weight values ​​to the extracted feature vectors based on a digital generative profile definition matrix that includes dimensions, sub-criteria, indicators, documentation requirements and importance coefficients, with the weighting being distributed across the generative dimensions defined in the digital matrix and configurable according to the institutional context; a quantitative rating unit configured to calculate a generative rating score by aggregating weighted feature vectors derived from self-assessment inputs, interview-based ratings, document analyses, and authenticity predictions, with the aggregation including normalization, nonlinearity correction, conflict handling, and artifact frequency balancing to obtain a consolidated score; a proof verification unit configured to electronically validate referenced digital evidence by performing content extraction, metadata verification, pattern matching, and cross-document correlation to determine authenticity, credibility, and contextual relevance with respect to the calculated feature vectors; a classification determination unit configured to assign a classification level to an applicant by comparing the generative assessment score with a set of system-defined calculation thresholds, including at least a lower threshold, a middle threshold and an upper threshold, the classification levels representing different generative maturity states and determining subsequent eligibility for selection; a decision generation unit configured to produce a digital output data set that includes classification level, feature aggregation summaries, evidence validation results, and recommended organizational actions, wherein the decision generation unit encodes the data set in a digitally signed, tamper-proof format and stores it on a non-volatile storage medium; and A system control unit acts as an operational interface to all other units and is configured to orchestrate data flow, scheduling, process state transitions, and event logging to ensure verifiable traceability, consistency, and auditability of the evaluation and selection processes.

The invention provides a multi-mode PDF (Portable Document Format) document analysis method, device and equipment and a medium, and the method comprises the following steps: loading a PDF document and carrying out preprocessing, including page splitting and content cleaning, to generate standardized document data; dynamically extracting contents in the standardized document data, wherein the contents comprise paragraphs, pictures and table elements; processing the dynamically extracted pictures, including shielding meaningless pictures based on a preset rule, and analyzing picture contents by using a multi-modal model to generate readable picture information; processing the dynamically extracted table, including optimizing and merging the table structure into a single element format to generate structured table data; combining paragraphs, readable picture information and structured table data, converting the paragraphs, the readable picture information and the structured table data into a complete structured document format, and inserting in key positions to enhance coherence context description; and outputting the complete structured document format as a final analysis result. According to the method, the analysis precision and the knowledge extraction efficiency of the complex PDF document can be remarkably improved.

The invention discloses a document analysis evaluation method and system based on multi-modal semantic consistency. The method comprises the following steps: acquiring multi-modal contract document data, and preprocessing the multi-modal contract document data to obtain preprocessed data; extracting contract element features from the preprocessed data to generate a fusion feature vector; based on the fusion feature vector, evaluating the semantic consistency of the document elements by using a double-constraint loss function and a three-level judgment mechanism to obtain a cross-modal semantic consistency quantification result; based on the cross-modal semantic consistency quantification result, calculating a basis and semantic enhancement index, and integrating the basis and semantic enhancement index into a comprehensive evaluation index; and outputting the comprehensive evaluation index and the corresponding related suggestions, and guiding contract intelligent analysis and algorithm optimization. By implementing the method provided by the invention, intelligent and accurate document analysis can be realized, and the problems of dependence on geometric positioning, missing of cross-modal association and insufficient logic verification in the existing document analysis technology are solved.

The invention belongs to the technical field of intelligent document processing, and provides a WEB-end intelligent bidding document structured processing system based on a hybrid AI analysis engine, comprising: a multi-modal document analysis module extracts key information of a bidding document by using a fuzzy starvation game algorithm, and dynamically sorts core terms according to semantic association; the bidding document blind box analysis module safely disassembles the encrypted bidding document through a block chain technology to generate a structured review matrix; the cloud collaborative review module integrates the multi-dimensional data board, simulates bid evaluation by using a Monte Carlo algorithm, and generates a risk thermodynamic diagram; the risk early warning module identifies dispute points, provides compliance suggestions in combination with a knowledge base, and synchronizes the compliance suggestions to all review terminals; according to the method, automatic and structured processing of the WEB end bidding document is realized by fusing the mixed AI analysis engine, so that the efficiency and accuracy of bidding document review are improved, manual intervention is reduced, the review process is accelerated, and the risk of misjudgment and omission is reduced.

The invention relates to a medical guide document analysis and content extraction system based on natural language processing and computer vision technology, the system comprises a layout detection model, a formula detection model, a table recognition model, a formula recognition model and an OCR (optical character recognition) model, the layout detection model is used for positioning different elements in a document; the formula detection model is used for positioning a formula in a document; and the table identification model is used for detecting table boundaries, segmenting table cells and analyzing a complex structure. The invention further provides a medical guide analysis and content extraction method applying the medical guide document analysis and content extraction system based on the natural language processing and computer vision technology. According to the invention, efficient analysis and accurate extraction of the medical guide document are realized. The system can accurately identify the text, table, formula and picture information in the document, improves the medical information processing efficiency, enables the acquisition of medical knowledge to be more convenient and efficient, and facilitates the improvement of the medical service quality and research efficiency.

The embodiment of the invention relates to a credit review report generation method and device, equipment and a storage medium. The method comprises the steps that document analysis is conducted on an investigation document to obtain a document analysis result; extracting an abstract of the survey document according to a document analysis result to obtain a document abstract, vectorizing the survey document to obtain a document vector, and / or constructing questions and answers related to the survey document to obtain document questions and answers, and storing the document questions and answers in a knowledge base; obtaining a target report type of the to-be-generated credit review report, and determining a retrieval condition and a cue word corresponding to the target report type; performing retrieval in the knowledge base by utilizing the retrieval condition to obtain a retrieval result; inputting the retrieval result and the cue word into a pre-trained first large language model, and obtaining a plurality of report segments of a to-be-generated credit review report output by the first large language model; and generating the to-be-generated credit report according to the plurality of report fragments. According to the embodiment of the invention, the accuracy and efficiency of credit review report generation are improved.

The embodiment of the invention discloses a textile detection report structured analysis method based on multi-modal deep learning, and relates to the technical field of document content extraction and processing.The method comprises the steps that a document analysis tool is used for dividing text content and image information in a document to obtain text blocks and image areas, and the text blocks and the image areas are used for analyzing the text blocks and the image areas; performing marking to obtain structured data, performing image processing and feature extraction on an image region to obtain image features, matching the image region and a text block to obtain a multi-modal content block, performing semantic analysis, semantic enhancement and context association on the multi-modal content block by using BERT and NLP to obtain multi-modal data, and formatting the multi-modal data to obtain multi-modal data; and obtaining a document content file by combining the relevance between the text content and the image data in the multi-modal data through a deep bidirectional representation model BERT. The problems that in the prior art, images embedded in documents cannot be effectively processed, comprehensive processing and correlation analysis are lacked, and the accuracy of information extraction is low are solved.