1967results about "Document management systems" patented technology

Techniques for a unified relational database framework for hybrid vector search are provided. In one technique, multiple documents are accessed and a vector table and a text table are generated. For each accessed document, data within the document is converted to plaintext, multiple chunks are generated based on the plaintext, an embedding model generates a vector for each of the chunks, the vectors are stored in the vector table along with a document identifier that identifies the accessed document, tokens are generated based on the plaintext, the tokens are stored in the text table along with the document identifier. Such processing may be performed in a database system in response to a single database statement to create a hybrid index. In response to receiving a hybrid query, a vector query and a text query are generated and executed and the respective results may be combined.

Example systems and methods for analyzing and summarizing legal documents using artificial intelligence are disclosed. A system receives a legal document such as a contract or agreement, and utilizes multiple AI models in combination to process and summarize the document. This includes identifying the type of legal document using a natural language model, and then extracting key information like parties, dates, and monetary values. Related clauses within the document are consolidated using a clause consolidation algorithm even if they are not contiguous. Summaries are generated for each section of the document. Additionally, a question-answering module preemptively generates common questions and answers about the agreement to highlight key considerations for the parties involved. By leveraging an ensemble of customized AI models, the system aims to simplify comprehension of legal documents.

The invention discloses an intelligent monitoring management method and system based on archive digitization, and relates to the technical field of data management, and the method comprises the steps: collecting and preprocessing multi-source archive data, employing a multi-mode BERT model to carry out the feature fusion of different data sources, and generating a unified semantic representation; semantic labeling is performed on archive data through a multi-label classification model, a semantic graph of archive content is constructed by using a graph database, an association relationship between archives is represented, a semantic index tree is constructed based on the semantic graph, and rapid positioning and calling of the archive content are optimized; and recording the change of each file version, positioning the change position based on a semantic index tree, identifying the semantic change of the file through a semantic difference comparison algorithm, recording hash, carrying out granularity division on the file content through the semantic boundary of each level of node in the index tree, and generating a user access strategy. According to the invention, dynamic perception and risk early warning of user behaviors are realized, and the intellectualization and safety of the archive management system are effectively improved.

Embodiments described herein relate to systems and methods for automatically generating content, generating API requests and / or request bodies, structuring user-generated content, and / or generating structured content in collaboration platforms, such as documentation systems, issue tracking systems, project management platforms, and other platforms. The systems and methods described use a network architecture that includes generative interface panel used to access a prompt generation service and a set of one or more purpose-configured large language model instances (LLMs) and / or other trained classifiers or natural language processors used to provide generative responses for content collaboration platforms.

Methods and systems for a document review process are provided. The method includes receiving an input digital model representation comprising at least one externally-accessible model endpoint for generating a digital artifact. Then, generating a document splice comprising access to multiple document subunits, with at least one document subunit written in a natural language and comprising the digital artifact; the access to each document subunit is provided through an externally-accessible document endpoint for the subunit. Then, generating a document by combining the document subunits, and generating a view associated with the document, based on an user authorization result including selective access rights to the document subunits. The view comprises access to the digital model representation, the digital artifact, each document subunit, and the document. Finally, receiving a user input and updating, via one of the externally-accessible document endpoints, the document splice based on the user input.

An advanced search system leverages a pre-trained large language model to enhance user query responses. The system, equipped with hardware processors, a search query via an interface and accesses a pre-trained large language model designed to respond to the search query. The system fine-tunes the model to generate a task-specific generative model. The system employs the task-specific generative model to generate a search result to the search query and analyzes the search result based on a performance metric associated with the task-specific generative model. The system refines the task-specific generative model based on the analyzing of the search result.

The present invention proposes a vector database retrieval method and system, which relates to the technical field of big data processing and intelligent information retrieval. The method includes preprocessing high-dimensional multimodal data to obtain a dimension reduction feature vector; constructing a cluster center based on the dimension reduction feature vector; establishing an inverted file and an intra-cluster plane index based on the cluster center, compressing the inverted file and the intra-cluster plane index to obtain a compressed inverted file and an intra-cluster plane index; obtaining a user's query vector, using the inverted file to screen candidate clusters for the query vector, introducing a hierarchical navigable small-world graph in the intra-cluster plane index, performing an intra-cluster search on the cluster cluster, and obtaining a vector database retrieval result. The present invention effectively takes into account the efficiency and accuracy of high-dimensional data retrieval, and improves the retrieval efficiency and accuracy.

A large language model predicts a topic summarization of a long document given a set of segments from the long document that pertain to a topic of interest. The set of segments from the long document are selected by searching for similar segments from other documents that have been labeled to indicate whether or not the segment pertains to a topic of interest. The search is based on an embedding of a segment from the long document closely matching embeddings of the labeled segments. Each segment of the long document is scored based on the labels of the closest-matching similar segments. The segments from the long document are ranked by their respective score and the highest-scored segments are included in a prompt to the large language model for the model to generate a topic summarization of the long document.

A computer program comprising instructions which, when executed by a computer, cause the computer to perform the following operations: Receiving an input document (104), wherein the input document (104) contains content elements including at least one text element; Performing a lossless hierarchical text processing process (106) in which the input document (104) is reproduced as a hierarchical representation (108) in which all text elements from the input document (104) are preserved verbatim and organized according to a structure of the input document (104), the lossless hierarchical text processing process (106) comprising: Prompting a generative language model to generate the hierarchical representation (108), wherein the prompt instructs the generative language model to generate the hierarchical representation (108) without summarizing or omitting any of the text elements; and Performing a retrieval unit generation process (110) in which retrieval units (112) are generated based on the hierarchical representation (108) and stored in a memory accessible by a generative client language model for retrieval-enhanced generation.

A data processing system implements receiving a call requesting a generative model to generate a semantic tree for a source content; constructing a first prompt including the source content and instructions to the model to analyze a semantic structure of the source content and to generate a semantic outline and content chunks of the source content, the semantic outline including one or more topics each connected with one or more of the content chunks, to compute one summary for each of the content chunks, to apply indices to reference each topic node of the semantic tree to one of the topics, and to apply indices to reference each leaf node of the semantic tree to one of the content chunks and the respective summary; providing the first prompt to the model and receiving the semantic tree of the source content; and storing the semantic tree in a database.

Systems and methods include pre-processing documents in cloud storage using query embeddings, providing personalized prompts to users based on documents in cloud storage, real-time anticipation of user interest in information contained in documents in cloud storage, and providing generative answers including citation to source documents in cloud storage. The system and methods generate generative machine learning model (MLM) prompts based on document portions of documents in a cloud-based content management platform. The systems and methods use the generative MLM to generate responses to prompts, and the responses include citations to the document portions used to generate the responses in order for users to verify the responses.

Methods, systems, apparatuses, devices, and computer program products are described. A system may obtain a set of documents associated with a knowledge base for retrieval-augmented generation (RAG). The system may generate multiple representations of the information included in the documents using multiple knowledge extraction pipelines. For example, the system may generate a set of metadata-based vector embeddings based on the documents, a set of knowledge graphs based on the documents, and a set of hierarchical tree representations based on the documents. The system may receive a user query and may retrieve contextual information from the set of vector embeddings, the set of knowledge graphs, and the set of hierarchical tree representations to augment the user query for a large language model (LLM) prompt. The system may input the prompt to the LLM, and the LLM may output a response based on the user query and the contextual information.

The invention relates to the technical field of medical document management, in particular to a digital management method and system for medical documents. Obtaining medical document images of a target medical business system, processing the medical document images, and generating a standardized text stream of unified coding of each medical document image; constructing a feature matrix with spatial-semantic dual attributes in a feature region in each medical document through the standardized text stream of the unified coding of each medical document image; and extracting an entity relationship triple in the feature matrix, obtaining semantic fingerprint features of each medical document according to the entity relationship triple, and classifying each medical document according to the semantic fingerprint features of each medical document. According to the invention, efficient and accurate classification of the medical documents can be realized, and the intelligent and automatic level of medical document management is improved.

The embodiment of the invention provides a project research and development data key information processing method and device. A research and development content recognition system and a self-adaptive research and development knowledge graph are constructed. Unified processing and time sequence alignment of text, voice and image contents are realized through multi-modal information decomposition and fusion. Semantic completion and error correction are carried out based on research and development of a semantic analysis model, a knowledge graph structure is dynamically constructed and optimized, and a structured document with a traceability relation is generated. The system adopts a deep neural network model to extract research and development key information, constructs a multi-level document framework, and realizes intelligent conversion from research and development data to a project application document. According to the method, the defects of the traditional technology in the aspects of multi-modal information processing and knowledge structure optimization are effectively overcome, and the research and development data management and project declaration efficiency is remarkably improved.

The invention relates to the technical field of cloud archive management, and discloses an archive management system based on a cloud archive library, which comprises a data acquisition module, a data preprocessing module, a cross-format semantic retrieval module, an intelligent rule generation module, a distributed authority control module and a dynamic resource optimization module. According to the method, through construction of the multi-modal semantic vector space, unified retrieval of heterogeneous archive data such as texts, images and audios is realized, and the problem of low retrieval efficiency caused by format differences in the prior art is solved; an archive life cycle rule is dynamically generated in combination with a reinforcement learning algorithm, so that the accuracy and suitability of resource management are effectively improved; authority control is realized based on a block chain technology, and the security and consistency of data access are enhanced; through load prediction and resource scheduling optimization, the system energy consumption is obviously reduced, and the response capability of a high-concurrency scene is improved. The file security and the data consistency are enhanced, and the problem of low authority control efficiency in a multi-terminal access environment in the prior art is solved.

A knowledge management system may receive a set of data instances. The system may extract a plurality of entities from the set of data instances. The system may convert the plurality of entities into a plurality of entity embeddings, each entity embedding representing an entity in a latent space. The system may generate a reference embedding that has the same length as the plurality of entity embeddings. The system may compare, for each value in each entity embedding, the value to a corresponding value of the reference embedding. The system may generate a plurality of entity fingerprints, each entity fingerprint corresponding to an entity embedding, each entity fingerprint comprising Boolean values that are generated based on comparing values in each entity embedding to corresponding values of the reference embedding. The system may store the plurality of entity fingerprints to represent the plurality of entities.

Certain aspects of the present disclosure describe a method of information retrieval. In certain aspects, the method includes identifying a set of relevant nodes of a document graph embedding semantic units associated with the document based on a document search query. The method further includes reconstructing a structural context for each relevant node in the set of relevant nodes. The method further includes processing the set of relevant nodes and the structural context of each relevant node with a large language model to generate a contextual response to the document search query.

The present invention is related to data processing methods and systems thereof. According to an embodiment, the present invention provides a method of processing documents using a machine learning model. The process begins by accessing data files and extracting information from them, which is subsequently stored. This document information, along with the machine learning model trained on various document formats, is used to classify the data files and generate tabular data. From this tabular data, data objects are created and included in an output data file. The information from the output file is then used to update the data of the machine learning model, optimizing it for improved future document processing. There are other embodiments as well.

An organization-specific cybersecurity dialogue system (“system”) intelligently generates responses to user utterances for cybersecurity by employing documentation and playbook agents for an associated cybersecurity organization. The system extracts an intent and an intent category from a user utterance, extracts relevant entities from the intent and uses them to determine relevant user telemetry data, and matches the intent, intent category, and user telemetry data to documents of the cybersecurity organization. The system then determines whether to generate a response based on matching document, matching playbook agents, or to prompt a user to create a ticket according to logic applied to the intent, intent category, user telemetry data, and matching documents and generates a corresponding response with large language models.

A document is analyzed to identify attributes of the document. A set of statistical measures are calculated for each of the formatting attributes. A correlation between these statistical measures and elements of the document are identified. A hierarchical relationship is determined between the elements of the document. Data from the document is split into chunks using the hierarchical relationship. A representation of the document that includes the hierarchical structure is then generated. The representation is stored in a data store as a vector usable by a machine learning model to perform a query on the document according to the hierarchical structure.

This disclosure describes utilizing a generative document system to dynamically build and provide generative search result documents. The generative document system utilizes an aggregated framework that leverages one or more large generative models (LGMs). For example, the aggregated framework includes three stages where local processes are applied to generative outputs from LGMs, with each stage building upon the generative inputs from previous stages. The generative document system uses the aggregated framework to create generative search result documents based on search queries and their corresponding search result links. These generative search result documents provide interactive, intuitive, comprehensive, and flexible curation of answers that address the respective search queries.

The invention discloses an intelligent archive description method and device and a storage medium, which are applied to edge nodes, and the method comprises the steps: carrying out the hierarchical feature extraction and fusion of pre-collected archive information through a pre-deployed lightweight dual model, and generating a description item set with a confidence label; uploading the low-confidence bibliographic items in the bibliographic item set to a cloud server; acquiring description correction data transmitted by the cloud server, wherein the description correction data is generated by performing multi-modal comparison analysis on the low-confidence description item based on the cloud server; and integrating the bibliographic items which are not marked as the low-confidence bibliographic items with the bibliographic correction data, and generating a standard bibliographic file according to a standard bibliographic rule. And high-quality generation of the standard description file in a complex scene is realized.

A research assistant system described herein includes a research assistant tool and associated components and a graphical user interface to guide user input to research, discover, and evidence answers for complex research questions. The research assistant system may include the graphical user interface (“GUI” or “user interface”) for presentation on a user device associated with a user. The user interface may provide prompts and guidance for collaboration and exploration of research concepts iteratively. A concept may include a search term, entities, and / or propositions / statements.

The invention provides an archive full-life-cycle management method and system based on automatic paper composition and archiving, and relates to the technical field of computers. The method comprises the steps of carrying out multi-source collection and standardized import on archives, carrying out intelligent classification and volume formation based on NLP and machine learning, carrying out dynamic metadata extraction and management, optimizing storage and migration according to life cycles, and carrying out multi-dimensional retrieval and analysis. According to the system, the functions are modularly integrated, and intelligent, efficient and extensible archive management is realized through security authority control and a bottom data access layer.

A method, an apparatus, and a computer-readable storage medium for generating a document graph. A plurality of electronic documents is received. Each electronic document has a predetermined document type. A machine learning model is selected from the plurality of machine learning models based on the predetermined document type. The selected machine learning model is instructed to extract a plurality of document portions from each electronic document in the plurality of electronic documents in accordance with the predetermined document type. A relationship between two or more document portions is defined based on the content of each document portion, and the document portions are associated based on the relationship. A graph structure having a plurality of nodes is generated. Each node includes at least one document portion. Each node is connected to another node in accordance with the relationship between document portions included in the nodes. The graph structure is stored.

The invention discloses an intelligent archive opening and identifying method based on a large model, particularly relates to the technical field of archive data auditing, and is used for solving the problems of insufficient cross-modal data analysis capability, lagging rule updating and low man-machine cooperation efficiency in the prior art. Fusing cross-modal features of texts, images and metadata through a hybrid expert model to generate multi-modal feature vectors, and dynamically allocating the multi-modal feature vectors to a rule network, a semantic network and a domain network for cooperative processing based on attention weights; the rule network parameters are optimized through gradient projection constraint, and regulation-driven real-time adaptation is achieved; matching sensitive data in combination with a multi-dimensional feature matrix of auditing personnel, and optimizing task allocation accuracy; removing redundant links by utilizing value flow analysis to generate a lightweight process, and recording as a tamper-proof evidence chain through a block chain evidence storage solidification operation; the auditing efficiency and accuracy are improved, and the compliance traceability is guaranteed.

Disclosed are methods, systems, devices, apparatus, media, and other implementations for improved search-time content retrieval performed by an information retrieval platform. The implementations include a method including determining by a searching system, at a first time instance, one or more first search results for a first query comprising one or more query terms associated with a first concept, modifying the query, based on the determined one or more first search results, to include one or more modified query terms associated with one or more concepts hierarchically related to the first concept, and determining at a subsequent time instance one or more subsequent search results for the modified query comprising the one or more modified query terms.

A data processing system implements obtaining an image of a document and an indication of one or more content items to generate; analyzing the image of the document to generate a textual representation of contents of the document in the image; constructing a query based on the textual representation; analyzing the query using a second machine learning model to obtain embeddings representing one or more categories of information represented in the query; searching a knowledge graph based on the query embeddings to obtain results of the query; providing the query results to a content generation unit to generate the one or more content items based on the results of the query; and obtaining the one or more content items from the content generate unit.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses an intelligent document processing method, device, equipment and medium, comprising: receiving a document processing request and generating a task identifier, creating and sending a document processing task, constructing an intermediate document structure and generating a plurality of subtasks, and processing the sub-tasks, writing states and page contents into a cache, regularly querying task states, updating accessible identifiers, responding to an access request, loading the page contents, and integrating pages to generate a complete document after all the sub-tasks are completed. According to the method, the document generation task is divided into a plurality of sub-tasks which can be independently processed, and page-level asynchronous loading is realized in combination with a state cache and a regular query mechanism, so that the response speed and the system processing efficiency are remarkably improved while the generation accuracy is ensured; the problems that in the prior art, document generation delay is high, loading is slow, and user waiting time is long are effectively solved.