1407 results about "Optical character recognition" patented technology

The invention discloses a knowledge graph construction method and system based on traditional Chinese medicine classics, and relates to the technical field of knowledge graph construction, and the method comprises the steps: collecting multi-source heterogeneous data of traditional Chinese medicine classics, carrying out the standardization processing, and generating a cross-time aligned standardized corpus through optical character recognition and multi-modal feature extraction; based on a language model and a causal reasoning engine, extracting an entity relationship and a dialectical rule from the standardized corpus, and generating a dynamic dialectical reasoning model supporting nonlinear reasoning; obtaining an output result of the dynamic dialectical reasoning model, and constructing a redundancy-removed and dynamically-calibrated traditional Chinese medicine knowledge base through knowledge fusion and conflict resolution of various traditional Chinese medicine classics; based on edge calculation and privacy protection technologies, real-time iteration and clinical curative effect feedback optimization of the knowledge graph are realized. According to the method, the problems of trans-era evolution, regional expression difference, multi-modal feature splitting and the like in the traditional Chinese medicine classics digitalization process are solved.

Various embodiments of the present disclosure relate to operator assistance based on extracting natural language characters from one or more sensed objects. For instance, particular embodiments may generate a natural language utterance based on extracting natural language text in a nearby traffic sign. In an illustrative example, particular embodiments may detect, via object detection and within image data, one or more regions of the image data depicting the traffic sign. Particular embodiments can then extract one or more first natural language characters represented in the traffic sign based at least on performing optical character recognition within the one or more regions of the image data in response to detecting the one or more regions of the image data depicting the traffic sign.

The present invention provides a screenshot content extraction method based on a multimodal large model, which is used to extract OTA hotel structured information, including the following steps: obtaining a screenshot image with hotel information; performing text recognition on the image through an optical character recognition model to obtain a text information box set; performing text area positioning on the image through an image positioning model, and extracting the text content of the text area to obtain a text content set; inputting the text content set into a text large model, extracting structured information through preset prompt words, and obtaining first structured information; inputting the image into a visual language model, extracting structured information through prompt words, and obtaining second structured information; comparing and fusing the first structured information and the second structured information to obtain hotel structured information. The present invention can understand the image content more comprehensively and accurately, significantly improve the accuracy of hotel structured information extraction, and reduce the error rate of information extraction.

A computer implemented method, system and non-transitory computer-readable device for a remote deposit environment. Upon receiving a user request, based on interactions with the UI, the method implements an electronic deposit of a financial instrument by activating a camera on the client device to generate a live stream of image data of a field of view of at least one camera, wherein the live stream includes imagery of at least a portion of the financial instrument. The method continues by extracting in real-time, based on the formation of byte array objects from the live stream of image data, data fields from a ranked sequence of imagery to be processed by an optical character recognition (OCR) program resident on the client device. The OCR process extracts one or more data fields from of the financial instrument that are communicated to a remote deposit server to complete the electronic deposit.

A method including receiving a digital image including text arranged in a layout. The method also includes generating, by an optical character recognition model, a layout text vector that encodes at least one word in the text of the digital image and a position of the at least one word in the layout of the digital image. The method also includes generating, by a visual encoder model, a visual representation vector embedding a content of the digital image. The method also includes converting both the layout text vector and the visual representation vector into a projected text vector including a digital format suitable for input to a large language model. The method also includes combining, into a prompt, the projected text vector, a system message, and a task instruction. The method also includes generating an output including a key-value pair.

The invention provides an AI-based automatic identity card image cutting and OCR recognition method and system, and relates to the technical field of image processing, and the method comprises the steps: collecting a multi-angle depth image and a visible light image, reconstructing a three-dimensional model of a certificate through a three-dimensional point cloud registration network, and achieving the perspective correction of an image through the combination of attention posture estimation and projection matrix optimization; a double-flow memory neural network is adopted to carry out information area positioning, a feature extraction backbone network constructs a multi-scale feature pyramid, and a dynamic memory updating network carries out feature matching and dictionary updating based on a time sequence attention module and comparative learning; and performing character recognition on the segmented information sub-images through a multi-branch feature enhancement network, improving the recognition precision in combination with a self-attention enhancement unit and a context reasoning unit, and dynamically optimizing network parameters by using a reinforcement learning controller until a preset recognition credibility threshold value is reached.

The invention relates to the technical field of text travel data analysis, in particular to a text travel content recommendation system for analyzing preferences of text travel scenic spots, which comprises a culture gene bank construction and user interest modeling unit and a dynamic situation awareness and recommendation optimization unit. The data acquisition and preprocessing module extracts culture elements from a multi-channel text through optical character recognition and natural language processing, the culture gene extraction and fusion module constructs a knowledge graph and fuses similar elements to form a gene cluster, and the user interest model training module generates interest portraits based on user text travel platform data. In a dynamic situation awareness and recommendation optimization unit, a situation data acquisition and analysis module acquires and analyzes user situation data, a recommendation strategy generation and adjustment module generates a recommendation strategy according to a user state and interest by using a deep Q network algorithm, recommendation is optimized in combination with situation factors, and the accuracy of travel content recommendation is effectively improved.

The invention provides an operational research course knowledge graph construction method based on multi-source data fusion. The method comprises the following steps: firstly, discussing logical association of courses, majors and students, collecting data such as textbooks, exercises and teaching programs by taking operational research knowledge points as a core and utilizing technologies such as OCR (Optical Character Recognition) and crawlers, and carrying out preprocessing and manual labeling; then, an improved deep learning model is adopted for entity recognition and relation extraction, BERT + BiLSTM + CRF is adopted for entity recognition, and a dynamic context pooling enhancement model is fused to improve the capture ability of a complex knowledge boundary; bERT + BiLSTM is adopted for relation extraction, a multi-head attention mechanism is combined, and hidden logical relation mining is enhanced. And finally, constructing a multi-level knowledge network which takes knowledge points as nodes and logic relations as edges, and embedding the multi-level knowledge network into a Neo4j graph database for visualization. The map can optimize a teaching path, provides personalized learning recommendation, and is widely applied to the fields of wisdom education, knowledge retrieval and the like.

The invention relates to an engineering document index consistency proofreading method and system based on a multi-modal large model, and the method comprises the steps: Q1. OCR detection and recognition: carrying out the optical character recognition and format analysis of a source document, converting an uploaded PDF document into a processable text message in a Markdown format, and carrying out the format discrimination of a table, a formula and a plain text; and Q2, table and formula processing: adopting a hierarchical processing strategy, intelligently selecting an optimal processing mode according to the complexity of the table, and converting table information into a descriptive long text through a language large model and cue words. According to the method, accurate, reliable and efficient document index checking service can be provided for a user, the quality and efficiency of professional document processing are remarkably improved, the efficiency and quality of knowledge graph construction are remarkably improved, a knowledge verification system capable of being evolved continuously is established, and the method is suitable for popularization and application. And a reliable technical support is provided for knowledge management and professional decision-making in a complex field.

The invention provides a multi-modal document content cross-platform analysis system, and relates to the technical field of data processing, and the system comprises a document preprocessing module which is used for receiving multi-source heterogeneous document input data, and generating a preprocessed document through format conversion, page segmentation, noise reduction and optical character recognition; the feature extraction module is used for extracting three types of features, including spatial layout features, semantic features and logic structure features, based on the preprocessed document; according to the method, the multi-source heterogeneous document is cooperatively processed, accurate extraction, calibration and association of features in cross-platform analysis are realized, finally structured data are generated, and the accuracy, consistency and cross-platform applicability of multi-modal document analysis are improved.

The invention provides an intelligent retrieval matching method and system for multidimensional data of image-text features, and relates to the technical field of icon image retrieval. Comprising the following steps: extracting image features, text content and semantic features of an icon image by using a convolutional neural network, an image segmentation attention mechanism network, a converter optical character recognition model and a bidirectional semantic understanding model, constructing the extracted features into heterogeneous feature tensors, and performing singular value decomposition to obtain icon feature fingerprint vectors; and constructing a multi-level index based on locality sensitive hashing, realizing rapid retrieval, calculating visual, text and semantic similarities in combination with a deep metric learning model, weighting according to variances and discrimination coefficients of similarity features to obtain a comprehensive similarity score, and outputting a retrieval result with the highest similarity.

Methods and systems for remote check deposit are disclosed. A check for deposit is processed without the need for a server to receive any image of the check initially. Instead, optical character recognition (OCR) data is received at the server from a mobile device. Verification processing for the check is then performed using the OCR data. If the verification process is successful, a confirmation notification is sent to the mobile device. Subsequently, after sending the confirmation notification, a check image is received, from which the OCR data was determined. The check is, in turn, processed for deposit using the received check image.

A system and method for automatically extracting data from tables and graphs in scientific literature, particularly in life sciences and healthcare, is presented. The invention employs a hybrid approach combining computer vision, natural language processing (NLP), and a large language model (LLM)-based data extraction module. A neural network enhances accuracy by providing contextual information. The system performs table structure detection, optical character recognition (OCR), Vision Transformers (ViTs) for text recognition, and graph-to- table conversion. An LLM refines the extracted data using advanced prompt engineering. A user interface enables data review, validation, and iterative refinement. The system employs a novel two-stage approach: de-rendering tables and graphs into a machine-readable format, followed by interpretation and user-defined mapping. A knowledge graph enhances extraction by resolving ambiguities and inferring relationships. Designed for scalability and continuous improvement, the invention significantly enhances data extraction efficiency and accuracy, accelerating research and knowledge discovery.

The invention discloses a circuit netlist generation method supporting deep learning model multi-stage reasoning, and belongs to the technical field of electronic circuit design and automation, and the method comprises the steps: obtaining a circuit diagram image through optical scanning, carrying out the preprocessing of the image, carrying out the recognition of a component through a deep learning model YOLOv5, and determining the boundary frame coordinates and class information. And further performing port fine identification on the component, and determining the position and the direction of the port. And eliminating character interference by using an optical character recognition technology, performing wire recognition, including Hough straight line detection and jumper processing, and determining starting point and ending point coordinates of the wire. And matching the identification results of the components, the ports and the wires, constructing a topological structure of a circuit diagram, finally generating a circuit netlist, and performing error elimination and JSON format output. According to the method, automatic netlist generation of the analog circuit diagram can be realized, the analog circuit diagram file is converted into the netlist file with device function annotations, and the efficiency and quality of circuit design and simulation are improved.

Disclosed herein are system, apparatus, device, method and / or computer program product embodiments for providing a mid-stream deposit availability schedule to a customer electronically depositing a check. The deposit availability schedule is generated by activating a mobile financial application, receiving a customer request to deposit a financial instrument, and based on the customer request, activating a camera on the client mobile device to access a field of view of at least one camera and capture one or more images of a financial instrument, store, in a computer memory on the client mobile device, the one or more images. An optical character recognition program, resident on the client mobile device, extracts in real-time, one or more data fields from one or more portions of the financial instrument, communicates the one or more data fields to a remote deposit server and receives a deposit availability schedule, before acceptance of the remote deposit.

Using generative AI to supplement automated information extraction is disclosed. Computer vision (CV) and / or optical character recognition (OCR) models and a generative artificial intelligence (AI) model are used together to extract information (e.g., names, dates, invoice numbers, etc.) from a source. Acceptance threshold(s) may be used to accept predictions for extracted data elements from the models, and the prediction from the generative AI model may be preferred or a human may be tasked with reviewing the element. If no model meets its respective acceptance threshold (whether common or specific to that model), these element(s) may be marked for subsequent human review, or a human can be looped in to correct these element(s). The models may then be retrained using these labeled elements.

The invention discloses a dynamic data processing and recognition method and device for a mixed font text, and belongs to the technical field of optical character recognition, and the method comprises the following steps: collecting a mixed font text image to be processed, and inputting the mixed font text image into an enhanced DBNet detection network to position a text region; integrating a lightweight MobileNetV3 font classification sub-network, sharing bottom layer features with a detection trunk, training a multi-task network through a joint loss function, and outputting a text region with a font type label; then selecting identification branches according to the labels, and identifying the printed form by using the traditional CRNN; according to the handwritten form, traditional convolution is replaced by linear variable convolution, kernel dynamic scaling is guided by a thermodynamic diagram, and multi-head attention mechanism recognition is embedded in a BiLSTM layer; and finally, results are fused, and detection and identification results with labels are output. According to the method, the mixed font text data processing and recognition precision is improved, the adaptability and robustness of handwritten text recognition are enhanced, and various text recognition requirements are met.

The invention belongs to the technical field of document analysis, and particularly relates to a multi-algorithm collaborative PDF document intelligent analysis system which comprises a preprocessing module used for recognizing the type of a PDF document, performing layout correction on a scanning document PDF and uniformly adjusting the scanning document PDF into a vertical storage format; the layout analysis module is used for identifying page element categories based on a target detection algorithm, and processing element superposition and separation problems through a merging de-duplication or priority discarding strategy; and the text processing module is used for analyzing all places with characters in the PDF based on the OCR, outputting the characters and corresponding textbox coordinates, and dividing the contents of the text blocks in combination with layout analysis. The system can extract characters of the PDF of the scanned copy, distinguish element types such as titles, texts, tables and formulas, solve the problem of confusion of cross-page tables, column texts and characters with similar shapes, and can completely reserve the content structure of the document.

Various embodiments include methods for generating image datasets for training an artificial intelligence machine learning (AI / ML) optical character recognition (OCR) model. Image processing may be performed on a plurality of roadway images to identify street signs within the images and generate a dataset of sign images categorized into sign variants of the same shape, color, pictogram, and characters. An OCR model may process sign images to obtain OCR results for images of each sign variant. An aggregation process may be performed on the OCR results for all sign images within each sign variant to identify a ground truth OCR result for each sign variant. The ground truth OCR result may be used to automatically label all sign images of each sign variant to produce an OCR model training dataset. The produced training dataset may then be used to retrain the initial AI / ML OCR model and / or train other AI / ML OCR models.

The invention relates to the technical field of intelligent file processing, and discloses an element extraction method and device of a test report, computer equipment and a storage medium, the method comprises the following steps: obtaining scanning document documents of a plurality of paper test reports, and screening out a multi-modal format document from the scanning document documents; identifying and extracting text features, picture features and table features in the multi-modal format document based on an optical character identification technology model; performing paragraph combination on the extracted text features; and extracting structured data from the text features, the picture features and the table features after paragraph combination by adopting a multi-modal element extraction model to obtain a complete electronic document corresponding to the multi-modal format document. Based on an optical character recognition technology, character features, image features and table features in various paper test reports are accurately recognized and extracted by using a number, image and character recognition and extraction technology, and the recognition and extraction accuracy and extraction efficiency are improved.

The invention discloses a receipt identification method and device, equipment and a medium, and relates to the technical field of bill content identification. The method comprises the following steps: acquiring a receipt image through a preset acquisition mode, and identifying the receipt image by using a preset optical character identification model to determine text content and corresponding position information in the receipt image; performing information matching on the receipt image in a preset multi-mode large model prompt word bank to obtain a first prompt word, and inputting the first prompt word, the text content and the position information into a preset multi-mode large model to obtain a key information key value pair; and performing information matching on the receipt image in a preset language large model prompt word library to obtain a second prompt word, and inputting the second prompt word, the text content, the position information and the key information key value pair into a preset language large model to obtain a target key information key value pair. Through the technical scheme of the invention, the accuracy of identifying the key field content of the non-standard receipt can be improved.

The invention discloses a contract auditing method and device based on a large model, equipment and a storage medium, and relates to the technical field of artificial intelligence, and the method comprises the steps: analyzing a target contract file based on an optical character recognition technology and a natural language processing technology, and generating a target structured analysis fragment corresponding to the target contract file; constructing a contract relation knowledge graph based on the target structured analysis fragment by using the target large model, and generating a target structured data table; verifying each contract term in the target structured data table based on a dynamic rule engine, and generating an early warning report based on a verification result; performing risk assessment on contract terms in the target structured data table based on the target domain knowledge base, the target large model and the contract relation knowledge graph to generate risk data; and generating a revision suggestion based on the early warning report and the risk data by using the target large model, and revising the target contract file based on the revision suggestion. According to the invention, the automation level and accuracy of contract auditing can be improved.

The invention relates to an RAG-based voucher classification method, a medium and equipment, and the method comprises the steps: receiving digital image data of a to-be-classified voucher, carrying out the multi-modal optical character recognition processing to generate a structured OCR result, extracting a text semantic feature vector and a visual layout feature vector based on the structured OCR result, carrying out the fusion of the text semantic feature vector and the visual layout feature vector to generate a multi-modal query vector, and carrying out the classification of the to-be-classified voucher. Similar samples and semantic similarity scores and category metadata thereof are obtained through approximate nearest neighbor retrieval, after an initial candidate category list is generated, key field values are extracted for each candidate category, evidence credibility scores are calculated, comprehensive confidence scores are generated by fusing the semantic similarity scores and the evidence credibility scores, reordering is conducted, and a candidate category list is obtained. And finally, selecting a classification decision path according to the score distribution, and outputting a classification result and an interpretability report. The accuracy and robustness of voucher classification are effectively improved, and complex voucher scenes with changeable formats and fuzzy semantics can be processed; and the interpretability and reliability of the classification decision are enhanced.

The invention provides a supply chain purchase bid invitation project multi-mode intelligent auditing method, and belongs to the technical field of electronic purchase. Comprising the following steps: defining a review rule system comprising rule contents, review points and review logic; in the bidding stage, bidding files and quotation information uploaded by suppliers are received, and after bid opening, bid invitation files, bidding files of entered suppliers and corresponding review rule systems are input into a multi-mode large model server; performing unstructured data analysis on the bidding document and the bidding document by using a multi-modal large model in combination with an OCR (Optical Character Recognition) technology, and identifying and matching response contents in the bidding document through intention; pushing the extracted content to a corresponding business auditing agent, and performing judgment according to an auditing point and auditing logic; and summarizing the review results, and generating an intelligent review report containing the number of conformity items, the number of non-conformity items, conclusions of the review points and judgment bases. The examination efficiency and accuracy are improved, and human errors and compliance risks are reduced.

The invention discloses a geological domain named entity accurate recognition and classification method based on thinking chain enhancement and hybrid expert architecture, which is characterized by comprising the following steps: firstly, extracting geological document text data through an OCR (Optical Character Recognition) technology, and extracting structured entity data by utilizing a locally deployed large language model; then calling a local large model to generate a diversified sentence pattern template according to language styles in the geological field, filling the template with the extracted professional entities, and constructing an instruction fine tuning data set; further constructing a thinking chain (CoT) enhanced data set on the basis, and explicitly simulating an expert reasoning process; efficient fine tuning is carried out on the large model by innovatively combining a low-rank adaptation (DoRA) technology and a hybrid expert (MoE) architecture, the DoRA technology carries out dimension reduction decomposition and orthogonal transformation on weight matrixes of a decoder layer and a multi-layer perceptron, and the MoE architecture constructs a plurality of special sub-networks to enhance the multi-task processing capability; and finally, performing entity extraction on the geological document by using the fine-tuned model, outputting an identification result containing a reasoning process, and filtering and perfecting the result through a rule matching mechanism. According to the method, the problems of fuzzy boundary, indefinite semantics, difficulty in classification and the like of the named entities in the geological field are effectively solved, the recognition and classification accuracy of the named entities in the geological field is remarkably improved, and key technical support is provided for downstream applications such as geological resource exploration and mineral evaluation.

The invention discloses an intelligent analysis method and device for an unstructured PDF document, equipment and a medium, and relates to the field of document analysis, the method comprises the steps of obtaining a to-be-analyzed PDF document, analyzing page elements in the PDF document, and generating a document metadata dictionary; if the PDF document does not contain the extractable text, converting the PDF document into an image and performing optical character recognition to generate first structured data; if the PDF document contains the extractable text, judging whether the PDF document contains a table or not; if the PDF document does not contain the table, a PDFMiner is adopted to extract the text, and second structured data is generated; if the PDF document contains the table, performing multi-modal feature extraction and feature fusion on the PDF document according to the document metadata dictionary to obtain multi-modal fusion features, and generating third structured data according to the multi-modal fusion features; according to the method and the device, the analysis precision and efficiency of the PDF document are improved.

According to various embodiments, a system and method for verifying a user's identity using both document-based and biometric data is disclosed. The system may prompt a user to upload an image of a government-issued identification document and extract user information from the image using optical character recognition (OCR). The system may also extract the embedded face image from the ID and prompt the user to take a real-time selfie while performing one or more randomized actions or poses. A facial recognition engine may compare the extracted ID image to the live selfie to determine a similarity score. Based on this match, along with optional document authenticity checks, the system may confirm the user's identity in real-time for use cases such as account access, onboarding, and regulatory KYC compliance.

Methods and systems for remote check deposit are disclosed. A check for deposit is processed without the need for a server to receive any image of the check initially. Instead, optical character recognition (OCR) data is received at the server from a mobile device. Verification processing for the check is then performed using the OCR data. If the verification process is successful, a confirmation notification is sent to the mobile device. Subsequently, after sending the confirmation notification, a check image is received, from which the OCR data was determined. The check is, in turn, processed for deposit using the received check image.

The invention discloses a graph retrieval enhancement generation method based on a telecom specification multi-modal knowledge graph, and belongs to the technical field of multi-modal knowledge graphs. The method comprises the following steps of: firstly, analyzing titles, texts, pictures and tables in a PDF (Portable Document Format) by virtue of layout analysis, OCR (Optical Character Recognition) and LLM tools through a telecom standard analysis agent; calling a telecom specification multi-modal extraction agent, and extracting chart names and description information from pictures and tables by using a multi-modal large model; the method comprises the following steps: constructing a title hierarchical structure and extracting a triple from a text block, and constructing a multi-modal, multi-hierarchy and multi-granularity telecommunication specification knowledge graph comprising a title, the text block, a picture, a table and the triple; and finally, calling a telecommunication specification multi-granularity retrieval agent, and deeply combining the knowledge graph with the large model, thereby solving the problem that the traditional RAG cannot perform multi-hop reasoning and relieving the illusion problem possibly occurring in the question and answer process of the large model.

Methods and systems for remote check deposit are disclosed. A check for deposit is processed without the need for a server to receive any image of the check initially. Instead, optical character recognition (OCR) data is received at the server from a mobile device. Verification processing for the check is then performed using the OCR data. If the verification process is successful, a confirmation notification is sent to the mobile device. Subsequently, after sending the confirmation notification, a check image is received, from which the OCR data was determined. The check is, in turn, processed for deposit using the received check image.